This script fetches blocklist .json from urls (such as shavar-prod-lists) and generates safebrowsing-compatible digest list files to be served by shavar.

A shavar_list_creation.ini file must exist in the same directory that specifies the following parameters. (See sample_shavar_list_creation.ini for an example.)

./lists2safebrowsing.py

This is run by a Jenkins deployment job every 30 minutes that:

1. Checks out this repository
2. Checks out the shavar-list-creation-config repository
3. Copies stage.ini or prod.ini to shavar_list_creation.ini
4. Runs python lists2safebrowsing.py, which uploads updated safebrowsing list files to S3 for shavar.