openwpm-data-release

Code for Princeton Web Census data release.

To process new census crawls:

Name		Name	Last commit message	Last commit date
Latest commit History 95 Commits
crawl_utils @ 6f5a46a		crawl_utils @ 6f5a46a
notebooks		notebooks
.gitignore		.gitignore
.gitmodules		.gitmodules
Crawl-Data-Metrics.ipynb		Crawl-Data-Metrics.ipynb
LICENSE		LICENSE
README.md		README.md
analyze_crawl.py		analyze_crawl.py
batch-process-crawl-data.sh		batch-process-crawl-data.sh
batch-process.sh		batch-process.sh
compute_metrics.py		compute_metrics.py
convert-bz2-to-lz4.sh		convert-bz2-to-lz4.sh
create_sample_dbs.py		create_sample_dbs.py
db_schema.py		db_schema.py
fix_alexa_ranks.py		fix_alexa_ranks.py
manage_users.py		manage_users.py
normalize_db.py		normalize_db.py
process_crawl_data.py		process_crawl_data.py
util.py		util.py

isabella232/openwpm-data-release