corona19-data-pipeline

Scan/Trim/Extract Pipeline for Coronavirus Site

Scanner

AZ uses tableau. page never changes as a result. WA, ND, and WV all use a javascript redirect. IA uses a recaptura.

Name		Name	Last commit message	Last commit date
Latest commit History 129 Commits
tests		tests
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
backup_to_s3.py		backup_to_s3.py
captive_browser.py		captive_browser.py
change_list.py		change_list.py
compare.py		compare.py
content_table.py		content_table.py
content_text.py		content_text.py
data_pipeline.ini		data_pipeline.ini
data_pipeline.py		data_pipeline.py
directory_cache.py		directory_cache.py
google_sheet.py		google_sheet.py
html_cleaner.py		html_cleaner.py
html_extracter.py		html_extracter.py
html_formater.py		html_formater.py
html_helpers.py		html_helpers.py
notes.txt		notes.txt
parser.py		parser.py
requirements.txt		requirements.txt
scanner.py		scanner.py
specialized_capture.py		specialized_capture.py
udatetime.py		udatetime.py
url_manager.py		url_manager.py
url_source.py		url_source.py
url_source_manager.py		url_source_manager.py
url_source_parsers.py		url_source_parsers.py
url_source_validator.py		url_source_validator.py
util.py		util.py
util_git.py		util_git.py
x_html_compare.py		x_html_compare.py