wier-gov-crawler

How to run the program

Go into the crawler directory and run

python main.py

If you want the program to use more than one thread specify the number of desired threads as an argument to the program, e.g.

python main.py 4

Name		Name	Last commit message	Last commit date
Latest commit History 70 Commits
config		config
crawler		crawler
.gitignore		.gitignore
README.md		README.md
db		db
report.pdf		report.pdf