A crawler for crawling user profiles, followings and followers on Twitter.
To initial the crawling task, execute:
python main.py user_list
where user_list is the file name of a text file that contains user ids. One user id per line.
To continue the task after program crash, execute:
python main_load.py
- Complete the commond-line arguments processing function
- Meet PEP8 Standard
- Rewrite three thread classes; Consider a solution using thread pool
- Logging function
- Combine main.py and main_load.py