narakai / scrapy_weibo_v1 Public

forked from lijiahong/scrapy_weibo_v1

Notifications You must be signed in to change notification settings
Fork 0
Star 0

sina v1 api crawler using scrapy, redis and MongoDB

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 15 Commits
cron4win		cron4win
scrapy_weibo		scrapy_weibo
.gitignore		.gitignore
README.md		README.md
requirements.txt		requirements.txt
scrapy.cfg		scrapy.cfg
setup.py		setup.py

Repository files navigation

scrapy_weibo

distributed crawler for weibo

you need to install packages below:

Scrapy: https://pypi.python.org/pypi/Scrapy
Redis: http://redis.io/download
MongoDB: http://www.mongodb.org/downloads
utils4scrapy: https://github.com/linhaobuaa/utils4scrapy.git
weibopy: https://github.com/linhaobuaa/weibopy.git
scrapy-redis: https://github.com/darkrho/scrapy-redis

About

sina v1 api crawler using scrapy, redis and MongoDB

Report repository

Releases

No releases published

Packages

No packages published