Name		Name	Last commit message	Last commit date
Latest commit History 96 Commits
data/20141122		data/20141122
scrapy_boat		scrapy_boat
source		source
tools_daily		tools_daily
tools_halfyear		tools_halfyear
tools_weekly		tools_weekly
.gitignore		.gitignore
README.md		README.md
scrapy.cfg		scrapy.cfg
scrapy.sh		scrapy.sh
scrapy_consts.cfg		scrapy_consts.cfg
scrapy_halfyear.sh		scrapy_halfyear.sh
tools_consts.py		tools_consts.py

Repository files navigation

scrapy_boat

scrapy for 714

usage:

cd scrapy_boat
修改scrapy.sh中对应的起止日期, 注意指定从上周六零时到本周六零时
./scrapy.sh, 到此步骤爬数据成功结束
cd scrapy_boat/tools/
修改utils.py中对应的起止日期
./calculate.sh

http://www.guguncube.com/2733/python-spynner-installation-in-ubuntu

https://github.com/princehaku/pyrailgun/wiki/%E4%BD%BF%E7%94%A8webkit%E5%86%85%E6%A0%B8%E6%8A%93%E5%8F%96%E7%BD%91%E9%A1%B5

About

scrapy for 714

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 42.6%
C++ 26.4%
HTML 20.3%
C 9.5%
Other 1.2%