Skip to content

csrgxtu/ShaishufangCrawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

96 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ShaishufangCrawler

Use scrapy crawl shaishufang.com

根据uid抓取isbn

./runUID uid

程序运行完成后会在当前文件夹生成uid-isbns.csv文件

批量爬取

./run

通过HTTP URL的方式获取

1, 首先启动服务器

python Server.py

2, 访问链接,给定uid,获取isbn

GET http://localhost:5000/uid/1