Skip to content

知蛛 — 抓取知乎的问题及答案的爬虫,采用SQLite存储

Notifications You must be signed in to change notification settings

Blueve/ZhiSpider

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ZhiSpider

知蛛 — 抓取知乎的问题及答案的爬虫,采用SQLite存储

配置说明

  • Mac OS X
  1. sudo pip install requests

  2. sudo pip install pyyaml

  3. STATIC_DEPS=true sudo pip install lxml

  • Ubuntu
  1. sudo pip install requests

  2. sudo pip install pyyaml

  3. sudo apt-get install libxml2-dev libxslt-dev python-dev

  4. sudo pip install lxml

使用

1.修改Config.yaml文件中的知乎账号部分信息,填入可以使用的账号

2.执行python Setup.py

3.参考ZhiSpider.py的__main__部分,开启功能,并执行python ZhiSpider.py

About

知蛛 — 抓取知乎的问题及答案的爬虫,采用SQLite存储

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages