Skip to content

fdrong/spider_news

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

spider_news

crawl the current news from sina,baidu and tecent

------------------------------------------------------------

安装redis并启动

on mac

brew install redis
brew services start redis

安装requirement.txt模块包

pip install -r requirement.txt

初始化celery分布式任务队列

启动方式:

celery -A src worker -l info
celery -A src beat -l info

------------------------------------------------------------

About

crawl the current news from sina,baidu and tecent

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages