sparrow-crawler

安装

|------------|------|

celery broker	redis
celery result	mysql
------------	------

celery -A sparrow_crawler worker -l info --concurrency=2

gunicorn -c gunicorn.py sparrow_crawler.wsgi

celery -A sparrow_crawler beat -l info --scheduler django_celery_beat.schedulers:DatabaseScheduler

Name		Name	Last commit message	Last commit date
Latest commit History 68 Commits
adminsite		adminsite
brand_spider		brand_spider
celery_tasks		celery_tasks
db_backend		db_backend
logs		logs
media		media
sparrow_crawler		sparrow_crawler
static		static
templates		templates
utils		utils
.gitignore		.gitignore
Dockerfile		Dockerfile
README.md		README.md
gunicorn.py		gunicorn.py
gunicorn_start.sh		gunicorn_start.sh
localrun		localrun
manage.py		manage.py
package.json		package.json
requirements.txt		requirements.txt