Real Time Data Processing Server using Celery and Tornado for http://pak-track.rit.edu/
pip install -r requirements-freeze.txt
pip install flower
python start.py --port=8000 --db_host=localhost --db=paktrackDB
celery worker -A paktrack --loglevel=INFO -P processes --concurrency=3 -Q vibration -n worker2.%%h
celery worker -A paktrack --loglevel=INFO -P processes --concurrency=3 -Q shock -n worker2.%%h
celery worker -A paktrack --loglevel=INFO -P processes --concurrency=3 -Q vibration_report -n worker2.%%h
Start the server using supervisor(Refer here for supervisor documentation http://supervisord.org/)
The config file assumes you have user paktrack and it has access to write to /var/log/celery|tornado|flower folders. Also you have virtualenv installed and a virtulenv is created in /home/paktrack/virtualenv/data-processing-server
- Add
tornado.conf
,celery.conf
&flower.conf
to the supervisor config - Start
supervisord
- Check the process using
supervisorctl
- You could also use https://flower.readthedocs.io/en/latest/ to monitor the celery workers