This repo is under active maintenance. Updates will be documented here.
docker
RabbitMQ
(will be moving to supporting RabbitMQ on Docker shortly)
- Produces a stream of data from Dublin Bus, Dublin Bikes and some other dependent variables such as weather
- This data is ingested into a RabbitMQ MQ
- Consumers subscribe to these topics and build an online learning model
docker-compose up
docker build -t pipeline .
python main.py --flag=bus --host=localhost --start_index=0 --end_index=2
- This repo will undergo active maintenance for the next few months. Will be using RabbitMQ with Spark for stream processing on the consumer side (MLlib)