Packet Processing Platform is an open source streaming big data pipeline that ingests packets using a distributed proxy, into Kafka and onto Spark-streaming for detecting packet anomalies using MLib.
- Version 0.1
- We are currently using mitmproxy project as our http proxy
- Kafka is our ingestion engine
- Spark is our packet processing engine
- We run a Flask as a REST API service
- SaaS application is a modified version of the Stripe's rails app
- Summary of set up
- Configuration
- Dependencies
- Database configuration
- How to run tests
- Deployment instructions
- Writing tests
- Code review
- Other guidelines
- Repo owner or admin: dhananjay.sampath@gmail.com
- Other community or team contact: blazear@gmail.com