SchPark is a Scheduler for Spark with a web interface for manage all jobs. It uses spark-submit program for send jobs to Spark Master.
- Django 1.8
- django-cron https://github.com/Tivix/django-cron
- Apache Spark
Check wiki: https://github.com/trencube/SchPark/wiki
SPARK_BIN_DIR = '/opt/spark/bin'
Is the spark binary directory
SPARK_MASTER = '127.0.0.1:7077'
Is the ip and port of spark master
<VirtualHost *:80>
ServerName serverdomain.com
WSGIScriptAlias / /var/www/SchPark/SchPark/wsgi.py
Alias /static/ /var/www/SchPark/static/
<Directory />
Options FollowSymLinks
AllowOverride None
Order deny,allow
Allow from all
</Directory>
</VirtualHost>