mavarick / run-spark Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

middleware to use spark easily, with a configuration file

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 5 Commits
README.md		README.md
beautifulsoup4-4.4.0-py2.7.egg		beautifulsoup4-4.4.0-py2.7.egg
extract_short_words.py		extract_short_words.py
jieba-0.37-py2.7.egg		jieba-0.37-py2.7.egg
preprocessing.py		preprocessing.py
py_files_mapper.py		py_files_mapper.py
run-spark		run-spark
tokens.py		tokens.py

Repository files navigation

run-spark

middleware to use spark easily, with a configuration file

USAGE

run run-spark -c config.conf to generate configuration file
edit configuation file and full needed parameters
run run-spark -f config.conf

What you Can do:

uniform api for third-part packages
easy to run spark program

About

middleware to use spark easily, with a configuration file

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%