Ensure you have docker before executing the following commands.
Unit testing, PEP8 checks and other lint checks:
./bin/pod.sh tox
To run only unit test:
./bin/pod.sh tox -e py36
wanderijames/sparkjob
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Running simple jobs on spark. We will create a simple pipeline using docker, spark, airflow and livy
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published