Skip to content

The project uses airflow to manage workflow. \newlineThe flow is uploading the file to AWS S3, fetching it, analysing it and then uploading result to AWS S3.

Notifications You must be signed in to change notification settings

jenniferdo2211/Airflow-Analysis

Repository files navigation

Analysis File with Airflow

Purpose: Illustrate how to work with Airflow in Python.

Workflow:

  1. Uploading training set file (format .csv) to AWS S3
  2. Fetching file
  3. Reading file
  4. Analyze data
  5. Save result to AWS S3

About

The project uses airflow to manage workflow. \newlineThe flow is uploading the file to AWS S3, fetching it, analysing it and then uploading result to AWS S3.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages