Skip to content

NaqibY/data-engineering-projects

Repository files navigation

Data Engineering Projects

Description

In this project, we want to explore the fundamental of the data engineering by building the data pipeline using library that comes with Python. This pipeline are use to build the flows of the data from the sources to data scientist,analyst,consumer and etc. The sources are come from various types then ingest it into storage before being transform and loads into data warehouse for end user.

etldiagram

Project 7 : Kafka and Pyspark

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published