Skip to content

kehindetomiwa/Data_enginering_task

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Data Engineering

data_generator project to:

  • create random data
  • store in Postgresql
  • Dump data from Postgresql to csv
  • move data from csv to AWS S3 bucket

map_reduce is a mapper and reduce function for simple word count.

sql script for creating table schema

JSON uses JQ to reformat a JSON file to a desired format

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published