Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
.gitattributes		.gitattributes
E1.py		E1.py
E2.py		E2.py
E3.py		E3.py
E4.py		E4.py
E5.py		E5.py
H1.py		H1.py
N1.py		N1.py
N2N3.py		N2N3.py
N4.py		N4.py
N4.txt		N4.txt
N5.py		N5.py
N6.py		N6.py
N7.py		N7.py
README.md		README.md
Report.docx		Report.docx
Spark__project.pdf		Spark__project.pdf

Repository files navigation

spark_data-analysis

In this project, I use Apache Spark to analyze a big dataset: Mernis database, which contains more than 120 million records of Turkey citizen information.

This is the final project of DATA130014 Advanced Big Data Analysis @Fudan University.

For more details, please read Spark__project.pdf and Report.docx

About

Use Apache Spark to analyze big data(Turkey citizen data)

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%