learn spark the hard way

基于2.1版本的源码，主要对spark core的部署模块，作业调度，内存管理，shuffle流程和块管理做了注释。对spark sql的执行流程和structured streaming做了注释。对spark streaming做了注释。对mllib的分类和回归算法做了注释。欢迎交流qq：1010525457。

Name		Name	Last commit message	Last commit date
Latest commit History 19,253 Commits
.github		.github
R		R
assembly		assembly
bin		bin
build		build
common		common
conf		conf
core		core
data		data
dev		dev
docs		docs
examples		examples
external		external
graphx		graphx
launcher		launcher
licenses		licenses
mllib-local		mllib-local
mllib		mllib
project		project
python		python
repl		repl
resource-managers		resource-managers
sbin		sbin
sql		sql
streaming		streaming
tools		tools
.gitattributes		.gitattributes
.gitignore		.gitignore
.travis.yml		.travis.yml
CONTRIBUTING.md		CONTRIBUTING.md
LICENSE		LICENSE
NOTICE		NOTICE
README.md		README.md
appveyor.yml		appveyor.yml
pom.xml		pom.xml

License

Atthemoment/spark

Folders and files

Latest commit

History

Repository files navigation

learn spark the hard way

spark core 重要的类

spark sql 分析优化规则、执行

spark ml 分类和回归类图

About

Resources

License

Security policy

Stars

Watchers

Forks

Languages