Skip to content

a map/reduce-based computing framework implemented by Python

Notifications You must be signed in to change notification settings

caodonglei/mapred

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 

Repository files navigation

mapred

A map/reduce-based computing framework implemented by Python using multiprocessing. The first version only facilicates from the multi-cores of a single machine. New version will take multiple machines into accound by delivering messages among machines across the network.

The procedure of a map/reduce job is as follows:

masive input data -> splitter -> data partitions -> mapper(sorter) -> shuffler -> reducer -> collector -> output data

About

a map/reduce-based computing framework implemented by Python

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages