Skip to content
/ hazoo Public

service discovery for yarn to be merged into 'dynamic yarn'

Notifications You must be signed in to change notification settings

Yasumoto/hazoo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Note- I decided to cheat and use this in the (super) short-term instead of Dynamic Yarn but will come back around to merge them if/when we move forward with our approach.

Hadoop Service Discovery on Aurora

This generates a pex file which will perform service discovery into a local ZooKeeper ensemble to find the correct location of a headnode (which includes both a Name Node and a Resource Manager). It will then update the local configuration file so the workernode knows how to communicate with the headnode.

About

service discovery for yarn to be merged into 'dynamic yarn'

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published