Series of notes/code-snippets about various hyperparameter optimisation techniques.

Code is based on the paper by Talwalkar A. Non-stochastic best arm identification and hyperparameter optimization. Some Example code for :

• sklearn: RandomForest, GradientBoosting, etc...
• xgboost

More information can be found in this blog post

Code is based on the paper by Talwalkar A. Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization.

• add setup.py
• add example Extreme-random-forest
• add proper hyperparameter-spaces in examples
• ? comparison for some dataset?

• zygmuntz hyperband

Spark implementation of Random Search for sampling over breeze.stats.distribution. More information can be found in this blog post