Hyperopt-Sklearn: Automatic Hyperparameter Configuration for Scikit-Learn
Brent Komer, James Bergstra, Chris Eliasmith · Proceedings of the Python in Science Conferences · 2014
Hyperopt-sklearn is a new software project that provides automatic algorithm configuration of the Scikit-learn machine learning library.Following Auto-Weka, we take the view that the choice of classifier and even the choice of preprocessing module can be taken together to represent a single large hyperparameter optimization problem.We use Hyperopt to define a search space that encompasses many standard components (e.g.SVM, RF, KNN, PCA, TFIDF) and common patterns of composing them together.We demonstrate, using search algorithms in Hyperopt and standard benchmarking data sets (MNIST, 20-Newsgroups, Convex Shapes), that searching this space is practical and effective.In particular, we improve on best-known scores for the model space for both MNIST and Convex Shapes.
Cited by 295 works. doi:10.25080/majora-14bd3278-006 Open-access PDF
Authors
References
- Gradient-based learning applied to document recognition
- Scikit-learn: Machine Learning in Python
- The WEKA data mining software
- Multi-column deep neural networks for image classification
- Practical Bayesian Optimization of Machine Learning Algorithms
- An empirical evaluation of deep architectures on problems with many factors of variation
- Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures
- Auto-WEKA
- Algorithms for Hyper-Parameter Optimization
- Sequential Model-Based Optimization for General Algorithm Configuration