Gradient boosting machines, a tutorial
Alexey Natekin, Alois Knoll · Frontiers in Neurorobotics · 2013
Gradient boosting machines are a family of powerful machine-learning techniques that have shown considerable success in a wide range of practical applications. They are highly customizable to the particular needs of the application, like being learned with respect to different loss functions. This article gives a tutorial introduction into the methodology of gradient boosting methods with a strong focus on machine learning aspects of modeling. A theoretical information is complemented with descriptive examples and illustrations which cover all the stages of the gradient boosting model design. Considerations on handling the model complexity are discussed. Three practical examples of gradient boosting applications are presented and comprehensively analyzed.
Cited by 3,845 works. doi:10.3389/fnbot.2013.00021 Open-access PDF
Authors
References
- Random Forests
- Classification and Regression Trees.
- A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting
- Rapid object detection using a boosted cascade of simple features
- Greedy function approximation: A gradient boosting machine.
- UCI Machine Learning Repository
- Regularization and Variable Selection Via the Elastic Net
- The Cascade-Correlation learning architecture
- Neural network ensembles
- Graph drawing by force‐directed placement