Random Forest: A Classification and Regression Tool for Compound Classification and QSAR Modeling
Vladimir Svetnik, Andy I. Liaw, Christopher Tong et al. · Journal of Chemical Information and Computer Sciences · 2003
A new classification and regression tool, Random Forest, is introduced and investigated for predicting a compound's quantitative or categorical biological activity based on a quantitative description of the compound's molecular structure. Random Forest is an ensemble of unpruned classification or regression trees created by using bootstrap samples of the training data and random feature selection in tree induction. Prediction is made by aggregating (majority vote or averaging) the predictions of the ensemble. We built predictive models for six cheminformatics data sets. Our analysis demonstrates that Random Forest is a powerful tool capable of delivering performance that is among the most accurate methods to date. We also present three additional features of Random Forest: built-in performance assessment, a measure of relative importance of descriptors, and a measure of compound similarity that is weighted by the relative importance of descriptors. It is the combination of relatively high prediction accuracy and its collection of desired features that makes Random Forest uniquely suited for modeling in cheminformatics.
Cited by 3,573 works. doi:10.1021/ci034160g
Authors
References
- Classification and Regression Trees.
- A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting
- The Elements of Statistical Learning
- Pattern Recognition and Neural Networks
- Greedy function approximation: A gradient boosting machine.
- Arcing classifier (with discussion and a rejoinder by the author)
- On Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality
- Partial least squares for discrimination
- Chemical Similarity Searching
- Atom pairs as molecular features in structure-activity studies: definition and applications