Deep Neural Nets as a Method for Quantitative Structure–Activity Relationships
Junshui Ma, Robert P. Sheridan, Andy I. Liaw et al. · Journal of Chemical Information and Modeling · 2015
Neural networks were widely used for quantitative structure-activity relationships (QSAR) in the 1990s. Because of various practical issues (e.g., slow on large problems, difficult to train, prone to overfitting, etc.), they were superseded by more robust methods like support vector machine (SVM) and random forest (RF), which arose in the early 2000s. The last 10 years has witnessed a revival of neural networks in the machine learning community thanks to new methods for preventing overfitting, more efficient training algorithms, and advancements in computer hardware. In particular, deep neural nets (DNNs), i.e. neural nets with more than one hidden layer, have found great successes in many applications, such as computer vision and natural language processing. Here we show that DNNs can routinely make better prospective predictions than RF on a set of large diverse QSAR data sets that are taken from Merck's drug discovery effort. The number of adjustable parameters needed for DNNs is fairly large, but our results show that it is not necessary to optimize them for individual data sets, and a single set of recommended parameters can achieve better performance than RF for most of the data sets we studied. The usefulness of the parameters is demonstrated on additional data sets not used in the calibration. Although training DNNs is still computationally intensive, using graphical processing units (GPUs) can make this issue manageable.
Cited by 1,157 works. doi:10.1021/ci500747n
Authors
References
- ImageNet classification with deep convolutional neural networks
- Random Forests
- Support-Vector Networks
- Learning representations by back-propagating errors
- A Fast Learning Algorithm for Deep Belief Nets
- Dropout: a simple way to prevent neural networks from overfitting
- Rectified Linear Units Improve Restricted Boltzmann Machines
- Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups
- Advances in Neural Information Processing Systems 25
- CUDAMat: a CUDA-based matrix class for Python