Comparing protein–ligand docking programs is difficult
Jason C. Cole, Christopher W. Murray, J. Willem M. Nissink et al. · Proteins Structure Function and Bioinformatics · 2005
There is currently great interest in comparing protein-ligand docking programs. A review of recent comparisons shows that it is difficult to draw conclusions of general applicability. Statistical hypothesis testing is required to ensure that differences in pose-prediction success rates and enrichment rates are significant. Numerical measures such as root-mean-square deviation need careful interpretation and may profitably be supplemented by interaction-based measures and visual inspection of dockings. Test sets must be of appropriate diversity and of good experimental reliability. The effects of crystal-packing interactions may be important. The method used for generating starting ligand geometries and positions may have an appreciable effect on docking results. For fair comparison, programs must be given search problems of equal complexity (e.g. binding-site regions of the same size) and approximately equal time in which to solve them. Comparisons based on rescoring require local optimization of the ligand in the space of the new objective function. Re-implementations of published scoring functions may give significantly different results from the originals. Ostensibly minor details in methodology may have a profound influence on headline success rates.
Cited by 371 works. doi:10.1002/prot.20497
Authors
References
- The Protein Data Bank
- Nonparametric Statistics for the Behavioral Sciences.
- The Cambridge Structural Database: a quarter of a million crystal structures and rising
- Automated docking using a Lamarckian genetic algorithm and an empirical binding free energy function
- Development and validation of a genetic algorithm for flexible docking 1 1Edited by F. E. Cohen
- Glide: A New Approach for Rapid, Accurate Docking and Scoring. 1. Method and Assessment of Docking Accuracy
- A Fast Flexible Docking Method using an Incremental Construction Algorithm
- Glide: A New Approach for Rapid, Accurate Docking and Scoring. 2. Enrichment Factors in Database Screening
- Empirical scoring functions: I. The development of a fast empirical scoring function to estimate the binding affinity of ligands in receptor complexes
- ICM—A new method for protein modeling and design: Applications to docking and structure prediction from the distorted native conformation