A statistical framework to evaluate virtual screening

BMC Bioinformatics

Volumn 10, Issue , 2009, Pages

  Zhao, Wei ^a   Hevener, Kirk E ^b   White, Stephen W ^a,b   Lee, Richard E ^a   Boyett, James M ^a  

^a ST JUDE CHILDREN S RESEARCH HOSPITAL   (United States)

^b UNIVERSITY OF TENNESSEE HEALTH SCIENCE CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BOOTSTRAP SIMULATION; EXACT DISTRIBUTION; EXTENSIVE SIMULATIONS; RECEIVER OPERATING CHARACTERISTIC CURVES; STATISTICAL COMPARISONS; STATISTICAL FRAMEWORK; TYPE I ERROR RATE; VIRTUAL SCREENING;

ARTICLE; BOOTSTRAPPING; CLASSIFIER; COMPUTER SIMULATION; CONTROLLED STUDY; DRUG SCREENING; INFORMATION PROCESSING; INTERMETHOD COMPARISON; MATHEMATICAL COMPUTING; RECEIVER OPERATING CHARACTERISTIC; STATISTICAL DISTRIBUTION; STATISTICAL SIGNIFICANCE; VIRTUAL REALITY; BIOLOGY; GENE EXPRESSION PROFILING; METHODOLOGY; ROC CURVE; STATISTICAL MODEL;

COMPUTATIONAL BIOLOGY; GENE EXPRESSION PROFILING; MODELS, STATISTICAL; ROC CURVE;

EID: 68949158347     PISSN: None     EISSN: 14712105     Source Type: Journal    
DOI: 10.1186/1471-2105-10-225     Document Type: Article

References (36)

1. Shoichet BK Virtual screening of chemical libraries Nature 2004, 432(7019):862-5 1360234 15602552 10.1038/nature03197
2. Kirchmair J Distinto S Schuster D Spitzer G Langer T Wolber G Enhancing drug discovery through in silico screening: Strategies to increase true positives retrieval rates Current Medicinal Chemistry 2008, 15(20):2040-53 10.2174/092986708785132843 18691055
3. Jain AN Virtual screening in lead discovery and optimization Current Opinion Drug Discovery & Development 2004, 7(4):396-403
4. Cavasotto CN Orry AJ Ligand docking and structure-based virtual screening in drug discovery Current Topics in Medicinal Chemistry 2007, 7(10):1006-14 10.2174/156802607780906753 17508934
5. Klebe G Virtual ligand screening: Strategies, perspectives and limitations Drug Discovery Today 2006, 11(13-14):580-94 10.1016/ j.drudis.2006.05.012 16793526
6. Doman TN McGovern SL Witherbee BJ Kasten TP Kurumbail R Stallings WC Connolly DT Shoichet BK Molecular docking and high-throughput screening for novel inhibitors of protein tyrosine phosphatase-1B Journal of Medicinal Chemistry 2002, 45(11):2213-21 10.1021/jm010548w 12014959
7. Brenk R Irwin JJ Shoichet BK Here be dragons: Docking and screening in an uncharted region of chemical space Journal Biomolecular Screening 2005, 10(7):667-74 10.1177/1087057105281047
8. Bissantz C Folkers G Rognan D Protein-based virtual screening of chemical databases. 1. Evaluation of different docking/scoring combinations Journal Medicinal Chemistry 2000, 43(25):4759-67 10.1021/ jm001044l
9. Warren GL Andrews CW Capelli AM Clarke B LaLonde J Lambert MH Lindvall M Nevins N Semus SF Senger S Tedesco G Wall ID Woolven JM Peishoff CE Head MS A critical assessment of docking programs and scoring functions Journal Medicinal Chemistry 2006, 49(20):5912-31 10.1021/jm050362n
10. Chen H Lyne PD Giordanetto F Lovell T Li J On evaluating molecular-docking methods for pose prediction and enrichment factors Journal of Chemical Information Modeling 2006, 46(1):401-15 10.1021/ ci0503255
11. Kirchmair J Markt P Distinto S Wolber G Langer T Evaluation of the performance of 3D virtual screening protocols: RMSD comparisons, enrichment assessments, and decoy selection-what can we learn from earlier mistakes? Journal of Computer-Aided Molecular Design 2008, 22(3-4):213-28 10.1007/s10822-007-9163-6 18196462
12. Cole JC Murray CW Nissink JWM Taylor RD Taylor R Comparing protein-ligand docking programs is difficult Proteins 2005, 60(3):325-32 10.1002/prot.20497 15937897
13. Jain AN Bias, reporting, and sharing: Computational evaluations of docking methods Journal of Computer-Aided Molecular Design 2008, 22(3-4):201-12 10.1007/s10822-007-9151-x 18075713
14. Sheridan RP Singh SB Fluder EM Kearsley SK Protocols for bridging the peptide to nonpeptide gap in topological similarity searches Journal of Chemical Information and Computer Sciences 2001, 41(5):1395-406
15. Clark RD Webster-Clark DJ Managing bias in ROC curves Journal of Computer-Aided Molecular Design 2008, 22:141-146 10.1007/ s10822-008-9181-z 18256892
16. Truchon JF Bayly CI Evaluating virtual screening methods: Good and bad metrics for the "early recognition" problem Journal of Chemical Information Modeling 2007, 47:488-508 10.1021/ci600426e
17. Triballeau N Acher F Brabet I Pin JP Bertrand HO Virtual screening workflow development guided by the "receiver operating characteristic" curve approach. Application to high-throughput docking on metabotropic glutamate receptor subtype 4 Journal of Medicinal Chemistry 2005, 48:2534-47 10.1021/jm049092j 15801843
18. Hevener K Zhao W Ball D Babaoglu K Qi JJ White S Lee R Validation of Molecular Docking Programs for Virtual Screening against Dihydropteroate Synthase Journal of Chemical Information and Modeling 2009, 46(2):444-460 10.1021/ci800293n
19. Pham TA Jain AN Parameter estimation for scoring protein-ligand interactions using negative training data Journal of Medicinal Chemistry 2005, 49:5856-68 10.1021/jm050040j
20. Konstantinou-Kirtay C Mitchell JBO Lumley JA Scoring functions and enrichment: A case study on Hsp90 BMC Bioinformatics 2007, 8:27 1790905 17257425 10.1186/1471-2105-8-27
21. Cannon EO Nigsch F Mitchell JBO A novel hybrid ultrafast shape descriptor method for use in virtual screening Chemistry Central Journal 2008, 2:3 2275267 18282294 10.1186/1752-153X-2-3
22. Jain AN Bias, reporting, and sharing: Computational evaluations of docking methods Journal of Computer-Aided Molecular Design 2008, 22:201-12 10.1007/s10822-007-9151-x 18075713
23. Griner PF Mayewski RJ Mushlin AI Greenland P. Selection and interpretation of diagnostic tests and procedures Annals of Internal Medicine 1981, 94:555-600
24. Metz CE Basic principles of ROC analysis Seminars in Nuclear Medicine 1978, 8:283-298 10.1016/S0001-2998(78)80014-2 112681
25. Zweig MH Campbell G Receiver-operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine Clinical Chemistry 1993, 39:561-577 8472349
26. Hanley JA McNeil BJ The meaning and use of the area under a receiver operating characteristic (ROC) curve Radiology 1982, 143:29-36 7063747
27. Hanley JA McNeil BJ A method of comparing the areas under receiver operating characteristic curves derived from the same cases Radiology 1983, 148:839-843 6878708
28. Venkatraman ES Begg CB A distribution-free procedure for comparing receiver operating characteristic curves from a paired experiment Biometrika 1996, 83:835-848 10.1093/biomet/83.4.835
29. Venkatraman ES A permutation test to compare receiver operating characteristic curves Biometrics 2000, 56:1134-8 10.1111/ j.0006-341X.2000.01134.x 11129471
30. DeLong ER DeLong DM Clarke-Pearson DL Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach Biometrics 1998, 44:837-845 10.2307/2531595
31. Bamber D The area above the ordinal dominance graph and the area below the receiver operating characteristic curve Journal of Mathematical Psychology 1975, 12:387-415 10.1016/0022-2496(75)90001-2
32. Zhou XH Gatsonis CA A simple method for comparing correlated ROC curves using incomplete data Statistics in Medicine 1998, 15:11687-1693
33. Efron B Tibshirani RJ An introduction to the bootstrap Chapman & Hall/CRC, Boca Raton 1993
34. Davison AC Hinkley D Bootstrap methods and their applications Cambridge University Press, Cambridge 8 2006
35. Simon JL Resampling: The new statistics Resampling Stats, Arlington 1997
36. Casella G Berger RL Statistical Inference Duxbury Press, Pacific Grove 2001