Trust, but Verify II: A Practical Guide to Chemogenomics Data Curation

Journal of Chemical Information and Modeling

Volumn 56, Issue 7, 2016, Pages 1243-1252

  Fourches, Denis ^a   Muratov, Eugene ^b   Tropsha, Alexander ^b  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

^b UNC Hamner Institute for Drug Safety Sciences   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CHEMICAL ENGINEERING; CHEMISTRY;

CHEMICAL AND BIOLOGICALS; CHEMINFORMATICS; GENOMICS DATABASE; MODEL DEVELOPMENT; PRACTICAL GUIDE; PUBLIC CONCERN; REPRODUCIBILITIES; SCIENTIFIC LITERATURE;

DATA CURATION;

CONSENSUS; GENOMICS; QUALITY CONTROL; QUANTITATIVE STRUCTURE ACTIVITY RELATION; REPRODUCIBILITY; STANDARDS; STATISTICS;

CONSENSUS; GENOMICS; QUALITY CONTROL; QUANTITATIVE STRUCTURE-ACTIVITY RELATIONSHIP; REPRODUCIBILITY OF RESULTS; STATISTICS AS TOPIC;

EID: 84979530276     PISSN: 15499596     EISSN: 1549960X     Source Type: Journal    
DOI: 10.1021/acs.jcim.6b00129     Document Type: Review

References (54)

1. Elkins, J. M.; Fedele, V.; Szklarz, M.; Abdul Azeez, K. R.; Salah, E.; Mikolajczyk, J.; Romanov, S.; Sepetov, N.; Huang, X.-P.; Roth, B. L.; Al Haj Zen, A.; Fourches, D.; Muratov, E.; Tropsha, A.; Morris, J.; Teicher, B. A.; Kunkel, M.; Polley, E.; Lackey, K. E.; Atkinson, F. L.; Overington, J. P.; Bamborough, P.; Müller, S.; Price, D. J.; Willson, T. M.; Drewry, D. H.; Knapp, S.; Zuercher, W. J. Comprehensive Characterization of the Published Kinase Inhibitor Set Nat. Biotechnol. 2015, 34, 95-103 10.1038/nbt.3374
2. ChEMBL Database. https://www.ebi.ac.uk/chembl/ (accessed March 1, 2016).
3. PubChem. http://pubchem.ncbi.nlm.nih.gov/ (accessed March 1, 2016).
4. PDSP. http://pdsp.med.unc.edu (accessed March 1, 2016).
5. Hu, Y.; Bajorath, J. Learning from "Big Data": Compounds and Targets Drug Discovery Today 2014, 19, 357-360 10.1016/j.drudis.2014.02.004
6. Cherkasov, A.; Muratov, E. N.; Fourches, D.; Varnek, A.; Baskin, I. I.; Cronin, M.; Dearden, J.; Gramatica, P.; Martin, Y. C.; Todeschini, R.; Consonni, V.; Kuz'min, V. E.; Cramer, R.; Benigni, R.; Yang, C.; Rathman, J.; Terfloth, L.; Gasteiger, J.; Richard, A.; Tropsha, A. QSAR Modeling: Where Have You Been? Where Are You Going To? J. Med. Chem. 2014, 57, 4977-5010 10.1021/jm4004285
7. Howe, D.; Costanzo, M.; Fey, P.; Gojobori, T.; Hannick, L.; Hide, W.; Hill, D. P.; Kania, R.; Schaeffer, M., St; St. Pierre, S.; Twigger, S.; White, O.; Rhee, S. Y. Big Data: The Future of Biocuration Nature 2008, 455, 47-50 10.1038/455047a
8. Frye, S. V.; Arkin, M. R.; Arrowsmith, C. H.; Conn, P. J.; Glicksman, M. A.; Hull-Ryde, E. A.; Slusher, B. S. Tackling Reproducibility in Academic Preclinical Drug Discovery Nat. Rev. Drug Discovery 2015, 14, 733-734 10.1038/nrd4737
9. Olah, M.; Mracec, M.; Ostopovici, L.; Rad, R.; Bora, A.; Hadaruga, N.; Olah, I.; Banda, M.; Simon, Z.; Oprea, T. I. WOMBAT: World of Molecular Bioactivity. In Chemoinformatics in Drug Discovery; Oprea, T. I., Ed.; Wiley-VCH: New York, 2005; pp 223-239.
10. Olah, M.; Rad, R.; Ostopovici, L.; Bora, A.; Hadaruga, N.; Hadaruga, D.; Moldovan, R.; Fulias, A.; Mracec, M.; Oprea, T. I. In Chemical Biology: From Small Molecules to Systems Biology and Drug Design; Schreiber, S. L.; Kapoor, T. M.; Wess, G., Eds.; Wiley-VCH: New York, 2007; pp 760-786.
11. Young, D.; Martin, D.; Venkatapathy, R.; Harten, P. Are the Chemical Structures in Your QSAR Correct? QSAR Comb. Sci. 2008, 27, 1337-1345 10.1002/qsar.200810084
12. Prinz, F.; Schlange, T.; Asadullah, K. Believe It or Not: How Much Can We Rely on Published Data on Potential Drug Targets? Nat. Rev. Drug Discovery 2011, 10, 712 10.1038/nrd3439-c1
13. Begley, C. G.; Ellis, L. M. Drug Development: Raise Standards for Preclinical Cancer Research Nature 2012, 483, 531-533 10.1038/483531a
14. Kramer, C.; Kalliokoski, T.; Gedeck, P.; Vulpetti, A. The Experimental Uncertainty of Heterogeneous Public K(i) Data J. Med. Chem. 2012, 55, 5165-5173 10.1021/jm300131x
15. Ekins, S.; Olechno, J.; Williams, A. J. Dispensing Processes Impact Apparent Biological Activity as Determined by Computational and Statistical Analyses PLoS One 2013, 8, e62325 10.1371/journal.pone.0062325
16. Editorial. Facilitating Reproducibility Nat. Chem. Biol. 2013, 9, 345 10.1038/nchembio.1269
17. Collins, F. S.; Tabak, L. A. Policy: NIH Plans to Enhance Reproducibility Nature 2014, 505, 612-613 10.1038/505612a
18. Editorial. Repetitive Flaws Nature 2016, 529, 256 10.1038/529256a
19. Editorial. Joining the Reproducibility Initiative Nat. Nanotechnol. 2014, 9, 949 10.1038/nnano.2014.287
20. National Institute of Health. NIH Rigor and Reproducibility. https://www.nih.gov/research-training/rigor-reproducibility (accessed May 25, 2016).
21. Fourches, D.; Muratov, E.; Tropsha, A. Trust, but Verify: On the Importance of Chemical Structure Curation in Cheminformatics and QSAR Modeling Research J. Chem. Inf. Model. 2010, 50, 1189-1204 10.1021/ci100176x
22. Fourches, D.; Muratov, E.; Tropsha, A. Curation of Chemogenomics Data Nat. Chem. Biol. 2015, 11, 535 10.1038/nchembio.1881
23. Martin, Y. C. Let's Not Forget Tautomers J. Comput.-Aided Mol. Des. 2009, 23, 693-704 10.1007/s10822-009-9303-2
24. Sitzmann, M.; Ihlenfeldt, W.-D.; Nicklaus, M. C. Tautomerism in Large Databases J. Comput.-Aided Mol. Des. 2010, 24, 521-551 10.1007/s10822-010-9346-4
25. ChemAxon. http://www.chemaxon.com (accessed March 1, 2016).
26. RDKit. http://www.rdkit.org/ (accessed March 1, 2016).
27. Schrodinger. LigPrep. http://www.schrodinger.com/LigPrep/ (accessed Mar 1, 2016).
28. KNIME. http://www.knime.org/ (accessed March 1, 2016).
29. Mansouri, K.; Abdelaziz, A.; Rybacka, A.; Roncaglioni, A.; Tropsha, A.; Varnek, A.; Zakharov, A.; Worth, A.; Richard, A. M.; Grulke, C. M.; Trisciuzzi, D.; Fourches, D.; Horvath, D.; Benfenati, E.; Muratov, E.; Wedebye, E. B.; Grisoni, F.; Mangiatordi, G. F.; Incisivo, G. M.; Hong, H.; Ng, H. W.; Tetko, I. V.; Balabin, I.; Kancherla, J.; Shen, J.; Burton, J.; Nicklaus, M.; Cassotti, M.; Nikolov, N. G.; Nicolotti, O.; Andersson, P. L.; Zang, Q.; Politi, R.; Beger, R. D.; Todeschini, R.; Huang, R.; Farag, S.; Rosenberg, S. A.; Slavov, S.; Hu, X.; Judson, R. S. CERAPP: Collaborative Estrogen Receptor Activity Prediction Project Environ. Health Perspect. 2016, 10.1289/ehp.1510267
30. ChemSpider. http://www.chemspider.com (accessed March 1, 2016).
31. Baurin, N.; Baker, R.; Richardson, C.; Chen, I.; Foloppe, N.; Potter, A.; Jordan, A.; Roughley, S.; Parratt, M.; Greaney, P.; Morley, D.; Hubbard, R. E. Drug-like Annotation and Duplicate Analysis of a 23-Supplier Chemical Database Totalling 2.7 Million Compounds J. Chem. Inf. Comput. Sci. 2004, 44, 643-651 10.1021/ci034260m
32. Veith, H.; Southall, N.; Huang, R.; James, T.; Fayne, D.; Artemenko, N.; Shen, M.; Inglese, J.; Austin, C. P.; Lloyd, D. G.; Auld, D. S. Comprehensive Characterization of Cytochrome P450 Isozyme Selectivity across Chemical Libraries Nat. Biotechnol. 2009, 27, 1050-1055 10.1038/nbt.1581
33. Varnek, A.; Fourches, D.; Horvath, D.; Klimchuk, O.; Gaudin, C.; Vayer, P.; Solov'ev, V.; Hoonakker, F.; Tetko, I. V.; Marcou, G. ISIDA-Platform for Virtual Screening Based on Fragment and Pharmacophoric Descriptors Curr. Comput.-Aided Drug Des. 2008, 4, 191-198 10.2174/157340908785747465
34. Kuz'min, V. E.; Artemenko, A. G.; Muratov, E. N. Hierarchical QSAR Technology Based on the Simplex Representation of Molecular Structure J. Comput.-Aided Mol. Des. 2008, 22, 403-421 10.1007/s10822-008-9179-6
35. Kalliokoski, T.; Kramer, C.; Vulpetti, A.; Gedeck, P. Comparability of Mixed IC50 Data-a Statistical Analysis PLoS One 2013, 8, e61007 10.1371/journal.pone.0061007
36. Fourches, D.; Sassano, M. F.; Roth, B. L.; Tropsha, A. HTS Navigator: Freely-Accessible Cheminformatics Software for Analyzing High-Throughput Screening Data Bioinformatics 2014, 30, 588-589 10.1093/bioinformatics/btt718
37. Benigni, R.; Giuliani, A. Computer-Assisted Analysis of Interlaboratory Ames Test Variability J. Toxicol. Environ. Health 1988, 25, 135-148 10.1080/15287398809531194
38. TM Drug Discovery Today 2014, 19, 1696-1698 10.1016/j.drudis.2014.08.003
39. Sparano, J. A.; Bernardo, P.; Stephenson, P.; Gradishar, W. J.; Ingle, J. N.; Zucker, S.; Davidson, N. E. Randomized Phase III Trial of Marimastat versus Placebo in Patients with Metastatic Breast Cancer Who Have Responding or Stable Disease after First-Line Chemotherapy: Eastern Cooperative Oncology Group Trial E2196 J. Clin. Oncol. 2004, 22, 4683-4690 10.1200/JCO.2004.08.054
40. Maggiora, G. M. On Outliers and Activity Cliffs - Why QSAR Often Disappoints J. Chem. Inf. Model. 2006, 46, 1535 10.1021/ci060117s
41. Golbraikh, A.; Muratov, E. N.; Fourches, D.; Tropsha, A. Dataset Modelability by QSAR J. Chem. Inf. Model. 2014, 54, 1-4 10.1021/ci400572x
42. Hu, Y.; Bajorath, J. Exploration of 3D Activity Cliffs on the Basis of Compound Binding Modes and Comparison of 2D and 3D Cliffs J. Chem. Inf. Model. 2012, 52, 670-677 10.1021/ci300033e
43. Fourches, D.; Muratov, E.; Ding, F.; Dokholyan, N. V.; Tropsha, A. Predicting Binding Affinity of CSAR Ligands Using Both Structure-Based and Ligand-Based Approaches J. Chem. Inf. Model. 2013, 53, 1915-1922 10.1021/ci400216q
44. Kuz'min, V. E.; Muratov, E. N.; Artemenko, A. G.; Varlamova, E. V.; Gorb, L.; Wang, J.; Leszczynski, J. Consensus QSAR Modeling of Phosphor-Containing Chiral AChE Inhibitors QSAR Comb. Sci. 2009, 28, 664-677 10.1002/qsar.200860117
45. Low, Y.; Uehara, T.; Minowa, Y.; Yamada, H.; Ohno, Y.; Urushidani, T.; Sedykh, A.; Muratov, E.; Kuz'min, V.; Fourches, D.; Zhu, H.; Rusyn, I.; Tropsha, A. Predicting Drug-Induced Hepatotoxicity Using QSAR and Toxicogenomics Approaches Chem. Res. Toxicol. 2011, 24, 1251-1262 10.1021/tx200148a
46. Marcou, G.; Horvath, D.; Varnek, A. Kernel Target Alignment Parameter: A New Modelability Measure for Regression Tasks J. Chem. Inf. Model. 2016, 56, 6-11 10.1021/acs.jcim.5b00539
47. Tropsha, A. Best Practices for QSAR Model Development, Validation, and Exploitation Mol. Inf. 2010, 29, 476-488 10.1002/minf.201000061
48. Alves, V. M.; Muratov, E.; Fourches, D.; Strickland, J.; Kleinstreuer, N.; Andrade, C. H.; Tropsha, A. Predicting Chemically-Induced Skin Reactions. Part I: QSAR Models of Skin Sensitization and Their Application to Identify Potentially Hazardous Compounds Toxicol. Appl. Pharmacol. 2015, 284, 262-272 10.1016/j.taap.2014.12.014
49. Royal Society of Chemistry. Next RSC president predicts that in 15 years no chemist will do bench experiments without computer-modelling them first. http://www.rsc.org/AboutUs/News/PressReleases/2013/Dominic-Tildesley-Royal-Society-of-Chemistry-President-Elect.asp (accessed May 25, 2016).
50. Nielsen, E. I.; Friberg, L. E. Pharmacokinetic-Pharmacodynamic Modeling of Antibacterial Drugs Pharmacol. Rev. 2013, 65, 1053-1090 10.1124/pr.111.005769
51. Orchard, S.; Al-Lazikani, B.; Bryant, S.; Clark, D.; Calder, E.; Dix, I.; Engkvist, O.; Forster, M.; Gaulton, A.; Gilson, M.; Glen, R.; Grigorov, M.; Hammond-Kosack, K.; Harland, L.; Hopkins, A.; Larminie, C.; Lynch, N.; Mann, R. K.; Murray-Rust, P.; Lo Piparo, E.; Southan, C.; Steinbeck, C.; Wishart, D.; Hermjakob, H.; Overington, J.; Thornton, J. Minimum Information about a Bioactive Entity (MIABE) Nat. Rev. Drug Discovery 2011, 10, 661-669 10.1038/nrd3503
52. Clark, A. M.; Litterman, N. K.; Kranz, J. E.; Gund, P.; Gregory, K.; Bunin, B. A. BioAssay Templates for the Semantic Web PeerJ. Comput. Sci. 2016, 2, e61 10.7717/peerj-cs.61
53. Editorial. Journals Unite for Reproducibility Nature 2014, 515, 7-8 10.1038/515007a
54. Fourches, D.; Pu, D.; Li, L.; Zhou, H.; Mu, Q.; Su, G.; Yan, B.; Tropsha, A. Computer-Aided Design of Carbon Nanotubes with the Desired Bioactivity and Safety Profiles Nanotoxicology 2016, 10, 374-383 10.3109/17435390.2015.1073397