Ensuring confidence in predictions: A scheme to assess the scientific validity of in silico models

Advanced Drug Delivery Reviews

Volumn 86, Issue , 2015, Pages 101-111

  Hewitt, Mark ^a,b   Ellison, Claire M ^b   Cronin, Mark T D ^b   Pastor, Manuel ^c   Steger Hartmann, Thomas ^d   Munoz Muriendas, Jordi ^e   Pognan, Francois ^f   Madden, Judith C ^b  

^a UNIVERSITY OF WOLVERHAMPTON   (United Kingdom)

^b LIVERPOOL JOHN MOORES UNIVERSITY   (United Kingdom)

^c UNIVERSITAT POMPEU FABRA   (Spain)

^d BAYER PHARMA AG   (Germany)

^e GLAXOSMITHKLINE   (United Kingdom)

^f NOVARTIS PHARMA AG   (Switzerland)

Author keywords

Good computer modelling practice; Model reliability; Peer verification; QSAR; Toxicity prediction; Validation

Indexed keywords

FORECASTING; LAWS AND LEGISLATION; TOXICITY;

COMPUTER MODELLING; MODEL RELIABILITY; QSAR; TOXICITY PREDICTIONS; VALIDATION;

COMPUTATIONAL CHEMISTRY;

ANIMAL TESTING REDUCTION; COMPUTER MODEL; DATA PROCESSING; DRUG ABSORPTION; DRUG DISTRIBUTION; DRUG ELIMINATION; DRUG LEGISLATION; DRUG METABOLISM; DRUG RESEARCH; DRUG SAFETY; MEDICAL ETHICS; NONHUMAN; PEER REVIEW; PILOT STUDY; PREDICTION; PRIORITY JOURNAL; RELIABILITY; REVIEW; SCIENTIFIC VALIDITY; TOXICITY TESTING; VALIDITY; COMPUTER SIMULATION; HUMAN; REPRODUCIBILITY; THEORETICAL MODEL;

COMPUTER SIMULATION; HUMANS; MODELS, THEORETICAL; PILOT PROJECTS; REPRODUCIBILITY OF RESULTS;

EID: 84937631859     PISSN: 0169409X     EISSN: 18728294     Source Type: Journal    
DOI: 10.1016/j.addr.2015.03.005     Document Type: Review

References (33)

1. Hou T.J., Wang J., Zhang W., Wang W., Xu X. Recent advances in computational prediction of drug absorption and permeability in drug discovery. Curr. Med. Chem. 2006, 13:2653-2667.
2. Hou T.J., Wang J. Structure-ADME relationship: still a long way to go?. Expert Opin. Drug Metab. Toxicol. 2008, 4:759-771.
3. Hou T.J., Li Y., Zhang W., Wang J. Recent developments of in silico predictions of intestinal absorption and oral bioavailability. Comb. Chem. High Throughput Screen. 2009, 12:497-506.
4. Zhu J.Y., Wang J., Yu H., Li Y., Hou T.J. Recent developments of in silico predictions of oral bioavailability. Comb. Chem. High Throughput Screen. 2011, 14:362-375.
5. European Union, Regulation (EC) No. 1907/2006 of the European Parliament and of the Council of 18 December 2006 concerning the Registration, Evaluation, Authorisation and Restriction of Chemicals (REACH), establishing a European Chemicals Agency, amending Directive 1999/45/ EC and repealing Council Regulation (EEC) No. 793/93 and Commission Regulation (EC) No. 1488/94as well as Council Directive 76/769/EEC and Commission Directives 91/155/EEC, 93/67/ EEC, 93/105/EC and 2000/21/EC. Off. J. 2006, L 396:1-850.
6. Cosmetic Products Regulation (EC) No 1223/2009 2009.
7. Scientific report of EFSA, modern methodologies and tools for human hazard assessment of chemicals. EFSA J. 2014, 12. http://www.efsa.europa.eu/en/efsajournal/doc/3638.pdf (Accessed July 2014).
8. Cronin M.T.D., Schultz T.W. Pitfalls in QSAR. J. Theor. Chem. (Theochem) 2003, 622:39-51.
9. Organisation for Economic Cooperation and Development Report from the expert group on (quantitative) structure-activity relationships ((Q)SARs) on the principles for the validation of (Q)SARs. (ENV/JM/MONO(2004)24) 2004.
10. Dearden J.C., Cronin M.T.D., Kaiser K.L.E. How not to develop a quantitative structure-activity or structure-property relationship (QSAR/QSPR). SAR QSAR Environ. Res. 2009, 20:241-266.
11. Stouch T.R., Kenyon J.R., Johnson S.R., Chen X.-Q., Doweyko1 A., Li Y. In silico ADME/Tox: why models fail. J. Comput. Aided Mol. Des. 2003, 17:83-92.
12. Judson P.H. Towards establishing good practice in the use of computer prediction. Qual. Assur. J. 2010, 12:120-125.
13. Kristam R., Gillet V.J., Lewis R.A., Thorner D. Comparison of conformational analysis techniques to generate pharmacophore hypotheses using catalyst. J. Chem. Inf. Model. 2005, 45:461-476.
14. ECHA (Accessed August 2014). http://echa.europa.eu/web/guest/guidance-documents/guidance-on-information-requirements-and-chemical-safety-assessment.
15. Worth A.P. The role of QSAR methodology in the regulatory assessment of chemicals. Recent Advances in QSAR Studies 2010, 367-382. Springer. T. Puzyn, J. Leszczynski, M.T. Cronin (Eds.).
16. Young D., Martin T., Venkatapathy R., Harten P. Are the chemical structures in your QSAR correct?. QSAR Comb. Sci. 2008, 23:1337-1345.
17. Beck B., Geppert T. Industrial applications of in silico ADMET. J. Mol. Model. 2014, 20:2322-2336.
18. Schneider K., Schwarz M., Burkholder I., Kopp-Schneider A., Edler L., Kinsner-Ovaskainan A., Hartung T., Hoffmann S. "ToxRTool", a new tool to assess the reliability of toxicological data. Toxicol. Lett. 2009, 189:138-144.
19. Klimisch H.J., Andreae M., Tillmann U. A systematic approach for evaluating the quality of experimental toxicological and ecotoxicological data. Regul. Toxicol. Pharmacol. 1997, 25:1-5.
20. Nendza M., Aldenberg T., Benfenati E., Benigni R., Cronin M., Escher S., Fernandez A., Gabbert S., Giralt F., Hewitt M., Hrovat M., Jeram S., Kroese D., Madden J., Mangelsdorf I., Rallo R., Roncaglioni A., Rorije E., Segner H., Simon-Hettich B., Vemeire T. Data quality assessment for in silico methods: a survey of approaches and needs. In Silico Toxicology: Principles and Applications 2010, 59-118. The Royal Society of Chemistry, Cambridge. M.T.D. Cronin, J.C. Madden (Eds.).
21. Madden J.C. Sources of chemical information, toxicity data and assessment of their quality. Chemical Toxicity Prediction: Category Formation and Read-Across 2013, 98-126. The Royal Society of Chemistry, Cambridge. M.T.D. Cronin, J.C. Madden, S.J. Enoch, D.W. Roberts (Eds.).
22. Przybylak K.R., Madden J.C., Cronin M.T.D., Hewitt M. Assessing toxicological data quality: basic principles, existing schemes and current limitations. SAR QSAR Environ. Res. 2012, 23:435-459.
23. (Accessed July 2014). http://ihcp.jrc.ec.europa.eu/our_labs/predictive_toxicology/qsar_tools/QRF.
24. (Accessed August 2014). http://www.etoxproject.eu/.
25. Briggs K., Cases M., Heard D.J., Pastor M., Pognan F., Sanz F., Schwab C.H., Steger-Hartmann T., Sutter A., Watson D.K., Wichard J.D. Inroads to predict in vivo toxicology-an Introduction to the eTOX Project. Int. J. Mol. Sci. 2012, 13:3820-3846.
26. Cases M., Briggs K., Steger-Hartmann T., Pognan F., Marc P., Kleinoder T., Schwab C.H., Pastor M., Wichard J., Sanz F. The eTOX data-sharing project to advance in silico drug-induced toxicity prediction. Int. J. Mol. Sci. 2014, 15:21136-21154.
27. Ruusmann V., Sild S., Maran U. QSAR DataBank-an approach for the digital organization and archiving of QSAR model information. J. Cheminf. 2014, 14:6-25.
28. Fourches D., Muratov E., Tropsha A. Trust, but verify: on the importance of chemical structure curation in chemoinformatics and QSAR modeling research. J. Chem. Inf. Model. 2010, 50:1189-1204.
29. Sushko I., Novotarskyi S., Körner R., Pandey A.K., Rupp M., Teetz W., Brandmaier S., Abdelaziz A., Prokopenko V.V., Tanchuk V.Y., Todeschini R., Varnek A., Marcou G., Ertl P., Potemkin V., Grishina M., Gasteiger J., Schwab C., Baskin I.I., Palyulin V.A., Radchenko E.V., Welsh W.J., Kholodovych V., Chekmarev D., Cherkasov A., Aires-de-Sousa J., Zhang Q.Y., Bender A., Nigsch F., Patiny L., Williams A., Tkachenko V., Tetko I.V. Online chemical modeling environment (OCHEM): web platform for data storage, model development and publishing of chemical information. J. Comput. Aided Mol. Des. 2011, 25:533-554.
30. Brandmaier S., Peijnenburg W., Durjava M.K., Kolar B., Gramatica P., Papa E., Bhhatarai B., Kovarich S., Cassani S., Roy P.P., Rahmberg M., Öberg T., Jeliazkova N., Golsteijn L., Comber M., Charochkina L., Novotarskyi S., Sushko I., Abdelaziz A., D'Onofrio E., Kunwar P., Ruggiu F., Tetko I.V. The QSPR-THESAURUS: the online platform of the CADASTER project. Altern. Lab. Anim. (ATLA) 2014, 42:13-24.
31. Hardy B., Douglas N., Helma C., Rautenberg M., Jeliazkova N., Jeliazkov V., Nikolova I., Benigni R., Tcheremenskaia O., Kramer S., Girschick T., Buchwald F., Wicker J., Karwath A., Gütlein M., Maunz A., Sarimveis H., Melagraki G., Afantitis A., Sopasakis P., Gallagher D., Poroikov V., Filimonov D., Zakharov A., Lagunin A., Gloriozova T., Novikov S., Skvortsova N., Druzhilovsky D., Chawla S., Ghosh I., Ray S., Patel H., Escher S. Collaborative development of predictive toxicology applications. J. Cheminfo. 2010, 31:7.
32. Ellison C.M., Sherhod R., Cronin M.T., Enoch S.J., Madden J.C., Judson P.N. Assessment of methods to define the applicability domain of structural alert models. J. Chem. Inf. Model. 2011, 23:975-985.
33. Carrió P., Pinto M., Ecker G., Sanz F., Pastor M. Applicability Domain Analysis (ADAN): a robust method for assessing the reliability of drug property predictions. J. Chem. Inf. Model. 2014, 54:1500-1511.