A Historical Excursus on the Statistical Validation Parameters for QSAR Models: A Clarification Concerning Metrics and Terminology

Journal of Chemical Information and Modeling

Volumn 56, Issue 6, 2016, Pages 1127-1131

  Gramatica, Paola ^a   Sangion, Alessandro ^a  

^a UNIVERSITY OF INSUBRIA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

MOLECULAR GRAPHICS;

PREDICTIVE CAPABILITIES; PREDICTIVITY; QSAR MODEL; SCIENTIFIC LITERATURE; STATISTICAL VALIDATION;

COMPUTATIONAL CHEMISTRY;

HISTORY; QUANTITATIVE STRUCTURE ACTIVITY RELATION; STATISTICS; THEORETICAL MODEL;

HISTORY, 21ST CENTURY; MODELS, THEORETICAL; QUANTITATIVE STRUCTURE-ACTIVITY RELATIONSHIP; STATISTICS AS TOPIC;

EID: 84976408037     PISSN: 15499596     EISSN: 1549960X     Source Type: Journal    
DOI: 10.1021/acs.jcim.6b00088     Document Type: Review

References (29)

1. 2: Simple, Unambiguous Assessment of the Prediction Accuracy of QSAR and QSPR Models J. Chem. Inf. Model. 2015, 55, 1316-1322 10.1021/acs.jcim.5b00206
2. Oprea, T. I.; García, A. E. Three-Dimensional Quantitative Structure-Activity Relationships of Steroid Aromatase Inhibitors J. Comput.-Aided Mol. Des. 1996, 10, 186-200 10.1007/BF00355042
3. Golbraikh, A.; Tropsha, A. Beware of q2! J. Mol. Graphics Modell. 2002, 20, 269-276 10.1016/S1093-3263(01)00123-1
4. Tropsha, A.; Gramatica, P.; Gombar, V. K. The Importance of Being Earnest: Validation Is the Absolute Essential for Successful Application and Interpretation of QSPR Models QSAR Comb. Sci. 2003, 22, 69-77 10.1002/qsar.200390007
5. Gramatica, P. Principles of QSAR Models Validation: Internal and External QSAR Comb. Sci. 2007, 26, 694-701 10.1002/qsar.200610151
6. Roy, K. On Some Aspects of Validation of Predictive Quantitative Structure-Activity Relationship Models Expert Opin. Drug Discovery 2007, 2, 1567-1577 10.1517/17460441.2.12.1567
7. Schüurmann, G.; Ebert, R.-U.; Chen, J.; Wang, B.; Kuehne, R. External Validation and Prediction Employing the Predictive Squared Correlation Coefficient-Test Set Activity Mean vs Training Set Activity Mean J. Chem. Inf. Model. 2008, 48, 2140-2145 10.1021/ci800253u
8. Roy, P. P.; Paul, S.; Mitra, I.; Roy, K. On Two Novel Parameters for Validation of Predictive QSAR Models Molecules 2009, 14, 1660-1701 10.3390/molecules14051660
9. Consonni, V.; Ballabio, D.; Todeschini, R. Comments on the Definition of the Q(2) Parameter for QSAR Validation J. Chem. Inf. Model. 2009, 49, 1669-1678 10.1021/ci900115y
10. Consonni, V.; Ballabio, D.; Todeschini, R. Evaluation of Model Predictive Ability by External Validation Techniques J. Chemom. 2010, 24, 194-201 10.1002/cem.1290
11. Tropsha, A. Best Practices for QSAR Model Development, Validation, and Exploitation Mol. Inf. 2010, 29, 476-488 10.1002/minf.201000061
12. Chirico, N.; Gramatica, P. Real External Predictivity of QSAR Models: How To Evaluate It? Comparison of Different Validation Criteria and Proposal of Using the Concordance Correlation Coefficient J. Chem. Inf. Model. 2011, 51, 2320-2335 10.1021/ci200211n
13. Chirico, N.; Gramatica, P. Real External Predictivity of QSAR Models. Part 2. New Intercomparable Thresholds for Different Validation Criteria and the Need for Scatter Plot Inspection J. Chem. Inf. Model. 2012, 52, 2044-2058 10.1021/ci300084j
14. Roy, K.; Mitra, I.; Kar, S.; Ojha, P. K.; Das, R. N.; Kabir, H. Comparative Studies on Some Metrics for External Validation of QSPR Models J. Chem. Inf. Model. 2012, 52, 396-408 10.1021/ci200520g
15. Gramatica, P. On the Development and Validation of QSAR Models. In Computational Toxicology; Reisfeld, B.; Mayeno, A. N., Eds.; Methods in Molecular Biology; Humana Press, 2013; pp 499-526.
16. Roy, K.; Kar, S.; Das, R. N. A Primer on QSAR/QSPR Modeling: Fundamental Concepts; Springer, 2015.
17. Gramatica, P.; Cassani, S.; Roy, P. P.; Kovarich, S.; Yap, C. W.; Papa, E. QSAR Modeling Is Not "push a Button and Find a Correlation": A Case Study of Toxicity of (benzo-)triazoles on Algae Mol. Inf. 2012, 31, 817-835 10.1002/minf.201200075
18. Gramatica, P. External Evaluation of QSAR Models, in Addition to CrossValidation: Verification of Predictive Capability on Totally New Chemicals Mol. Inf. 2014, 33, 311-314 10.1002/minf.201400030
19. Shi, L. M.; Fang, H.; Tong, W. D.; Wu, J.; Perkins, R.; Blair, R. M.; Branham, W. S.; Dial, S. L.; Moland, C. I.; Sheehan, D. M. QSAR Models Using a Large Diverse Set of Estrogens J. Chem. Inf. Comput. Sci. 2001, 41, 186-195 10.1021/ci000066d
20. Todeschini, R.; Consonni, V.; Pavan, M. MobyDigs: Models by Descriptors in Genetic Selection; Talete srl: Milan, Italy, 2002.
21. Principles for the Validation, for Regulatory Purposes, of (Quantitative) Structure-Activity Relationship Models; OECD Publishing: Paris, 2004.
22. Guidance Document on the Validation of (Quantitative) Structure-Activity Relationships [(Q)SAR] Models. OECD Series on Testing and Assessment, No. 69, OECD Publishing: Paris, 2007.
23. Roy, K.; Das, R. N.; Ambure, P.; Aher, R. B. Be Aware of Error Measures. Further Studies on Validation of Predictive QSAR Models Chemom. Intell. Lab. Syst. 2016, 152, 18-33 10.1016/j.chemolab.2016.01.008
24. Lin, L. I.-K. A Concordance Correlation Coefficient to Evaluate Reproducibility Biometrics 1989, 45, 255-268 10.2307/2532051
25. Lin, L. I.-K. Assay Validation Using the Concordance Correlation Coefficient Biometrics 1992, 48, 599-604 10.2307/2532314
26. Chai, T.; Draxler, R. R. Root Mean Square Error (RMSE) or Mean Absolute Error (MAE)?-Arguments against Avoiding RMSE in the Literature Geosci. Model Dev. 2014, 7, 1247-1250 10.5194/gmd-7-1247-2014
27. Gramatica, P.; Chirico, N.; Papa, E.; Cassani, S.; Kovarich, S. QSARINS: A New Software for the Development, Analysis, and Validation of QSAR MLR Models J. Comput. Chem. 2013, 34, 2121-2132 10.1002/jcc.23361
28. Gramatica, P.; Cassani, S.; Chirico, N. QSARINS-Chem: Insubria Datasets and New QSAR/QSPR Models for Environmental Pollutants in QSARINS J. Comput. Chem. 2014, 35, 1036-1044 10.1002/jcc.23576
29. Netzeva, T. I.; Worth, A.; Aldenberg, T.; Benigni, R.; Cronin, M. T. D.; Gramatica, P.; Jaworska, J. S.; Kahn, S.; Klopman, G.; Marchant, C. A.; Myatt, G.; Nikolova-Jeliazkova, N.; Patlewicz, G. Y.; Perkins, R.; Roberts, D.; Schultz, T.; Stanton, D. W.; van de Sandt, J. J. M.; Tong, W.; Veith, G.; Yang, C. Current Status of Methods for Defining the Applicability Domain of (quantitative) Structure-Activity Relationships. Report and Recommendations of ECVAM Workshop 52 Altern. Lab. Anim. 2005, 33, 155-173