Real external predictivity of QSAR models. Part 2. New intercomparable thresholds for different validation criteria and the need for scatter plot inspection

Journal of Chemical Information and Modeling

Volumn 52, Issue 8, 2012, Pages 2044-2058

  Chirico, Nicola ^a   Gramatica, Paola ^a  

^a UNIVERSITY OF INSUBRIA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL CHEMISTRY; FORECASTING; LOCATION; MOLECULAR GRAPHICS;

CORRELATION COEFFICIENT; DATA DISTRIBUTION; PRECAUTIONARY APPROACH; PREDICTIVE MODELS; STATISTICAL CRITERION; STATISTICAL PARAMETERS; VALIDATION CRITERIA; VALIDATION PARAMETERS;

PREDICTIVE ANALYTICS;

EID: 84865466657     PISSN: 15499596     EISSN: 1549960X     Source Type: Journal    
DOI: 10.1021/ci300084j     Document Type: Article

References (24)

1. 2 J. Mol. Graphics Modell. 2002, 20, 269-276
2. Tropsha, A.; Gramatica, P.; Gombar, V. K. The importance of being earnest: Validation in the absolute essential for successful application and interpretation of QSPR models QSAR Comb. Sci. 2003, 22, 69-76
3. Gramatica, P. Principles of QSAR models validation: Internal and external QSAR Comb. Sci. 2007, 5, 694-701 (Pubitemid 46932857)
4. Tropsha, A. Best practices for QSAR model development, validation, and exploitation Mol. Inf. 2010, 29, 476-488
5. 2 for the training set or low root mean square error of prediction for the test set? QSAR Comb. Sci. 2005, 24, 385-396 (Pubitemid 40637940)
6. Puzyn, T.; Gajewicz, A.; Rybacka, A.; Haranczyk, M. Global versus local QSPR models for persistent organic pollutants: Balancing between predictivity and economy Struct. Chem. 2011, 22, 873-884
7. Puzyn, T.; Mostrag-Szlichtyng, A.; Gajewicz, A.; Skrzyński, M.; Worth, A. P. Investigating the influence of data splitting on the predictive ability of QSAR/QSPR models Struct. Chem. 2011, 22, 795-804
8. Oberg, T. A QSAR for the hydroxyl radical reaction rate constant: Validation, domain of application, and prediction Atmos. Environ. 2005, 39, 2189-2200 (Pubitemid 40544370)
9. Shi, L. M.; Fang, H.; Tong, W.; Wu, J.; Perkins, R.; Blair, R. M.; Branham, W. S.; Dial, S. L.; Moland, C. L.; Sheehan, D. M. QSAR models using a large diverse set of estrogens J. Chem. Inf. Comput. Sci. 2001, 41, 186-195 (Pubitemid 33645689)
10. Schüürmann, G.; Ebert, R.; Chen, J.; Wang, B.; Kühne, R. External validation and prediction employing the predictive squared correlation coefficients test set activity mean vs training set activity mean J. Chem. Inf. Model. 2008, 48, 2140-2145
11. 2 parameter for QSAR validation J. Chem. Inf. Model. 2009, 49, 1669-1678
12. Consonni, V.; Ballabio, D.; Todeschini, R. Evaluation of model predictive ability by external validation techniques J. Chemom. 2010, 24, 194-201
13. Roy, K. On some aspects of validation of predictive quantitative structure-activity relationship models. Expert Opin Drug Discovery 2007, 2, 1567-1577 (Pubitemid 350285346)
14. m metrics for validation of QSPR models Chemom. Intell. Lab. Syst. 2011, 107, 194-205
15. Ojia, P. K.; Roy, K. Comparative QSARs for antimalarial endochins: Importance of descriptor-thinning and noise reduction prior to feature selection Chemom. Intell. Lab. Syst 2011, 109, 146-161
16. Chirico, N.; Gramatica, P. Real external predictivity of QSAR models: How to evaluate it? Comparison of different validation criteria and proposal of using the concordance correlation coefficient J. Chem. Inf. Model. 2011, 51, 2320-2335
17. Lin, L. I. A concordance correlation coefficient to evaluate reproducibility Biometrics 1989, 45, 255-268
18. Roy, K.; Mitra, I.; Kar, S.; Ojha, P.; Das, R. N.; Kabir, H. Comparative studies on some metrics for external validation of QSPR models J. Chem. Inf. Model. 2012, 52, 396-408
19. Pogliani, L.; de Julián-Ortiz, J. V. Plot methods in quantitative structure-property studies Chem. Phys. Lett. 2004, 393, 327-330
20. Emili Besalú, E.; de Julián-Ortiz, J. V.; Pogliani, L. Trends and plot methods in MLR studies J. Chem. Inf. Model. 2007, 47, 751-760 (Pubitemid 46973688)
21. Atkinson, G.; Nevill, A. Comments on the use of concordance correlation to assess the agreement between two variables Biometrics 1997, 53, 775-777
22. Lin, L. I.; Chinchilli, V. Rejoinder to the letter to the editor from Atkinson and Nevill Biometrics 1997, 53, 777-778
23. Lei, B.; Yimeng, Ma, Y.; Li, Y.; Liu, H. X.; Yao, X.; Gramatica, P. Prediction of the adsorption capability onto activated carbon of a large data set of chemicals by local lazy regression method Atmos. Environ. 2010, 44, 2954-2960
24. Chirico, N.; Papa, E.; Kovarich, S.; Cassani, S.; Gramatica, P. QSARINS, Software for QSAR MLR Model Development and Validation; University of Insubria: Varese, Italy, 2012. http://www.qsar.it (accessed May 12, 2012).