Reshaped sequential replacement for variable selection in QSPR: Comparison with other reference methods

Journal of Chemometrics

Volumn 28, Issue 4, 2014, Pages 249-259

  Grisoni, F ^a   Cassotti, M ^a   Todeschini, R ^a  

^a UNIVERSITY OF MILANO BICOCCA   (Italy)

Author keywords

QSAR; QSPR; Reshaped Sequential Replacement; Variable selection

Indexed keywords

COMPUTATIONAL CHEMISTRY; PARTICLE SWARM OPTIMIZATION (PSO); STATISTICAL MECHANICS;

OPTIMAL SUBSETS; QSAR; QUANTITATIVE STRUCTURE PROPERTY RELATIONSHIPS; QUANTITATIVE STRUCTURE-PROPERTY RELATIONSHIP MODELS; REFERENCE METHOD; REPLACEMENT ALGORITHM; RESHAPED SEQUENTIAL REPLACEMENT; SELECTION TECHNIQUES; VARIABLE SELECTION METHODS; VARIABLES SELECTIONS;

GENETIC ALGORITHMS;

EID: 84897543946     PISSN: 08869383     EISSN: 1099128X     Source Type: Journal    
DOI: 10.1002/cem.2603     Document Type: Article

References (41)

1. Todeschini R, Consonni V. Molecular Descriptors for Chemoinformatics (2nd Revised and Enlarged Edition). Wiley-VCH: Weinheim, Germany; 2009.
2. Myung IJ, Pitt MA. Applying Occam's razor in modeling cognition: a Bayesian approach. Psychon. B. Rev. 1997; 4:79-95.
3. Yu L, Lai KK, Wang S, Huang W. A bias-variance-complexity trade-off framework for complex system modeling. In Computational Science and Its Applications-ICCSA 2006, Gavrilova M, Gervasi O, Kumar V, Tan CJK, Taniar D, Laganá A, et al. (eds.). Springer: Berlin Heidelberg, 2006; 518-27.
4. Gonzalez MP, Teran C, Saiz-Urra L, Teijeira M. Variable selection methods in QSAR: an overview. Curr. Top. Med. Chem. 2008; 8: 1606-27.
5. Guyon I, Elisseeff A. An introduction to variable and feature selection. J. Mach. Learn. Res. 2003; 3: 1157-82.
6. Efroymson M. Multiple regression analysis. Math. Methods Digital Comput. 1960; 1: 191-203.
7. Kim K-J, Cho S-B. A comprehensive overview of the applications of artificial life. Artif. Life 2006; 12(1): 153-82.
8. Leardi R Nature-inspired Methods in Chemometrics: Genetic Algorithms and Artificial Neural Networks. Elsevier: Amsterdam, The Netherlands; 2003.
9. Yang X-S. Nature-Inspired Metaheuristic Algorithms: Second Edition. Luniver Press: Frome, United Kingdom; 2010.
10. Goldberg DE, Holland JH. Genetic algorithms and machine learning. Mach. Learn. 1988; 3(2-3): 95-9.
11. Shen Q, Jiang J-H, Jiao C-X, Shen G, Yu R-Q. Modified particle swarm optimization algorithm for variable selection in MLR and PLS modelling: QSAR studies of antagonism of angiotensin II antagonists. Eur. J. Pharm. Sci. 2004; 22(2-3): 145-52.
12. Dorigo M, Di Caro G. Ant colony optimization: a new meta-heuristic. Proceedings of the 1999 Congress on Evolutionary Computation 1999. p. -1477 Vol. 2.
13. Fogel DB. Evolutionary Computation: Toward a New Philosophy of Machine Intelligence. John Wiley & Sons: New Jersey, USA; 2006.
14. Tibshirani R Regression shrinkage and selection via the LASSO. J. R. Stat. Soc. Ser. B (Methodological) 1996; 58(1): 267-88.
15. Zou H, Hastie T. Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B (Statistical Methodology) 2005; 67(2): 301-20.
16. Miller AJ. Selection of subsets of regression variables. J. R. Stat. Soc. Ser. A (General). 1984; 147(3): 89-425.
17. Cassotti M, Grisoni F, Todeschini R. Reshaped Sequential Replacement algorithm: an efficient approach to variable selection. Chemom. Intell. Lab. (in press). 2014. DOI: 10.1016/j.chemolab.2014.01.011
18. Bledsoe W. The use of biological concepts in the analytical study of systems. Proceedings of the ORSA-TIMS National Meeting 1961.
19. Holland JH. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. University of Michigan: USA, 1975. Oxford, England: U Michigan Press.
20. Eberhart R, Kennedy J. A new optimizer using particle swarm theory. Proceedings of the Sixth International Symposium on Micro Machine and Human Science 1995; p. 39-43.
21. Kennedy J, Eberhart RC. A discrete binary version of the particle swarm algorithm. IEEE International Conference on Systems, Man, and Cybernetics, 1997; p. 4104-4108 vol.5.
22. Todeschini R, Consonni V, Mauri A, Pavan, M. Detecting 'bad' regression models: multicriteria fitness functions in regression analysis. Anal. Chim. Acta 2004; 515(1): 199-208.
23. Mason CH, Perreault WD. Collinearity, power, and interpretation of multiple regression analysis. J. Marketing Res. 1991; 28(3): 268-80.
24. Stewart GW. Collinearity and least squares regression. Stat. Sci. 1987; 2(1): 68-84.
25. Todeschini R, Consonni V, Maiocchi A. The K correlation index: theory development and its application in chemometrics. Chemom. Intell. Lab. Syst. 1999; 46(1): 13-29.
26. Lindgren F, Hansen B, Karcher W, Sjöström M, Eriksson L. Model validation by permutation tests: applications to variable selection. J. Chemom. 1996; 10(5-6): 521-32.
27. Todeschini R, Ballabio D, Consonni V, Manganaro A, Mauri A. Canonical measure of correlation (CMC) and canonical measure of distance (CMD) between sets of data. Part 1. Theory and simple chemometric applications. Anal. Chim. Acta 2009; 648(1): 45-51.
28. Consonni V, Ballabio D, Todeschini R. Evaluation of model predictive ability by external validation techniques. J. Chemom. 2010; 24(3-4): 194-201.
29. US EPA 2013. Toxicity Estimation Software Tool (T.E.S.T.)-http://www.epa.gov/nrmrl/std/qsar/qsar.html [9 September 2013]
30. Talete srl. Dragon (Software for Molecular Descriptor Calculation) Version 6.0-2012-http://www.talete.mi.it/. 2012.
31. MATLAB. R2012b. Natick. The MathWorks Inc.: Massachusetts, 2012.
32. MICHEM website. http://michem.disat.unimib.it/chm/.
33. Ertl P, Rohde B, Selzer P. Fast calculation of molecular polar surface area as a sum of fragment-based contributions and its application to the prediction of drug transport properties. J. Med. Chem. 2000; 43(20): 3714-7.
34. Randić M, Jurs PC. On a fragment approach to structure-activity correlations. Quant. Struct.-Act. Relat. 1989; 8(1): 39-48.
35. Galvez J, Garcia R, Salabert MT, Soler R. Charge indexes. New topological descriptors. J. Chem. Inf. Comput. Sci. 1994; 34(3): 520-5.
36. Ghose AK, Viswanadhan VN, Wendoloski JJ. Prediction of hydrophobic (lipophilic) properties of small organic molecules using fragmental methods: an analysis of ALOGP and CLOGP methods. J. Phys. Chem. A 1998; 102(21): 3762-72.
37. Viswanadhan VN, Ghose AK, Revankar GR, Robins RK. Atomic physicochemical parameters for three dimensional structure directed quantitative structure-activity relationships. 4. Additional parameters for hydrophobic and dispersive interactions and their application for an automated superposition of certain naturally occurring nucleoside antibiotics. J. Chem. Inf. Comput. Sci. 1989; 29(3): 163-72.
38. Héberger K, Kollár-Hunek K. Sum of ranking differences for method discrimination and its validation: comparison of ranks with random numbers. J. Chemom. 2011; 25(4): 151-8.
39. Derksen S, Keselman HJ. Backward, forward and stepwise automated subset selection algorithms: frequency of obtaining authentic and noise variables. Br. J. Math. Stat. Psychol. 1992; 45(2): 265-82.
40. Steyerberg EW, Eijkemans MJC, Habbema JDF. Stepwise selection in small data sets: a simulation study of bias in logistic regression analysis. J. Clin. Epidemiol. 1999; 52(10): 935-42.
41. Burnham KP, Anderson DR. Model Selection and Multi-model Inference: A Practical Information-theoretic Approach. Springer: New York, USA; 2002.