The costs of complex model optimization

Chemometrics and Intelligent Laboratory Systems

Volumn 125, Issue , 2013, Pages 139-146

  Rubingh, C M ^a   Martens, H ^b   Van der Voet, H ^c   Smilde, A K ^d  

^a TNO   (Netherlands)

^b NOFIMA   (Norway)

^c WAGENINGEN UNIVERSITY   (Netherlands)

^d UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Degrees of freedom; Meta parameter estimation; Model optimization; Variable selection

Indexed keywords

ANALYTICAL ERROR; ARTICLE; CALCULATION; COMPLEX MODEL OPTIMIZATION; COMPUTER PROGRAM; CONTROLLED STUDY; DATA ANALYSIS; MATHEMATICAL VARIABLE; METABOLOMICS; PREDICTION; PRIORITY JOURNAL; STATISTICAL MODEL; STATISTICAL PARAMETERS; VALIDATION STUDY;

EID: 84877314007     PISSN: 01697439     EISSN: 18733239     Source Type: Journal    
DOI: 10.1016/j.chemolab.2013.04.004     Document Type: Article

References (20)

1. Akaike H. Information theory and an extension of the maximum likelihood principle. Second International Symposium on Information Theory 1973, 267-281. Akademiai Kiado, Budapest. B.N. Petrov, F. Csaki (Eds.).
2. Ambroise C., McLachlan G.J. Selection bias in gene extraction on the basis of microarray gene-expression data. PNAS 2002, 99:6562-6566.
3. Anderssen E., Dyrstad K., Westad F., Martens H. Reducing over-optimism in variable selection by cross-model validation. Chemometrics and Intelligent Laboratory 2006, 84:69-74.
4. Filzmoser P., Liebmann B., Varmuza K. Repeated double cross-validation. Journal of Chemometrics 2009, 23:160-171.
5. Gavai A.K., Tikunov Y., Ursem R., Bovy A., van Eeuwijk F., Nijveen H., Lucas P.J.F., Leunissen J.A.M. Constraint-based probabilistic learning of metabolic pathways from tomato volatiles. Metabolomics 2009, 5:419-428.
6. Geladi P., Kowalski B.R. Partial least squares regression: a tutorial. Analytica Chimica Acta 1986, 185:1-17.
7. Good I.J. What are degrees of freedom?. The American Statistician 1973, 27:227-228.
8. Hastie T., Tibshirani B., Friedman J.H. The Elements of Statistical Learning: Data Mining, Inference and Prediction 2001, 214-215. Springer Series in Statistics.
9. Mallows C.L. Some comments on Cp. Technometrics 1973, 15:661-675.
10. Martens H., Naes T. Multivariate Calibration 1989, John Wiley & Sons, Chichester, UK.
11. Rubingh C.M., Bijlsma S., Derks E.P.P.A., Bobeldijk I., Verheij E.R., Kochhar S., Smilde A.K. Assessing the performance of statistical validation tools for megavariate metabolomics data. Metabolomics 2006, 2:53-61.
12. Rubingh C.M., Bijlsma S., Jellema R.H., Overkamp K.M., van der Werf M.J., Smilde A.K. Analyzing Longitudinal Microbial Metabolomics Data, 2013. Journal of Proteome Research 2009, 8(9):4319-4327.
13. Smit S., Breemen M.J., Hoefsloot H.C.J., Smilde A.K., Aerts J.M.F.G., de Koster C.G. Assessing the statistical validity of proteomics based biomarkers. Analytica Chimica Acta 2007, 592:210-217.
14. Stone M. Cross validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society: Series B Methodological 1974, 36:111-147.
15. Ursem R., Tikunov Y., Bovy A., van Berloo R., van Eeuwijk F. A correlation network approach to metabolic data analysis for tomato fruits. Euphytica 2008, 161:181-193.
16. van Berloo R., Zhu A.G., Ursem R., Verbakel H., Gort G., van Eeuwijk F.A. Diversity and linkage disequilibrium analysis within a selected set of cultivated tomatoes. Theoretical and Applied Genetics 2008, 117:89-101.
17. van der Voet H. Comparing the predictive accuracy of models using a simple randomization test. Chemometrics and Intelligent Laboratory Systems 1994, 25:313-323.
18. Van der Voet H. Pseudo-degrees of freedom for complex predictive models: the example of partial least squares. Journal of Chemometrics 1999, 13:195-208.
19. Wold S., Martens H., Wold H. The multivariate calibration problem in chemistry solved by the PLS method. Proc. Conf. Matrix Pencils 1983, 286-293. Springer Verlag, Heidelberg. A. Ruhe, B. Kågström (Eds.).
20. Ye J. On measuring and correcting the effects of data mining and model selection. Journal of the American Statistical Association 1998, 93:120-131.