On estimating model complexity and prediction errors in multivariate calibration: Generalized resampling by random sample weighting (RSW)

Journal of Chemometrics

Volumn 25, Issue 2, 2011, Pages 51-58

  Xu, L ^a   Xu, Q S ^b,c   Yang, M ^a   Zhang, H Z ^a   Cai, C B ^d   Jiang, J H ^c   Wu, H L ^c   Yu, R Q ^c  

^a DALI UNIVERSITY   (China)

^b CENTRAL SOUTH UNIVERSITY   (China)

^c HUNAN UNIVERSITY   (China)

^d CHUXIONG NORMAL UNIVERSITY   (China)

Author keywords

Bootstrapping; Cross validation; PLS model complexity; Random sample weighting; Randomization test

Indexed keywords

MEAN SQUARE ERROR; MONTE CARLO METHODS; RANDOM ERRORS; RANDOM PROCESSES; SAMPLING;

BOOTSTRAPPING; CROSS VALIDATION; MODELING COMPLEXITY; PLS MODEL COMPLEXITY; PLS MODELLING; PREDICTION ERRORS; RANDOM SAMPLE; RANDOM SAMPLE WEIGHTING; RANDOMIZATION TESTS; SAMPLE'S WEIGHTING;

FORECASTING;

EID: 79951861339     PISSN: 08869383     EISSN: 1099128X     Source Type: Journal    
DOI: 10.1002/cem.1323     Document Type: Article

References (39)

1. Wold H. Research Papers in Statistics, David F (ed.). Wiley: New York, USA, 1966; 411-444.
2. Denham MC. Choosing the number of factors in partial least squares regression: estimating and minimizing the mean squared error of prediction. J. Chemom. 2000; 14: 351-361.
3. Stone M. Cross-validatory choice and assessment of statistical predictions. J. Roy. Stat. Soc. B 1974; 36: 111-133.
4. Wold S. Cross-validatory estimation of the number of components in factor and principal components models. Technometrics 1978; 20: 397-405.
5. Osten DW. Selection of optimal regression models via cross-validation. J. Chemom. 1988; 2: 39-48.
6. Lorber A, Kowalski BR. Alternatives to cross-validatory estimation of the number of factors in multivariate calibration. Appl. Spectrosc. 1990; 44: 1464-1470.
7. Wakeling IN, Morris JJ. A test of significance for partial least squares regression. J. Chemom. 1993; 7: 291-304.
8. van der Voet H. Comparing the predictive accuracy of models using a simple randomization test. Chemom. Intell. Lab. Syst. 1994; 25: 313-323.
9. Höskuldsson A. Dimension of linear models. Chemom. Intell. Lab. Syst. 1996; 32: 37-55.
10. Messick NJ, Kalivas JH, Lang PM. Selecting factors for partial least squares. Microchem. J. 1997; 55: 200-207.
11. Martens HA, Dardenne P. Validation and verification of regression in small data sets. Chemom. Intell. Lab. Syst. 1998; 44: 99-121.
12. Liu D, Shah SL, Grant Fisher D. Choice of latent explanatory variables: a multiobjective optimization approach. J. Chemom. 2000; 14: 79-92.
13. Faber NM. Critical evaluation of a significance test for partial least squares regression. Anal. Chim. Acta 2001; 432: 235-240.
14. Lazraq A, Cléroux R. The PLS multivariate regression model: testing the significance of successive PLS components. J.Chemom. 2001; 15: 523-536.
15. Rutledge DN, Barros A, Delgadillo I. PoLiSh-smoothed partial least-squares regression. Anal. Chim. Acta 2001; 446: 281-296.
16. Xu QS, Liang YZ. Monte Carlo cross validation. Chemom. Intell. Lab. Syst. 2001; 56: 1-11.
17. Green RL, Kalivas JH. Graphical diagnostics for regression model determinations with consideration of the bias/variance trade-off. Chemom. Intell. Lab. Syst. 2002; 60: 173-188.
18. Li B, Morris J, Martin EB. Model selection for partial least squares regression. Chemom. Intell. Lab. Syst. 2002; 64: 79-89.
19. Thomas EV. Non-parametric statistical methods for multivariate calibration model selection and comparison. J. Chemom. 2003; 17: 653-659.
20. Gourvénec S, Fernández Pierna JA, Massart DL, Rutledge DN. An evaluation of the PoLiSh smoothed regression and the Monte Carlo cross-validation for the determination of the complexity of a PLS model. Chemom. Intell. Lab. Syst. 2003; 68: 41-51.
21. Seipel H, Kalivas JH. Effective rank for multivariate calibration methods. J. Chemom. 2004; 18: 306-311.
22. Xu QS, Liang YZ, Du YP. Monte Carlo cross-validation for selecting a model and estimating the prediction error in multivariate calibration. J. Chemom. 2004; 18: 112-120.
23. Wiklund S, Nilsson D, Eriksson L, Sjöström M, Wold S, Faber K. A randomization test for PLS component selection. J. Chemom. 2007; 21: 427-439.
24. Faber NM, Rajkó R. How to avoid over-fitting in multivariate calibration-the conventional validation approach and an alternative. Anal. Chim. Acta 2007; 595: 98-106.
25. Filzmoser P, Liebmann B, Varmuza K. Repeated double cross validation. J. Chemom. 2009; 23: 160-171.
26. Efron B. The Jackknife, the Bootstrap, and Other Resampling Plans. SIAM: Philadelphia, USA, 1982.
27. Wehrens R, van der Linden WE. Bootstrapping principal component regression models. J. Chemom. 1997; 11: 157-171.
28. Wehrens R, Putter H, Buydens LMC. The Bootstrap: A Tutorial. Chemom. Intell. Lab. Syst. 2000; 54: 35-52.
29. Amato S, Vinzi VE. Bootstrap-based $\hat {Q}-{kh}^{2} $ for the selection of components and variables in PLS regression. Chemom. Intell. Lab. Syst. 2003; 68: 5-16.
30. Rebafka T, Clémençon S, Feinberg M. Bootstrap-based tolerance intervals for application to method validation. Chemom. Intell. Lab. Syst. 2007; 89: 69-81.
31. Næs T. Leverage and influence measures related to principal component regression. Chemom. Intell. Lab. Syst. 1989; 5: 155-168.
32. Indahl UG, Næs T. Evaluation of alternative spectral feature extraction methods of textural images for multivariate modeling. J. Chemom. 1998; 12: 261-278.
33. Du YP, Kasemsumran S, Maruo K, Nakagawa T, Ozaki Y. Ascertainment of the number of samples in the validation set in Monte Carlo cross validation and the selection of model dimension with Monte Carlo cross validation. Chemom. Intell. Lab. Syst. 2006; 82: 83-89.
34. Xu L, Jiang JH, Lin WQ, Zhou YP, Wu HL, Shen GL, Yu RQ. Optimized sample-weighted partial least squares. Talanta 2007; 71: 561-566.
35. Borggaard C, Thodberg HH. Optimal minimal neural interpretation of spectra. Anal. Chem. 1992; 64: 545-551.
36. Eigenvector Research, Inc. [1 June 2009].
37. Wiklund S, Nilsson D, Eriksson L, Sjöström M, Wold S, Faber K. A randomization test for PLS component selection. J. Chemom. 2007; 21: 427-439.
38. Haaland DM, Thomas EV. Partial least-squares methods for spectral analyses. 1. Relation to other quantitative calibration methods and the extraction of qualitative information. Anal. Chem. 1988; 60: 1193-1202.
39. McGill R, Tukey JW, Larsen WA. Variations of box plots. Am. Stat. 1978; 32: 12-16.