A randomization test for PLS component selection

Journal of Chemometrics

Volumn 21, Issue 10-11, 2007, Pages 427-439

  Wiklund, Susanne ^a   Nilsson, David ^a   Eriksson, Lennart ^b   Sjöström, Michael ^a   Wold, Svante ^a   Faber, Klaas ^c  

^a UMEÅ UNIVERSITY   (Sweden)

^b Umetrics AB   (Sweden)

^c Chemometry Consultancy   (Netherlands)

Author keywords

Component selection; Factor selection; Latent variable selection; Partial least squares; Permutation test; Randomization test

Indexed keywords

RANDOM PROCESSES;

COMPONENT SELECTION; FACTOR SELECTION; LATENT VARIABLE; LATENT VARIABLE SELECTION; NUMBER OF METHODS; OPTIMAL NUMBER; PARTIAL LEAST-SQUARES; PERMUTATION TESTS; RANDOMIZATION TESTS; VARIABLES SELECTIONS;

LEAST SQUARES APPROXIMATIONS;

EID: 36148979710     PISSN: 08869383     EISSN: 1099128X     Source Type: Journal    
DOI: 10.1002/cem.1086     Document Type: Article

References (65)

1. Wold S, Eriksson L, Sjöström M. PLS in chemistry. In The Encyclopedia of Computational Chemistry, Schleyer PVR, Allinger NL, Clark T, Gasteiger J, Kollman PA, Schaefer HF, III, Schreiner PR (eds). Wiley: Chichester, UK, 1999; 2006-2020.
2. Denham MC. Choosing the number of factors in partial least squares regression: estimating and minimizing the mean squared error of prediction. J. Chemometr. 2000; 14: 351-361.
3. Haaland DM, Thomas EV. Partial least-squares methods for spectral analyses. 1. Relation to other quantitative calibration methods and the extraction of qualitative information. Anal. Chem. 1988; 60: 1193-1202.
4. Osten DW. Selection of optimal regression models via cross-validation. J. Chemometr. 1988; 2: 39-48.
5. Wakeling IN, Morris JJ. A test of significance for partial least squares regression. J. Chemometr. 1993; 7: 291-304.
6. Höskuldsson A. Dimension of linear models. Chemometr. Intell. Lab. Syst. 1996; 32: 37-55.
7. Messick NJ, Kalivas JH, Lang PM. Selecting factors for partial least squares. Microchem. J. 1997; 55: 200-207.
8. Faber NM, Kowalski BR. Propagation of measurement errors for the validation of predictions obtained by principal component regression and partial least squares. J. Chemometr. 1997; 11: 181-238.
9. Holcomb TR, Hjalmarsson H, Morari M, Tyler ML. Significance regression: a statistical approach to partial least squares. J. Chemometr. 1997; 11: 283-309.
10. Liu D, Shah SL, Grant Fisher D. Choice of latent explanatory variables: a multiobjective optimization approach. J. Chemometr. 2000; 14: 79-92.
11. Lazraq A, Cléroux R. The PLS multivariate regression model: testing the significance of successive PLS components. J. Chemometr. 2001; 15: 523-536.
12. Green RL, Kalivas JH. Graphical diagnostics for regression model determinations with consideration of the bias/variance trade-off. Chemometr. Intell. Lab. Syst. 2002; 60: 173-188.
13. Li B, Morris J, Martin EB. Model selection for partial least squares regression. Chemometr. Intell. Lab. Syst. 2002; 64: 79-89.
14. Forina M, Lanteri S, Cerrato Oliveros MC, Pizarro Millan C. Selection of useful predictors in multivariate calibration. Anal. Bioanal. Chem. 2004; 380: 397-418.
15. Fisher RA. The Design of Experiments. Oliver and Boyd: Edinburgh, 1935.
16. Klopman G, Kalos AN. Causality in structure-activity studies. J. Comput. Chem. 1985; 6: 492-506.
17. Thioulouse J, Lobry JR. Co-inertia analysis of amino-acid physico-chemical properties and protein composition with the ADE package. Comput. Appl. Biosci. 1995; 11: 321-329.
18. Lindgren F, Hansen B, Karcher W, Sjöström M, Eriksson L. Model validation by permutation tests: applications to variable selection. J. Chemometr. 1996; 10: 521-532.
19. Baumann K, Stiefl N. Validation tools for variable subset regression. J. Comput.-Aided Mol. Des. 2004; 18: 549-562.
20. van der Voet H. Comparing the predictive accuracy of models using a simple randomization test. Chemometr. Intell. Lab. Syst. 1994; 25: 313-323.
21. van der Voet H. Corrigendum to 'comparing the predictive accuracy of models using a simple randomization test'. Chemometr. Intell. Lab. Syst. 1995; 28: 315.
22. Dijksterhuis GB, Heiser WJ. The role of permutation tests in exploratory multivariate data analysis. Food Qual. Prefer. 1995; 6: 263-270.
23. Sheridan RP, Nachbar RB, Bush BL. Extending the trend vector: the trend matrix and sample-based partial least squares. J. Comput.-Aided Mol. Des. 1994; 8: 323-340.
24. Stone M. Cross-validatory choice and assessment of statistical predictions. J. Roy. Stat. Soc. B 1974; 36: 111-133.
25. Wold S. Cross-validatory estimation of the number of components in factor and principal components models. Technometrics 1978; 20: 397-405.
26. Allen DM. The prediction sum of squares as a criterion for selecting prediction variables. Technical Report No. 23, Dept. of Statistics, University of Kentucky: Lexington, KY, 1971.
27. Martens H, Naes T. Multivariate calibration by data compression. In Near-Infrared Technology in the Agricultural and Food Industries, Williams P, Norris K (eds). American Cereal Association: St Paul, MN, 1987; 57-87.
28. Lorber A, Kowalski BR. Alternatives to cross-validatory estimation of the number of factors in multivariate calibration. Appl. Spectrosc. 1990; 44: 1464-1470.
29. Marbach R, Heise HM. Calibration modeling by partial least-squares and principal component regression and its optimization using an improved leverage correction for prediction testing. Chemometr. Intell. Lab. Syst. 1990; 9: 45-63.
30. SIMCA-P and SIMCA P+ 10, User Guide, Umetrics AB: Umeå, Sweden, 2002.
31. Unscrambler for Windows, User's guide. CAMO AS: Trondheim, Norway, 1996.
32. Picard RR, Cook RD. Cross-validation of regression models. J. Amer. Stat. Assoc. 1984; 79: 575-583.
33. Shao J. Linear model selection by cross-validation. J. Amer. Stat. Assoc. 1993; 88: 486-194.
34. Zhang P. Model selection via multifold cross validation. Ann. Stat. 1993; 21: 299-313.
35. Xu Q-S, Liang Y-Z. Monte Carlo cross validation. Chemometr. Intell. Lab. Syst. 2001; 56: 1-11.
36. Gourvénec S, Fernández Pierna JA, Massart DL, Rutledge DN. An evaluation of the PoLiSh smoothed regression and the Monte Carlo cross-validation for the determination of the complexity of a PLS model. Chemometr. Intell. Lab. Syst. 2003; 68: 41-51.
37. Xu Q-S, Liang Y-Z, Du Y-P. Monte Carlo cross-validation for selecting a model and estimating the prediction error in multivariate calibration. J. Chemometr. 2004; 18: 112-120.
38. Baumann K, Albert H, von Korff M. A systematic evaluation of the benefits and hazards of variable selection in latent variable regression. Part I. Search algorithm, theory and simulations. J. Chemometr. 2002; 16: 339-350.
39. Baumann K, von Korff M, Albert H. A systematic evaluation of the benefits and hazards of variable selection in latent variable regression. Part II. Practical applications. J. Chemometr. 2002; 16: 351-360.
40. Baumann K. Cross-validation as the objective function for variable selection techniques. Trends Anal. Chem. 2003; 22: 395-406.
41. Breiman L, Friedman JH, Olshen RA, Stone C. Classification and Regression Trees. Wadsworth: Belmont, CA, 1984.
42. Reeves JB, III, Delwiche SR. SAS® partial least squares regression for analysis of spectroscopic data. J. Near Infrared Spectrosc. 2003; 11: 415-431.
43. van der Voet H. Pseudo-degrees of freedom for complex predictive models: the example of partial least squares. J. Chemometr. 1999; 13: 195-208.
44. Jackson JE. A User's Guide to Principal Components. Wiley: New York, 1991.
45. Martens HA, Dardenne P. Validation and verification of regression in small data sets. Chemometr. Intell. Lab. Syst. 1998; 44: 99-121.
46. Westad F, Martens H. Variable selection in near infrared spectroscopy based on significance testing in partial least squares regression. J. Near Infrared Spectrosc. 2000; 8: 117-124.
47. Hay M, Steen K, Martens H. Review of partial least squares regression prediction error in Unscrambler. Chemometr. Intell. Lab. Syst. 1998; 44: 123-133.
48. Faber NM. Comparison of two recently proposed expressions for partial least squares regression prediction error. Chemometr. Intell. Lab. Syst. 2000; 52: 123-134.
49. Faber NM. Estimating the uncertainty in estimates of root mean square error of prediction: application to determining the size of an adequate test set in multivariate calibration. Chemometr. Intell. Lab. Syst. 1999; 49: 79-89.
50. Efron B. Bootstrap methods: another look at the jack knife. Ann. Stat. 1979; 7: 1-26.
51. Fisher RA. Statistical Methods for Research Workers. Oliver and Boyd: Edinburgh, 1925.
52. Hotelling H. New light on the correlation coefficient and its transform. J. Roy. Stat. Soc. B 1953; 15: 193-232.
53. Chhikara RS, Folks JL. The Inverse Gaussian Distribution: Theory, Methodology, and Applications. Marcel Dekker: New York, 1989.
54. Dennis B, Munholland PL, Scott JM. Estimation of growth and extinction parameters for endangered species. Ecol. Monogr. 1991; 61: 115-143.
55. Wold S, Eriksson L. Statistical validation of QSAR results. In Chemometric Methods in Molecular Design, van de Waterbeemd H (ed.). VCH Publishers: Weinheim, 1995; 309-318.
56. Dyrby M, Petersen RV, Larsen J, Rudolf B, Norgaard L, Engelsen SB. Towards on-line monitoring of the composition of commercial carrageenan powders. Carbohydr. Polym. 2004; 57: 337-348.
57. Persson E, Sjöström M, Sundblad L-G, Wiklund S, Wilhemsson L. Fresh timber - a challenge to forestry and mensuration. Resultat 2002; 8: 2-4.
58. Nilsson D, Edlund U, Sjöström M, Agnemo R. Prediction of thermo mechanical pulp brightness using NIR spectroscopy on wood raw material. Paperi Ja Puu (Pap. Timber) 2005; 87: 102-109.
59. Fernández Pierna JA, Jin L, Wahl F, Faber NM, Massart DL. Estimation of partial least squares regression (PLSR) prediction uncertainty when the reference values carry a sizeable measurement error. Chemometr. Intell. Lab. Syst. 2003; 65: 281-291.
60. Nilsson D, Edlund U. Pine and spruce roundwood species classification using multivariate image analysis on bark. Holzforschung 2005; 59: 689-695.
61. Wiklund S, Karlsson M, Antti H, Johnels D, Sjöström M, Wingsle G, Edlund U. A new metabonomic strategy for analyzing the growth process in poplar tree. Plant Biotechnol. J. 2005; 3: 353-362.
62. Kelder J, Greven HM. A quantitative study on the relationship between structure and behavi activity of peptides related to ACTH. Rec. Trav. Chim. Pays-Bas 1979; 98: 168-172.
63. Kubinyi H. Evolutionary variable selection in regression and PLS analyses. J. Chemometr. 1996; 10: 119-133.
64. Eriksson L, Johansson E, Kettaneh-Wold N, Wold S. Multi- and Megavariate Data analysis. Principles and Applications. Umetrics AB: Umeå, Sweden, 2002.
65. Helland IS. On the structure of partial least squares regression. Commun. Stat. - Simula. 1988; 17: 581-607.