A comparison of various methods for multivariate regression with highly collinear variables

Statistical Methods and Applications

Volumn 16, Issue 2, 2007, Pages 193-228

  Kiers, Henk A L ^a   Smilde, Age K ^b  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Multicollinearity; Multivariate regression; PLS; Power regression; Principal component regression; Principal covariate regression

Indexed keywords

EID: 34547424353     PISSN: 16182510     EISSN: 1613981X     Source Type: Journal    
DOI: 10.1007/s10260-006-0025-5     Document Type: Article

References (24)

1. Breiman L, Friedman JH (1997) Predicting multivariate responses in multiple linear regression (with discussion). J R Stat Soc Series B 59: 3-54
2. Bro R (1996) Multiway calibration. Multilinear PLS. J Chemometrics 10: 47-61
3. Brooks R, Stone M (1994) Joint continuum regression for multiple predictands. J Am Stat Assoc 89: 1374-1377
4. Coxe KL (1986) Principal components regression analysis. In: Encyclopedia of Statistical Sciences, vol. 7, Johnson NL, Kotz S (Eds), Wiley, New York, pp. 181-186
5. D'Ambra L, Lauro N (1982) Analisi in componenti principali in rapporto ad un sottospazio di riferimento. Rivista di Statistica Applicata 1.
6. De Jong S (1993) SIMPLS: an alternative approach to patial least squares regression. Chemome Intell Lab Syst 18: 251-263
7. De Jong S, Kiers HAL (1992) Principal Covariates Regression: part I. Theory, Chemometrics and Intelligent Laboratory Syst 14: 155-164
8. De Jong S, Wise BM, Ricker NL (2001) Canonical partial least squares and continuum power regression. J Chemom 15: 85-100
9. Esposito Vinzi V, Lauro C, Morineau A, Tenenhaus M (2001) PLS and related methods. In: Proceedings of the PLS'01 International Symposium, CISIA-CERESTA, Montreuil, France
10. Frank IE (1987) Intermediate least squares regression method. Chemom Intell Lab Syst 1: 233-242
11. Hastie T, Tibshirani R, Friedman J (2001) The elements of statistical learning. Springer, Berlin Heidelberg New York
12. Hoerl AE, Kennard RW (1970) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12: 55-67
13. Izenman AJ (1975) Reduced-rank regression for the multivariate linear model. J Multivar Analy 5: 248-264
14. Kelly JJ, Barlow CH, Jinguji TM, Callis JB (1989) Prediction of gasoline octane numbers from near-infrared spectral features in the range 660-1215nm. Anal Chem 61: 313-320
15. Kiers HAL (1990) Maximizaiton as a tool for optimizing a class of matrix functions. Psychometrika 55: 417-428
16. Kresta JV, Marlin TE, MacGregor JF (1994) Development of inferential process models using PLS. Comput Chem Eng 18: 597-611
17. Manne R (1987) Analysis of partial-least-squares algorithms for multivariate calibration. Chemom Intell Lab Syst 2: 283-290
18. Martens H, Naes T (1989) Multivariate Calibration. Wiley, New York
19. Rao CR (1964) The use and interpretation of principal components analysis in applied research. Sankhya A 26: 329-358
20. Stone M, Brooks RJ (1990) Continuum regression: cross-validated sequentially constructred prediction embracing ordinary least squares, partial least squares and principal components regression (with discussion). J R Stat Soc, Series B 52: 237-269
21. Van den Wollenberg AL (1977) Redundancy analysis: an alternative for canonical correlation analysis. Psychometrika 49: 79-94
22. Van der Werf MJ (2005) Towards replacing closed with open target selection approaches. Trends Biotechnol 23: 11-16
23. Van Sprang ENM, Ramaker HJ, Boelens HFM, Westerhuis JA, Whiteman D, Baines D, Weaver I(2002) Batch process monitoring using on-line MIR spectroscopy. Analyst 127: 3-7
24. Wold S, Ruhe A, Wold H, Dunn III WJ (1984) The collinearity problem in linear regression. The partial least squares (PLS) approach to generalized inverses. SIAM J Sci Stat Comput 5: 735-744