On the numerical stability of two widely used PLS algorithms

Journal of Chemometrics

Volumn 22, Issue 2, 2008, Pages 101-105

  Fabera, Nicolaas M ^b   Ferré, Joan ^a  

^a UNIVERSITAT ROVIRA I VIRGILI   (Spain)

^b Chemometry Consultancy   (Netherlands)

Author keywords

Algorithm; Gram schmidt; Numerical stability; PLS; Reorthogonalization; SIMPLS

Indexed keywords

MOLECULAR PHYSICS;

COMPUTING TIME; GRAM-SCHMIDT; MACHINE PRECISION; NUMBER OF COMPONENTS; ORTHOGONALITY; PARTIAL LEAST SQUARE ALGORITHMS; PARTIAL LEAST-SQUARES; REORTHOGONALIZATIONS; SIMPLS;

LEAST SQUARES APPROXIMATIONS;

EID: 53649111957     PISSN: 08869383     EISSN: 1099128X     Source Type: Journal    
DOI: 10.1002/cem.1112     Document Type: Article

References (32)

1. Wold S, Ruhe A, Wold H, Dunn WJ III. The collinearity problem in linear regression. The partial least squares (PLS) approach to generalized inverses. SIAM J. Sci. Stat. Comput. 1984; 5: 735-743.
2. Marine R. Analysis of two partial-least-squares algorithms for multivariate calibration. Chemom. Intell. Lab. Syst. 1987; 2: 187-197.
3. Helland IS. On the structure of partial least squares regression. Commun. Stat. -Simula. 1988; 17: 581-607.
4. de Jong S. SIMPLS: an alternative approach to partial least squares regression. Chemom. Intell. Lab. Syst. 1993; 18: 251-263.
5. Bush BL, Nachbar RB. Sample-distance partial least squares: PLS optimized for many variables, with application to CoMFA. J. Comput. Aided Mol. Des. 1993; 7: 587-619.
6. Lindgren F, Geladi P, Wold S. The kernel algorithm for PLS. J. Chemom. 1993; 7: 45-59.
7. Lindgren F, Geladi P, Wold S. Kernel-based PLS regression crossvalidation and applications to spectral data. J. Chemom. 1994; 8: 377-389.
8. de Jong S, ter Braak OF. Comments on the PLS kernel algorithm. J. Chemom. 1994; 8: 169-174.
9. Rännar S, Lindgren F, Geladi P, Wold S. A PLS kernel algorithm for data sets with many variables and fewer objects. Part 1: theory and algorithm. J. Chemom. 1994; 8: 111-125.
10. Rännar S, Geladi P, Lindgren F, Wold S. A PLS kernel algorithm for data sets with many variables and fewer objects. Part II: cross-validation, missing data and examples. J. Chemom. 1995; 9: 459-470.
11. Höskuldsson A. A combined theory for PCA and PLS. J. Chemom. 1995; 9: 91-123.
12. Zhu E, Barnes RM. A simple iteration algorithm for PLS regression. J. Chemom. 1995; 9: 363-372.
13. Goutis C. A fast method to compute orthogonal loadings partial least-squares. J. Chemom. 1997; 11: 33-38.
14. Dayal BS, MacGregor JF. Improved PLS algorithms. J. Chemom. 1997; 11: 73-85.
15. ter Braak CJF, de Jong S. The objective function of partial least squares regression. J. Chemom. 1998; 12: 41-54.
16. Wu W, Manne R. Fast regression methods in a Lanczos (or PLS-1) basis. Theory and applications. Chemom. Intell. Lab. Syst. 2000; 51: 145-161.
17. de Jong S, Wise BM, Ricker NL. Canonical partial least squares and continuum power regression. J. Chemom. 2001; 15: 85-100.
18. Brenchley JM, Lang PM, Nieves RG, Kalivas JH. Stabilization of cyclic subspace regression. Chemom. Intell. Lab. Syst. 1998; 41: 127-134.
19. Meurant G, Strakoš Z. The Lanczos and conjugate gradient algorithms in finite precision arithmetic. Acta Numerica 2006; 15: 471-542.
20. Press WH, Teukolsky SA, Vetterling WT, Flannery BP. Numerical Recipes in C. The Art of Scientific Computing. Cambridge University Press: Cambridge, 1992; 66.
21. Parlett BN. The Symmetric Eigenvalue Problem. Prentice-Hall: Engle-wood Cliffs, NJ, 1980; 105-109.
22. Giraud L, Langou J, Rozložník M. On the round-off error analysis of the Gram-Schmidt algorithm with reorthogonalization. Technical Report TR/PA/02/33, CERFACS: Toulouse, 2002.
23. Matlab, The Mathworks, Natick, MA.
24. Esbensen KH, Schönkopf S, Midtgaard T. Multivariate analysis in practice. CAMO: Trondheim, 1994.
25. Forina M, Armanino C, Castino M, Ubigli M. Multivariate data analysis as a discriminating method of the origin of wines. Vitis 1986; 25: 189-201.
26. Phatak A, Reilly PM, Penlidis A. An approach to interval estimation in partial least squares regression. Anal. Chim. Acta 1993; 277: 495-501.
27. Denham MC. Prediction intervals in partial least squares. J. Chemom. 1997;11 : 39-52.
28. Faber K, Kowalski BR. Propagation of measurement errors for the validation of predictions obtained by principal component regression and partial least squares. J. Chemom. 1997; 11: 181-238.
29. Phatak A, Reilly PM, Penlidis A. The asymptotic variance of the univariate PLS estimator. Linear Algebra Appl. 2002; 354: 245-253.
30. Serneels S, Lemberge P, Van Espen PJ. Calculation of PLS prediction intervals using efficient recursive relations for the Jacobian matrix. J. Chemom. 2004; 18: 76-80.
31. Zhang MH, Xu QS, Massart DL. Boosting partial least squares. Anal. Chem. 2005; 77: 1423-1431.
32. Pell RJ, Ramos LS, Manne R. The model space in partial least squares regression. J. Chemom. 2007; 21: 165-172.