Partial least squares algorithms and methods

Wiley Interdisciplinary Reviews: Computational Statistics

Volumn 5, Issue 1, 2013, Pages 1-19

  Esposito Vinzi, Vincenzo ^a   Russolillo, Giorgio ^b  

^a ESSEC BUSINESS SCHOOL   (France)

^b University of Paris Cité   (France)

Author keywords

Multi block data; NIPALS; Path models; Shrinkage

Indexed keywords

BROAD SPECTRUM; COMPUTATIONAL FLOWS; ITERATIVE ALGORITHM; LEAST SQUARE; MULTI-BLOCK DATA; MULTIVARIATE TECHNIQUES; NIPALS; OPTIMIZATION CRITERIA; PARTIAL LEAST SQUARE (PLS); PARTIAL LEAST SQUARES ALGORITHMS; PATH MODELS; PLS MODELS; PLS REGRESSION; PRINCIPAL COMPONENTS;

ALGORITHMS; OPTIMIZATION; REGRESSION ANALYSIS; SHRINKAGE;

PRINCIPAL COMPONENT ANALYSIS;

EID: 84871837951     PISSN: 19395108     EISSN: 19390068     Source Type: Journal    
DOI: 10.1002/wics.1239     Document Type: Review

References (60)

1. Wold H. Non linear estimation by iterative least squares procedure, Research paper in Statistics: Festschift for J. Neyman. F. David, 1966.
2. Wold H. Estimation of principal component and related models by iterative least squares. In: Krishnaiah PR, ed. Multivariate Analysis. New York: Academic Press; 1966, 391-420.
3. Wold H. Path models with latent variables: the non-linear iterative partial least squares (NIPALS) approach. In: Blalock HM, Aganbegian A, Borodkin FM, Boudon Raymond, Capecchi Vittorio, eds. Quantitative Sociology: Intentional Perspective on Mathematical and Statistical Modeling. New York: Academic Press; 1975, 307-357.
4. Wold H. Causal flows with latent variables. Partings of the ways in the light of NIPALS modelling. Eur Econ Rev 1984, 5:67-86.
5. Wold H. Soft modeling by latent variables: the nonlinear iterative partial least squares approach. In: Gani J, ed. Perspectives in Probability and Statistics, Papers in Honor of M.S. Bartlett. London: Academic Press; 1975, 117-142.
6. Wold H. Soft modeling: the basic design and some extensions. In: Jöreskog KG, Wold H, eds. Systems under Indirect Observation, Part II. Amsterdam: North-Holland; 1982, 1-54.
7. Tenenhaus M, Esposito Vinzi V, Chatelin Y-M, Lauro CN. PLS path modeling. Comput Stat Data Anal 2005, 48:159-205.
8. Jöreskog KJ. A general method for analysis of covariance structure. Biometrika 1970, 57:239-251.
9. Wold S, Martens H, Wold H. The multivariate calibration problem in chemistry solved by the PLS method. In: Ruhe A, Kagstrom B, eds. Proceedings of the Conference on Matrix Pencils. Lectures Notes in Mathematics. Heidelberg: Springer; 1983.
10. Wold S, Ruhe A, Wold H, Dunn W. The collinearity problem in linear regression. the PLS approach to generalised inverses. J Sci Stat Comput, SIAM 1984, 5:735-743.
11. Wold S, Sjöström M, Eriksson L. PLS regression: a basic tool of chemometrics. Chemometr Intell Lab Syst 2001, 58:109-130.
12. Esposito Vinzi V, Trinchera L, Amato S. PLS path modeling: Recent developments and open issues for model assessment and improvement. In: Esposito Vinzi V, Chin W, Henseler J, Wang H, eds. Handbook of Partial Least Squares (PLS): Concepts, Methods and Applications. Berlin, Heidelberg, New York: Springer; 2010.
13. Sánchez G. PATHMOX approach: segmentation trees in partial least squares path modeling, PhD Thesis, Universitat Politècnica de Catalunya, Barcelona, Spain, 2009.
14. Tenenhaus M. La Régression PLS: Théorie et Pratique. Paris: Technip; 1998.
15. Abdi H. Partial least squares regression, projection on latent structures, PLS-regression. WIRES: Comput Stat 2010, 2:97-106.
16. De Jong S. PLS shrinks. J Chemometr 1995, 9:323-326.
17. Höskuldsson A. PLS regression methods. J Chemometr 1988, 2:211-228.
18. Frazer RA, Duncan WJ, Collar AR. Elementary Matrices and Some Applications to Dynamics and Differential Equations. Cambridge: Cambridge University Press; 1938, 1963 printing.
19. Frank IE, Friedman JH. A statistical view of some chemometrics regression tools. Technometrics 1993, 35:109-135.
20. Garthwaite PH. An interpretation of partial least squares. J Am Stat Assoc 1994, 89:122-127.
21. Hoerl AE, Kennard RW. Ridge regression: biased estimation of non-orthogonal components. Technometrics 1970, 12:55-67.
22. Jolliffe IT. A note on the use of principal components in regression. J R Stat Soc [Ser C](Appl Stat) 1982, 31:300-303.
23. Ball RJ. The significance of simultaneous methods of parameter estimation in econometric models. Appl Stat 1963, 12:14-25.
24. Wold S. PLS for multivariate linear modeling. In: van de Waterbeemd H, ed. QSAR: Chemometric Methods in Molecular Design. Methods and Principles in Medicinal Chemistry. Weinheim, Germany: Verlag-Chemie; 2009.
25. Wold H. Partial least squares. In: Kotzand S, Johnson NL, eds. Encyclopedia of Statistical Sciences, vol. 6, New York: Wiley; 1985, 581-591.
26. Sampson PD, Streissguth AP, Barr HM, Bookstein FL. Neurobehavioral effects of prenatal alcohol: Part ii. partial least squares analysis. Neurotoxicol Teratol 1989, 11:477-491.
27. Rosipal R, Krämer N. Overview and recent advances in partial least squares. In: Saunders C, Grobelnik M, Gunn S, Shawe-Taylor J, eds. Subspace, Latent Structure and Feature Selection Techniques. Springer; 2006, 34-51.
28. Wegelin JA. A survey on partial least squares (PLS) methods, with emphasis on the two-block case, Technical Report No 371, Department of Statistics, University of Washington, USA: Seattle, 2000.
29. Tishler A, Dvir D, Shenhar A, Lipovetsky S. Identifying critical success factors in defense development projects: a multivariate analysis. Technol Forecast Soc Change 1996, 51:151-171.
30. Tucker LR. An inter-battery method of factor analysis. Psychometrika 1958, 23:111-136.
31. Fornell C, Bookstein FL. Two structural equation models: LISREL and PLS applied to consumer exit-voice theory. J Mark Res 1982, XIX:440-452.
32. Addinsoft. XLSTAT 2012. 2012. Paris. Available at: http:www.xlstat.com/en/products/xlstat-plspm/. (Accessed November 29, 2012).
33. Lyttkens E, Areskoug B, Wold H. The convergence of NIPALS estimation procedures for six path models with one or two latent variables, Technical Report, University of Göteborg, 1975.
34. Krämer N. Analysis of high-dimensional data with partial least squares and boosting, PhD Thesis, Technische Universität Berlin, Berlin, Germany, 2007.
35. Henseler J. On the convergence of the partial least squares path modeling algorithm. Comput Stat 2010, 25:107-120.
36. Lohmöller JB. LVPLS Program Manual, version 1.8. Technical Report, Zentralarchiv für Empirische Sozialforschung, Universität Zu Köln, Köln, 1987.
37. Lohmöller JB. Latent Variable Path Modeling with Partial Least Squares. Heildelberg: Physica-Verlag; 1989.
38. Hanafi M. PLS path modeling: computation of latent variables with the estimation mode B. Comput Stat 2007, 22:275-292.
39. Fornell CC, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Mark Res 1981, 48:39-50.
40. Esposito Vinzi V, Tenenhaus M, Amato S. A global goodness-of-fit index for PLS structural equation modelling. Proceedings of the XLII SIS Scientific Meeting Vol. Contributed Papers, Padova: CLEUP; 2004, 739-742.
41. Stone M. Cross-validatory choice and assessment of statistical predictions. J R Stat Soc 1974, 36:111-147.
42. Geisser S. A predictive approach to the random effect model. Biometrika 1974, 61:101-107.
43. Efron B. The Jackknife, the Bootstrap and Other Resampling Plans. Philadelphia, PA: SIAM; 1982.
44. van Belle G. Statistical Rules of Thumb. New York: John Wiley & Sons; 2002.
45. Hotelling H. Relations between two sets of variates. Biometrika 1936, 28:321-377.
46. Rao CR. The use and interpretation of principal component analysis in applied research. Sankhya 1964, A 26:329-359.
47. Van de Wollenberg AL. Redundancy analysis. an alternative for canonical correlation analysis. Psychometrika 1977, 42:207-219.
48. Horst P. Relations among m sets of measures. Psychometrika 1961, 26:129-149.
49. Carroll JD. Generalization of canonical analysis to three or more sets of variables, Proceedings of the 76th Convention of the American Psychological Association, vol. 3, 1968; 227-228.
50. Escofier B, Pagés J. Multiple factor analysis (AFMULT package). Comput Stat Data Anal 1994, 18:121-140.
51. Kettenring JR. Canonical analysis of several sets of variables. Biometrika 1971, 58:433-451.
52. Tenenhaus M, Hanafi M. A bridge between PLS path modeling and multi-block data analysis. In: Esposito Vinzi V, Chin W, Henseler J, Wang H, eds. Handbook of Partial Least Squares (PLS): Concepts, Methods and Applications. Heidelberg, Germany: Springer Verlag; 2010.
53. Glang M. Maximierung der Summe erklärter Varianzen in linearrekursiven Strukturgleichungsmodellen mit multiple Indikatoren: Eine Alternative zum Schätzmodus B des Partial-Least-Squares-Verfahren, PhD Thesis, Universität Hamburg, Hamburg, Germany, 1988.
54. Mathes H. Global optimisation criteria of the pls-algorithm in recursive path models with latent variables. In: Haagen K, Bartholomew DJ, Deister M, eds. Statistical Modelling and Latent Variables. Amsterdam: Elsevier Science; 1993.
55. Tenenhaus A, Tenenhaus M. Regularized generalized canonical correlation analysis. Psychometrika 2011, 76:257-284.
56. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis. A Global Perspective. Upper Saddle River, New Jersey: Pearson Education Inc.; 2010.
57. Lê Cao KA, Rossouw D, Robert-Granié C, Besse P. Sparse pls: Variable selection when integrating omics data. Stat Appl Mol Biol 2008, 7.
58. Chun H, Keleş S. Sparse partial least squares regression for simultaneous dimension reduction and variable selection. J R Stat Soc [Ser B] (Stat Methodol) 2010, 72:3-25.
59. Krämer N, Sugiyama M. The degrees of freedom of partial least squares regression. J Am Stat Assoc 2011, 106:697-705.
60. Russolillo G. Non-metric partial least squares. Electron J Statistics 2012, 6:1641-1669.