Envelopes and partial least squares regression

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 75, Issue 5, 2013, Pages 851-877

  Cook, R D ^a   Helland, I S ^b   Su, Z ^c  

^a UNIVERSITY OF MINNESOTA   (United States)

^b UNIVERSITY OF OSLO   (Norway)

^c UNIVERSITY OF FLORIDA   (United States)

Author keywords

Dimension reduction; Envelope models; Envelopes; Maximum likelihood estimation; Partial least squares; SIMPLS algorithm

Indexed keywords

EID: 84885836186     PISSN: 13697412     EISSN: 14679868     Source Type: Journal    
DOI: 10.1111/rssb.12018     Document Type: Article

References (34)

1. Aldrich, J. (2005) Fisher and regression. Statist. Sci., 20, 401-417.
2. Bickel, P. and Levina, E. (2008) Regularized estimation of large covariance matrices. Ann. Statist., 36, 199-227.
3. Boulesteix, A.-L. and Strimmer, K. (2006) Partial least squares: a versatile tool for the analysis of high-dimensional genomic data. Brief. Bioinform., 7, 32-44.
4. Chun, H. and Keleş, S. (2010) Sparse partial least squares regression for simultaneous dimension reduction and variable selection. J. R. Statist. Soc. B, 72, 3-25.
5. Conway, J. (1990) A Course in Functional Analysis, 2nd edn. New York: Springer.
6. Cook, R. D. and Forzani, L. (2010) Letter to the editor. J. Am. Statist. Ass., 105, 881.
7. Cook, R. D., Li, B. and Chiaromonte, F. (2007) Dimension reduction in regression without matrix inversion. Biometrika, 94, 569-584.
8. Cook, R. D., Li, B. and Chiaromonte, F. (2010) Envelope models for parsimonious and efficient multivariate regression (with discussion). Statist. Sin., 20, 927-1010.
9. Delaigle, A. and Hall, P. (2012) Achieving near perfect classification for functional data. J. R. Statist. Soc. B, 74, 267-286.
10. Edelman, A., Tomás, A. A. and Smith, S. T. (1998) The geometry of algorithms with orthogonality constraints. SIAM J. Matrix Anal. Applic., 20, 303-353.
11. Frank, I. E. and Friedman, J. H. (1993) A statistical view of some chemometrics regression tools (with discussion). Technometrics, 35, 109-148.
12. Helland, I. S. (1988) On the structure of partial least squares regression. Communs Statist. Simuln Computn, 17, 581-607.
13. Helland, I. S. (1990) Partial least squares regression and statistical models. Scand. J. Statist., 17, 97-114.
14. Helland, I. S. (1992) Maximum likelihood regression on relevant components. J. R. Statist. Soc. B, 54, 637-647.
15. Helland, I. S. (2001) Some theoretical aspects of partial least squares regression. Chemometr. Intell. Lab. Syst., 58, 97-107.
16. Helland, I. S. (2010) Steps Towards a Unity of Scientific Models and Methods. Singapore: World Scientific Publishing.
17. Helland, I. S. (2012) A unified scientific basis for inference. Preprint arXiv:1206.5075. University of Olso, Oslo.
18. Helland, I. S. (2013) A basis for statistical theory and quantum theory. In Advances in Quantum Mechanics (ed. P. Bracken ). Rijeka: InTech.
19. Helland, I. S., Sæbø, S. and Tjelmeland, H. (2012) Near optimal prediction from relevant components. Scand. J. Statist. 39, 695-713.
20. de Jong, S. (1993) SIMPLS: an alternative approach to partial least squares regression. Chemometr. Intell. Lab. Syst., 18, 251-263.
21. Levina, E., Rothman, A. J. and Zhu, J. (2008) Sparse estimation of large covariance matrices via a nested Lasso penalty. Ann. Appl. Statist., 2, 245-263.
22. Liu, X., Srivistava, A. and Gallivan, K. (2004) Optimal linear representations of images for object recognition. IEEE Trans. Pattn Anal. Mach. Intell., 26, 662-666.
23. Martens, H. and Næs, T. (1989) Multivariate Calibration. New York: Wiley.
24. Nadler, B. and Coifman, R. R. (2005) The prediction error in cls and pls: the importance of feature selection prior to multivariate calibration. J. Chemometr., 19, 107-118.
25. Næs, T. and Helland, I. S. (1993) Relevant components in regression. Scand. J. Statist., 20, 239-250.
26. von Rosen, D. (1988) Moments for the inverted Wishart distribution. Scand. J. Statist., 15, 97-109.
27. Rothman, A. J., Bickel, P., Levina, E. and Zhu, J. (2008) Sparse permutation invariant covariance estimation. Electron. J. Statist., 2, 494-515.
28. Sæbø, S., Almøy, T. and Aaastveit, A. (2007) ST-PLS: a multi-directional nearest shrunken centroid classifier via PLS. J. Chemometr., 22, 54-62.
29. Shapiro, A. (1986) Asymptotic theory of overparameterized structural models. J. Am. Statist. Ass., 81, 142-149.
30. Small, C. G., Wang, J. and Yang, Z. (2000) Eliminating multiple root problems in estimation. Statist. Sci., 15, 313-341.
31. Su, Z. and Cook, R. D. (2011) Partial envelopes for efficient estimation in multivariate linear regression. Biometrika, 98, 133-146.
32. Su, Z. and Cook, R. D. (2012) Inner envelopes: efficient estimation in multivariate linear regression. Biometrika, 99, 687-702.
33. Su, Z. and Cook, R. D. (2013) Estimation of multivariate means with heteroscedastic errors using envelope models. Statist. Sin., 23, 213-230.
34. Wold, H. (1966) Estimation of principal components and related methods by iterative least squares. In Multivariate Analysis (ed. P. R. Krishnaiah ). New York: Academic Press.