The degrees of freedom of partial least squares regression

Journal of the American Statistical Association

Volumn 106, Issue 494, 2011, Pages 697-705

  Nicole, Krämer ^a   Masashi, Sugiyama ^b  

^a WEIERSTRASS INSTITUTE FOR APPLIED ANALYSIS AND STOCHASTICS   (Germany)

^b TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

Dimensionality reduction; Information criteria; Krylov subspaces; Model selection

Indexed keywords

EID: 79960116378     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/jasa.2011.tm10107     Document Type: Article

References (29)

1. Akaike, H. (1973), "Information Theory and an Extension of the Likelihood Ratio Principle," in Second International Symposium of Information Theory, Budapest: Akademiai Kiado, pp. 267-281. [698]
2. Blanchard, G., and Krämer, N. (2010a), "Kernel Partial Least Squares Is Universally Consistent," in JMLR Workshop and Conference Proceedings (AISTATS 2010), Vol. 9, Brookline, MA: Microtome Publishing, pp. 57-64. [704]
3. (2010b), "Optimal Learning Rates for Kernel Conjugate Gradient Regression," in Advances in Neural Information Processing Systems (NIPS), Vol. 23, Red Hook, NY: Curran Associates Inc., pp. 226-234. [704]
4. Brown, P., Fearn, T., and Vannucci, M. (2001), "Bayesian Wavelet Regression on CurvesWith Application to a Spectroscopic Calibration Problem," Journal of the American Statistical Association, 96 (454), 388-408. [705]
5. De Jong, S. (1993), "PLS Fits Closer Than PCR," Journal of Chemometrics, 7, 551-551. [700,704]
6. Denham, M. C. (1997), "Prediction Intervals in Partial Least Squares," Journal of Chemometrics, 11 (1), 39-52. [697,701]
7. Durand, J., and Sabatier, R. (1997), "Additive Splines for Partial Least Squares Regression," Journal of the American Statistical Association, 92, 1546-1554. [697]
8. Efron, B. (2004), "The Estimation of Prediction Error: Covariance Penalties and Cross-Validation," Journal of the American Statistical Association, 99 (467), 619-633. [698]
9. Eldén, L. (2004), "Partial Least-Squares vs. Lanczos Bidiagonalization-I: Analysis of a Projection Method for Multiple Regression," Computational Statistics and Data Analysis, 46 (1), 11-31. [701]
10. Frank, I., and Friedman, J. (1993), "A Statistical View of Some Chemometrics Regression Tools," Technometrics, 35 (2), 109-135. [697,699,700]
11. Goutis, C., and Fearn, T. (1996), "Partial Least Squares Regression on Smooth Factors," Journal of the American Statistical Association, 91, 627-632. [704]
12. Hansen, M., and Yu, B. (2001), "Model Selection and Minimum Description Length Principle," Journal of the American Statistical Association, 96, 746-774. [698]
13. Hoskuldsson, A. (1988), "PLS Regression Methods," Journal of Chemometrics, 2 (3), 211-228. [698,699,701]
14. Krämer, N., and Boulesteix, A.-L. (2009), "ppls: Penalized Partial Least Squares," R package version 1.4. [705]
15. Krämer, N., Boulesteix, A.-L., and Tutz, G. (2008), "Penalized Partial Least Squares With Applications to B-Spline Transformations and Functional Data," Chemometrics and Intelligent Laboratory Systems, 94, 60-69. [704]
16. Krämer, N., and Braun, M. (2007), "Kernelizing PLS, Degrees of Freedom, and Efficient Model Selection," in Proceedings of the 24th International Conference on Machine Learning, ed. Z. Ghahramani, ACM Press, pp. 441-448. [701,704]
17. Krämer, N., and Braun, M. L. (2009), "plsdof: Degrees of Freedom and Confidence Intervals for Partial Least Squares Regression," R package version 0.2-1. [697]
18. Lanczos, C. (1950), "An Iteration Method for the Solution of the Eigenvalue Problem of Linear Differential and Integral Operators," Journal of Research of the National Bureau of Standards, 45, 225-280. [701]
19. Leisch, F., and Dimitriadou, E. (2010), "mlbench: Machine Learning Benchmark Problems," R package version 1.1-6. [705]
20. Manne, R. (1987), "Analysis of Two Partial-Least-Squares Algorithms forMultivariate Calibration," Chemometrics and Intelligent Laboratory Systems, 2, 187-197. [699]
21. Martens, H., and Naes, T. (1989), Multivariate Calibration, New York: Wiley. [697,699]
22. Osborne, B., Miller, A., Fearn, T., and Douglas, S. (1984), "Application of Near Infrared Reflectance Spectroscopy to the Compositional Analysis of Biscuits and Biscuit Doughs," Journal of the Science of Food and Agriculture, 35, 99-105. [705]
23. Phatak, A., Rilley, P., and Penlidis, A. (2002), "The Asymptotic Variance of the Univariate PLS Estimator," Linear Algebra and Its Applications, 354, 245-253. [697,701]
24. Reiss, P., and Ogden, R. (2007), "Functional Principal Component Regression and Functional Partial Least Squares," Journal of the American Statistical Association, 102 (479), 984-996. [704]
25. Rosipal, R., and Trejo, L. (2001), "Kernel Partial Least Squares Regression in Reproducing Kernel Hilbert Spaces," Journal of Machine Learning Research, 2, 97-123. [697]
26. Schwarz, G. (1978), "Estimating the Dimension of a Model," The Annals of Statistics, 6 (2), 461-464. [697,698]
27. Serneels, S., Lemberge, P., and Espen, P. V. (2004), "Calculation of PLS Prediction Intervals Using Efficient Recursive Relations for the Jacobian Matrix," Journal of Chemometrics, 18, 76-80. [701]
28. Van der Voet, H. (1999), "Pseudo-Degrees of Freedom for Complex Predictive Models: The Example of Partial Least Squares," Journal of Chemometrics, 13, 195-208. [697]
29. Wold, H. (1975), "Path ModelsWith Latent Variables: The NIPALS Approach," in Quantitative Sociology: International Perspectives on Mathematical and Statistical Model Building, New York: Academic Press, pp. 307-357. [697, 698]