Penalized Partial Least Squares with applications to B-spline transformations and functional data

Chemometrics and Intelligent Laboratory Systems

Volumn 94, Issue 1, 2008, Pages 60-69

  Krämer, Nicole ^a   Boulesteix, Anne Laure ^b,c   Tutz, Gerhard ^d  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b Sylvia Lawry Centre for Multiple Sclerosis Research   (Germany)

^c TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^d UNIVERSITY OF MUNICH   (Germany)

Author keywords

Additive model; Conjugate gradient; Dimensionality reduction; Krylov spaces; NIR spectroscopy; Nonlinear regression

Indexed keywords

ALGORITHM; ARTICLE; DOUGH; KERNEL METHOD; LINEAR SYSTEM; LIPID ANALYSIS; MATHEMATICAL MODEL; NEAR INFRARED SPECTROSCOPY; NONLINEAR REGRESSION ANALYSIS; ORANGE JUICE; PARTIAL LEAST SQUARES REGRESSION; PREDICTOR VARIABLE; PRIORITY JOURNAL; SIMULATION;

EID: 50249088015     PISSN: 01697439     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chemolab.2008.06.009     Document Type: Article

References (45)

1. Boulesteix A.-L., Kondylis A., and Krämer N. Comments on "augmenting the bootstrap to analyze high-dimensional genomic data". TEST 17 (2008) 31-35 invited discussion
2. Boulesteix A.-L., and Strimmer K. Partial Least Squares: a versatile tool for the analysis of high-dimensional genomic data. Briefings in Bioinformatics 8 1 (2007) 32-44
3. Brown P.J., Fearn T., and Vannucci M. Bayesian wavelet regression on curves with application to a spectroscopic calibration problem. Journal of the American Statistical Association 96 (2001) 398-408
4. Cardot H., Ferraty F., and Sarda P. Spline estimators for the functional linear model. Statistica Sinica 13 (2003) 571-591
5. Chapelle O., Schölkopf B., and Zien A. Semi-supervised Learning (2006), MIT Press
6. de Boor C. A Practical Guide to Splines (1978), Springer
7. Durand J.F. Local polynomial additive regression through PLS and splines: PLSS. Chemometrics and Intelligent Laboratory Systems 58 (2001) 235-246
8. Durand J.F., and Sabatier R. Additive splines for partial least squares regression. Journal of the American Statistical Association 92 (1997) 1546-1554
9. Eilers P., and Marx B.D. Flexible smoothing with B-splines and penalties. Statistical Science 11 (1996) 89-121
10. Goutis C., and Fearn T. Partial least squares regression on smooth factors. Journal of the American Statistical Association 91 (1996) 627-632
11. Hastie T.J., and Tibshirani R.J. Generalized Additive Models (1990), Chapman and Hall
12. Hestenes M., and Stiefel E. Methods for conjugate gradients for solving linear systems. Journal of Research of the National Bureau of Standards 49 (1952) 409-436
13. Ide T., and Tsuda K. Change point detection using Krylov subspace learning. Proceedings of the SIAM International Conference on Data Mining (2007) 515-520
14. de Jong S. SIMPLS: an alternative approach to partial least squares regression. Chemometrics and Intelligent Laboratory Systems 18 (1993) 251-263
15. Kondylis A., and Whittaker J. Spectral preconditioning of Krylov spaces: combining PLS and PC regression. Computational Statistics & Data Analysis 52 5 (2008) 2588-2603
16. N. Krämer. Analysis of High-Dimensional Data with Partial Least Squares and Boosting. PhD Thesis, TU Berlin, 2006.
17. Krämer N., and Boulesteix A.-L. ppls: Penalized Partial Least Squares. R package version 1.01 (2008)
18. Krämer N., and Braun M.L. Kernelizing PLS, degrees of freedom, and efficient model selection. In: Ghahramani Z. (Ed). Proceedings of the 24th International Conference on Machine Learning (2007) 441-448
19. Lanczos C. An iteration method for the solution of the eigenvalue problem of linear differential and integral operators. Journal of Research of the National Bureau of Standards 45 (1950) 225-280
20. Manne R. Analysis of two Partial-Least-Squares algorithms for multivariate calibration. Chemometrics and Intelligent Laboratory Systems 2 (1987) 187-197
21. D. Marske. Biochemical Oxygen Demand Data Interpretation Using Sum of Squares Surface. Master's thesis, University of Wisconsin-Madison, 1967.
22. Marx B., and Eilers P. Generalized linear regression on samples signals and curves: a P-spline approach. Technometrics 41 (1999) 1-13
23. Martens H., and Naes T. Multivariate Calibration (1989), Wiley, New York
24. Momma M., and Bennett K.P. Constructing orthogonal latent features for arbitrary loss. Feature Extraction, Foundations and Applications (2006), Springer
25. Müller K.R., Mika S., Rätsch G., Tsuda K., and Schölkopf B. An introduction to kernel-based learning algorithms. IEEE Transactions on Neural Networks 12 2 (2001) 181-201
26. Nadler B., and Coifman R.R. The prediction error in CLS and PLS: the importance of feature selection prior to multivariate calibration. Journal of Chemometrics 19 2 (2005) 107-118
27. Osborne B.G., Fearn T., Miller A.R., and Douglas S. Application of near infrared reflectance spectroscopy to compositional analysis of biscuits and biscuits dough. Journal of the Science of Food and Agriculture 35 (1994) 99-105
28. Phatak A., and de Hoog F. Exploiting the connection between PLS, Lanczos, and conjugate gradients: alternative proofs of some properties of PLS. Journal of Chemometrics 16 (2003) 361-367
29. R Development Core Team. R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria (2008). http://www.R-project.org http://www.R-project.org
30. Ramsay J.O., and Silverman B.W. Functional Data Analysis. 2nd edition (2005), Springer, New York
31. Rännar S., Lindgren F., Geladi P., and Wold S. A PLS kernel algorithm for data sets with many variables and fewer objects, Part I: theory and applications. Journal of Chemometrics 8 (1994) 111-125
32. Reiss P., and Odgen R. Functional principal component regression and functional partial least squares. Journal of the American Statistical Association 102 (2007) 984-996
33. Rosipal R., and Krämer N. Overview and recent advances in partial least squares. In: Saunders C., Grobelnik M., Gunn S., and Shawe-Taylor J. (Eds). Subspace, Latent Structure and Feature Selection Techniques, Lecture Notes in Computer Science (2006), Springer 34-51
34. Rosipal R., and Trejo L.J. Kernel partial least squares regression in reproducing kernel Hilbert Spaces. Journal of Machine Learning Research 2 (2001) 97-123
35. Rosipal R., Trejo L.J., and Matthews B. Kernel PLS-SVC for linear and nonlinear classification. In: Fawcett T., and Mishra N. (Eds). Proceedings of the Twentieth International Conference on Machine Learning (2003) 640-647 Washington, DC
36. Saeys W., de Ketelaere B., and Darius P. Potential Applications of Functional Data Analysis in Chemometrics. Journal of Chemometrics 22 (2008) 335-344
37. Saigo H., Krämer N., and Tsuda K. Partial least squares regression for graph mining. 14th International Conference on Knowledge Discovery and Data Mining (2008) to appear
38. Schölkopf B., Smola A., and Müller K.-R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation 10 5 (1998) 1299-1319
39. Silverman B.W. Smoothed functional principal components analysis by choice of norm. The Annals of Statistics 24 1 (1996) 1-24
40. Spiegelman C.H., McShane M.J., Goetz M.J., Motamedi M., Yue Q.L., and Coté G.L. Theoretical justification of wavelength selection in PLS calibration: development of a new algorithm. Analytical Chemistry 70 1 (1998) 35-44
41. Tibshirani R. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological) 58 1 (1996) 267-288
42. Wold H. Path models with latent variables: the NIPALS approach. In: Blalock H.M., et al. (Ed). Quantitative Sociology: International Perspectives on Mathematical and Statistical Model Building (1975), Academic Press 307-357
43. Wold S., Ruhe H., Wold H., and Dunn III W.J. The collinearity problem in linear regression. The Partial Least Squares (PLS) approach to generalized inverses. SIAM Journal of Scientific and Statistical Computations 5 (1984) 735-743
44. Wood S.N. Modelling and smoothing parameter estimation with multiple quadratic penalties. Journal of the Royal Statistical Society B 62 2 (2000) 413-428
45. Wood S.N. Stable and efficient multiple smoothing parameter estimation for generalized additive models. Journal of the American Statistical Association 99 467 (2004) 673-687