Feature extraction in signal regression: A boosting technique for functional data regression

Journal of Computational and Graphical Statistics

Volumn 19, Issue 1, 2010, Pages 154-174

  Tutz, Gerhard ^a   Gertheiss, Jan ^a  

^a UNIVERSITY OF MUNICH   (Germany)

Author keywords

Boosting techniques; Generalized ridge regression; P Splines; Partial least squares

Indexed keywords

EID: 77749280569     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/jcgs.2009.07176     Document Type: Article

References (30)

1. Breiman, L. (1998), "Arcing Classifiers," The Annals of Statistics, 26, 801-849. [158]
2. Breiman, L. (1999), "Prediction Games and Arcing Algorithms," Neural Computation, 11, 1493-1517. [158]
3. Breiman, L. (2001), "Random Forests," Machine Learning, 45, 5-32. [165]
4. Bühlmann, P. (2006), "Boosting for High-Dimensional Linear Models," The Annals of Statistics, 34, 559-583. [158,161]
5. Bühlmann, P., and Yu, B. (2003), "Boosting With the L2 Loss: Regression and Classification," Journal of the American Statistical Association, 98, 324-339. [158,159,161]
6. Christensen, J., Nørgaard, L., Heimdal, H., Pedersen, J. G., and Engelsen, S. B. (2004), "Rapid Spectroscopic Analysis of Marzipan-Comparative Instrumentation," Journal of Near Infrared Spectroscopy, 12, 63-75. [154,169,170,173]
7. Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), "Least Angle Regression," The Annals of Statistics, 32, 407-499. [164]
8. Eilers, P. H. C., and Marx, B. D. (1996), "Flexible Smoothing With B-Splines and Penalties," Statistical Science, 11, 89-121. [172]
9. Frank, I. E., and Friedman, J. H. (1993), "A Statistical View of Some Chemometrics Regression Tools" (with discussion), Technometrics, 35, 109-148. [154]
10. Freund, Y., and Schapire, R. E. (1996), "Experiments With a New Boosting Algorithm," in Proceedings of the Thirteenth International Conference on Machine Learning, San Francisco, CA:Morgan Kaufmann, pp. 148-156. [158]
11. Friedman, J. H. (2002), "Stochastic Gradient Boosting," Computational Statistics & Data Analysis, 38, 367-378. [172]
12. Friedman, J. H., Hastie, T., and Tibshirani, R. (2000), "Additive Logistic Regression: A Statistical View of Boosting," The Annals of Statistics, 28, 337-407. [158,173]
13. Gertheiss, J., and Tutz, G. (2009), "Supervised Feature Selection in Mass Spectrometry Based Proteomic Profiling by Blockwise Boosting," Bioinformatics, 25, 1076-1077. [173]
14. Hastie, T., and Mallows, C. (1993), Discussion of "A Statistical View of Some Chemometrics Regression Tools," by I. E. Frank and J. H. Friedman, Technometrics, 35, 140-143. [156]
15. Hoerl, A. E., and Kennard, R. W. (1970), "Ridge Regression: Biased Estimation for Nonorthogonal Problems," Technometrics, 12, 55-67. [156,165]
16. Hurvich, C. M., Simonoff, J. S., and Tsai, C. (1998), "Smoothing Parameter Selection in Nonparametric Regression Using an Improved Akaike Information Criterion," Journal of the Royal Statistical Society, Ser. B, 60, 271-293. [161]
17. Krämer, N. (2006), "Boosting for Functional Data," in COMPSTAT 2006-Proceedings in Computational Statistics, Heidelberg: Physica, pp. 1121-1128. [172]
18. Land, S. R., and Friedman, J. H. (1997), "Variable Fusion: A New Adaptive Signal Regression Method," Technical Report 656, Carnegie Mellon University Pittsburg, Dept. of Statistics. [157,158]
19. Martens, H., and Naes, T. (1989), Multivariate Calibration, Chichester: Wiley. [164]
20. Marx, B. D., and Eilers, P. H. C. (1999), "Genaralized Linear Regression on Sampled Signals and Curves: A P-Spline Approach," Technometrics, 41, 1-13. [156,157,160,165,168,169,172]
21. Marx, B. D., and Eilers, P. H. C. (2005), "Multidimensional Penalized Signal Regression," Technometrics, 47, 13-22. [156]
22. Massy, W. F. (1965), "Principal Components Regression in Exploratory Statistical Research," Journal of the American Statistical Association, 60, 234-256. [164]
23. Osborne, B. G. (2000), "Near-Infrared Spectroscopy in Food Analysis," in Encyclopedia of Analytical Chemistry, ed. R. A. Meyers, Chichester: Wiley. [169,170]
24. R Development Core Team (2007), R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing. [164]
25. Ramsay, J. O., and Silverman, B. W. (2005), Functional Data Analysis (2nd ed.), New York: Springer. [154-157, 165,167,168,172,173]
26. Schapire, R. E. (1990), "The Strength of Weak Learnability," Machine Learning, 5, 197-227. [158]
27. Tibshirani, R. (1996), "Regression Shrinkage and Selection via the Lasso," Journal of the Royal Statistical Society, Ser. B, 58, 267-288. [156,157,164]
28. Tibshirani, R., Saunders, M., Rosset, S., Zhu, J., and Kneight, K. (2005), "Sparsity and Smoothness via the Fused Lasso," Journal of the Royal Statistical Society, Ser. B, 67, 91-108. [156,158,165,170]
29. Wold, H. (1975), "Soft Modeling by Latent Variables: The Nonlinear Partial Least Squares Approach," in Perspectives in Probability and Statistics, Papers in Honour of M. S. Bartlett, ed. J. Gani, London: Academic Press. [164]
30. Zou, H., and Hastie, T. (2005), "Regularization and Variable Selection via the Elastic Net," Journal of the Royal Statistical Society, Ser. B, 67, 301-320. [156,165]