Component selection and smoothing in multivariate nonparametric regression

Annals of Statistics

Volumn 34, Issue 5, 2006, Pages 2272-2297

  Lin, Yi ^a,c   Zhang, Hao Helen ^b  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

^c University of Wisconsin Madison   (United States)

Author keywords

Machine learning; Method of regularization; Model selection; Nonparametric classification; Nonparametric regression; Smoothing spline ANOVA

Indexed keywords

EID: 33847350805     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/009053606000000722     Document Type: Article

References (23)

1. BREIMAN, L. (1995). Better subset selection using the nonnegative garrote. Technometrics 37 373-384. MR1365720
2. CHEN, S., DONOHO, D. and SAUNDERS, M. (1998). Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 20 33-61. MR1639094
3. CHEN, Z. (1993). Fitting multivariate regression functions by interaction spline models. J. Roy. Statist. Soc. Ser. B 55 473-491. MR1224411
4. CRAVEN, P. and WAHBA, G. (1979). Smoothing noisy data with spline functions. Numer. Math. 31 377-403. MR0516581
5. EFRON, B., HASTIE, T., JOHNSTONE, I. and TIBSHIRANI, R. (2004). Least angle regression (with discussion). Ann. Statist. 32 407-499. MR2060166
6. FAN, J. and LI, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. J. Amer. Statist. Assoc. 96 1348-1360. MR1946581
7. FRANK, I. E. and FRIEDMAN, J. H. (1993). A statistical view of some chemometrics regression tools. Technometrics 35 109-148.
8. FRIEDMAN, J. H. (1991). Multivariate adaptive regression splines (with discussion). Ann. Statist. 19 1-141. MR1091842
9. GU, C. (1992). Diagnostics for nonparametric regression models with additive terms. J. Amer. Statist. Assoc. 87 1051-1058.
10. GU, C. (2002). Smoothing Spline ANOVA Models. Springer, Berlin. MR1876599
11. GUNN, S. R. and KANDOLA, J. S. (2002). Structural modeling with sparse kernels. Machine Learning 48 137-163.
12. SHEN, X., HUANG, H. and YE, J. (2004). Inference after model selection. J. Amer. Statist. Assoc. 99 751-762. MR2090908
13. SHEN, X. and YE, J. (2002). Adaptive model selection. J. Amer. Statist. Assoc. 97 210-221. MR1947281
14. TAPIA, R. and THOMPSON, J. (1978). Nonparametric Probability Density Estimation. Johns Hopkins Univ. Press, Baltimore. MR0502724
15. TIBSHIRANI, R. J. (1996). Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B 58 267-288. MR1379242
16. UTRERAS, F. (1983). Natural spline functions: Their associated eigenvalue problem. Numer. Math. 42 107-117. MR0716477
17. VAN DE GEER, S. (2000). Empirical Processes in M-Estimation. Cambridge Univ. Press.
18. VAN GESTEL, T., SUYKENS, J. A. K., BAESENS, B., VIAENE, S., VANTHIENEN, J., DEDENE, G., DE MOOR, B. and VANDEWALLE, J. (2004). Benchmarking least squares support vector machine classifiers. Machine Learning 54 5-32.
19. WAHBA, G. (1990). Spline Models for Observational Data. SIAM, Philadelphia. MR1045442
20. WAHBA, G., WANG, Y., GU, C., KLEIN, R. and KLEIN, B. (1995). Smoothing spline ANOVA for exponential families, with application to the Wisconsin Epidemiological Study of Diabetic Retinopathy. Ann. Statist. 23 1865-1895. MR1389856
21. YAU, P., KOHN, R. and WOOD, S. (2003). Bayesian variable selection and model averaging in high-dimensional multinomial nonparametric regression. J. Comput. Graph. Statist. 12 23-54. MR1965210
22. YE, J. (1998). On measuring and correcting the effects of data mining and model selection. J. Amer. Statist. Assoc. 93 120-131. MR1614596
23. ZHANG, H. H., WAHBA, G., LIN, Y., VOELKER, M., FERRIS, M., KLEIN, R. and KLEIN, B. (2004). Variable selection and model building via likelihood basis pursuit. J. Amer. Statist. Assoc. 99 659-672. MR2090901