Component selection and smoothing for nonparametric regression in exponential families

Statistica Sinica

Volumn 16, Issue 3, 2006, Pages 1021-1041

  Zhang, Hao Helen ^a   Lin, Yi ^b,c  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

^c University of Wisconsin   (United States)

Author keywords

Exponential family; LASSO; Nonparametric regression; Penalized likelihood; Smoothing spline ANOVA

Indexed keywords

EID: 33750973351     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (25)

1. Bach, F., Lanekriet, G. R. and Jordan, M. I. (2004). Multiple kernel learning, conic duality, and the SMO algorithm. Proceeding of the Twenty-First International Conference on Machine Learning.
2. Bach, P., Thibaux, H. and Jordan, M. I. (2004). Computing regularization paths for learning multiple kernels. Advances in Neural Information Processing Systems. To appear.
3. Breiman, L. (1995). Better subset election using the nonnegative garotte. Technometrics 37, 373-384.
4. Breiman, L., Friedman, J. H., Olshen, R. and Stone, C. J. (1984). Classification and Regression Trees. Wadswortk. Belmont, CA.
5. Efron, B., Hostie, T., Johnstone, I. and Tibshirani, R. (2004). Least angle regression. Ann. Statist. 32, 407-451.
6. Fan, J. and Li, R. Z. (2001). Variable selection via penalized likelihood. J. Amer. Statist. Assoc. 96, 1348-1300.
7. Friedman, J. H. (1991). Multivariate adaptive regression splines (invited paper). Ann. Statist. 19, 1-141.
8. Friedman, J. H. and Silvernion, B. W. (1989). Flexible parsimonious smoothing mid additive modeling (with discussion). Technometrics 31, 3-39.
9. Gu, C. (1992). Diagnostics for nonpararnetric regression models with additive term, J. Amer. Statist. Assoc. 87, 1051-1058.
10. Gu, C. (2002). Smoothing Spline. ANOVA Models. Springer-Verlag, New York.
11. Gu, C. and Kim, Y. J. (2001). Penalized likelihood regression: General formulation and efficient approximation. Canadian Journal of Statistics 30, 619-628.
12. Hastie, T. (1989). Discussion of "Flexible parsimonious smoothing and additive modeling" by J. Friedman and B. Silverman. Technometrics 31, 3-39.
13. Hastie, T. and Tibshirani, R. (1990). Generalized Additive Models. Chapman and Hall, New York.
14. Kimeldorf, G. and Wahba, G. (1971). Some results on Tchebycheffian spline functions. J. Math. Anal. Appl. 33, 82-85.
15. Lim, T. and Loh, W. Y. (2000). A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms. Machine Learning 40, 203-229.
16. Lin, Y. and Zhang, H. H. (2002). Component selection and smoothing in smoothing spline analysis of variance models. Tech. Rep. 1072, University of Wisconsin - Madison. Submitted.
17. Mangasarian, O. L. and Wolberg, W. H. (1990). Cancer diagnosis via linear programming. SIAM News 23-5, 1-18.
18. Ruppert, D. and Carroll, R. (2000). Spatially-adaptive penalties for spline fitting. Aust. N. Z. J. Stat. 45, 205-223.
19. Tapia, R. and Thompson, J. (1978). Nonparametric Probability Density Estimation. Johns Hopkins University Press, Baltimore, MD.
20. Tibshirani, R. J. (1996). Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B 58, 267-288.
21. Wahba, G. (1990). Spline Models for Observational Data, vol. 59. SIAM. BMS-NSF Regional Conference Series in Applied Mathematics.
22. Wahba, G., Wang, Y., Gu, C., Klein, R. and Klein, B. (1995). Smoothing spline ANOVA for exponential families, with application to the WESDR. Ann. Statist. 23, 1865-1895.
23. Xiang, D. and Wahba, G. (1998). Approximate smoothing spline methods for large data sets in the binary case. Proceedings of ASA Joint Statistical Meetings, Biometrics Section, 94-98.
24. Yau, P., Kohn, R. and Wood, S. (2002). Bayesian variable selection and model averaging in high dimensional multinomial nonparametric regression, J. Comput. Graph. Statist. 12, 23-54.
25. Zhang, H. H., Wahba, G., Lin, Y., Voelker, M., Ferris, M., Klein, R. and Klein, B. (2004). Variable selection and model building via likelihood basis pursuit. J. Amer. Statist. Assoc. 99, 659-672.