Structured variable selection and estimation

Annals of Applied Statistics

Volumn 3, Issue 4, 2009, Pages 1738-1757

  Yuan, Ming ^a   Roshan Joseph, V ^a   Zou, Hui ^b  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Effect heredity; Nonnegative garrote; Quadratic programming; Regularization; Variable selection

Indexed keywords

EID: 77955322588     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/09-AOAS254     Document Type: Article

References (28)

1. Boyd, S. and Vandenberghe, L. (2004). Convex Optimization. Cambridge Univ. Press, Cambridge.
2. Breiman, L. (1995). Better subset regression using the nonnegative garrote. Technometrics 37 373-384.
3. Breiman, L. and Friedman, J. (1985). Estimating optimal transformations for multiple regression and correlation. J. Amer. Statist. Assoc. 80 580-598.
4. Breiman, L., Friedman, J., Stone, C. and Olshen, R. (1984). Classifcation and Regression Trees. Chapman & Hall/CRC, New York.
5. Chipman, H. (1996). Bayesian variable selection with related predictors. Canad. J. Statist. 24 17-36.
6. Chipman, H., Hamada, M. and Wu, C. F. J. (1997). A Bayesian variable selection approach for analyzing designed experiments with complex aliasing. Technometrics 39 372-381.
7. Choi, N., Li, W. and Zhu, J. (2006). Variable selection with the strong heredity constraint and its oracle property. Technical report.
8. Efron, B., Johnstone, I., Hastie, T. and Tibshirani, R. (2004). Least angle regression (with discussion). Ann. Statist. 32 407-499.
9. Fan, J. and Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. J. Amer. Statist. Assoc. 96 1348-1360.
10. George, E. I. and McCulloch, R. E. (1993). Variable selection via Gibbs sampling. J. Amer. Statist. Assoc. 88 881-889.
11. Hamada, M. and Wu, C. F. J. (1992). Analysis of designed experiments with complex aliasing. Journal of Quality Technology 24 130-137.
12. Harrison, D. and Rubinfeld, D. (1978). Hedonic prices and the demand for clean air. Journal of Environmental Economics and Management 5 81-102.
13. Hastie, T., Tibshirani, R. and Friedman, J. (2003). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer, New York.
14. Joseph, V. R. and Delaney, J. D. (2007). Functionally induced priors for the analysis of experiments. Technometrics 49 1-11.
15. Li, X., Sundarsanam, N. and Frey, D. (2006). Regularities in data from factorial experiments. Complexity 11 32-45.
16. McCullagh, P. (2002). What is a statistical model (with discussion). Ann. Statist. 30 1225-1310.
17. McCullagh, P. and Nelder, J. (1989). Generalized Linear Models, 2nd ed. Chapman & Hall, London.
18. Nelder, J. (1977). A reformulation of linear models. J. Roy. Statist. Soc. Ser. A140 48-77.
19. Nelder, J. (1994). The statistics of linear models. Statist. Comput. 4 221-234.
20. Nelder, J. (1998). The selection of terms in response-surface models-how strong is the weak-heredity principle? Amer. Statist. 52 315-318.
21. Newman, D., Hettich, S., Blake, C. and Merz, C. (1998). UCI repository of machine learning databases. Dept. Information and Computer Science, Univ. California, Irvine, CA. Available at http://www.ics.uci.edu/~mlearn/MLRepository.html.
22. Osborne, M., Presnell, B. and Turlach, B. (2000). A new approach to variable selection in least squares problems. IMA J. Numer. Anal. 20 389-403.
23. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B 58 267-288.
24. Turlach, B. (2004). Discussion of "Least angle regression". Ann. Statist. 32481-490.
25. Yuan, M., Joseph, V. R. and Lin, Y. (2007). An efficient variable selection approach for analyzing designed experiments. Technometrics 49 430-439.
26. Yuan, M. and Lin, Y. (2006). Model selection and estimation in regression with grouped variables. J. Roy. Statist. Soc. Ser. B 68 49-67.
27. Yuan, M. and Lin, Y. (2007). On the the nonnegative garrote estimator. J. Roy. Statist. Soc. Ser. B 69 143-161.
28. Zhao, P., Rocha, G. and Yu, B. (2009). The composite absolute penalties family for grouped and hierarchical variable selection. Ann. Statist. 373468-3497.