Adaptive Lasso for sparse high-dimensional regression models

Statistica Sinica

Volumn 18, Issue 4, 2008, Pages 1603-1618

  Huang, Jian ^a   Ma, Shuangge ^b   Zhang, Cun Hui ^c  

^a UNIVERSITY OF IOWA   (United States)

^b YALE UNIVERSITY   (United States)

^c RUTGERS UNIVERSITY   (United States)

Author keywords

Asymptotic normality; High dimensional data; Oracle property; Penalized regression; Variable selection; Zero consistency

Indexed keywords

EID: 51049096710     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (23)

1. Bair, E., Hastie, T., Paul, D. and Tibshirani, R. (2006). Prediction by supervised principal components. J. Amer. Statist. Assoc. 101, 119-137.
2. Bolstad, B. M., Irizarry R. A., Astrand, M. and Speed, T. P. (2003). A comparison of normalization methods for high density oligonucleotide array data based on bias and variance. Bioinformatics 19, 185-193
3. Candes, E. and Tao, T. (2005). The Dantzig selector: statistical estimation when p is much larger than n. Preprint, Department of Computational and Applied Mathematics, Caltech. Accepted for publication by the Ann. Statist.
4. Chiang, A. P., Beck, J. S., Yen, H.-J., Tayeh, M. K., Scheetz, T. E., Swiderski, R., Nishimura, D., Braun, T. A., Kim, K.-Y., Huang, J., Elbedour, K., Carmi, R., Slusarski, D. C, Casavant, T. L., Stone, E. M. and Sheffield, V. C. (2006). Homozygosity Mapping with SNP Arrays Identifies a Novel Gene for Bardet-Biedl Syndrome (BBS10). Proc. Nat. Acad. Sci. 103, 6287-6292.
5. Efron, B., Hastie, T., Johnstone, I. and Tibshirani, R. (2004). Least angle regression (with discussion). Ann. Statist. 32, 407-499.
6. Fan, J. (1997). Comments on "Wavelets in statistics: A review," by A. Antoniadis. J. ITalian Statist. Sco. 6, 131-138.
7. Fan, J. and Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. J. Amer. Statist. Assoc. 96, 1348-1360.
8. Fan, J. and Peng, H. (2004). Nonconcave penalized likelihood with a diverging number of parameters. Ann. Statist. 32, 928-961.
9. Fan, J. and Lv, J. (2006). Sure independence screening for ultra-high dimensional feature space. Preprint, Department of Operational Research & Financial Engineering, Princeton University.
10. Frank, I. E. and Friedman, J. H. (1993). A statistical view of some chemometrics regression tools (with discussion). Technometrics 35, 109-148.
11. Greenshtein, E. and Ritov, Y. (2004). Persistence in high-dimensional linear predictor selection and the virtue of overparametrization. Bernoulli 10, 971-988.
12. Hoerl, A. E. and Kennard, R. W. (1970). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 12, 55-67.
13. Huang, J., Horowitz, J. L. and Ma, S. G. (2008). Asymptotic properties of bridge estimators in sparse high-dimensional regression models. Ann. Statist. 36, 587-613.
14. Irizarry, R. A., Hobbs, B., Collin, F., Beazer-Barclay, Y. D, Antonellis, K. J., Scherf, U. and Speed, T. P. (2003). Exploration, normalization, and summaries of high density oligonucleotide array probe level data. Biostatistics 4, 249-264.
15. Knight, K. and Fu, W. J. (2000). Asymptotics for Lasso-type estimators. Ann. Statist. 28, 1356-1378.
16. Leng, C., Lin, Y. and Wahba, G. (2004). A note on the Lasso and related procedures in model selection. Statistica Sinica 16, 1273-1284.
17. Meinshausen, N. and Buhlmann, P. (2006). High dimensional graphs and variable selection with the Lasso. Ann. Statist. 34, 1436-1462.
18. Scheetz, T. E., Kim, K.-Y. A., Swiderski, R. E., Philpl, A. R., Braun, T. A., Knudtson, K. L., Dorrance, A. M., DiBona, G. F., Huang, J., Casavant, T. L., Sheffield, V. C. and Stone, E. M. (2006). Regulation of gene expression in the mammalian eye and its relevance to eye disease. Proc. Nat. Acad. Sci. 103, 14429-14434.
19. Tibshirani, R. (1996). Regression shrinkage and selection via the Lasso. J. Roy. Statist. Soc. Ser. B 58, 267-288.
20. Zhang, C.-H. and Huang, J. (2008). Model-selection consistency of the LASSO in highdimensional linear regression. Ann. Statist. 36, 1567-1594.
21. Zhao, P. and Yu, B. (2007). On model selection consistency of Lasso. J. Machine Learning Res. 7, 2541-2567.
22. Zou, H. (2006). The adaptive Lasso and its oracle properties. J. Amer. Statist. Assoc. 101, 1418-1429.
23. Zou, H. and Hastie, T. (2005). Regularization and variable selection via the elastic net. J. Roy. Statist. Soc. Ser. B 67, 301-320.