Forward regression for Ultra-High dimensional variable screening

Journal of the American Statistical Association

Volumn 104, Issue 488, 2009, Pages 1512-1524

  Wang, Hansheng ^a  

^a Peking University   (China)

Author keywords

Adaptive LASSO; BIC; Forward regression; LASSO; SCAD; Screening consistency; Ultra High dimensional predictor

Indexed keywords

EID: 74049114100     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/jasa.2008.tm08516     Document Type: Article

References (26)

1. Barron, A. R., and Cohen, A. (2008), "Approximation and Learning by Greedy Algorithms," The Annals of Statistics, 36, 64-94.
2. Bickel, P. J., and Levina, E. (2008), "Regularized Estimation of Large Covariance Matrices," The Annals of Statistics, 36, 199-227.
3. Breiman, L. (1995), "Better Subset Selection Using Nonnegative Garrote," Technometrics, 37, 373-384.
4. Candes, E., and Tao, T. (2007), "The Dantzig Selector: Statistical Estimation When p Is Much Larger Than n," The Annals of Statistics, 35, 2313-2351.
5. Chen, J., and Chen, Z. (2008), "Extended Bayesian Information Criterion for Model Selection With Large Model Spaces," Biometrika, 95, 759-771.
6. Donoho, D., and Stodden, V. (2006), "Breakdown Point of Model Selection When the Number of Variables Exceeds the Number of Observations," in Proceedings ofthe International Joint Conference on Neural Networks,Los Alamitos, CA: IEEE, pp. 1916-1921.
7. Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), "Least Angle Regression," The Annals of Statistics, 32, 407-489.
8. Fan, J., and Li, R. (2001), "Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties," Journal ofthe American Statistical Association, 96, 1348-1360.
9. - (2006), "Statistical Challenges With High Dimensionality: Feature Selection in Knowledge Discovery," in Proceedings of the International Congress ofMathematicians, Vol. III, eds. M. Sanz-Sole, J. Soria, J. L. Varona, and J. Verdera, Zurich: European Mathematical Society, pp. 595-622.
10. Fan, J., and Lv, J. (2008), "Sure Independence Screening for Ultra - High Dimensional Feature Space" (with discussion), Journal ofthe Royal Statistical Society, Ser. B, 70, 849-911.
11. Fan, J., and Peng, H. (2004), "On Non-Concave Penalized Likelihood With Diverging Number of Parameters," The Annals of Statistics, 32, 928-961.
12. Fu, W. J. (1998), "Penalized Regression: The Bridge versus the LASSO," Journal ofComputational and Graphical Statistics, 7, 397-416.
13. Huang, J., Horowitz, J., and Ma, S. (2008), "Asymptotic Properties of Bridge Estimators in Sparse High - Dimensional Regression Models," The Annals of Statistics, 36, 587-613.
14. Huang, J., Ma, S., and Zhang, C. H. (2007), "Adaptive LASSO for Sparse High Dimensional Regression," Statistica Sinica, 18, 1603-1618.
15. Hunter, D. R., and Li, R. (2005), "Variable Selection Using MM Algorithms," The Annals of Statistics, 33, 1617-1642.
16. Jia, J., and Yu, B. (2008), "On Model Selection Consistency of the Elastic Net When p > n," unpublished manuscript, UC - Berkeley, Dept. of Statistics. Kong, E., and Xia, Y. (2007), "Variable Selection for Single - Index Model," Biometrika, 94, 217-229.
17. Leng, C., Lin, Y., and Wahba, G. (2006), "A Note on LASSO and Related Procedures in Model Selection," Statistica Sinica, 16, 1273-1284.
18. McCullagh, P., and Nelder, J. A. (1989), Generalized Linear Models,New York: Chapman & Hall. Tibshirani, R. J. (1996), "Regression Shrinkage and Selection via the LASSO," Journal ofthe Royal Statistical Society, Ser. B, 58, 267-288.
19. Yuan, M., and Lin, Y. (2007), "On the Nonnegative Garrote Estimator," Journal of the Royal Statistical Society, Ser. B, 69, 143-161.
20. Zhang, C. H., and Huang, J. (2008), "The Sparsity and Bias of the LASSO Selection in High - Dimensional Linear Regression," The Annals of Statistics, 36, 1567-1594.
21. Zhang, H. H., and Lu, W. (2007), "Adaptive LASSO for Cox's Proportional Hazard Model," Biometrika, 94, 691-703.
22. Zhao, P., and Yu, B. (2006), "On Model Selection Consistency of LASSO," Journal of Machine Learning Research, 7, 2541-2567.
23. Zou, H. (2006), "The Adaptive LASSO and Its Oracle Properties," Journal of the American Statistical Association, 101, 1418-1429.
24. Zou, H., and Hastie, T. (2005), "Regression Shrinkage and Selection via the Elastic Net With Application to Microarrays," Journal of the Royal Statistical Society, Ser. B, 67, 301-320.
25. Zou, H., and Li, R. (2008), "One - Step Sparse Estimates in Nonconcave Penalized Likelihood Models" (with discussion), The Annals of Statistics, 36, 1509-1533.
26. Zou, H., and Zhang, H. H. (2009), "On the Adaptive Elastic-Net With a Diverging Number of Parameters," The Annals of Statistics, 37, 1733-1751.