Regularization and variable selection via the elastic net

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 67, Issue 2, 2005, Pages 301-320

  Zou, Hui ^a   Hastie, Trevor ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

Grouping effect; LARS algorithm; Lasso; P n problem; Penalization; Variable selection

Indexed keywords

EID: 16244401458     PISSN: 13697412     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1467-9868.2005.00503.x     Document Type: Article

References (26)

1. Breiman, L. (1996) Heuristics of instability and stabilization in model selection. Ann. Statist., 24, 2350-2383.
2. Detlling, M. and Bühlmann, P. (2004) Finding predictive gene groups from microarray data. J. Multiv. Anal., 90, 106-131.
3. Diaz-Uriarte, R. (2003) A simple method for finding molecular signatures from gene expression data. Technical Report. Spanish National Cancer Center. (Available from http://www.arxiv.org/abs/q-bio.QM/0401043.)
4. Donoho, D. L., Johnstone, I. M., Kerkyacharian, G. and Picard, D. (1995) Wavelet shrinkage: asymptopia (with discussion)? J. R. Statist. Soc. B, 57, 301-369.
5. Efron, B., Hastie, T., Johnstone, I. and Tibshirani, R. (2004) Least angle regression. Ann. Statist., 32, 407-499.
6. Fan, J. and Li, R. (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. J. Am. Statist. Ass., 96, 1348-1360.
7. Frank, I. and Friedman, J. (1993) A statistical view of some chemometrics regression tools. Technometrics, 35, 109-148.
8. Friedman, J. (1989) Regularized discriminant analysis. J. Am. Statist. Ass., 84, 249-266.
9. Friedman, J., Hastie, T., Rosset, S., Tibshirani, R. and Zhu, J. (2004) Discussion of boosting papers. Ann. Statist., 32,102-107.
10. Fu, W. (1998) Penalized regression: the bridge versus the lasso. J. Computnl Graph. Statist., 7, 397-416.
11. Golub, G. and Van Loan, C. (1983) Matrix Computations. Baltimore: Johns Hopkins University Press.
12. Golub, T., Slonim, D., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J., Coller, H., Loh, M., Downing, J. and Caligiuri, M. (1999) Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science, 286, 513-536.
13. Guyon, I., Weston, J., Barnhill, S. and Vapnik, V. (2002) Gene selection for cancer classification using support vector machines. Mach. Learn., 46, 389-422.
14. Hastie, T., Tibshirani, R., Botstein, D. and Brown, P. (2003) Supervised harvesting of expression trees. Genome Biol., 2, 0003.1-0003.12.
15. Hastie, T., Tibshirani, R., Eisen, M., Brown, P., Ross, D., Scherf, U., Weinstein, J., Alizadeh, A., Staudt, L. and Botstein, D. (2000) 'Gene shaving' as a method for identifying distinct sets of genes with similar expression patterns. Genome Biol., 1, 1-21.
16. Hastie, T., Tibshirani, R. and Friedman, J. (2001) The Elements of Statistical Learning; Data Mining, Inference and Prediction. New York: Springer.
17. Hoerl, A. and Kennard, R. (1988) Ridge regression. In Encyclopedia of Statistical Sciences, vol. 8, pp. 129-136, New York: Wiley.
18. Rosset, S., Zhu, J. and Hastie, T. (2004) Boosting as a regularized path to a maximum margin classifier. J. Mach. Learn. Res., 5, 941-973.
19. Segal, M., Dahlquist, K. and Conklin, B. (2003) Regression approach for microarray data analysis. J. Computnl Biol., 10, 961-980.
20. Stamey, T, Kabalin, J., McNeal, J., Johnstone, L, Freiha, F., Redwine, E. and Yang, N. (1989) Prostate specific antigen in the diagnosis and treatment of adenocarcinoma of the prostate ii: radical prostatectomy treated patients. J. Urol., 16, 1076-1083.
21. Tibshirani, R. (1996) Regression shrinkage and selection via the lasso. J. R. Statist. Soc. B, 58, 267-288.
22. Tibshirani, R., Hastie, T., Narasimhan, B. and Chu, C. (2002) Diagnosis of multiple cancer types by shrunken centroids of gene expression. Proc. Natn. Acad. Sci. USA, 99, 6567-6572.
23. Tusher, V., Tibshirani, R. and Chu, C. (2001) Significance analysis of microarrays applied to transcriptional responses to ionizing radiation. Proc. Natn. Acad. Sci. USA, 98, 5116-5121.
24. West, M., Blanchettem, C., pressman, H., Huang, E., Ishida, S., Spang, R., Zuzan, H., Marks, J. and Nevins, J. (2001) Predicting the clinical status of human breast cancer using gene expression profiles. Proc. Natn. Acad. Sci. USA, 98, 11462-11467.
25. Zhang, T. (2004) Statistical behavior and consistency of classification methods based on convex risk minimization. Ann. Statist., 32, 469-475.
26. Zhu, J. and Hastie, T. (2004) Classification of gene microarrays by penalized logistic regression. Biostatistics, 5, 427-444.