The group lasso for logistic regression

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 70, Issue 1, 2008, Pages 53-71

  Meier, Lukas ^a   Van De Geer, Sara ^a   Bühlmann, Peter ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Categorical data; Co ordinate descent algorithm; DNA splice site; Group variable selection; High dimensional generalized linear model; Penalized likelihood

Indexed keywords

EID: 37849035696     PISSN: 13697412     EISSN: 14679868     Source Type: Journal    
DOI: 10.1111/j.1467-9868.2007.00627.x     Document Type: Article

References (28)

1. Antoniadis, A. Fan, J. (2001) Regularization of wavelet approximations (with discussion). J. Am. Statist. Ass., 96, 939 967.
2. Bakin, S. (1999) Adaptive regression and model selection in data mining problems. PhD Thesis. Australian National University, Canberra.
3. Balakrishnan, S. Madigan, D. (2006) Algorithms for sparse linear classifiers in the massive data setting. Rutgers University, Piscataway. (Available from http://www.stat.rutgers.edu/∼madigan/PAPERS/.) 2003) Nonlinear Programming. Belmont: Athena Scientific.
4. Burge, C 1998) Modeling dependencies in pre-mrna splicing signals. In Computational Methods in Molecular Biology (eds S. Salzberg, D. Searls S. Kasif), ch. 8, pp. 129 164. New York : Elsevier Science.
5. Burge, C. Karlin, S. (1997) Prediction of complete gene structures in human genomic DNA. J. Molec. Biol., 268, 78 94.
6. Cai, T. T. (2001) Discussion of ''Regularization of wavelet approximations'' (by A. Antoniadis and J. Fan). J. Am. Statist. Ass., 96, 960 962.
7. Efron, B., Hastie, T., Johnstone, I. Tibshirani, R. (2004) Least angle regression. Ann. Statist., 32, 407 499.
8. van de Geer, S. (2003) Adaptive quantile regression. In Recent Advances and Trends in Nonparametric Statistics (eds M. Akritas D. Politis pp. 235 250. New York : Elsevier.
9. van de Geer, S 2007) High-dimensional generalized linear models and the lasso. Ann. Statist., to be published.
10. Genkin, A., Lewis, D. D. Madigan, D. (2007) Large-scale bayesian logistic regression for text categorization. Technometrics, 49, 291 304.
11. Kim, Y., Kim, J. Kim, Y. (2006) Blockwise sparse regression. Statist. Sin., 16, 375 390.
12. King, G. Zeng, L. (2001) Logistic regression in rare events data. Polit. Anal., 9, 137 163.
13. Krishnapuram, B., Carin, L., Figueiredo, M. A. Hartemink, A. J. (2005) Sparse multinomial logistic regression: fast algorithms and generalization bounds. IEEE Trans. Pattn Anal. Mach. Intell., 27, 957 968.
14. Lokhorst, J. (1999) The lasso and generalised linear models. Honors Project. University of Adelaide, Adelaide.
15. Meinshausen, N 2007) Lasso with relaxation. Computnl Statist. Data Anal., 52, 374 393.
16. Osborne, M., Presnell, B. Turlach, B. (2000) A new approach to variable selection in least squares problems. IMA J. Numer. Anal., 20, 389 403.
17. 1-regularization path algorithm for generalized linear models. J. R. Statist. Soc. B, 69, 659 677.
18. Rosset, S 2005) Following curved regularized optimization solution paths. In Advances in Neural Information Processing Systems, vol. 17 (eds L. K. Saul, Y. Weiss L. Bottou pp. 1153 1160. Cambridge : MIT Press.
19. Roth, V. (2004) The generalized lasso. IEEE Trans. Neur. Netwrks, 15, 16 28.
20. Shevade, S. Keerthi, S. (2003) A simple and efficient algorithm for gene selection using sparse logistic regression. Bioinformatics, 19, 2246 2253.
21. 1 complexity regularization. Bernoulli, 12, 1045 1076.
22. Tibshirani, R. (1996) Regression shrinkage and selection via the lasso. J. R. Statist. Soc. B, 58, 267 288.
23. Tibshirani, R. (1997) The lasso method for variable selection in the cox model. Statist. Med., 16, 385 395.
24. Tseng, P. (2001) Convergence of a block coordinate descent method for nondifferentiable minimization. J. Optimizn Theory Appl., 109, 475 494.
25. Tseng, P Yun, S 2007) A coordinate gradient descent method for nonsmooth separable minimization. Math. Programmng B, to be published.
26. Yeo, G. W. Burge, C. B. (2004) Maximum entropy modeling of short sequence motifs with applications to RNA splicing signals. J. Computnl Biol., 11, 475 494.
27. Yuan, M. Lin, Y. (2006) Model selection and estimation in regression with grouped variables. J. R. Statist. Soc. B, 68, 49 67.
28. Zhao, P. Yu, B. (2007) Stagewise lasso. J. Mach. Learn. Res., to be published.