On the asymptotic properties of the group lasso estimator for linear models

Electronic Journal of Statistics

Volumn 2, Issue , 2008, Pages 605-633

  Nardi, Yuval ^a   Rinaldo, Alessandro ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Group Lasso; Least squares; Model selection; Oracle inequalities; Persistence; Sparsity

Indexed keywords

EID: 77949526376     PISSN: 19357524     EISSN: None     Source Type: Journal    
DOI: 10.1214/08-EJS200     Document Type: Article

References (42)

1. Bach, F. (2007). Consistency of the group Lasso and multiple kernel learning, to appear in Journal of Machine Learning.
2. Bickel, P.J., Ritov, Y. and Tsybakov, A. B. (2007). A Simultaneous analysis of Lasso and Dantzig selector. Submitted to Annals of Statistics.
3. Bunea, F., Tsybakov, A. B. and Wegkamp, M. H. (2007). Aggregation for Gaussian regression, The Annals of Statistics, 35(4), 1674-1697.
4. Bunea, F., Tsybakov, A. and Wegkamp, M. (2007b). Sparsity oracle inequalities for the lasso, Electronic Journal of Statistics, 1, 169-194.
5. Cavalier, L., Golubev, G. K., Picard, D. and Tsybakov, A. B. (2002). Oracle inequalities for inverse problems, Annals of Statistics, 30 843-874.
6. Dahinden, C., Parmiggiani, G., Emerick, M.C. and Bühlmann, P. (2006). Sparse Contingency Tables and High-Dimensional Log-Linealr Models for Alternative Splicing in Full-Length cDNA Libraries, Research Report 132, Swiss Federal Institute of Technology.
7. Efron, B., Hastie, T., Johnstone, I. and Tibshirani, R. (2004). Least angle regression, Annals of Statistics, 32, 407-499.
8. Fan, J. and Li, R. (2001). Variable selection via non-concave penalized likelihood and its oracle properties, Journal of the American Statistical Association, 96(456), 1348-1360.
9. Fan J. and Peng, H. (2004). Nonconcave penalized likelihood with a diverging number of parameters, Annals of Statistics, 32(3), 928-961.
10. Geyer, C. (1994). On the asymptotics of constrained-M estimation, Annals of Statistics, 22, 1993-2010.
11. Gilbert, A. C. and Strauss, M. J. (2006). Algorithms for Simultaneous Sparse Approximation Part II: Convex Relaxation, Signal Processing, 86, 572-588.
12. Greenshtein, E. and Ritov, Y. (2004). Persistence in high-dimensional predictor selection and the virtue of overparametrization, Bernoulli, 10, 971-988.
13. Greenshtein, E. (2006). Best subset selection, persistence in high-dimensional statistical learning and optimization under ℓ1 constraint, Annals of Statistics, 34(5), 2367-2386.
14. Kim, Y., Kim, J. and Kim, Y. (2006). Blockwise sparse regression. Statistica Sinica, 16(2).
15. Knight, K. and Fu, W. (2000). Asymptotics for Lasso-type estimators, Annals of Statistics, 28(5), 1356-1378.
16. Koltchinskii, V. (2005). Sparsity in Penalized Empirical Risk Minimization, manuscript.
17. Ledoux, M. and Talagrand, M. (1991). Probability in Banach spaces: isoperimetry and processes. Springer-Verlag.
18. Lounici, K. (2008). Sup-norm convergence rate and sign concentration property of Lasso and Dantzig estimators, Electronic Journal of Statistics, 2, 90-102.
19. Massart, P. (2007). Concentration Inequalities and Model Selection, Lecture Notes in Mathematics, Vol. 1896, Springer.
20. Meier, L., van der Geer, S. and Bühlmann, P. (2006). The Group Lasso for Logistic Regression, Journal of the Royal Statistical Society, Series B, 70(1), 53-7.
21. Meinshausen, N. and Bühlmann, P. (2006). High dimensional graphs and variable selection with the lasso, Annals of Statistics, 34(3), 1436-1462.
22. Meinshausen, N. and Yu, B. (2006). Lasso-type recovery of sparse representations for high-dimensional data, to appear in the Annals of Statistics.
23. Nardi, N. and Rinaldo, A. (2007). The Log-linear Group-Lasso Estimator and Its Asymptotic Properties, manuscript.
24. Osborne, M.R., Presnell, B. and Turlach, B.A. (2000). On the LASSO and its Dual, Journal of Computational and Graphical Statistics, 9(2), 319-337.
25. Portnoy, S. (1988). Asymptotic behavior of likelihood methods for exponential families when the number of parameters tends to infinity, Annals of Statistics, 16(1), 356-366.
26. Ravikumar, P., Lafferty, J., Liu, H. and Wasserman, L. (2007). Sparse Additive Models, manuscript.
27. Rinaldo (2006). Computing Maximum Likelihood Estimates in Log-Linear Models, Technical report, Department of Statistics, Carnegie Mellon University.
28. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso, Journal of the Royal Statistical Society, Series B, 58(1), 267-288.
29. van de Geer, S.A. (2007). Oracle inequalities and Regularization, in Lectures on Empirical Processes, European Mathematical Society.
30. van der Vaart, A.W. and Wellner, J.A. (1998). Weak Convergence and Empirical Processes, Springer.
31. Wainwright, M. J. (2006). Sharp thresholds for high-dimensional and noisy recovery of sparsity, Technical Report 708, Department of Statistics, UC Berkeley.
32. Wainwright, M. J. (2007). Information-theoretic limits on sparsity recovery in the high-dimensional and noisy setting, Technical Report, UC Berkeley, Department of Statistics.
33. Yuan, M. and Lin Y. (2006). Model selection and estimation in regression with grouped variables, Journal of the Royal Statistical Society, B, 68(1), 49-67.
34. Yuan, M. and Lin Y. (2006). On the non-negative garrotte estimator, Journal of the Royal Statistical Society, B, 69(2), 143-161.
35. Zhang, T. (2007). Some Sharp Performance Bounds for Least Squares Regression with Regularization, manuscript.
36. Zhang, H. and Huang, J. (2007). The sparsity and bias of the Lasso selection in high-dimensional linear regression, to appear in the Annals of Statistics.
37. Zhao, P., Rocha, G. and Yu, B. (2008). Grouped and hierarchical model selection through composite absolute penalties, manuscript.
38. Zhao, P. and Yu, B. (2006). On Model Selection Consistency of Lasso, Journal of Machine Learning Research, 7, 2541-2563.
39. Zhou, S., Lafferty, J. and Wasserman, L. (2007). Compressed Regression, manuscript.
40. Zhou, N. and Zhu, J. (2007). Group Variable Selection via Hierarchical Lasso and Its Oracle Property, manuscript.
41. Zou, H. (2006). The adaptive lasso and its oracle properties, Journal of the American Statistical Association, 101(476), 1418-1429.
42. H. Zou and T. Hastie. Regularization and variable selection via the elastic net, Journal of the Royal Statistical Society, Series B, 67(2):301-320, 2005.