Simultaneous analysis of lasso and dantzig selector

Annals of Statistics

Volumn 37, Issue 4, 2009, Pages 1705-1732

  Bickel, Peter J ^a   Ritov, Ya'acov ^b   Tsybakov, Alexandre B ^c,d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^c CREST   (France)

^d University of Paris VII LPSM partially supported by ERC Starting Grant 680275 MALIG   (France)

Author keywords

Linear models; Model selection; Nonparametric statistics

Indexed keywords

EID: 68649086910     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/08-AOS620     Document Type: Article

References (27)

1. BICKEL, P. J. (2007). Discussion of "The Dantzig selector: Statistical estimation when p is much larger than n," by E. Candes and T. Tao. Ann. Statist. 35 2352-2357. MR2382645
2. BUNEA, F., TSYBAKOV, A. B. and WEGKAMP, M. H. (2004). Aggregation for regression learning. Preprint LPMA, Univ. Paris 6-Paris 7, n? 948. Available at arXiv:math. ST/0410214 and at https://hal.ccsd.cnrs.fr/ ccsd-00003205.
3. BUNEA, F., TSYBAKOV, A. B. and WEGKAMP, M. H. (2006). Aggregation and sparsity via -1 penalized least squares. In Proceedings of 19th Annual Conference on Learning Theory (COLT 2006) (G. Lugosi and H. U. Simon, eds.). Lecture Notes in Artificial Intelligence 4005 379-391. Springer, Berlin. MR2280619
4. BUNEA, F., TSYBAKOV, A. B. and WEGKAMP, M. H. (2007). Aggregation for Gaussian regression. Ann. Statist. 35 1674-1697. MR2351101
5. BUNEA, F., TSYBAKOV, A. B. and WEGKAMP, M. H. (2007). Sparsity oracle inequalities for the Lasso. Electron. J. Statist. 1 169-194. MR2312149
6. BUNEA, F., TSYBAKOV, A. B. and WEGKAMP, M. H. (2007). Sparse density estimation with -1 penalties. In Proceedings of 20th Annual Conference on Learning Theory (COLT 2007) (N. H. Bshouty and C. Gentile, eds.). Lecture Notes in Artificial Intelligence 4539 530-543. Springer, Berlin. MR2397610
7. CANDES, E. and TAO, T. (2007). The Dantzig selector: Statistical estimation when p is much larger than n. Ann. Statist. 35 2313-2351. MR2382644
8. DONOHO, D. L., ELAD, M. and TEMLYAKOV, V. (2006). Stable recovery of sparse overcomplete representations in the presence of noise. IEEE Trans. Inform. Theory 52 6-18. MR2237332
9. EFRON, B., HASTIE, T., JOHNSTONE, I. and TIBSHIRANI, R. (2004). Least angle regression. Ann. Statist. 32 407-451. MR2060166
10. FRIEDMAN, J., HASTIE, T., HÖFLING, H. and TIBSHIRANI, R. (2007). Pathwise coordinate optimization. Ann. Appl. Statist. 1 302-332. MR2415737
11. FU, W. and KNIGHT, K. (2000). Asymptotics for Lasso-type estimators. Ann. Statist. 28 1356-1378. MR1805787
12. GREENSHTEIN, E. and RITOV, Y. (2004). Persistency in high dimensional linear predictorselection and the virtue of over-parametrization. Bernoulli 10 971-988. MR2108039
13. JUDITSKY, A. and NEMIROVSKI, A. (2000). Functional aggregation for nonparametric estimation. Ann. Statist. 28 681-712. MR1792783
14. KOLTCHINSKII, V. (2006). Sparsity in penalized empirical risk minimization. Ann. Inst. H. Poincaré Probab. Statist. To appear.
15. KOLTCHINSKII, V. (2007). Dantzig selector and sparsity oracle inequalities. Unpublished manuscript.
16. MEIER, L., VAN DE GEER, S. and BÜHLMANN, P. (2008). The Group Lasso for logistic regression. J. Roy. Statist. Soc. Ser. B 70 53-71.
17. MEINSHAUSEN, N. and BÜHLMANN, P. (2006). High-dimensional graphs and variable selection with the Lasso. Ann. Statist. 34 1436-1462. MR2278363
18. MEINSHAUSEN, N. and YU, B. (2006). Lasso type recovery of sparse representations for high dimensional data. Ann. Statist. To appear.
19. NEMIROVSKI, A. (2000). Topics in nonparametric statistics. In Ecole d'Eté de Probabilités de Saint-Flour XXVIII-1998. Lecture Notes in Math. 1738. Springer, New York. MR1775640
20. OSBORNE, M. R., PRESNELL, B. and TURLACH, B. A (2000a). On the Lasso and its dual. J. Comput. Graph. Statist. 9 319-337. MR1822089
21. OSBORNE, M. R., PRESNELL, B. and TURLACH, B. A (2000b). A new approach to variable selection in least squares problems. IMA J. Numer. Anal. 20 389-404.
22. TIBSHIRANI, R. (1996). Regression shrinkage and selection via the Lasso. J. Roy. Statist. Soc. Ser. B 58 267-288. MR1379242
23. TSYBAKOV, A. B. (2006). Discussion of "Regularization in Statistics," by P. Bickel and B. Li. TEST 15 303-310. MR2273731
24. TURLACH, B. A. (2005). On algorithms for solving least squares problems under an L1 penalty or an L1 constraint. In 2004 Proceedings of the American Statistical Association, Statistical Computing Section [CD-ROM] 2572-2577. Amer. Statist. Assoc., Alexandria, VA.
25. VAN DE GEER, S. A. (2008). High dimensional generalized linear models and the Lasso. Ann. Statist. 36 614-645. MR2396809
26. ZHANG, C.-H. and HUANG, J. (2008). Model-selection consistency of the Lasso in highdimensional regression. Ann. Statist. 36 1567-1594. MR2435448
27. ZHAO, P. and YU, B. (2006). On model selection consistency of Lasso. J. Mach. Learn. Res. 7 2541-2563. MR2274449