High-dimensional generalized linear models and the Lasso

Annals of Statistics

Volumn 36, Issue 2, 2008, Pages 614-645

  Van De Geer, Sara A ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Lasso; Oracle inequality; Sparsity

Indexed keywords

EID: 51049121146     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/009053607000000929     Document Type: Article

References (27)

1. BOUSQUET, O. (2002). A Bennet concentration inequality and its application to suprema of empirical processes. C. R. Math. Acad. Sci. Paris 334 495-550. MR1890640
2. 1-penalized least squares. In Proceedings of 19th Annual Conference on Learning Theory, COLT 2006. Lecture Notes in Comput. Sci. 4005 379-391. Springer. Berlin. MR2280619
3. 1 penalties. COLT 2007 4539 530-543.
4. BUNEA, F., TSYBAKOV, A. B. and WEGKAMP, M. H. (2007b). Sparsity oracle inequalities for the Lasso. Electron. J. Statist. 1 169-194. MR2312149
5. DAHINDEN, C., PARMIGIANI, G., EMERICK, M. C. and BÜHLMANN, P. (2008). Penalized likelihood for sparse contingency tables with an application to full length cDNA libraries. BMC Bioinformatics. To appear.
6. DONOHO, D. L. ( 1995). De-noising by soft-thresholding. IEEE Trans. Inform. Theory 41 613-627. MR1331258
7. 1-norm near-solution approximates the sparsest near-solution. Comm. Pure Appl. Math. 59 907-934. MR2222440
8. 1-norm solution is also the sparsest solution. Comm. Pure Appl. Math. 59 797-829. MR2217606
9. 1 constraint. Ann. Statist. 34 2367-2386. MR2291503
10. HASTIE, T., TIBSHIRANI, R. and FRIEDMAN, J. (2001). The Elements of Statistical Learning. Data Mining, Inference and Prediction. Springer, New York. MR1851606
11. LEDOUX, M. (1996). Talagrand deviation inequalities for product measures. ESAIM Probab. Statist. 163-87. MR1399224
12. LEDOUX, M. and TALAGRAND, M. (1991). Probability in Banach Spaces: Isoperimetry and Processes. Springer, Berlin. MR1102015
13. LOUBES, J.-M. and VAN DE GEER, S. (2002). Adaptive estimation in regression, using soft thresholding type penalties. Statist. Neerl. 56 453-478.
14. MASSART, P. (2000a). About the constants in Talagrand's concentration inequalities for empirical processes. Ann. Probab. 28 863-884. MR1782276
15. MASSART, P. (2000b). Some applications of concentration inequalities to statistics. Ann. Fac. Sci. Toulouse Math. (6) 9 245-303. MR1813803
16. MEIER, L.. VAN DE GEER, S. and BÜHLMANN, P. (2008). The group Lasso for logistic regression. Research Report 131, ETH Zürich. J. Roy. Statist. Soc. Ser. B. To appear.
17. MEINSHAUSEN, N. (2007). Relaxed Lasso. Comput. Statist. Data Anal. 52 374-393.
18. MEINSHAUSEN, N. and BÜHLMANN, P. (2006). High-dimensional graphs and variable selection with the Lasso. Ann. Statist. 34 1436-1462. MR2278363
19. MEINSHAUSEN, N. and YU, B. (2007). Lasso-type recovery of sparse representations for high-dimensional data. Technical Report 720, Dept. Statistics, UC Berkeley.
20. ROCKAFELLER, R. T. (1970). Convex Analysis. Princeton Univ. Press. MR0274683
21. 1 complexity regularization. Bernoulli 12 1045-1076. MR2274857
22. TIBSHIRANI, R. (1996). Regression analysis and selection via the Lasso. J. Roy. Statist. Soc. Ser. B 58 267-288. MR 1379242
23. TSYBAKOV, A. B. (2004). Optimal aggregation of classifiers in statistical learning. Ann. Statist. 32 135-166. MR2051002
24. VAN DE GEER, S. (2000). Empirical Processes in M-Estimation. Cambridge Univ. Press.
25. VAN DE GEER, S. (2003). Adaptive quantile regression. In Recent Advances and Trends in Nonparametric Statistics (M. G. Akritas and D. N. Politis, eds.) 235-250. North-Holland, Amsterdam.
26. ZHANG, C.-H. and HUANG, J. (2006). Model-selection consistency of the Lasso in high-dimensional linear regression. Technical Report 2006-003, Dept. Statistics, Rutgers Univ.
27. ZHAO, P. and YU, B. (2006). On model selection consistency of Lasso. J. Mach. Learn. Res. 7 2541-2563. MR2274449