Strong consistency of lasso estimators

Sankhya: The Indian Journal of Statistics

Volumn 73, Issue 1, 2011, Pages 55-78

  Chatterjee, A ^a   Lahiri, S N ^b  

^a INDIAN STATISTICAL INSTITUTE   (India)

^b TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Convergence rates; Penalized regression; Strong law

Indexed keywords

EID: 80054714071     PISSN: 09727671     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (18)

1. Athreya, K. B. and Lahiri, S. N. (2006). Measure theory and Probability theory. Springer Texts in Statistics, Springer, New York.
2. Bickel, P. J., Ritov, Y. and Tsybakov, A. B. (2009). Simultaneous analysis of lasso and dantzig selector. Ann. Statist., 37, 1705-1732.
3. Drygas, H. (1976). Weak and strong consistency of the least squares estimators in regression models. Z. Wahrscheinlichkeitstheorie und Verw. Gebiete, 34, 119-127.
4. Efron, B., Hastie, T., Johnstone, I. and Tibshirani, R. (2004). Least angle regression. Ann. Statist., 32, 407-499. With discussion, and a rejoinder by the authors.
5. Fu, W. J. (1998). Penalized regressions: the bridge versus the lasso. J. Comput. Graph. Statist., 7, 397-416.
6. Huang, J., Horowitz, J. L. and Ma, S. (2008). Asymptotic properties of bridge estimators in sparse high-dimensional regression models. Ann. Statist., 36, 587-613.
7. Knight, K. and Fu, W. (2000). Asymptotics for lasso-type estimators. Ann. Statist., 28, 1356-1378.
8. Lai, T. L., Robbins, H. and Wei, C. Z. (1978). Strong consistency of least squares estimates in multiple regression. Proc. Nat. Acad. Sci. U.S.A., 75, 3034-3036.
9. Lounici, K. (2008). Sup-norm convergence rate and sign concentration property of Lasso and Dantzig estimators. Electron. J. Stat., 2, 90-102.
10. Meinshausen, N. and Bühlmann, P. (2006). High-dimensional graphs and variable selection with the lasso. Ann. Statist., 34, 1436-1462.
11. Meinshausen, N. and Yu, B. (2009). Lasso-type recovery of sparse representations for high-dimensional data. Ann. Statist., 37, 246-270.
12. Osborne, M. R., Presnell, B. and Turlach, B. A. (2000). On the LASSO and its dual. J. Comput. Graph. Statist., 9, 319-337.
13. Rao, C. R. (1973). Linear statistical inference and its applications. John Wiley & Sons, New York London-Sydney, second edition. Wiley Series in Probability and Mathematical Statistics.
14. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc., Ser. B, 58, 267-288.
15. Wainwright, M. J. (2006). Sharp thresholds for high-dimensional and noisy recovery of sparsity. Technical report, Dept. of Statistics, UC Berkeley. Preprint available at http://arxiv.org/abs/math/0605740.
16. Zhang, C.-H. and Huang, J. (2008). The sparsity and bias of the lasso selection in high-dimensional linear regression. Ann. Statist., 36, 1567-1594.
17. Zhao, P. and Yu, B. (2006). On model selection consistency of Lasso. J. Mach. Learn. Res., 7, 2541-2563.
18. Zou, H. (2006). The adaptive lasso and its oracle properties. J. Amer. Statist. Assoc., 101, 1418-1429.