Learning exponential families in high-dimensions: Strong convexity and sparsity

Journal of Machine Learning Research

Volumn 9, Issue , 2010, Pages 381-388

  Kakade, Sham M ^a   Shamir, Ohad ^b   Sridharan, Karthik ^c   Tewari, Ambuj ^c  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^c TOYOTA TECHNOLOGICAL INSTITUTE AT CHICAGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONVEXITY PROPERTIES; EXPONENTIAL FAMILY; GENERALIZATION ABILITY; HIGH DIMENSIONS; L1 REGULARIZATIONS; OPTIMAL PARAMETER; STATISTICAL MODELS;

SOFTWARE ENGINEERING;

ARTIFICIAL INTELLIGENCE;

EID: 84861312320     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (15)

1. Francis Bach. Self-concordant analysis for logistic regression. CoRR, abs/0910.4627, 2009.
2. S. Bernstein. The Theory of Probabilities. Gastehizdat Publishing House, Moscow, 1946.
3. Peter J. Bickel, Ya'acov Ritov, and Alexandre B. Tsybakov. Simultaneous analysis of Lasso and Dantzig selector. Annals of Statistics, 37(4):1705-1732, 2008.
4. 2 penalization. Electronic Journal of Statistics, 2:1153-1194, 2008.
5. Emmanuel Candes and Terence Tao. The Dantzig selector: Statistical estimation when p is much larger than n. Annals of Statistics, 35:2313, 2007.
6. A.J. Dobson. An Introduction to Generalized Linear Models. Chapman and Hall, 1990.
7. Subhashis Ghosal. Asymptotic normality of posterior distributions for exponential families when the number of parameters tends to infinity. J. Multivar. Anal., 74(1): 49-68, 2000. ISSN 0047-259X.
8. Nicolai Meinshausen and Bin Yu. Lasso-type recovery of sparse representations for high-dimensional data. Annals of Statistics, 37:246, 2009.
9. S. Negahban, P. Ravikumar, M. Wainwright, and B. Yu. A unified framework for high-dimensional analysis of m-estimators with decomposable regularizers. In NIPS, 2009.
10. S. Portnoy. Asymptotic behavior of likelihood methods for exponential families when the number of parameters tends to infinity. Annals of Statistics, 16, 1988.
11. P. Ravikumar, M. J. Wainwright, and J. Lafferty. High-dimensional ising model selection using l1-regularized logistic regression. Technical Report Technical Report 750, UC Berkeley, Department of Statistics., 2008a.
12. Pradeep Ravikumar, Martin J Wainwright, Garvesh Raskutti, and Bin Yu. High-dimensional covariance estimation by minimizing l1-penalized log-determinant divergence. Technical Report arXiv:0811.3628, Nov 2008b.
13. Sara A. van de Geer. High-dimensional generalized linear models and the lasso. Annals of Statistics, 36(2):614-645, 2008.
14. T. Zhang. Adaptive forward-backward greedy algorithm for sparse learning with linear models. In Advances in Neural Information Processing Systems 22, 2008.
15. P. Zhao and B. Yu. On model selection consistency of lasso. Journal of Machine Learning Research, 7:2541-2567, 2006.