High-dimensional regression with noisy and missing data: Provable guarantees with non-convexity

Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011

Volumn , Issue , 2011, Pages

  Loh, Po Ling ^a   Wainwright, Martin J ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CONVEX OPTIMIZATION;

GLOBAL MINIMIZERS; GRADIENT DESCENT ALGORITHMS; HIGH-DIMENSIONAL; HIGH-DIMENSIONAL REGRESSIONS; HIGHER-DIMENSIONAL; MISSING DATA; NOISY DATA; NONCONVEXITY; PREDICTION PROBLEM; PROJECTED GRADIENT;

POLYNOMIAL APPROXIMATION;

EID: 85162468591     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. R. Little and D. B. Rubin. Statistical analysis with missing data. Wiley, New York, 1987.
2. J. T. Hwang. Multiplicative errors-in-variables models with applications to recent data released by the U.S. Department of Energy. Journal of the American Statistical Association, 81(395):pp. 680-688, 1986.
3. R. J. Carroll, D. Ruppert, and L. A. Stefanski. Measurement Error in Nonlinear Models. Chapman and Hall, 1995.
4. S. J. Iturria, R. J. Carroll, and D. Firth. Polynomial regression and estimating functions in the presence of multiplicative measurement error. Journal of the Royal Statistical Society Series B - Statistical Methodology, 61:547-561, 1999.
5. Q. Xu and J. You. Covariate selection for linear errors-in-variables regression models. Communications in Statistics - Theory and Methods, 36(2):375-386, 2007.
6. N. Städler and P. Bühlmann. Missing values: Sparse inverse covariance estimation and an extension to sparse regression. Statistics and Computing, pages 1-17, 2010.
7. M. Rosenbaum and A. B. Tsybakov. Sparse recovery under matrix uncertainty. Annals of Statistics, 38:2620-2651, 2010.
8. P. Loh and M.J. Wainwright. High-dimensional regression with noisy and missing data: Provable guarantees with non-convexity. Technical report, UC Berkeley, September 2011. Available at http://arxiv.org/abs/1109.3714.
9. R. Tibshirani. Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society, Series B, 58(1):267-288, 1996.
10. S. Chen, D. L. Donoho, and M. A. Saunders. Atomic decomposition by basis pursuit. SIAM Journal on Scientific Computing, 20(1):33-61, 1998.
11. S. van de Geer. The deterministic Lasso. In Proceedings of Joint Statistical Meeting, 2007.
12. P. J. Bickel, Y. Ritov, and A. Tsybakov. Simultaneous analysis of Lasso and Dantzig selector. Annals of Statistics, 37(4):1705-1732, 2009.
13. S. van de Geer and P. Buhlmann. On the conditions used to prove oracle results for the Lasso. Electronic Journal of Statistics, 3:1360-1392, 2009.
14. G. Raskutti, M. J.Wainwright, and B. Yu. Restricted eigenvalue properties for correlated Gaussian designs. Journal of Machine Learning Research, 11:2241-2259, 2010.
15. A. Agarwal, S. Negahban, and M.J. Wainwright. Fast global convergence of gradient methods for highdimensional statistical recovery. Technical report, UC Berkeley, April 2011. Available at http://arxiv.org/abs/1104.4824.
16. 1-ball for learning in high dimensions. In International Conference on Machine Learning, pages 272-279, 2008.
17. C. H. Zhang and J. Huang. The sparsity and bias of the Lasso selection in high-dimensional linear regression. Annals of Statistics, 36(4):1567-1594, 2008.
18. N. Meinshausen and B. Yu. Lasso-type recovery of sparse representations for high-dimensional data. Annals of Statistics, 37(1):246-270, 2009.
19. S. Negahban, P. Ravikumar, M. J. Wainwright, and B. Yu. A unified framework for the analysis of regularized M-estimators. In Advances in Neural Information Processing Systems, 2009.
20. N. Meinshausen and P. Bühlmann. High-dimensional graphs and variable selection with the Lasso. Annals of Statistics, 34:1436-1462, 2006.
21. M. Yuan. High-dimensional inverse covariance matrix estimation via linear programming. Journal of Machine Learning Research, 99:2261-2286, August 2010.
22. A. J. Rothman, P. J. Bickel, E. Levina, and J. Zhu. Sparse permutation invariant covariance estimation. Electronic Journal of Statistics, 2:494-515, 2008.