Union support recovery in high-dimensional multivariate regression

46th Annual Allerton Conference on Communication, Control, and Computing

Volumn , Issue , 2008, Pages 21-26

  Obozinski, Guillaume ^a   Wainwright, Martin J ^a   Jordan, Michael I ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COVARIATES; CRITICAL THRESHOLDS; HIGH PROBABILITIES; HIGH-DIMENSIONAL; MATRIXES; MULTIVARIATE REGRESSIONS; OVERLAP FUNCTIONS; REGRESSION COEFFICIENT VECTORS; REGRESSION COEFFICIENTS; REGRESSION MODELS; REGRESSION VECTORS; SAMPLE COMPLEXITY; SAMPLE SIZES; SCALINGS;

PROBABILITY;

REGRESSION ANALYSIS;

EID: 78650760574     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ALLERTON.2008.4797530     Document Type: Conference Paper

References (26)

1. R. Tibshirani, "Regression shrinkage and selection via the lasso," Journal of the Royal Statistical Society, Series B, vol. 58, no. 1, pp. 267-288, 1996.
2. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Computing, vol. 20, no. 1, pp. 33-61, 1998.
3. D. Donoho and X. Huo, "Uncertainty principles and ideal atomic decomposition," IEEE Trans. Info Theory, vol. 47, no. 7, pp. 2845-2862, 2001.
4. S. Boyd and L. Vandenberghe, Convex optimization. Cambridge, UK: Cambridge University Press, 2004.
5. M. R. Osborne, B. Presnell, and B. A. Turlach, "A new approach to variable selection in least squares problems," IMA Journal of Numerical Analysis, vol. 20, no. 3, pp. 389-403, 2000. [Online]. Available: citeseer.ist.psu.edu/article/osborne00new.html
6. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani, "Least angle regression," Annals of Statistics, vol. 32, no. 2, pp. 407-499, 2004.
7. K. Knight and W. J. Fu, "Asymptotics for lasso-type estimators," Annals of Statistics, vol. 28, pp. 1356-1378, 2000.
8. N. Meinshausen and P. Bühlmann, "High-dimensional graphs and variable selection with the Lasso," Annals of Statistics, vol. 34, pp. 1436-1462, 2006.
9. 1-constrained quadratic programs," Department of Statistics, UC Berkeley, Tech. Rep. 709, 2006.
10. P. Zhao and B. Yu, "On model selection consistency of Lasso," Journal of Machine Learning Research, vol. 7, pp. 2541-2567, 2006.
11. E. Candes and T. Tao, "The Dantzig selector: Statistical estimation when p is much larger than n," Annals of Statistics, vol. 35, no. 6, pp. 2313-2351, 2007.
12. M. Yuan and Y. Lin, "Model selection and estimation in regression with grouped variables," Journal of the Royal Statistical Society B, vol. 1, no. 68, p. 4967, 2006.
13. P. Zhao, G. Rocha, and B. Yu, "Grouped and hierarchical model selection through composite absolute penalties," Statistics Department, University of California, Berkeley, Tech. Rep. 703, 2007.
14. G. Obozinski, B. Taskar, and M. Jordan, "Joint covariate selection for grouped classification," Department of Statistics, University of California, Berkeley, Tech. Rep. 743, 2007.
15. A. Argyriou, T. Evgeniou, and M. Pontil, "Multi-task feature learning," in Advances in Neural Information Processing Systems, 18. Cambridge, MA: MIT Press, 2006.
16. B. Turlach, W. Venables, and S. Wright, "Simultaneous variable selection," Technometrics, vol. 27, pp. 349-363, 2005.
17. H. Zhang, H. Liu, Y Wu, and J. Zhu, "Variable selection for the multi-category SVM via adaptive sup-norm regularization," Electronic Journal of Statistics, vol. 2, pp. 1149-1167, 2008.
18. F. Bach, G. Lanckriet, and M. I. Jordan, "Multiple kernel learning, conic duality, and the SMO algorithm," in Proc. Int. Conf. Machine Learning (ICML). Morgan Kaufmann, 2004.
19. J. A. Tropp, "Just relax: Convex programming methods for identifying sparse signals in noise," IEEE Trans. Info Theory, vol. 52, no. 3, pp. 1030-1051, March 2006.
20. P. Ravikumar, H. Liu, J. Lafferty, and L. Wasserman, "SpAM: sparse additive models," Carnegie Mellon University, Tech. Rep. arXiv:0711.4555v2, 2008.
21. L. Meier, S. van de Geer, and P. Bühlmann, "The group lasso for logistic regression," Journal of the Royal Statistical Society, Series B, vol. 70, pp. 53-71, 2008.
22. F. Bach, "Consistency of the group Lasso and multiple kernel learning," INRIA, Département dTnformatique, Ecole Normale Supérieure, Tech. Rep., 2008.
23. 2 regularized regression," Carnegie Mellon University, Tech. Rep. arXiv:0802.1517vl, 2008.
24. G. Obozinski, M. J. Wainwright, and M. I. Jordan, "Union support recovery in high-dimensional multivariate regression," Department of Statistics, UC Berkeley, Tech. Rep., August 2008.
25. V. V. Buldygin and Y. V. Kozachenko, Metric characterization of random variables and random processes. Providence, RI: American Mathematical Society, 2000.
26. N. Meinshausen and B. Yu, "Lasso-type recovery of sparse representations for high-dimensional data," Annals of Statistics, 2008.