A dirty model for multiple sparse regression

IEEE Transactions on Information Theory

Volumn 59, Issue 12, 2013, Pages 7947-7968

  Jalali, Ali ^a   Ravikumar, Pradeep ^a   Sanghavi, Sujay ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

High dimensional statistics; multi task learning; multiple regression

Indexed keywords

HIGH-DIMENSIONAL STATISTICS; LINEAR MEASUREMENTS; MULTIPLE REGRESSIONS; MULTITASK LEARNING; NUMBER OF SAMPLES; RECENT RESEARCHES; SPARSE LINEAR REGRESSIONS; SPARSE REGRESSION;

LINEAR REGRESSION;

PROBLEM SOLVING;

EID: 84889572573     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2013.2280272     Document Type: Article

References (24)

1. R. Baraniuk, "Compressive sensing," IEEE Signal Process. Mag., vol. 24, no. 4, pp. 118-121, Jul. 2007.
2. R. Tibshirani, "Regression shrinkage and selection via the LASSO," J. Roy. Statist. Soc., Ser. B, vol. 58, no. 1, pp. 267-288, 1996.
3. B. Recht, M. Fazel, and P. A. Parrilo, "Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization," presented at the Allerton Conf., Allerton House, IL, USA, 2007.
4. S. Negahban and M. J. Wainwright, "Estimation of (near) low-rank matrices with noise and high-dimensional scaling," in Proc. 27th Int. Conf. Mach. Learn., 2010, pp. 823-830.
5. P. Ravikumar, M. J. Wainwright, and J. Lafferty, "High-dimensional Ising model selection using -regularized logistic regression," Ann. Statist., vol. 38, no. 3, pp. 1287-1319, 2009.
6. R. Caruana, "Multitask learning," Mach. Learn., vol. 28, pp. 41-75, 1997. (Pubitemid 127507169)
7. F. Bach, "Consistency of the group LASSO and multiple kernel learning," J. Mach. Learn. Res., vol. 9, pp. 1179-1225, 2008.
8. P. Ravikumar, H. Liu, J. Lafferty, and L. Wasserman, "Sparse additive models," J. Roy. Statist. Soc., Ser. B, vol. 71, no. 5, pp. 1009-1030, 2009.
9. J. A. Tropp, A. C. Gilbert, and M. J. Strauss, "Algorithms for simultaneous sparse approximation," Signal Process., Spec. Issue Sparse Approx. Signal Image Process., vol. 86, pp. 572-602, 2006.
10. M. Yuan and Y. Lin, "Model selection and estimation in regression with grouped variables," J. Roy. Statist. Soc., Ser. B, vol. 68, no. 1, pp. 49-67, 2006. (Pubitemid 43415335)
11. B. Turlach, W. N. Venables, and S. J. Wright, "Simultaneous variable selection," Technometrics, vol. 27, pp. 349-363, 2005. (Pubitemid 41164070)
12. C. Zhang and J. Huang, "Model selection consistency of the LASSO selection in high-dimensional linear regression," Ann. Statist., vol. 36, pp. 1567-1594, 2008.
13. S. Negahban and M. J.Wainwright, "Joint support recovery under highdimensional scaling: Benefits and perils of -regularization," IEEE Trans. Inf. Theory, vol. 57, no. 6, pp. 3841-3863, Jun. 2011.
14. K. Lounici, A. B. Tsybakov, M. Pontil, and S. A. van de Geer, "Taking advantage of sparsity in multi-task learning," in Proc. 22nd Conf. Learn. Theory, 2009, pp. 73-82.
15. G. Obozinski, M. J. Wainwright, and M. I. Jordan, "Support union recovery in high-dimensional multivariate regression," Ann. Statist., vol. 39, no. 1, pp. 1-47, 2010.
16. M. J. Wainwright, "Sharp thresholds for noisy and high-dimensional recovery of sparsity using -constrained quadratic programming (LASSO)," IEEE Trans. Inf. Theory, vol. 55, no. 5, pp. 2183-2202, May 2009.
17. R. P. W. Duin. Delft, The Netherlands, Delft University of Technology, Department of Applied Physics, 2002.
18. M. van Breukelen, R. P. W. Duin, D.M. J. Tax, and J. E. den Hartog, "Handwritten digit recognition by combined classifiers," Kybernetika, vol. 34, no. 4, pp. 381-386, 1998.
19. X. He and P. Niyogi, "Locality preserving projections," Neural Inf. Process. Syst., vol. 16, pp. 1-8, 2003.
20. K. R. Davidson and S. J. Szarek, "Local operator theory, random matrices and Banach spaces," in Handbook of Banach Spaces. Amsterdam, The Netherlands: Elsevier, 2001, vol. 1, pp. 317-336.
21. B. Laurent and P. Massart, "Adaptive estimation of a quadratic functional by model selection," Ann. Statist., vol. 28, pp. 1303-1338, 1998.
22. M. Ledoux and M. Talagrand, Probability in Banach Spaces: Isoperimetry and Processes. New York, NY, USA: Springer-Verlag, 1991.
23. H. Liu, M. Palatucci, and J. Zhang, "Blockwise coordinate descent procedures for the multi-task LASSO, with applications to neural semantic basis discovery," in Proc. 26th Int. Conf. Mach. Learn., 2009, pp. 649-656.
24. P. Tseng and S. Yun, "A coordinate gradient descent method for nonsmooth separable minimization," Math. Program., vol. 117, no. 1, pp. 387-423, 2009.