Joint estimation of structured sparsity and output structure in multiple-output regression via inverse-covariance regularization

Journal of Machine Learning Research

Volumn 22, Issue , 2012, Pages 1081-1089

  Sohn, Kyung Ah ^a   Kim, Seyoung ^a  

^a Carnegie Mellon University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; INVERSE PROBLEMS;

FAST OPTIMIZATIONS; GAUSSIAN GRAPHICAL MODELS; INVERSE COVARIANCE; QUASI-NEWTON ALGORITHM; REGRESSION COEFFICIENT; REGULARIZATION FUNCTION; SIMULATED DATASETS; STRUCTURED SPARSITIES;

REGRESSION ANALYSIS;

EID: 84895998243     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (22)

1. G. Andrew and J. Gao. Scalable training of l1-regularized log-linear models. In Proceedings of the 24th International Conference on Machine Learning, 2007.
2. A. Beck and M. Teboulle. A fast iterative shrinkage thresholding algorithm for linear inverse problems. SIAM Journal of Image Science, 2(1):183-202, 2009.
3. S. Boyd and L. Vandenberghe. Convex Optimization. Cambridge University Press, 2004.
4. X. Chen, Q. Lin, S. Kim, J. Carbonell, and E.P. Xing. Smoothing proximal gradient method for general structured sparse learning. In Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence (UAI), pages 105-114. AUAI Press, 2011.
5. J. Friedman, T. Hastie, and R. Tibshirani. Pathwise coordinate optimization. The Annals of Applied Statistics, 1(2):302-332, 2007.
6. J. Friedman, T. Hastie, and R. Tibshirani. Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 9(3):432-41, 2008.
7. R. Jenatton, J. Audibert, and F. Bach. Structured variable selection with sparsity-inducing norms. Technical report, INRIA, 2009.
8. Z. Kang, K. Grauman, and F. Sha. Learning with whom to share in multi-task feature learning. In Proceedings of the 28th International Conference on Machine Learning, 2011.
9. S. Kim and E.P. Xing. Statistical estimation of correlated genome associations to a quantitative trait network. PLoS Genetics, 5(8):e1000587, 2009.
10. S. Kim and E.P. Xing. Tree-guided group lasso for multi-task regression with structured sparsity. In Proceedings of the 27th International Conference on Machine Learning, pages 543-550. Omnipress, 2010.
11. D. Koller and N. Friedman. Probabilistic Graphical Models: Principles and Techniques. The MIT Press, 2009.
12. J. Lafferty, A. McCallum, and F. Pereira. Conditional random fields: probabilistic models for segmenting and labeling sequence data. In Proceedings of the 18th International Conference on Machine Learning, 2001.
13. K. Mardia, J. Kent, and J Bibby. Multivariate Analysis. Academic Press, 1979.
14. N. Meinshausen and P. Buhlmann. High dimensional graphs and variable selection with the lasso. Annals of Statistics, 34:1436-1462, 2006.
15. G. Obozinski, M.J. Wainwright, and M.J. Jordan. High-dimensional union support recovery in multivariate regression. In Advances in Neural Information Processing Systems 21, 2008.
16. A. Rothman, E. Levina, and J. Zhu. Sparse multivariate regression with covariance estimation. Journal of Computational and Graphical Statistics, 19(4):947-962, 2010.
17. E. Schadt, C. Molony, E. Chudin, K. Hao, and X. et al Yang. Mapping the genetic architecture of gene expression in human liver. PLoS Biology, 6(5):e107, 2008.
18. R. Tibshirani. Regression shrinkage and selection via the lasso. Journal of Royal Statistical Society, Series B, 58(1):267-288, 1996.
19. Wellcome Trust Case Control Consortium. Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls. Nature, 447:661-78, 2007.
20. D. Witten and R. Tibshirani. Covarianceregularized regression and classification for highdimensional problems. Journal of the Royal Statistical Society. Series B, Statistical methodology, 71(3):615-636, 2009.
21. M. Yuan and Y. Lin. Model selection and estimation in regression with grouped variables. Journal of Royal Statistical Society, Series B, 68(1):49-67, 2006.
22. P. Zhao, G. Rocha, and B. Yu. Grouped and hierarchical model selection through composite absolute penalties. Technical Report 703, Department of Statistics, University of California, Berkeley, 2008.