Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data

Journal of Machine Learning Research

Volumn 9, Issue , 2008, Pages 485-516

  Banerjee, Onureena ^a   El Ghaoui, Laurent ^a   D'Aspremont, Alexandre ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b PRINCETON UNIVERSITY   (United States)

Author keywords

Binary data; Convex optimization; Gaussian graphical model; Maximum likelihood estimation; Model selection

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY; GAUSSIAN DISTRIBUTION; MATHEMATICAL MODELS; PROBLEM SOLVING;

BINARY DATA; CONVEX OPTIMIZATION; GAUSSIAN GRAPHICAL MODEL; MODEL SELECTION;

MAXIMUM LIKELIHOOD ESTIMATION;

EID: 41549101939     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (20)

1. M. Ashburner, C. A. Ball, J. A. Blake, D. Botstein, H. Butler, J. M. Cherry, A. P. Davis, K. Dolinski, S. S. Dwight, J. T. Eppig, M. A. Harris, D. P. Hill, L. Issel-Tarver, A. Kasarskis, S. Lewis, J. C. Matese, J. E. Richardson, M. Ringwald, G. M. Rubin, and G. Sherlock. Gene ontology: Tool for the unification of biology. Nature Genet., 25:25-29, 2000.
2. D. Bertsekas. Nonlinear Programming. Athena Scientific, 1998.
3. P. J. Bickel and E. Levina. Regularized estimation of large covariance matrices. Annals of Statistics, 36(1):199-227, 2008.
4. J. Dahl, V. Roychowdhury, and L. Vandenberghe. Covariance selection for non-chordal graphs via chordal embedding. To appear in Optimization Methods and Software, Revised 2007.
5. A.d'Aspremont, L. El Ghaoui, M.I. Jordan, and G. R. G. Lanckriet. A direct formulation for sparse PCA using semidefinite programming. Advances in Neural Information Processing Systems, 17, 2004.
6. A. Dobra and M. West. Bayesian covariance selection. Technical Report, 2004.
7. J. Friedman, T. Hastie, and R. Tibshirani. Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 2007.
8. T. R. Hughes, M. J. Marton, A. R. Jones, C. J. Roberts, R. Stoughton, C. D. Armour, H. A. Bennett, E. Coffey, H. Dai, Y. D. He, M. J. Kidd, A. M. King, M. R. Meyer, D. Slade, P. Y. Lum, S. B. Stepaniants, D. D. Shoemaker, D. Gachotte, K. Chakraburtty, J. Simon, M. Bard, and S. H. Friend. Functional discovery via a compendium of expression profiles. Cell, 102(1): 109-126, 2000.
9. S. Lauritzen. Graphical Models. Springer Verlag, 1996.
10. H. Li and J. Gui. Gradient directed regularization for sparse gaussian concentration graphs, with applications to inference of genetic networks. University of Pennsylvania Technical Report, 2005.
11. Z. Q. Luo and P. Tseng. On the convergence of the coordinate descent method for convex differentiable minimization. Journal of Optimization Theory and Applications, 72(1):7-35, 1992.
12. N. Meinshausen and P. Bühlmann. High dimensional graphs and variable selection with the lasso. Annals of statistics, 34:1436-1462, 2006.
13. G. Natsoulis, L. El Ghaoui, G. Lanckriet, A. Tolley, F. Leroy, S. Dunlea, B. Eynon, C. Pearson, S. Tugendreich, and K. Jarnagin. Classification of a large microarray data set: algorithm comparison and analysis of drug signatures. Genome Research, 15:724 -736, 2005.
14. Y. Nesterov. Smooth minimization of non-smooth functions. Math. Prog., 103(1):127-152, 2005.
15. M. R. Osborne, B. Presnell, and B. A. Turlach. On the lasso and its dual. Journal of Computational and Graphical Statistics, 9(2):319-337, 2000.
16. T. P. Speed and H. T. Kiiveri. Gaussian markov distributions over finite graphs. Annals of Statistics, 14(1): 138-150, 1986.
17. R. Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal statistical society, series B, 58(267-288), 1996.
18. L. Vandenberghe, S. Boyd, and S.-P. Wu. Determinant maximization with linear matrix inequality constraints. SIAM Journal on Matrix Analysis and Applications, 19(4):499 - 533, 1998.
19. M. Wainwright and M. Jordan. Log-determinant relaxation for approximate inference in discrete markov random fields. IEEE Transactions on Signal Processing, 2006.
20. 1-regularized logistic regression. Proceedings of Advances in Neural Information Processing Systems, 2006.