Efficient structure learning of Markov networks using L 1- regularization

Advances in Neural Information Processing Systems

Volumn , Issue , 2007, Pages 817-824

  Lee, Su In ^a   Ganapathi, Varun ^a   Koller, Daphne ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATE INFERENCE; COMPUTATIONAL BIOLOGY; COMPUTATIONAL COSTS; COMPUTATIONALLY EFFICIENT; CONTINUOUS SPACES; CONVEX OPTIMIZATION PROBLEMS; EFFECTIVE ALGORITHMS; GAUSSIAN PARAMETERS; GENERALIZATION PERFORMANCE; GENETIC SEQUENCE; GRADIENT COMPUTATION; LEARNING PARAMETERS; LOGLINEAR MODEL; MARKOV NETWORKS; MRF NETWORKS; NATURAL LANGUAGES; NETWORK STRUCTURES; PIXEL VALUES; REAL WORLD DATA; STRUCTURE-LEARNING; SYNTHETIC DATA;

BIOINFORMATICS; COMPUTER VISION; CONVEX OPTIMIZATION; GRADIENT METHODS; REGRESSION ANALYSIS;

MARKOV PROCESSES;

EID: 70049111780     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. F. Bach and M. Jordan. Thin junction trees. In NIPS 14, 2002.
2. F.R. Bach, G.R.G. Lanckriet, and M.I. Jordan. Multiple kernel learning, conic duality, and the smo algorithm, 2004.
3. The International HapMap Consortium. The international hapmap project. Nature, 426:789.796, 2003.
4. Robert G. Cowell and David J. Spiegelhalter. Probabilistic Networks and Expert Systems. Springer-Verlag New York, Inc., Secaucus, NJ, USA, 1999.
5. H. Daumé III. Notes on CG and LM-BFGS optimization of logistic regression. August 2004.
6. S. Della Pietra, V.J. Della Pietra, and J.D. Lafferty. Inducing features of random fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(4):380.393, 1997.
7. A. Deshpande, M.N. Garofalakis, and M.I. Jordan. Efficient stepwise selection in decomposable models. In Proc. UAI, pages 128.135, 2001.
8. D. Donoho and X. Huo. Uncertainty principles and ideal atomic decomposition, 1999.
9. A. Genkin, D. D. Lewis, and D. Madigan. Large-scale bayesian logistic regression for text categorization. 2004.
10. J. Goodman. Exponential priors for maximum entropy models. In North American ACL, 2005.
11. Alexander T. Ihler, John W. Fischer III, and Alan S.Willsky. Loopy belief propagation: Convergence and effects of message errors. J. Mach. Learn. Res., 6:905.936, 2005.
12. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278.2324, November 1998.
13. Martijn A. R. Leisink and Hilbert J. Kappen. General lower bounds based on computer generated higher order expansions. In UAI, pages 293.300, 2002.
14. A. McCallum. Efficiently inducing features of conditional random fields. In Proc. UAI, 2003.
15. Thomas P. Minka. Algorithms for maximum-likelihood logistic regression. 2001.
16. K. P. Murphy, Y. Weiss, and M. I. Jordan. Loopy belief propagation for approximate inference: an empirical study. pages 467.475, 1999.
17. J. Pearl. Probabilistic Reasoning in Intelligent Systems. Morgan Kaufmann, 1988.
18. S. Perkins, K. Lacker, and J. Theiler. Grafting: Fast, incremental feature selection by gradient descent in function space. 3(2003):1333.1356, 2003.
19. Stefan Riezler and Alexander Vasserman. Incremental feature selection and l1 regularization for relaxed maximum-entropy modeling. In Proceedings of EMNLP 2004.
20. Sekhar Tatikonda and Michael I. Jordan. Loopy belief propogation and gibbs measures. In UAI, pages 493.500, 2002.
21. R Tibshirani. Regression shrinkage and selection via the lasso. J. Royal. Statist. Soc B, 1996.
22. Martin J. Wainwright, Pradeep Ravikumar, and Lafferty. Inferring graphical model structure using '1- regularized pseudo-likelihood. In Advances in Neural Information Processing Systems 19, 2007.
23. Martin J. Wainwright, Erik B. Sudderth, and Alan S. Willsky. Tree-based modeling and estimation of gaussian processes on graphs with cycles. In Todd K. Leen, Thomas G. Dietterich, and Volker Tresp, editors, Advances in Neural Information Processing Systems 13, pages 661.667. MIT Press, 2001.
24. Jonathan S. Yedidia, William T. Freeman, and Yair Weiss. Generalized belief propagation. In Advances in Neural Information Processing Systems 13. MIT Press, 2001.
25. J. Zhu, S. Rosset, T. Hastie, and R. Tibshirani. 1-norm support vector machines. In Proc. NIPS, 2003.