Approximate inference on planar graphs using loop calculus and belief propagation

Journal of Machine Learning Research

Volumn 11, Issue , 2010, Pages 1273-1296

  Gómez, Vicenç ^a   Kappen, Hilbert J ^a   Chertkov, Michael ^b  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^b LOS ALAMOS NATIONAL LABORATORY   (United States)

Author keywords

Approximate inference; Belief propagation; Ising model; Loop calculus; Partition function; Planar graphs

Indexed keywords

APPROXIMATE INFERENCE; BELIEF PROPAGATION; BINARY VARIABLES; GRAPHICAL MODEL; PAIRWISE INTERACTION; PARTITION FUNCTIONS; PFAFFIAN; PLANAR GRAPH; PLANAR MODEL; STATE-OF-THE-ART METHODS;

ALGORITHMS; CALCULATIONS; INFERENCE ENGINES; ISING MODEL; SPEECH RECOGNITION;

GRAPHIC METHODS;

EID: 77951950559     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (30)

1. F. Barahona. On the computational complexity of Ising spin glass models. Journal of Physics A: Mathematical and General, 15(10):3241-3253, 1982. URL http://stacks.iop.org/305-4470/15/3241.
2. M. Chertkov and V. Y. Chernyak. Loop series for discrete statistical models on graphs. Journal of Statistical Mechanics: Theory and Experiment, 2006(06) :P06009, 2006a.
3. M. Chertkov and V. Y. Chernyak. Loop calculus helps to improve belief propagation and linear programming decodings of LDPC codes. In invited talk at 44th Allerton Conference, September 2006b.
4. M. Chertkov, V. Y. Chernyak, and R. Teodorescu. Belief propagation and loop series on planar graphs. Journal of Statistical Mechanics: Theory and Experiment, 2008(05):P05003 (19pp), 2008. URL http://stacks.iop.org/1742-5468/ 2008/P05003.
5. G. Elidan, I. McGraw, and D. Koller. Residual belief propagation: Informed scheduling for asynchronous message passing. In Proceedings of the 22nd Annual Conference on Uncertainty in Artificial Intelligence (UAI-06), Boston, Massachussetts, 2006. AUAI Press.
6. M. E. Fisher. On the dimer solution of the planar Ising model. Journal of Mathematical Physics, 7 (10): 1776-1781, 1966.
7. M. E. Fisher. Statistical mechanics of dimers on a plane lattice. Physical Review, 124:1664-1672, 1961.
8. B. J. Frey and D. J. C. MacKay. A revolution: belief propagation in graphs with cycles. In Advances in Neural Information Processing Systems 10, pages 479-486. MIT Press, Cambridge, MA, 1998.
9. A. Globerson and T. S. Jaakkola. Approximate inference using planar graph decomposition. In Advances in Neural Information Processing Systems 19, pages 473-480. MIT Press, Cambridge, MA, 2007.
10. V. Gómez, J. M. Mooij, and H. J. Kappen. Truncating the loop series expansion for belief propagation. Journal of Machine Learning Research, 8:1987-2016, 2007. ISSN 1533-7928.
11. T. Heskes, K. Albers, and H. J. Kappen. Approximate inference and constrained optimization. In Proceedings of the 19th Annual conference on Uncertainty in Artificial Intelligence (UAI-03), pages 313-320, San Francisco, CA, 2003. Morgan Kaufmann Publishers.
12. M. Jerrum. Counting, Sampling and Integrating : Algorithms and Complexity. Lectures in Mathematics - ETH Zrich. Birkhuser, Basel, 2003.
13. G.D. Forney Jr. Codes on graphs: normal realizations. IEEE Transactions on Information Theory, 47(2):520-548, Feb 2001. ISSN 0018-9448. doi: 10.1109/18.910573.
14. M. Karpinski and W. Rytter. Fast parallel algorithms for graph matching problems. In Oxford Lecture Series in Mathematics & Its Applications Number 9, pages 164-170. Oxford University Press, USA, 1998.
15. P. W. Kasteleyn. The statistics of dimers on a lattice : I. The number of dimer arrangements on a quadratic lattice. Physica, 27:1209-1225, 1961.
16. P. W. Kasteleyn. Dimer statistics and phase transitions. Journal of Mathematical Physics, 4(2): 287-293,1963. URL http://link.aip.Org/link/7JMP/4/ 287/.
17. S. L. Lauritzen and D. J. Spiegelhalter. Local computations with probabilities on graphical structures and their application to expert systems. Journal of the Royal Statistical society. Series B-Methodological, 50(2): 154-227,1988.
18. H.-A. Loeliger. An introduction to factor graphs. Signal Processing Magazine, IEEE, 21(1):28-41, 2004. ISSN 1053-5888. doi: 10.1109/MSP.2004. 1267047.
19. T. Minka and Y. Qi. Tree-structured approximations by expectation propagation. In Sebastian Thrun, Lawrence Saul, and Bernhard Schölkopf, editors, Advances in Neural Information Processing Systems 16. MIT Press, Cambridge, MA, 2004.
20. J. M. Mooij. libDAI: A free/open source C++ library for discrete approximate inference methods, 2008. http://mloss.org/software/view/77/.
21. J. M. Mooij and H. J. Kappen. On the properties of the Bethe approximation and loopy belief propagation on binary networks. Journal of Statistical Mechanics: Theory and Experiment, 2005 (11):P11012, 2005.
22. K. P. Murphy, Y. Weiss, and M. I. Jordan. Loopy Belief Propagation for approximate inference: An empirical study. In Proceedings of the 15th Annual Conference on Uncertainty in Artificial Intelligence (UAI-99), pages 467-475, San Francisco, CA, 1999. Morgan Kaufmann Publishers.
23. J. Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann Publishers, San Francisco, CA, 1988. ISBN 1558604790.
24. N. Schraudolph and D. Kamenetsky. Efficient exact inference in planar Ising models. In Advances in Neural Information Processing Systems 22. MIT Press, Cambridge, MA, 2008.
25. E. B. Sudderth, M. J. Wainwright, and A. S. Willsky. Loop series and Bethe variational bounds in attractive graphical models. In Advances in Neural Information Processing Systems 20, pages 1425-1432. MIT Press, Cambridge, MA, 2007.
26. H. N. V. Temperley and M. E. Fisher. Dimer problem in statistical mechanics - an exact result. Philosophical Magazine, 6:1061-1063, 1961.
27. M. J. Wainwright, T. S. Jaakkola, and A. S. Willsky. A new class of upper bounds on the log partition function. IEEE Transactions on Information Theory, 51(7):2313-2335, 2005. (Pubitemid 41136395)
28. Y. Watanabe and K. Fukumizu. Loop series expansion with propagation diagrams. Journal of Physics A: Mathematical and Theoretical, 42(4):045001 (18pp), 2009.
29. J. S. Yedidia, W. T. Freeman, and Y. Weiss. Generalized belief propagation. In Advances in Neural Information Processing Systems 13, pages 689-695, 2000.
30. J. S. Yedidia, W. T. Freeman, and Y. Weiss. Constructing free-energy approximations and general-ized belief propagation algorithms. IEEE Transactions on Information Theory, 51(7):2282-2312, 2005.