Stable fixed points of loopy belief propagation are minima of the bethe free energy

Advances in Neural Information Processing Systems

Volumn , Issue , 2003, Pages

  Heskes, Tom ^a  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

BETHE FREE ENERGY; CONSTRAINED MINIMIZATION; DOUBLE-LOOP; LOOPY BELIEF PROPAGATION; SADDLE POINT PROBLEMS; STABILITY ANALYSIS; STABLE FIXED POINTS; UNSTABLE FIXED POINT;

FREE ENERGY;

EID: 84898959007     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. J. Pearl. Probabilistic Reasoning in Intelligent systems: Networks of Plausible Inference. Morgan Kaufmann, San Francisco, CA, 1988.
2. K. Murphy, Y. Weiss, and M. Jordan. Loopy belief propagation for approximate inference: An empirical study. In UAI'99, pages 467-475, 1999.
3. J. Yedidia, W. Freeman, and Y. Weiss. Generalized belief propagation. In NIPS 13, pages 689-695, 2001.
4. F. Kschischang, B. Frey, and H. Loeliger. Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory, 47(2):498-519, 2001.
5. A. Yuille. CCCP algorithms to minimize the Bethe and Kikuchi free energies: Convergent alternatives to belief propagation. Neural Computation, 14:1691-1722, 2002.
6. Y. Teh and M. Welling. The unified propagation and scaling algorithm. In NIPS 14, 2002.
7. T. Minka. The EP energy function and minimization schemes. Technical report, MIT Media Lab, 2001.
8. S. Seung, T. Richardson, J. Lagarias, and J. Hopfield. Minimax and Hamilto-nian dynamics of excitatory-inhibitory networks. In NIPS 10, 1998.
9. M. Wainwright, T. Jaakola, and A. Willsky. Tree-based reparameterization for approximate estimation on loopy graphs. In NIPS 14, 2002.
10. T. Heskes and O. Zoeter. Expectation propagation for approximate inference in dynamic Bayesian networks. In UAI-2002, pages 216-223, 2002.