Stable Fixed Points of Loopy Belief Propagation Are Minima of the Bethe Free Energy

NIPS 2002: Proceedings of the 15th International Conference on Neural Information Processing Systems

Volumn , Issue , 2002, Pages 343-350

  Heskes, Tom ^a  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

BACKPROPAGATION; FREE ENERGY;

BETHE FREE ENERGY; CONSTRAINED MINIMIZATION; DOUBLE-LOOP; LOCAL MINIMUMS; LOOP ALGORITHMS; LOOPY BELIEF PROPAGATION; SADDLE POINT PROBLEMS; STABILITY ANALYZE; STABLE FIXED POINTS; UNSTABLE FIXED POINT;

CONSTRAINED OPTIMIZATION;

EID: 85156240585     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. J. Pearl. Probabilistic Reasoning in Intelligent systems: Networks of Plausible Inference. Morgan Kaufmann, San Francisco, CA, 1988.
2. K. Murphy, Y. Weiss, and M. Jordan. Loopy belief propagation for approximate inference: An empirical study. In UAI'99, pages 467-475, 1999.
3. J. Yedidia, W. Freeman, and Y. Weiss. Generalized belief propagation. In NIPS 13, pages 689-695, 2001.
4. F. Kschischang, B. Frey, and H. Loeliger. Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory, 47(2):498-519, 2001.
5. A. Yuille. CCCP algorithms to minimize the Bethe and Kikuchi free energies: Convergent alternatives to belief propagation. Neural Computation, 14:1691-1722, 2002.
6. Y. Teh and M. Welling. The unified propagation and scaling algorithm. In NIPS 14, 2002.
7. T. Minka. The EP energy function and minimization schemes. Technical report, MIT Media Lab, 2001.
8. S. Seung, T. Richardson, J. Lagarias, and J. Hopfield. Minimax and Hamiltonian dynamics of excitatory-inhibitory networks. In NIPS 10, 1998.
9. M. Wainwright, T. Jaakola, and A. Willsky. Tree-based reparameterization for approximate estimation on loopy graphs. In NIPS 14, 2002.
10. T. Heskes and O. Zoeter. Expectation propagation for approximate inference in dynamic Bayesian networks. In UAI-2002, pages 216-223, 2002.