Correctness of belief propagation in Gaussian graphical models of arbitrary topology

Advances in Neural Information Processing Systems

Volumn , Issue , 2000, Pages 673-679

  Weiss, Yair ^a   Freeman, William T ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b MITSUBISHI ELECTRIC RESEARCH LABORATORIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; GRAPHIC METHODS; PROBABILITY DISTRIBUTIONS;

BELIEF PROPAGATION ALGORITHM; EMPIRICAL PERFORMANCE; GAUSSIAN GRAPHICAL MODELS; GAUSSIAN RANDOM VARIABLE; LOOPY BELIEF PROPAGATION; MAX-PRODUCT ALGORITHMS; MAXIMUM POSTERIOR PROBABILITY; POSTERIOR PROBABILITY;

TOPOLOGY;

EID: 84898973486     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. S.M. Aji, G.B. Horn, and RJ. McEliece. On the convergence of iterative decoding on graphs with a single cycle. In Proc. 1998ISIT, 1998.
2. C. Berrou, A. Glavieux, and R Thitimajshima. Near Shannon limit error-correcting coding and decoding: Turbo codes. In Proc. IEEE International Communications Conference '93, 1993.
3. R. Cowell. Advanced inference in Bayesian networks. In M.I. Jordan, editor, Learning in Graphical Models. MIT Press, 1998.
4. G.D. Forney, F.R. Kschischang, and B. Marcus. Iterative decoding of tail-biting trellisses. preprint presented at 1998 Information Theory Workshop in San Diego, 1998.
5. W. T. Freeman and Y. Weiss. On the fixed points of the max-product algorithm. Technical Report 99-39, MERL, 201 Broadway, Cambridge, MA 02139, 1999.
6. W.T. Freeman and EC. Pasztor. Learning to estimate scenes from images. In M.S. Kearns, SA. Solla, and DA. Cohn, editors, Adv. Neural Information Processing Systems 11. MIT Press, 1999.
7. B.J. Frey. Turbo factor analysis. In Adv. Neural Information Processing Systems 12. 2000. to appear.
8. Brendan J. Frey. Bayesian Networks for Pattern Classification, Data Compression and Channel Coding. MIT Press, 1998.
9. R.G. Gallager. Low Density Parity Check Codes. MIT Press, 1963.
10. F. R. Kschischang and B. J. Frey. Iterative decoding of compound codes by probability propagation in graphical models. IEEE Journal on Selected Areas in Communication, 16(2):219-230, 1998.
11. R.J. McEliece, D.J.C. MackKay, and J.F. Cheng. Turbo decoding as as an instance of Pearl's 'belief propagation' algorithm. IEEE Journal on Selected Areas in Communication, 16(2): 140-152,1998.
12. R.J. McEliece, E. Rodemich, and J.F. Cheng. The Turbo decision algorithm. In Proc. 33rd Allerton Conference on Communications, Control and Computing, pages 366-379, Monticello, IL, 1995.
13. K.P. Murphy, Y. Weiss, and M.I. Jordan. Loopy belief propagation for approximate inference: an empirical study. In Proceedings of Uncertainty in AI, 1999.
14. Rusmevichientong P. and Van Roy B. An analysis of Turbo decoding with Gaussian densities. In Adv. Neural Information Processing Systems 12. 2000. to appear.
15. Judea Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, 1988.
16. Gilbert Strang. Introduction to Applied Mathematics. Wellesley-Cambridge, 1986.
17. Y. Weiss. Belief propagation and revision in networks with loops. Technical Report 1616, MIT AI lab, 1997.
18. Y. Weiss. Correctness of local probability propagation in graphical models with loops. Neural Computation, to appear, 2000.
19. Y. Weiss and W. T. Freeman. Loopy propagation gives the correct posterior means for Gaussians. Technical Report UCB.CSD-99-1046, Berkeley Computer Science Dept., 1999. www.cs.berkeley.edu yweiss/.
20. N. Wiberg. Codes and decoding on general graphs. PhD thesis, Department of Electrical Engineering, U. Linkoping, Sweden, 1996.