Correctness of Belief Propagation in Gaussian Graphical Models of Arbitrary Topology

Neural Computation

Volumn 13, Issue 10, 2001, Pages 2173-2200

  Weiss, Yair ^a   Freeman, William T ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b MITSUBISHI ELECTRIC RESEARCH LABORATORIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0011952756     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976601750541769     Document Type: Article

References (26)

1. Aji, S., Horn, G., & McEliece, R. (1998). On the convergence of iterative decoding on graphs with a single cycle. In Proc. 1998 ISIT.
2. Aji, S. M., & McEliece, R. (1999). The generalized distributive law. IEEE Transactions on Information Theory, 46, 325-343.
3. Berrou, C., Glavieux, A., & Thitimajshima, P. (1993). Near Shannon limit error-correcting coding and decoding: Turbo codes. In Proc. IEEE International Communications Conference '93.
4. Cowell, R. (1998). Advanced inference in Bayesian networks. In M. Jordan (Ed.), Learning in graphical models. Cambridge, MA: MIT Press.
5. Daniel, M. M., & Willsky, A. S. (1999). The modeling and estimation of statistically self-similar processes in a multiresolution framework. IEEE Trans. Info. Theory, 45(3), 955-970.
6. Forney, G., Kschischang, F., Marcus, B., & Tuncel, S. (2000). Iterative decoding of tail-biting trellises and connections with symbolic dynamics. In Proc. IMA Workshop on Codes, Systems, and Graphical Models. New York: Springer-Verlag.
7. Freeman, W., Pasztor, E., & Carmichael, O. (2000). Learning low-level vision. Intl. J. of Comp. Vision, 40(1), 25-47.
8. Frey, B. J. (1998). Graphical models for pattern classification, data compression and channel coding. Cambridge, MA: MIT Press.
9. Frey, B. (2000). Local probability propagation for factor analysis. In S. A. Solla, T. K. Leen, & K.-R. Müller (Eds.), Advances in neural information processing systems, 12. Cambridge, MA: MIT Press.
10. Frey, B. J., Koetter, R., & Vardy, A. (1998). Skewness and pseudocode-words in iterative decoding. In Proc. 1998 ISIT.
11. Gallager, R. (1963). Low density parity check codes. Cambridge, MA: MIT Press.
12. Geman, S., & Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. PAMI, 6(6), 721-741.
13. Jensen, F. (1996). An introduction to Bayesian networks. New York: Springer-Verlag.
14. Kschischang, F. R., & Frey, B. J. (2000). Iterative decoding of compound codes by probability propagation in graphical models. IEEE Journal on Selected Areas in Communication, 16(2), 219-230.
15. Lauritzen, S. (1996). Graphical models. New York: Oxford University Press.
16. Luettgen, M. R., Karl, W. C., & Willsky, A. S. (1994). Efficient multiscale regularization with application to the computation of optical flow. IEEE Transactions on Image Processing, 3(1), 41-64.
17. McEliece, R., MacKay, D., & Cheng, J. (1998). Turbo decoding as an instance of Pearl's "belief propagation" algorithm. IEEE Journal on Selected Areas in Communication, 16(2), 140-152.
18. McEliece, R., Rodemich, E., & Cheng, J. (1995). The Turbo decision algorithm. In Proc. 33rd Allerton Conference on Communications, Control and Computing (pp. 366-379). Monticello, IL.
19. Murphy, K., Weiss, Y., & Jordan, M. (1999). Loopy belief propagation for approximate inference: An empirical study. In Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence. San Mateo, CA: Morgan Kaufmann.
20. Pearl, J. (1988). Probabibilistic reasoning in intelligent systems: Networks of plausible inference. San Mateo, CA: Morgan Kaufmann.
21. Rusmevichientong, P., & Van Roy, B. (2000). An analysis of Turbo decoding with gaussian densities. In S. A. Solla, T. K. Leen, & K.-R. M'uller (Eds.), Advances in neural information processing systems, 12. Cambridge, MA: MIT Press.
22. Weiss, Y. (1996). Interpreting images by propagating Bayesian beliefs. In M. Mozer, M. Jordan, & T. Petsche (Eds.), Advances in neural information processing systems, 9. Cambridge, MA: MIT Press.
23. Weiss, Y. (1997). Belief propagation and revision in networks with loops (Tech. Rep. No. 1616). Cambridge, MA: MIT AI Lab.
24. Weiss, Y. (2000). Correctness of local probability propagation in graphical models with loops. Neural Computation, 12, 1-41.
25. Weiss, Y., & Freeman, W. (2001). On the optimality of solutions of the max-product belief propagation algorithm. IEEE Transactions on Information Theory, 37(2), 736-744.
26. Wiberg, N. (1996). Codes and decoding on general graphs. Unpublished doctoral dissertation, University of Linkoping, Sweden.