Correctness of local probability propagation in graphical models with loops

Neural Computation

Volumn 12, Issue 1, 2000, Pages 1-41

  Weiss, Yair ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; BAYES THEOREM; COMPUTER SIMULATION; PROBABILITY; STATISTICAL MODEL;

BAYES THEOREM; COMPUTER SIMULATION; MARKOV CHAINS; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER); PROBABILITY;

EID: 84988779772     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976600300015880     Document Type: Article

References (27)

1. Aji, S., Horn, G., & McEliece, R. (1998). On the convergence of iterative decoding on graphs with a single cycle. In Proc. 1998 ISIT.
2. Aji, S. M., & McEliece, R. (in press). The generalized distributive law. IEEE Trans. Inform. Theory. Available at: http://www.systems.caltech.edu/ EE/Faculty/rjm.
3. Benedetto, S., Montorsi, G., Divsalar, D., & Pollara, F. (1996). Soft-output decoding algorithms in iterative decoding of turbo codes (Jet Propulsion Laboratory, Telecommunications and Data Acquisition Progress Rep. 42-124). Pasadena, CA: California Institute of Technology.
4. Berrou, C., Glavieux, A., & Thitimajshima, P. (1993). Near Shannon limit error-correcting coding and decoding: Turbo codes. In Proc. IEEE International Communications Conference '93.
5. Bertsekas, D. P. (1987). Dynamic programming: Deterministic and stochastic models. Englewood Cliffs, NJ: Prentice Hall.
6. Forney, G. (1997). On iterative decoding and the two-way algorithm. In Intl. Symp. Turbo Codes and Related Topics (Brest, France).
7. Forney, G., Kschischang, F., & Marcus, B. (1998). Iterative decoding of tail-biting trellisses. Presented at 1998 Information Theory Workshop in San Diego.
8. Frey, B. J. (1998). Graphical models for pattern classification, data compression and channel coding. Cambridge, MA: MIT Press.
9. Frey, B. J., Koetter, R., & Vardy, A. (1998). Skewness and pseudocodewords in iterative decoding. In Proc. 1998 ISIT.
10. Gallager, R. (1963). Low density parity check codes. Cambridge, MA: MIT Press.
11. Gelb, A.(Ed.). (1974). Applied optimal estimation. Cambridge, MA: MIT Press.
12. Geman, S., & Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. PAMI, 6(6), 721-741.
13. Jensen, F. (1996). An introduction to Bayesian networks. Berlin: Springer-Verlag.
14. Kschischang, F. R., & Frey, B. J. (1998). Iterative decoding of compound codes by probability propagation in graphical models. IEEE Journal on Selected Areas in Communication, 16(2), 219-230.
15. Lauritzen, S. (1996). Graphical models. New York: Oxford University Press.
16. MacKay, D., & Neal, R. M. (1995). Good error-correcting codes based on very sparse matrices. In Cryptography and Coding: 5th IAM Conference. Lecture Notes in Computer Science No. 1025 (pp. 100-111). Berlin: Springer-Verlag.
17. McEliece, R., MacKay, D., and Cheng, J. (1998). Turbo decoding as an instance of Pearl's "belief propagation" algorithm. IEEE Journal on Selected Areas in Communication, 16(2), 140-152.
18. McEliece, R., Rodemich, E., & Cheng, J. (1995). The Turbo decision algorithm. In Proc. 33rd Allerton Conference on Communications, Control and Computing (pp. 366-379). Monticello, IL.
19. Minc, H. (1988). Nonnegative matrices. New York: Wiley.
20. Pearl, J. (1988). Probabilistic reasoning in intelligent systems: Networks of plausible inference. San Mateo, CA: Morgan Kaufmann.
21. Rabiner, L. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE, 77(2), 257-286.
22. Smyth, P. (1997). Belief networks, hidden Markov models, and Markov random fields: A unifying view. Pattern Recognition, 18(11), 1261-1268.
23. Smyth, P., Heckerman, D., & Jordan, M. I. (1997). Probabilistic independence networks for hidden Markov probability models. Neural Computation, 9(2), 227-269.
24. Strang, G. (1986). Introduction to applied mathematics. Wellesley, MA: Wellesley-Cambridge.
25. Weiss, Y. (1996). Interpreting images by propagating Bayesian beliefs. In M. Mozer, M. Jordan, & T. Petsche (Eds.), Advances in neural information processing systems, 9. Cambridge, MA: MIT Press.
26. Weiss, Y. (1997). Belief propagation and revision in networks with loops (Tech. Rep. No. 1616). Cambridge, MA: MIT Artificial Intelligence Laboratory.
27. Wiberg, N. (1996). Codes and decoding on general graphs. Unpublished doctoral dissertation, University of Linkoping, Sweden.