Instanton method of post-error-correction analytical evaluation

2004 IEEE Information Theory Workshop - Proceedings, ITW

Volumn , Issue , 2004, Pages 220-224

  Chernyak, Vladimir ^a   Chertkov, Misha ^b   Stepanov, Misha ^c   Vasic, Bane ^d  

^a Corning Inc ^*  (United States)

^b LOS ALAMOS NATIONAL LABORATORY   (United States)

^c University of Arizona   (United States)

^d UNIVERSITY OF ARIZONA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BELIEF PROPOGATION (BP) DECODING; ERROR CODES; LINEAR BLOCK CODES; MAXIMUM A-POSTERION (MAP) DECODING;

ALGORITHMS; APPROXIMATION THEORY; BIT ERROR RATE; BLOCK CODES; COMMUNICATION CHANNELS (INFORMATION THEORY); COMPUTER SIMULATION; ERROR CORRECTION; GRAPH THEORY; ITERATIVE METHODS; MATHEMATICAL MODELS; PROBABILITY; TREES (MATHEMATICS); TURBO CODES;

FADING (RADIO);

EID: 19544370665     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (42)

1. D. Burshtein and G. Miller, "Bounds On The Performance Of Belief Propagation Decoding," IEEE Trans. Inform. Theory, vol. 48, pp. 112-122, Jan. 2002.
2. M. Luby, M. Mitzenmacher, A. Shokrollahi, and D. A. Spielman, "Improved Low-Density Parity-Check Codes Using Irregular Graphs," IEEE Trans. Inform. Theory, vol. 47, pp. 585-598, Feb. 2001.
3. T. Richardson and R. Urbanke, "The Capacity Of Low-Density Parity Check Codes Under Message-passing Decoding," IEEE Trans. Inform. Theory, vol. 47, pp. 599-618, Feb. 2001.
4. T. Richardson, A. Shokrollahi, and R. Urbanke, "Design of Capacity-approaching Irregular Low-Density Parity-Check Codes," IEEE Trans. Inform. Theory, vol. 47, pp. 619-637, Feb. 2001.
5. M. Sipser and D. Spielman, "Expander Codes," IEEE Trans. Inform. Theory, vol. 42, pp. 1710-1723, Nov. 1996.
6. R. G. Gallager, Low Density Parity Check Codes. Cambridge, MA: M.I.T Press, 1963.
7. N. Sourlas, "Spin-Glass Models as Error-Correcting Codes", Nature, vol. 338, pp. 693-695, 1989.
8. N. Sourlas, " Spin Glasses, Error-Correcting Codes and Finite-Temperature Decoding," Europhysics Letters, vol. 25, pp. 159-164, 1994.
9. N. Sourlas, "Statistical Mechanics And Capacity-Approaching Error-Correcting Codes," Physica A, vol. 302 pp. 14-21, 2001.
10. I. M. Lifshitz, "Energy spectrum structure and quantum states of disodered condensed systems, Usp. Fiz. Nauk, vol. 83, no. 4, pp. 617-663, 1964.
11. [Sov. Phys. Uspehi 7 (4) 549-573 (1965)].
12. L. N. Lipatov, "Divergence of the perturbation-theory series and the quasiclassical theory," Zh. Eksp. Tear. Fiz., vol. 72, no. 2, pp. 411-427, 1977.
13. [Sov. Phys. JETP 45 (2) 216-223 (1977)].
14. G. Falkovich, I. Kolokolov, V. Lebedev, and A. Migdal, "Instantons and Intermittency," Phys. Rev. E 54, vol. 5, pp. 4896-4907, 1996.
15. M. Chertkov, "Instanton For Random Avection," Phys. Rev. E 55, vol. 3, pp. 2722-2735, 1997.
16. E. Balkovsky and V. Lebedev, "Instanton for the Kraichnan Passive Scalar Problem," Phys. Rev. E, vol. 58, no. 5, pp. 5776-5795, 1998.
17. A.I. Chernykh, M.G. Stepanov, "Large Negative Velocity Gradients in Burgers Turbulence," Phys. Rev. E, vol. 64, pp. 026306-11, 2001.
18. R. M. Tanner, "A Recursive Approach to Low Complexity Codes," IEEE Trans. Inform. Theory, vol. IT-27, pp. 533-547, Sept. 1981.
19. P. Rujan, "Finite Temperature Error-Correcting Codes," Physical Review Letters, vol. 70, pp. 2968-2971, 1993.
20. H. Nishimori, "Optimum Decoding Temperature for Error-Correcting Codes," Journal of the Physical Society of Japan, vol. 62, pp. 2973-2975, 1993.
21. A. Montanari, "Turbo Codes: The Phase Transition," The European Physical Journal B, vol. 18, pp. 121-136, 2000.
22. A. Montanari, "The Glassy Phase of Gallager Codes," Eur. Phys. J. B, vol. 23, pp. 121-136, 2001.
23. J. Yedidia, W. Freeman, and Y, Weiss, " Generalized Belief Propagation," in Advances in Neural Information Processing Systems, 13, Eds. T. Leen, T. Dietrich and V. Tresp, pp. 689-695, 2000.
24. J. Yedidia, W. Freeman, and Y, Weiss, "Bethe Free Energy, Kikuchi Approximations, and Belief Propagation Algorithms," available at www.merl.com/papers/TR2001-16/.
25. J. Yedidia, W. Freeman, and Y, Weiss, " Constructing Free Energy Approximations and Generalized Belief Propagation Algorithms," available at www.merl.com/papers/TR2002-35/.
26. S. Franz, M. Leone, A. Montanari, F. Ricci-Tersenghi, "Dynamic Phase Transition for Decoding Algorithms," Physical Review E, vol. 66, pp. 0461201-17, 2002.
27. M. Mezard, G. Parisi, M.A. Virasoro, Spin Glass Theory and Beyond: An Introduction to the Replica Method and Its Applications, World Scientific Lecture Notes in Physics, Vol. 9, 1987.
28. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo, CA: Morgan Kaufmann, 1988.
29. H. A. Bethe, Statistical theory of superlattices. Proc. Roy. Soc. London, ser.A, vol.150, pp.552-575, 1935.
30. S. Litsyn and V. Shevelev, "On ensembles of low-density parity-check codes: distance distributions," IEEE Trans. Inform. Theory, submitted for publication.
31. D. J. C. MacKay, "Good error-correcting codes based on very sparse matrices," IEEE Trans. Inform. Theory, vol. 45, pp. 399-431, Mar. 1999.
32. G. Miller and D. Burshtein, "Bounds on the maximum like-lihood decoding error probability of low density parity check codes," IEEE Trans. Inform. Theory, vol. 47, pp. 2696-2710, Nov. 2001.
33. A. Kolmogorov, I. Petrovsky and N. Piscounov, " Etude de l'Équation del la Diffusion avec Crossance de la Quantité de Matière et son Application à un Problèma Biologigue," Moscow Univ. Bull. Ser. Internat. Sect. A, 1, pp. 1-25, 1937.
34. P. Pakzad, and V. Anantharam, "Belief Propagation and Statistical Physics," Proc. 8002 Conf. Inform. Sciences and Systems, Princeton, March 2002.
35. B. Derrida, "Random-Energy Model: An Exactly Solvable Model of Disordered Systems," Physical Review B, vol. 24, pp. 2613-2626, 1981.
36. R. Kindermann and J. L. Snell, Markov Random Fields and their Applications, Providence, Rhode Island: American Mathematical Society, 1980.
37. E. Aarts and J. Korst, Simulated Annealing and Boltzmann Machines, Chichester, England: Wiley, 1989.
38. C. Di, D. Proietti, E. Telatar, T. Richardson, and R. Urbanke, "Finite Length Analysis of Low-density Parity-check Codes," IEEE Trans. Inform. Theory, vol. 48, pp. 1570-1579, 2002.
39. R. McEliece, The Theory of Information and Coding, Reading, Massachusetts: Addison-Wesley, 1977.
40. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pt. I, pp. 379-423, 1948;
41. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pt. II, pp. 623-656, 1948.
42. D. Burshtein and G. Miller, "Expander Graph Arguments For Message Passing Algorithms," IEEE Trans. Inform. Theory, vol. 47, pp. 782-790, Feb. 2001.