The generalized area theorem and some of its consequences

IEEE Transactions on Information Theory

Volumn 55, Issue 11, 2009, Pages 4793-4821

  Méasson, Cyril ^a   Montanari, Andrea ^b   Richardson, Thomas J ^a   Urbanke, Rüdiger ^c  

^a QUALCOMM INC   (United States)

^b STANFORD UNIVERSITY   (United States)

^c EPFL   (Switzerland)

Author keywords

Area theorem; Belief propagation (BP); Entropy; EXIT curve; Maximum a posteriori; Maximum likelihood; Maxwell construction; Phase transition; Threshold

Indexed keywords

AREA THEOREM; BELIEF PROPAGATION (BP); EXIT CURVE; MAXIMUM A POSTERIORI; MAXWELL CONSTRUCTION; THRESHOLD;

BACKPROPAGATION; INFORMATION THEORY; ITERATIVE DECODING; MAXWELL EQUATIONS; PHASE TRANSITIONS; PROBABILITY; SIGNAL ENCODING;

MAXIMUM LIKELIHOOD;

EID: 70350710226     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2009.2030457     Document Type: Article

References (45)

1. C. Méasson, A. Montanari, T. Richardson, and R. Urbanke, "Life above threshold: From list decoding to area theorem and MSE," in Proc. IEEE Information Theory Workshop, San Antonio, TX, Oct. 2004.
2. C. Méasson, A. Montanari, T. Richardson, and R. Urbanke, "Maximum a posteriori decoding and turbo codes for general memoryless channels," in Proc. e IEEE Int. Symp. Information Theory, Adelaide, Australia, Sep. 2005, pp. 1241-1245.
3. C. Méasson and R. Urbanke, "An upper-bound on the ML thresholds of LDPC ensembles over the BEC," in Proc. 41th Annu. Allerton Conf. Communication, Control and Computing, Monticello, IL, Oct. 2003.
4. C. Méasson, A. Montanari, and R. Urbanke, "Maxwell's construction: The hidden bridge between maximum-likelihood and iterative decoding," in Proc. IEEE Int. Symp. Information Theory, Chicago, IL, Jun./Jul. 2004, p. 224.
5. C. Méasson, A. Montanari, and R. Urbanke, "Maxwell's construction: The hidden bridge between iterative and maximum a posteriori decoding," IEEE Trans. Inf. Theory., vol. 54, no. 12, Dec. 2008.
6. D. Guo, S. Shamai (Shitz), and S. Verdú, "Mutual information and conditional mean estimation in Poisson channels," in Proc. IEEE Informormation Theory Workshop, San Antonio, TX, Oct. 2004, pp. 265-270.
7. D. Guo, S. Shamai (Shitz), and S. Verdú, "Mutual information and minimum mean-square error in gaussian channels," IEEE Trans. Inf. Theory, vol. 51, no. 4, pp. 1261-1882, Apr. 2005.
8. N. Macris, "Correlation inequalities: A useful tool in the theory of LDPC codes," in Proc. IEEE Int. Symp. Information Theory, Adelaide, Australia, Sep. 2005, pp. 2369-2373.
9. D. Guo, S. Shamai (Shitz), and S. Verdú, "Additive non-gaussian noise channels: Mutual information and conditional mean estimation," in Proc. IEEE Int. Symp. Information Theory, Adelaide, Australia, Sep. 2005, pp. 719-723.
10. M. Zakai, "On mutual information, likelihood-ratios and estimation error for the additive gaussian channel," IEEE Trans. Inf. Theory submitted for publication.
11. T. Richardson and R. Urbanke, Modern Coding Theory. Cambridge, U.K.: Cambridge Univ. Press, 2009.
12. M. Luby, M. Mitzenmacher, A. Shokrollahi, and D. A. Spielman, "Efficient erasure correcting codes," IEEE Trans. Inf. Theory, vol. 47, no. 2, pp. 569-584, Feb. 2001.
13. M. Luby, M. Mitzenmacher, A. Shokrollahi, and D. A. Spielman, "Improved low-density parity-check codes using irregular graphs," IEEE Trans. Inf. Theory, vol. 47, no. 2, pp. 585-598, Feb. 2001.
14. T. Richardson and R. Urbanke, "The capacity of low-density parity check codes under message-passing decoding," IEEE Trans. Inf. Theory, vol. 47, no. 2, pp. 599-618, Feb. 2001.
15. T. Richardson, A. Shokrollahi, and R. Urbanke, "Design of capacity-approaching irregular low-density parity-check codes," IEEE Trans. Inf. Theory, vol. 47, no. 2, pp. 619-637, Feb. 2001.
16. A. Ashikhmin, G. Kramer, and S. ten Brink, "Extrinsic information transfer functions: Model and erasure channel property," IEEE Trans. Inf. Theory, vol. 50, no. 11, pp. 2657-2673, Nov. 2004.
17. S. ten Brink, "Convergence of iterative decoding," Electron. Lett. vol. 35, no. 10, pp. 806-808, May 1999.
18. S. ten Brink, "Iterative decoding for multicode CDMA," in Proc. IEEE Vehicular Technology Conf. (VTC), May 1999, vol. 3, pp. 1876-1880.
19. S. ten Brink, "Designing iterative decoding schemes with the extrinsic information transfer chart," AEU Int. J. Electron. Commun., vol. 54, pp. 389-398, 2000.
20. S. ten Brink, "Iterative decoding trajectories of parallel concatenated codes," in Proc. 3rd IEEE/ITG Conf. Source Channel Coding, Munich, Germany, Jan. 2000, pp. 75-80.
21. S. ten Brink, "Convergence behavior of iteratively decoded parallel concatenated codes," IEEE Trans. Commun., vol. 49, no. 10, pp. 1727-1737, Oct. 2001.
22. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
23. I. Land, P. Hoeher, S. Huettinger, and J. B. Huber, "Bounds on information combining," in Proc. 3rd Int. Symp. Turbo Codes and Related Topics, Brest, France, Sep. 2003, pp. 39-42.
24. S. Huettinger and J. B. Huber, "Information processing and combining in channel coding," in Proc. of the 3rd Int. Symp. on Turbo Codes and Related Topics, Brest, France, Sep. 2003.
25. I. Sutskover, S. Shamai (Shitz), and J. Ziv, "Extremes of information combining," in Proc. 41th Annu. Allerton Conf. Communication, Control and Computing, Monticello, IL, 2003.
26. D. Guo, S. Shamai (Shitz), and S. Verdú, "Mutual information and MMSE in gaussian channels," in Proc. IEEE Int. Symp. Information Theory, Chicago, IL, Jun./Jul. 2004, p. 349.
27. A. Montanari, "The glassy phase of Gallager codes," Eur. Phys. J. B vol. 23, pp. 121-136, 2001.
28. A. Montanari, "Tight bounds for LDPC and LDGM codes under MAP decoding," IEEE Trans. Infm. Theory, vol. 51, no. 9, pp. 3221-3246, Sep. 2005.
29. G.Wiechman and I. Sason, "Improved bounds on the parity-check density and achievable rates of binary linear block codes with applications to LDPC codes," IEEE Trans. Inf. Theory, submitted for publication.
30. D. Burshtein, M. Krivelevich, S. L. Litsyn, and G. Miller, "Upper bounds on the rate of LDPC codes," IEEE Trans. Inf. Theory, vol. 48, no. 9, pp. 2437-2449, Sep. 2002.
31. A. N. Shiryaev, Probability. New York: Springer, 1996.
32. R. F. Brown, A Topological Introduction to Nonlinear Analysis. Cambridge, MA: Birkhäuser, 1993.
33. I. Land, P. Hoeher, S. Huettinger, and J. B. Huber, "Bounds on information combining," IEEE Trans. Inf. Theory, vol. 51, no. 2, pp. 612-619, Feb. 2005.
34. I. Sutskover, S. Shamai(Shitz), and J. Ziv, "Constrained information combining: Theory and applications for LDPC coded systems," IEEE Trans. Inf. Theory, submitted for publication.
35. K. Bhattad and K. R. Narayanan, "An MSE based transfer chart to analyze iterative decoding schemes," in Proc. Allerton Conf. Communications, Control and Computing, Monticello, IL, Oct. 2004.
36. A. Shokrollahi, "Capacity-achieving sequences," in Codes, Systems, and Graphical Models, B. Marcus and J. Rosenthal, Eds. New York: Springer-Verlag, 2000, vol. 123, IMA Volumes in Mathematics and its Applications, pp. 153-166.
37. P. Oswald and A. Shokrollahi, "Capacity achieving sequences for the erasure channel," in Proc. Int. Symp. Information Theory, Washington, DC, Jun. 2001, p. 48.
38. A. Ashikhmin, G. Kramer, and S. ten Brink, "Extrinsic information transfer functions: A model and two properties," in Proc. Conf. Information Sciences and Systems (CISS), Mar. 2002.
39. A. Ashikhmin, G. Kramer, and S. ten Brink, "Code rate and the area under extrinsic information transfer curves," in Proc. IEEE Int. Symp. Information Theory, Lausanne, Switzerland, Jun./Jul. 2002, p. 115.
40. C. Méasson and R. Urbanke, "Asymptotic analysis of turbo codes over the binary erasure channel," in Proc. 12th Joint Conf. Communications and Coding, Saas Fee, Switzerland, Mar. 2002.
41. C. Méasson and R. Urbanke, "Further analytic properties of EXIT-like curves and applications," in Proc. IEEE Int. Symp. Information Theory, Yokohama, Japan, Jun./Jul. 2003, p. 266.
42. G. D. Forney, Lecture Notes. Cambridge, MA: MIT, 2005.
43. J. Hagenauer, E. Offer, and L. Papke, "Iterative decoding of binary block and convolutional codes," IEEE Trans. Inf. Theory, vol. 42, no. 2, pp. 429-445, Mar. 1996.
44. A. H. Zemanian, Distribution Theory and Transform Analysis. New York: Dover, 1965.
45. D. Guo, "Gaussian Channels: Information, Estimation and Multiuser Detection," Ph.D. dissertation, Princeton University, Preinceton, NJ, 2004.