Threshold saturation for spatially coupled LDPC and LDGM codes on BMS channels

IEEE Transactions on Information Theory

Volumn 60, Issue 12, 2014, Pages 7389-7415

  Kumar, Santhosh ^a   Young, Andrew J ^b   Macris, Nicolas ^c   Pfister, Henry D ^d  

^a Texas A and M University   (United States)

^b Department of Electrical Engineering and Computer Science   (United States)

^c EPFL   (Switzerland)

^d USA   (United States)

Author keywords

Convolutional LDPC codes; density evolution; entropy functional; potential functions; spatial coupling; threshold saturation

Indexed keywords

CONVOLUTION; CONVOLUTIONAL CODES; ENTROPY; FORWARD ERROR CORRECTION; SATELLITE COMMUNICATION SYSTEMS;

CONVOLUTIONAL LDPC CODES; DENSITY EVOLUTION; ENTROPY FUNCTIONAL; POTENTIAL FUNCTION; SPATIAL COUPLINGS; THRESHOLD SATURATIONS;

DECODING;

EID: 84912119370     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2014.2360692     Document Type: Article

References (46)

1. A. J. Felstrom and K. S. Zigangirov, "Time-varying periodic convolutional codes with low-density parity-check matrix," IEEE Trans. Inf. Theory, vol. 45, no. 6, pp. 2181-2191, Sep. 1999.
2. A. Sridharan, M. Lentmaier, D. J. Costello, Jr., and K. Zigangirov, "Convergence analysis for a class of LDPC convolutional codes on the erasure channel," in Proc. Annu. Allerton Conf. Commun., Control, Comput., Monticello, IL, USA, Oct. 2004, pp. 953-962.
3. M. Lentmaier, A. Sridharan, K. S. Zigangirov, and D. J. Costello, "Terminated LDPC convolutional codes with thresholds close to capacity," in Proc. IEEE Int. Symp. Inf. Theory, Adelaide, Australia, Sep. 2005, pp. 1372-1376.
4. M. Lentmaier, A. Sridharan, D. J. Costello, and K. S. Zigangirov, "Iterative decoding threshold analysis for LDPC convolutional codes," IEEE Trans. Inf. Theory, vol. 56, no. 10, pp. 5274-5289, Oct. 2010.
5. S. Kudekar, T. J. Richardson, and R. L. Urbanke, "Threshold saturation via spatial coupling: Why convolutional LDPC ensembles perform so well over the BEC," IEEE Trans. Inf. Theory, vol. 57, no. 2, pp. 803-834, Feb. 2011.
6. S. Kudekar and R. Urbanke. Spatial Coupling and The Threshold Saturation Phenomenon. [Online]. Available: http://ipg.epfl.ch/ doku.php?id=en:publications:scc-tutorial, accessed Dec. 24, 2013.
7. S. Kudekar, T. Richardson, and R. L. Urbanke, "Spatially coupled ensembles universally achieve capacity under belief propagation," IEEE Trans. Inf. Theory, vol. 59, no. 12, pp. 7761-7813, Dec. 2013.
8. S. Kudekar, C. Méasson, T. Richardson, and R. Urbanke, "Threshold saturation on BMS channels via spatial coupling," in Proc. 6th Int. Symp. Turbo Codes Iterative Inf. Process., Sep. 2010, pp. 309-313.
9. V. Rathi, R. Urbanke, M. Andersson, and M. Skoglund, "Rateequivocation optimal spatially coupled LDPC codes for the BEC wiretap channel," in Proc. IEEE Int. Symp. Inf. Theory, St. Petersburg, Russia, Jul. 2011, pp. 2393-2397.
10. A. Yedla, H. D. Pfister, and K. R. Narayanan, "Universality for the noisy Slepian-Wolf problem via spatial coupling," in Proc. IEEE Int. Symp. Inf. Theory, St. Petersburg, Russia, Jul. 2011, pp. 2567-2571.
11. S. Kudekar and K. Kasai, "Threshold saturation on channels with memory via spatial coupling," in Proc. IEEE Int. Symp. Inf. Theory, St. Petersburg, Russia, Jul. 2011, pp. 2562-2566.
12. S. Kudekar and K. Kasai, "Spatially coupled codes over the multiple access channel," in Proc. IEEE Int. Symp. Inf. Theory, St. Petersburg, Russia, Jul. 2011, pp. 2816-2820.
13. P. S. Nguyen, A. Yedla, H. D. Pfister, and K. R. Narayanan. "Spatiallycoupled codes and threshold saturation on intersymbol-interference channels." [Online]. Available: http://arxiv.org/abs/1107.3253
14. P. S. Nguyen, A. Yedla, H. D. Pfister, and K. R. Narayanan, "Threshold saturation of spatially-coupled codes on intersymbol-interference channels," in Proc. IEEE Int. Conf. Commun., Ottawa, ON, Canada, Jun. 2012, pp. 2209-2214.
15. K. Takeuchi, T. Tanaka, and T. Kawabata, "Improvement of BP-based CDMA multiuser detection by spatial coupling," in Proc. IEEE Int. Symp. Inf. Theory, St. Petersburg, Russia, Jul. 2011, pp. 1489-1493.
16. C. Schlegel and D. Truhachev, "Multiple access demodulation in the lifted signal graph with spatial coupling," in Proc. IEEE Int. Symp. Inf. Theory, St. Petersburg, Russia, Jul. 2011, pp. 2989-2993.
17. Y.-Y. Jian, H. D. Pfister, and K. R. Narayanan, "Approaching capacity at high rates with iterative hard-decision decoding," in Proc. IEEE Int. Symp. Inf. Theory, Jul. 2012, pp. 2696-2700.
18. S. H. Hassani, N. Macris, and R. Urbanke, "Coupled graphical models and their thresholds," in Proc. IEEE Inf. Theory Workshop, Dublin, Ireland, Aug. 2010, pp. 1-5.
19. S. H. Hassani, N. Macris, and R. Urbanke, "Chains of mean-field models," J. Statist. Mech., Theory Experim., vol. 2012, p. P02011, Feb. 2012.
20. S. H. Hassani, N. Macris, and R. Urbanke, "Threshold saturation in spatially coupled constraint satisfaction problems," J. Statist. Phys., vol. 150, no. 5, pp. 807-850, 2013.
21. S. Kudekar and H. D. Pfister, "The effect of spatial coupling on compressive sensing," in Proc. 48th Annu. Allerton Conf. Commun., Control, Comput., Monticello, IL, USA, Oct. 2010, pp. 347-353.
22. F. Krzakala, M. Mézard, F. Sausset, Y. F. Sun, and L. Zdeborová, "Statistical-physics-based reconstruction in compressed sensing," Phys. Rev. X, vol. 2, p. 021005, May 2012.
23. D. L. Donoho, A. Javanmard, and A. Montanari. (Dec. 2011). "Information-theoretically optimal compressed sensing via spatial coupling and approximate message passing." [Online]. Available: http://arxiv.org/abs/1112.0708
24. A. Yedla, Y.-Y. Jian, P. S. Nguyen, and H. D. Pfister, "A simple proof of threshold saturation for coupled scalar recursions," in Proc. 7th Int. Symp. Turbo Codes Iterative Inf. Process., Aug. 2012, pp. 51-55.
25. A. Yedla, Y.-Y. Jian, P. S. Nguyen, and H. D. Pfister, "A simple proof of threshold saturation for coupled vector recursions," in Proc. IEEE Inf. Theory Workshop, Sep. 2012, pp. 25-29.
26. K. Takeuchi, T. Tanaka, and T. Kawabata, "A phenomenological study on threshold improvement via spatial coupling," IEICE Trans. Fundam., vol. E95-A, no. 5, pp. 974-977, 2012.
27. N. Macris, "Griffith-Kelly-Sherman correlation inequalities: A useful tool in the theory of error correcting codes," IEEE Trans. Inf. Theory, vol. 53, no. 2, pp. 664-683, Feb. 2007.
28. R. Mori, "Connection between annealed free energy and belief propagation on random factor graph ensembles," in Proc. IEEE Int. Symp. Inf. Theory, Jul. 2011, pp. 2010-2014.
29. T. J. Richardson and R. L. Urbanke, Modern Coding Theory. New York, NY, USA: Cambridge Univ. Press, 2008.
30. A. Montanari, "Tight bounds for LDPC and LDGM codes under MAP decoding," IEEE Trans. Inf. Theory, vol. 51, no. 9, pp. 3221-3246, Sep. 2005.
31. S. Kumar, A. J. Young, N. Macris, and H. D. Pfister, "A proof of threshold saturation for spatially-coupled LDPC codes on BMS channels," in Proc. 50th Annu. Allerton Conf. Commun., Control, Comput., Monticello, IL, USA, Oct. 2012, pp. 176-184.
32. T. J. Richardson and R. L. Urbanke, "The capacity of low-density paritycheck codes under message-passing decoding," IEEE Trans. Inf. Theory, vol. 47, no. 2, pp. 599-618, Feb. 2001.
33. S. Kudekar and N. Macris, "Sharp bounds for optimal decoding of lowdensity parity-check codes," IEEE Trans. Inf. Theory, vol. 55, no. 10, pp. 4635-4650, Oct. 2009.
34. A. Giurgiu, N. Macris, and R. Urbanke. (Jan. 2013). "Spatial coupling as a proof technique." [Online]. Available: http://arxiv.org/abs/1301.5676
35. C. Méasson, A. Montanari, T. J. Richardson, and R. Urbanke, "The generalized area theorem and some of its consequences," IEEE Trans. Inf. Theory, vol. 55, no. 11, pp. 4793-4821, Nov. 2009.
36. M. Luby, "LT codes," in Proc. 43rd Annu. IEEE Symp. Found. Comput. Sci., Washington, DC, USA, Jun. 2002, pp. 271-280.
37. A. Shokrollahi, "Raptor codes," IEEE Trans. Inf. Theory, vol. 52, no. 6, pp. 2551-2567, Jun. 2006.
38. M. J. Wainwright, E. Maneva, and E. Martinian, "Lossy source compression using low-density generator matrix codes: Analysis and algorithms," IEEE Trans. Inf. Theory, vol. 56, no. 3, pp. 1351-1368, Mar. 2010.
39. V. Aref, N. Macris, and M. Vuffray. (Jul. 2013). "Approaching the ratedistortion limit with spatial coupling, belief propagation and decimation." [Online]. Available: http://arxiv.org/abs/1307.5210
40. V. Aref and R. L. Urbanke, "Universal rateless codes from coupled LT codes," in Proc. IEEE Inf. Theory Workshop, Oct. 2011, pp. 277-281.
41. W. Feller, An Introduction to Probability Theory and Its Applications, vol. 2. New York, NY, USA: Wiley, 1971.
42. G. B. Folland, Real Analysis: Modern Techniques and Their Applications. New York, NY, USA: Wiley, 1999.
43. F. W. Steutel and K. van Harn, Infinite Divisibility of Probability Distributions on the Real Line (Chapman & Hall/CRC Pure and Applied Mathematics). New York, NY, USA: Taylor & Francis, 2003.
44. M. Mézard and A. Montanari, Information, Physics, and Computation. New York, NY, USA: Oxford Univ. Press, 2009.
45. J. M. Walsh and P. A. Regalia, "On the relationship between belief propagation decoding and joint maximum likelihood detection," IEEE Trans. Commun., vol. 58, no. 10, pp. 2753-2758, Oct. 2010.
46. K. Y. M. Wong and D. Sherrington, "Graph bipartitioning and spin glasses on a random network of fixed finite valence," J. Phys. A, Math. General, vol. 20, no. 12, pp. L793-L799, 1987.