Joint source-channel decoding of variable-length codes with soft information: A survey

Eurasip Journal on Applied Signal Processing

Volumn 2005, Issue 6, 2005, Pages 906-927

  Guillemot, Christine ^a   Siohan, Pierre ^b  

^a CAMPUS DE BEAULIEU   (France)

^b France Telecom   (France)

Author keywords

Joint source channel decoding; Source controlled decoding; Turbo principle; Variable length codes

Indexed keywords

BIT ERROR RATE; COMMUNICATION CHANNELS (INFORMATION THEORY); DECODING; GAUSSIAN NOISE (ELECTRONIC); ITERATIVE METHODS; MARKOV PROCESSES; QUALITY OF SERVICE; STATISTICAL METHODS; WIRELESS TELECOMMUNICATION SYSTEMS;

JOINT SOURCE-CHANNEL DECODING (JSCD); SOURCE-CONTROLLED DECODING; TURBO PRINCIPLE; VARIABLE-LENGTH CODES;

TURBO CODES;

EID: 22944471710     PISSN: 11108657     EISSN: None     Source Type: Journal    
DOI: 10.1155/ASP.2005.906     Document Type: Review

References (95)

1. L.-A. Larzon, M. Degermark, S. Pink, L.-E. Jonsson Ed., and G. Fairhurst Ed., "The UDP-lite protocol," IETF internet Draft, December 2002, http://www.ietf.org/proceedings/03jul/I-D/draft-ietf-tsvwg-udp-lite-01.txt.
2. J. Hagenauer, "Rate-compatible punctured convolutional codes (RCPC codes) and their applications," IEEE Trans. Commun.,vol. 36, no. 4, pp. 389-400, 1988.
3. N. Farvardin, "A study of vector quantization for noisy channels," IEEE Trans. Inform. Theory,vol. 36, no. 4, pp. 799-809, 1990.
4. N. Farvardin and V. Vaishampayan, "On the performance and complexity of channel-optimized vector quantizers," IEEE Trans. Inform. Theory,vol. 37, no. 1, pp. 155-160, 1991.
5. T. J. Ferguson and J. H. Rabinowitz, "Self-synchronizing Huffman codes," IEEE Trans. Inform. Theory,vol. 30, no. 4, pp. 687-693, 1984.
6. W. M. Lam and A. R. Reibman, "Self-synchronizing variable-length codes for image transmission," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP '92),vol. 3, pp. 477-480, San Francisco, Calif, USA, March 1992.
7. K. Sayood and J. C. Borkenhagen, "Use of residual redundancy in the design of joint source/channel coders," IEEE Trans. Commun.,vol. 39, no. 6, pp. 838-846, 1991.
8. F. Alajaji, N. Phamdo, and T. Fuja, "Channel codes that exploit the residual redundancy in CELP-encoded speech," IEEE Trans. Speech Audio Processing,vol. 4, no. 5, pp. 325-336, 1996.
9. N. Phamdo and N. Farvardin, "Optimal detection of discrete Markov sources over discrete memoryless channels-applications to combined source-channel coding," IEEE Trans. Inform. Theory,vol. 40, no. 1, pp. 186-193, 1994.
10. K. Sayood, F. Liu, and J. D. Gibson, "A constrained joint source/channel coder design," IEEE J. Select. Areas Commun.,vol. 12, no. 9, pp. 1584-1593, 1994.
11. M. Park and D. J. Miller, "Decoding entropy-coded symbols over noisy channels by MAP sequence estimation for asynchronous HMMs," in Proc. 32nd Annual Conference on Information Sciences and Systems (CISS '98), pp. 477-482, Princeton, NJ, USA, March 1998.
12. J. Wen and J. D. Villasenor, "Utilizing soft information in decoding of variable length codes," in Proc. IEEE Data Compression Conference (DCC '99), pp. 131-139, Snowbird, Utah, USA, March 1999.
13. M. Park and D. J. Miller, "Joint source-channel decoding for variable-length encoded data by exact and approximate MAP sequence estimation," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP '99),vol. 5, pp. 2451-2454, Phoenix, Ariz, USA, March 1999.
14. A. Guyader, E. Fabre, C. Guillemot, and M. Robert, "Joint source-channel turbo decoding of entropy-coded sources," IEEE J. Select. Areas Commun.,vol. 19, no. 9, pp. 1680-1696, 2001, Special issue on the turbo principle: from theory to practice.
15. J. Wen and J. Villasenor, "Soft-input soft-output decoding of variable length codes," IEEE Trans. Commun.,vol. 50, no. 5, pp. 689-692, 2002.
16. A. H. Murad and T. E. Fuja, "Joint source-channel decoding of variable-length encoded sources," in Proc. Information Theory Workshop (ITW'98), pp. 94-95, Killarney, Ireland, June 1998.
17. N. Demir and K. Sayood, "Joint source/channel coding for variable length codes," in Proc. IEEE Data Compression Conference (DCC '98), pp. 139-148, Snowbird, Utah, USA, March-April 1998.
18. J. Hagenauer and P. Hoeher, "A Viterbi algorithm with soft-decision outputs and its applications," in Proc. IEEE Global Telecommunications Conference (GLOBECOM '89),vol. 3, pp. 1680-1686, Dallas, Tex, USA, November 1989.
19. L. R. Bahl, J. Cocke, F. Jelinek, and J. Raviv, "Optimal decoding of linear codes for minimizing symbol error rate," IEEE Trans. Inform. Theory,vol. 20, no. 2, pp. 284-287, 1974.
20. V. Buttigieg and P. G. Farrell, "On variable-length error-correcting codes," in Proc. IEEE International Symposium on Information Theory (ISIT '94), p. 507, Trondheim, Norway, June-July 1994.
21. V. B. Balakirsky, "Joint source-channel coding with variable length codes," in Proc. IEEE International Symposium on Information Theory (ISIT '97), p. 419, Ulm, Germany, June-July 1997.
22. D. J. Miller and M. Park, "A sequence-based approximate MMSE decoder for source coding over noisy channels using discrete hidden Markov models," IEEE Trans. Commun.,vol. 46, no. 2, pp. 222-231, 1998.
23. B. D. Pettijohn, M. W. Hoffman, and K. Sayood, "Joint source/channel coding using arithmetic codes," IEEE Trans. Commun.,vol. 49, no. 5, pp. 826-836, 2001.
24. T. Guionnet and C. Guillemot, "Soft decoding and synchronization of arithmetic codes: application to image transmission over noisy channels," IEEE Trans. Image Processing,vol. 12, no. 12, pp. 1599-1609, 2003.
25. E. Magli, M. Grangetto, and G. Olmo, "Error correcting arithmetic coding for robust video compression," in Proc. 6th Baiona Workshop on Signal Processing in Communications, Baiona, Spain, September 2003, http://wwwl.tlc.polito.it/SAS/grangetto.pdb.shtml.
26. G. F. Elmasry, "Embedding channel coding in arithmetic coding," IEE Proceedings-Communications,vol. 146, no. 2, pp. 73-78, 1999.
27. C. Boyd, J. G. Cleary, S. A. Irvine, I. Rinsma-Melchert, and I. H. Witten, "Integrating error detection into arithmetic coding," IEEE Trans. Commun.,vol. 45, no. 1, pp. 1-3, 1997.
28. G. F. Elmasry, "Joint lossless-source and channel coding using automatic repeat request," IEEE Trans. Commun.,vol. 47, no. 7, pp. 953-955, 1999.
29. I. Sodagar, B. B. Chai, and J. Wus, "A new error resilience technique for image compression using arithmetic coding," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP '00),vol. 4, pp. 2127-2130, Istanbul, Turkey, June 2000.
30. T. Guionnet and C. Guillemot, "Soft and joint source-channel decoding of quasi-arithmetic codes," Eurasip J. Appl. Signal Process.,vol. 2004, no. 3, pp. 393-411, 2004.
31. J. Garcia-Frias and J. D. Villasenor, "Combining hidden Markov source models and parallel concatenated codes," IEEE Commun. Lett.,vol. 1, no. 4, pp. 111-113, 1997.
32. N. Gortz, "On the iterative approximation of optimal joint source-channel decoding," IEEE J. Select. Areas Commun.,vol. 19, no. 9, pp. 1662-1670, 2001.
33. M. Adrat, U. von Agris, and P. Vary, "Convergence behavior of iterative source-channel decoding," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP '03),vol. 4, pp. 269-272, Hong Kong, China, April 2003.
34. S. ten Brink, "Convergence behavior of iteratively decoded parallel concatenated codes," IEEE Trans. Commun.,vol. 49, no. 10, pp. 1727-1737, 2001.
35. R. Bauer and J. Hagenauer, "Iterative source/channel- decoding using reversible variable length codes," in Proc. IEEE Data Compression Conference (DCC '00), pp. 93-102, Snowbird, Utah, USA, March 2000.
36. R. Bauer and J. Hagenauer, "Turbo FEC/VLC decoding and its application to text compression," in Proc. 34th Annual Conference on Information Sciences and Systems (CISS '00), pp. WA6.6-WA6.11, Princeton, NJ, USA, March 2000.
37. R. Bauer and J. Hagenauer, "Symbol-by-symbol MAP decoding of variable length codes," in Proc. 3rd ITC Conference on Source and Channel Coding (CSCC '00), pp. 111-116, Munich, Germany, January 2000.
38. J. Kliewer and R. Thobaben, "Parallel concatenated joint source-channel coding," Electronics Letters,vol. 39, no. 23, pp. 1664-1666, 2003.
39. J. Hagenauer, "Source-controlled channel decoding," IEEE Trans. Commun.,vol. 43, no. 9, pp. 2449-2457, 1995.
40. J. Garcia-Prias and J. D. Villasenor, "Joint turbo decoding and estimation of hidden Markov sources," IEEE J. Select. Areas Commun.,vol. 19, no. 9, pp. 1671-1679, 2001.
41. G.-C. Zhu, F. Alajaji, J. Bajcsy, and P. Mitran, "Non-systematic turbo codes for non-uniform i.i.d. sources over AWGN channels," in Proc. Conference on Information Sciences and Systems (CISS '02), Princeton, NJ, USA, March 2002.
42. L. Guivarch, J.-C. Carlach, and P. Siohan, "Joint source-channel soft decoding of Huffman codes with turbo-codes," in Proc. IEEE Data Compression Conference (DCC '00), pp. 83-92, Snowbird, Utah, USA, March 2000.
43. M. Jeanne, J.-C. Carlach, and P. Siohan, "Joint source-channel decoding of variable-length codes for convolutional codes and turbo codes," IEEE Trans. Commun.,vol. 53, no. 1, pp. 10-15, 2005.
44. G. D. Forney, "The Viterbi algorithm," Proc. IEEE,vol. 61, no. 3, pp. 268-278, 1973.
45. R. W. Chang and J. C. Hancock, "On receiver structures for channels having memory," IEEE Trans. Inform. Theory,vol. 12, no. 4, pp. 463-468, 1966.
46. P. L. McAdam, L. Welch, and C. Weber, "MAP bit decoding of convolutional codes," in Proc. IEEE International Symposium on Information Theory (ISIT '72), Asilomar, Calif, USA, January 1972.
47. J. A. Erfanian and S. Pasupathy, "Low-complexity parallel-structure symbol-by-symbol detection for ISI channels," in Proc. IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, pp. 350-353, Victoria, BC, Canada, June 1989.
48. P. Robertson, E. Villebrun, and P. Hoeher, "A comparison of optimal and sub-optimal MAP decoding algorithms operating in the log domain," in Proc. IEEE International Conference on Communications (ICC '95),vol. 2, pp. 1009-1013, Seattle, Wash, USA, June 1995.
49. F. R. Kschischang and B. J. Frey, "Iterative decoding of compound codes by probability propagation in graphical models," IEEE J. Select. Areas Commun.,vol. 16, no. 2, pp. 219-230, 1998.
50. D. A. Huffman, "A method for the construction of minimum redundancy codes," Proc. IRE,vol. 40, no. 9, pp. 1098-1101, 1952.
51. Y. Takishima, M. Wada, and H. Murakami, "Reversible variable length codes," IEEE Trans. Commun.,vol. 43, no. 2/3/4, pp. 158-162, 1995.
52. R. Bauer and J. Hagenauer, "On variable length codes for iterative source/channel decoding," in Proc. IEEE Data Compression Conference (DCC '01), pp. 273-282, Snowbird, Utah, USA, March 2001.
53. M. Jeanne, J.-C. Carlach, P. Siohan, and L. Guivarch, "Source and joint source-channel decoding of variable length codes," in Proc. IEEE International Conference on Communications (ICC '02),vol. 2, pp. 768-772, New York, NY, USA, April-May 2002.
54. K. P. Subbalakshmi and J. Vaisey, "Joint source-channel decoding of entropy coded Markov sources over binary symmetric channels," in Proc. IEEE International Conference on Communications (ICC '99),vol. 1, pp. 446-450, Vancouver, BC, Canada, June 1999.
55. J. J. Rissanen, "Arithmetic codings as number representations," Acta Polytechnica Scandinavica,vol. 31, pp. 44-51, 1979.
56. P. G. Howard and J. S. Vitter, "Practical implementations of arithmetic coding," in Image and Text Compression, J. A. Storer, Ed., pp. 85-112, Kluwer Academic Publishers, Norwell, Mass, USA, 1992.
57. P. G. Howard and J. S. Vitter, "Design and analysis of fast text compression based on quasi-arithmetic coding," in Proc. IEEE Data Compression Conference (DCC '93), pp. 98-107, Snowbird, Utah, USA, March-April 1993.
58. D. Taubman, "High performance scalable image compression with EBCOT," IEEE Trans. Image Processing,vol. 9, no. 7, pp. 1158-1170, 2000.
59. D. Marpe, G. Blättermann, G. Heising, and T. Wiegand, "Video compression using context-based adaptive arithmetic coding," in Proceedings of IEEE International Conference on Image Processing (ICIP '01),vol. 3, pp. 558-561, Thessaloniki, Greece, October 2001.
60. C. Christopoulos, A. Skodras, and T. Ebrahimi, "The JPEG2000 still image coding system: an overview," IEEE Trans. Consumer Electron.,vol. 46, no. 4, pp. 1103-1127, 2000, ISO/IECJTC1/SC29/WG1 (ITU-T) SG8.
61. T. Wiegand and G. Sullivan, "Draft ISO/IEC 14496-10 AVC," March 2003, http://www.h2631.com/h264/JVT-G050.pdf.
62. M. P. C. Fossorier, F. Burkert, S. Lin, and J. Hagenauer, "On the equivalence between SOVA and max-log-MAP decodings," IEEE Commun. Lett.,vol. 2, no. 5, pp. 137-139, 1998.
63. L. Gong, W. Xiaofu, and Y. Xiaoxin, "On SOVA for nonbinary codes," IEEE Commun. Lett.,vol. 3, no. 12, pp. 335-337, 1999.
64. J. Tan and G. L. Stuber, "A MAP equivalent SOVA for non-binary turbo codes," in Proc. IEEE International Conference on Communications (ICC '00),vol. 2, pp. 602-606, New Orleans, La, USA, June 2000.
65. A. J. Viterbi, "An intuitive justification and a simplified implementation of the MAP decoder for convolutional codes," IEEE J. Select. Areas Commun.,vol. 16, no. 2, pp. 260-264, 1998.
66. R. M. Fano, "A heuristic discussion of probabilistic decoding," IEEE Trans. Inform. Theory,vol. 9, no. 2, pp. 64-74, 1963.
67. S. Lin and D. J. Costello Jr., Error Control Coding: Fundamentals and Applications, Prentice Hall, Englewood Cliffs, NJ, USA, 1983.
68. J. L. Massey, "Variable-length codes and the Fano metric," IEEE Trans. Inform. Theory,vol. 18, no. 1, pp. 196-198, 1972.
69. C. Weiss, S. Riedel, and J. Hagenauer, "Sequential decoding using a priori information," Electronics Letters,vol. 32, no. 13, pp. 1190-1191, 1996.
70. A. Kopansky, Joint source-channel decoding for robust transmission of video, Ph.D. thesis, Drexel University, Philadelphia, Pa, USA, August 2002.
71. L. Perros-Meilhac and C. Lamy, "Huffman tree based metric derivation for a low-complexity sequential soft VLC decoding," in Proc. IEEE International Conference on Communications (ICC '02),vol. 2, pp. 783-787, New York, NY, USA, April-May 2002.
72. C. Lamy and L. Perros-Meilhac, "Low complexity iterative decoding of variable-length codes," in Proc. Picture Coding Symposium (PCS '03), pp. 275-280, Saint Malo, France, April 2003.
73. F. Jelinek, "Fast sequential decoding algorithm using a stack," IBM Journal of Research and Development,vol. 13, no. 6, pp. 675-685, 1969.
74. C. Demiroglu, M. W. Huffman, and K. Sayood, "Joint source channel coding using arithmetic codes and trellis coded modulation," in Proc. IEEE Data Compression Conference (DCC '01), pp. 302-311, Snowbird, Utah, USA, March 2001.
75. C. Berrou and A. Glavieux, "Near optimum error correcting coding and decoding: turbo-codes," IEEE Trans. Commun.,vol. 44, no. 10, pp. 1261-1271, 1996.
76. B. J. Frey and D. J. C. MacKay, "A revolution: belief propagation in graphs with cycles," in Proc. Neural Information Processing Systems Conference (NIPS '97), Denver, Colo, USA, December 1997.
77. R. J. McEliece, D. J. C. MacKay, and J.-F. Cheng, "Turbo decoding as an instance of Pearl's "belief propagation" algorithm," IEEE J. Select. Areas Commun.,vol. 16, no. 2, pp. 140-152, 1998.
78. J. Hagenauer, "The turbo principle: tutorial introduction and state of the art," in Proc. International Symposium on Turbo Codes and Related Topics, pp. 1-11, Brest, France, September 1997.
79. M. Jeanne, Etude des systèmes robustes de décodage conjoint source-canal pour la transmission sans fil de vidéo, Ph.D. thesis, Instituts Nationaux des Sciences Appliquées (INSA), Rennes, France, 2003.
80. S. Benedetto, G. Montorsi, D. Divsalar, and F. Pollara, "Iterative decoding of serially concatenated codes with interleavers and comparison with turbo codes," in Proc. IEEE Global Telecommunications Conference (GLOBECOM '97),vol. 2, pp. 654-658, Phoenix, Ariz, USA, November 1997.
81. G.-C. Zhu and F. Alajaji, "Turbo codes for nonuniform memoryless sources over noisy channels," IEEE Commun. Lett.,vol. 6, no. 2, pp. 64-66, 2002.
82. A. Elbaz, R. Pyndiah, B. Solaiman, and O. Ait Sab, "Iterative decoding of product codes with a priori information over a Gaussian channel for still image transmission," in Proc. IEEE Global Telecommunications Conference (GLOBECOM '99),vol. 5, pp. 2602-2606, Rio de Janeireo, Brazil, December 1999.
83. Z. Peng, Y.-F. Huang, and D. J. Costello Jr., "Turbo codes for image transmission-a joint channel and source decoding approach," IEEE J. Select. Areas Commun.,vol. 18, no. 6, pp. 868-879, 2000.
84. L. Guivarch, P. Siohan, and J.-C. Carlach, "Low complexity soft decoding of Huffman encoded Markov sources using turbo-codes," in Proc. IEEE 7th International Conference on Telecommunications (ICT '00), pp. 872-876, Acapulco, Mexico, May 2000.
85. T. Okuda, E. Tanaka, and T. Kasai, "A method for the correction of garbled words based on the Levenshtein metric," IEEE Trans. Comput.,vol. 25, no. 2, pp. 172-178, 1976.
86. K. Lakovic and J. Villasenor, "Combining variable length codes and turbo codes," in Proc. IEEE 55th Vehicular Technology Conference (VTC '02),vol. 4, pp. 1719-1723, Birmingham, Ala, USA, May 2002.
87. C. Weidmann and P. Siohan, "Décodage conjoint source-canal avec estimation en ligne de la source," in Compression et Représentation des Signaux Audiovisuels (CORESA '03), Lyon, France, January 2003.
88. C. Weidmann and P. Siohan, "Vidéo sur canal radio-mobile," Tech. Rep. 59, 2003, Chapter 8 of COSOCATI RNRT, http://www.telecom.gouv.fr/rnrt/rnrt/projets/res_d59_ap99.htm.
89. A. H. Murad and T. E. Fuja, "Robust transmission of variable-length encoded sources," in Proc. IEEE Wireless Communications and Networking Conference (WCNC '99),vol. 2, pp. 968-972, New Orleans, La, USA, September 1999.
90. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE,vol. 77, no. 2, pp. 257-286, 1989.
91. K. P. Subbalakshmi and Q. Chen, "Joint source-channel decoding for MPEG-4 coded video over wireless channels," in Proc. IASTED International Conference on Wireless and Optical Communications (WOC '02), pp. 617-622, Banff, AB, Canada, July 2002.
92. A. Kopansky and M. Bystrom, "Sequential decoding of MPEG-4 coded bitstreams for error resilience," in Proc. 33rd Annual Conference on Information Sciences and Systems (CISS '99), Baltimore, Md, USA, March 1999.
93. M. Jeanne, P. Siohan, and J.-C. Carlach, "Comparaison de deux approches du décodage conjoint source-canal," in Proc. GRETSI, Paris, France, September 2003.
94. X. Jaspar and L. Vandendorpe, "Three SISO modules joint source-channel turbo decoding of variable length coded images," in Proc. 5th International ITG Conference on Source and Channel Coding (SCC '04), Erlangen, Germany, January 2004.
95. S. Mérigeault and C. Lamy, "Concepts for exchanging extra information between protocol layers transparently for the standard protocol stack," in Proc. IEEE 10th International Conference on Telecommunications (ICT '03),vol. 2, pp. 981-985, Tahiti, French Polynesia, February-March 2003.