Duality between source coding and channel coding and its extension to the side information case

IEEE Transactions on Information Theory

Volumn 49, Issue 5, 2003, Pages 1181-1203

  Pradhan, S Sandeep ^a   Chou, Jim ^b   Ramchandran, Kannan ^b  

^a UNIVERSITY OF MICHIGAN   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Capacity cost function; Channel coding with side information; Duality; Rate distortion function; Source coding with side information

Indexed keywords

CHANNEL CAPACITY; COMMUNICATION CHANNELS (INFORMATION THEORY); COMPUTER NETWORKS; DATA COMMUNICATION SYSTEMS; DECODING; DIGITAL WATERMARKING; DISTRIBUTED COMPUTER SYSTEMS; MATHEMATICAL MODELS; SIGNAL DISTORTION;

CHANNEL CODING; DISTRIBUTED SENSOR NETWORKS; INFORMATION HIDING COMMUNICATION SYSTEMS; RATE DISTORTION FUNCTION; SOURCE CODING;

SIGNAL ENCODING;

EID: 0037516820     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2003.810622     Document Type: Article

References (35)

1. A. D. Wyner and J. Ziv, "The rate-distortion function for source coding with side information at the decoder," IEEE Trans. Inform. Theory, vol. IT-22, pp. 1-10, Jan. 1976.
2. D. P. Bertsekas, Nonlinear Programming. Belmont, MA: Athena Scientific, 1999.
3. C. E. Shannon, "Coding theorems for a discrete source with a fidelity criterion," in IRE Nat. Conv. Rec., Pt. 4, 1959, pp. 142-163.
4. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
5. R. E. Blahut, "Computation of channel capacity and rate-distortion functions," IEEE Trans. Inform. Theory, vol. IT-18, pp. 460-473, July 1972.
6. M. W. Marcellin and T. R. Fischer, "Trellis coded quantization of memoryless and Gauss-Markov sources," IEEE Trans. Commun., vol. 38, pp. 82-93, Jan. 1990.
7. M. V. Eyuboglu and G. D. Forney, "Lattice and trellis quantization with lattice and trellis-bounded codebooks - High rate theory for memoryless sources," IEEE Trans. Inform. Theory, vol. 39, pp. 46-59, Jan. 1993.
8. G. Ungerboeck, "Channel coding with multilevel/phase signals," IEEE Trans. Inform. Theory, vol. IT-28, pp. 55-67, Jan. 1982.
9. R. Laroia, N. Farvardin, and S. A. Tretter, "On optimal shaping of multidimensional constellations," IEEE Trans. Inform. Theory, vol. 40, pp. 1044-1056, July 1994.
10. R. Laroia and N. Farvardin, "A structured fixed-rate vector quantizer derived from a variable length scalar quantizer - Part I: Memoryless sources," IEEE Trans. Inform. Theory, vol. 39, pp. 851-867, May 1993.
11. S. Gel'fand and M. Pinsker, "Coding for channel with random parameters," Probl. Contr. Inform. Theory, vol. 9, pp. 19-31, 1980.
12. M. Gastpar, B. Rimoldi, and M. Vetterli, "To code or not to code," in Proc. IEEE Int. Symp. Information Theory (ISIT'00), Sorrento, Italy, June 2000.
13. ____, "To code or not to code: Lossy source-channel communication revisited," IEEE Trans. Inform. Theory, vol. 49, pp. 1147-1158, May 2003.
14. T. Berger, "Multiterminal source coding," in The Information Theory Approach to Communication (CISM Courses and Lecture Notes), G. Longo, Ed. New York: Springer-Verlag, 1977, vol. 229.
15. S. Shamai (Shitz), S. Verdù, and R. Zamir, "Systematic lossy source/channel coding," IEEE Trans. Inform. Theory, vol. 44, pp. 564-579, Mar. 1998.
16. J. A. O'Sullivan, P. Moulin, and J. M. Ettinger, "Information theoretic analysis of steganography," in Proc. IEEE Int. Symp. Information Theory (ISIT'98), Cambridge, MA, Aug. 1998, p. 297.
17. B. Chen and G. W. Wornell, "An information-theoretic approach to the design of robust digital watermarking systems," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Phoenix, AZ, Mar. 1999.
18. K. Marton, "A coding theorem for the discrete memoryless broadcast channel," IEEE Trans. Inform. Theory, vol. IT-25, pp. 306-311, May 1979.
19. M. Tomlinson, "New automatic equalizer employing modulo arithmetic," Electron. Lett., vol. 7, pp. 138-139, Mar. 1971.
20. M. Costa, "Writing on dirty paper," IEEE Trans. Inform. Theory, IT-29, pp. 439-441, May 1983.
21. A. Cohen and A. Lapidoth, "The Gaussian watermarking game," IEEE Trans. Inform. Theory, vol. 48, pp. 1639-1667, June 2002.
22. U. Erez, S. Shamai, and R. Zamir, "Capacity and lattice-strategies for cancelling known interference," in Proc. ISITA 2000, Honolulu, HI, Nov. 2000.
23. J. Chou, S. S. Pradhan, and K. Ramchandran, "On the duality between distributed source coding and data hiding," in Proc. 33rd Asilomar Conf. Signals, Systems and Computers, Pacific Grove, CA, Nov. 1999.
24. C. Heegard and A. El Gamal, "On the capacity of computer memory with defects," IEEE Trans. Inform. Theory, vol. IT-29, pp. 731-739, Sept. 1983.
25. M. Kesal, M. K. Mihcak, R. Kotter, and P. Moulin, "Iteratively decodable codes for watermarking applications," in Proc. 2nd Int. Symp. Turbo Codes and Related Topics, Brest, France, Sept. 2000.
26. R. Zamir and S. Shamai, "Nested linear/lattice codes for Wyner-Ziv encoding," in Proc. IEEE Information Theory Workshop, Killarney, Ireland, 1998.
27. S. S. Pradhan and K. Ramchandran, "Distributed source coding using syndromes (DISCUS): Design and construction," in Proc. IEEE Data Compression Conf., Snowbird, UT, Mar. 1999.
28. R. M. Gray, "A new class of lower bounds to information rates of stationary sources via conditional rate-distortion functions," IEEE Trans. Inform. Theory, vol. IT-19, pp. 480-489, July 1973.
29. M. Chiang and T. M. Cover, "Unified duality between channel capacity and rate distortion with side information," in Proc. Int. Symp. Information Theory (ISIT'01), Washington, DC, June 2001, p. 301.
30. D. J. Sakrison, "A geometric treatment of the source encoding of a Gaussian random variable," IEEE Trans. Inform. Theory, vol. IT-14, pp. 481-486, May 1968.
31. J. M. Wozencraft and I. M. Jacobs, Principles of Communication Engineering. New York: Wiley, 1967.
32. R. Durrett, Probability Theory and Examples. Pacific Grove, CA: Wadsworth and Brooks, 1996.
33. S. S. Pradhan and K. Ramchandran, "Distributed source coding: Symmetric rates and applications to sensor networks," in Proc. IEEE Data Compression Conf., Snowbird, UT, Mar. 2000.
34. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academi, 1981.
35. P. Moulin and J. A. O'Sullivan, "Information-theoretic analysis of information hiding," in Proc. IEEE Int. Symp. Information Theory (ISIT'00), Sorrento, Italy, June 2000.