On Joint Source-Channel Coding for the Wyner-Ziv Source and the Gel'fand-Pinsker Channel

IEEE Transactions on Information Theory

Volumn 49, Issue 11, 2003, Pages 2844-2855

  Merhav, Neri ^a   Shamai, Shlomo ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Channel state information (CSI); Gel'fand Pinsker coding; Joint source channel coding; Separation theorem; Side information; Wyner Ziv coding

Indexed keywords

CHANNEL CAPACITY; CODE CONVERTERS; CODES (SYMBOLS); ENCODING (SYMBOLS); THEOREM PROVING;

CHANNEL STATE INFORMATION (CSI); SEPARATION THEOREM;

INFORMATION THEORY;

EID: 0344012629     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2003.818410     Document Type: Article

References (47)

1. R. Ahlswede, "Arbitrarily varying channels with states sequence known to the sender," IEEE Trans. Inform. Theory, vol. IT-32, pp. 621-629, Sept. 1986.
2. E. A. Aroutunian and M. E. Aroutunian, "E-capacity upper bound for a channel with random parameter," Probl. Contr. Inform. Theory, vol. 17, no. 2, pp. 99-105, 1988.
3. R. J. Barron, B. Chen, and G. W. Wornell. (2001) The duality between information embedding and source coding with side information and its implications/applications. [Online]. Available: http://allegro.mit.edu/ dspg/publications/Journals/pdf/00Barron.pdf
4. _, "On the duality between information embedding and source coding with side information and some applications," IEEE Trans. Inform. Theory, vol. 49, pp. 1159-1180, May 2003. See Also Proc. IEEE Int. Symp. Information Theory (ISIT2001), Wshington, DC, June 2002, p. 300.
5. _, "On the duality between information embedding and source coding with side information and some applications," IEEE Trans. Inform. Theory, vol. 49, pp. 1159-1180, May 2003. See Also Proc. IEEE Int. Symp. Information Theory (ISIT2001), Wshington, DC, June 2002, p. 300.
6. E. Biglieri, J. Proakis, and S. Shamai (Shitz), "Fading channels: Information-theoretic and communications aspects," IEEE Trans. Inform. Theory, vol. 44, pp. 2619-2692, Oct. 1998.
7. G. Caire and S. Shamai (Shitz). "On the capacity of some channels with channel state information," IEEE Trans. Inform. Theory, vol. 45, pp. 2007-2019, Sept. 1999.
8. B. Chen, S. C. Draper, and G. W. Wornell, "Information embedding and related problems: Recent results and applications," presented at the 39th Allerton Conference on Communication, Control and Computing, Monticello, IL, Oct. 3-5, 2001.
9. M. Chiang and T. M. Cover, "Unified duality between channel capacity and rate distortion with state information." in Proc. Int. Symp. Information Theory (ISIT2001), Washington, DC, June 2001, p. 301.
10. A. S. Cohen, "Information theoretic analysis of watermarking systems," Ph.D. dissertation, MIT, Cambridge, MA, 2001. [Online]. Available: http://www.mit.edu:8001/people/acohen/Pubs/index.html.
11. _, "Communication with side information," Graduate Seminar 6.962, MIT, Cambridge, MA, 2001. [Online]. Available: http://web/mit.edu/6.962/www/www_spring_2001/schedule.html.
12. A. S. Cohen and A. Lapidoth, "The Gaussian watermarking game," IEEE Trans. Inform. Theory, vol. 48, pp. 1639-1667, June 2002.
13. M. H. M. Costa, "Writing on dirty paper," IEEE Trans. Inform. Theory, vol. IT-29, pp. 439-141, May 1983.
14. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
15. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic Press, 1981.
16. A. Das and P. Narayan, "Capacities of time-varying multiple-access channels with side information," IEEE Trans. Inform. Theory, vol. 48, pp. 4-25, Jan. 2002.
17. U. Erez, "Noise Prediction for Channel Coding with Side Information at the Transmitter." M.Sc. thesis, Tel-Aviv Univ., Tel-Aviv, Israel, 1998.
18. U. Erez, S. Shamai (Shitz), and R. Zamir, "Capacity and lattice-strategies for cancelling known interference," in Proc. Int. Symp. Information Theory and Its Applications (ISITA 2000), Honolulu, HI, Nov. 2000.
19. U. Erez and R. Zamir, "Noise prediction for channel coding with side information at the transmitter." IEEE Trans. Inform. Theory, vol. 46, pp. 1610-1617, July 2000.
20. _,"Error exponents of modulo-additive noise channels with side information at the transmitter," IEEE Trans. Inform. Theory, vol. 47, pp. 210-218. Jan. 2001.
21. R. G. Gallager, Information Theory and Reliable Communication. New York: Wiley, 1968.
22. M. Gastpar, B. Rimoldi, and M. Vetterli, "To code, or not to code: Lossy source-channel communication revisited," IEEE Trans. Inform. Theory, vol. 49, pp. 1147-1158, May 2003. See also R. Rimoldi, "Beyond the separation principle: A broader approach to source-channel coding," Proc. 4th Int. Conf. Source and Channel Coding, Berlin, Germany, Jan. 28-30, 2002, pp. 233-238.
23. M. Gastpar, B. Rimoldi, and M. Vetterli, "To code, or not to code: Lossy source-channel communication revisited," IEEE Trans. Inform. Theory, vol. 49, pp. 1147-1158, May 2003. See also R. Rimoldi, "Beyond the separation principle: A broader approach to source-channel coding," Proc. 4th Int. Conf. Source and Channel Coding, Berlin, Germany, Jan. 28-30, 2002, pp. 233-238.
24. S. I. Gel'fand and M. S. Pinsker, "Coding for channel with random parameters," Probl. Inform. and Contr., pp. 19-31, 1980.
25. C. Heegard, "On the capacity of permanent memory," IEEE Trans. Inform. Theory, vol. IT-31, pp. 34-42, Jan. 1985.
26. C. Heegard and A. A. El-Gammal, "On the capacity of commuter memory with defects," IEEE Trans. Inform. Theory, vol. IT-29, pp. 731-739, Sept. 1983.
27. A. H. Kaspi, "Rate-distortion function when side information may be present at the decoder," IEEE Trans. Inform. Theory, vol. 40, pp. 2031-2034, Nov. 1994.
28. A. V. Kuznetsov and A. J. Han Vinck, "On the general defective channel with informed encoder and capacities of some constrained memories, " IEEE Trans. Inform. Theory, vol. 40, pp. 1866-1871, Nov. 1994.
29. U. Mittal and N. Phamdo, "Joint source-channel codes for broadcasting and robust communication," IEEE Trans. Inform. Theory, to be published.
30. S. S. Pradhan, J. Chou, and K. Ramchandran. "Duality between source coding and channel coding and its extension for the side information case. " IEEE Trans. Inform. Theory, vol. 49, pp. 1181-1203, May 2003.
31. Z. Reznic, R. Zamir, and M. Feder, "Joint source-channel coding of a Gaussian mixture source over the Gaussian broadcast channel," IEEE Trans. Inform. Theory, vol. 48, pp. 776-781, Mar. 2002.
32. S. Shamai (Shitz), S. Verdú, and R. Zamir, "Information theoretic aspects of systematic coding," in Proc. Int. Symp. Turbo Codes and Related Topics, Brest, France, Sept. 3-5, 1997, pp. 40-46.
33. _, "Systematic lossy source/channel coding," IEEE Trans. Inform. Theory, vol. 44, pp. 564-579, Mar. 1998.
34. C. E. Shannon, "Channels with side information at the transmitter," IBM J. Res. Develop., vol. 2, pp. 289-293, Oct. 1958.
35. J. D. Slepian and J. K. Wolf, "Noiseless coding of correlated information sources," IEEE Trans. Inform. Theory, vol. IT-19, pp. 471-480. July 1973.
36. J. K. Su, J. J. Eggers, and B. Girod, "Illustration of the duality between channel coding and rate distortion with side information," in Proc. 34th Asimolar Conf. Signals, Systems and Computers. Asimolar, CA, Oct./Nov. 2000.
37. _,"Channel coding and rate distortion with side information: Geometric interpretation and illustration of duality," IEEE Trans. Inform. Theory, submitted for publication.
38. A. Sutivong, T. M. Cover, and M. Chiang, "Tradeoff between message and state information rates," in Proc. IEEE Int. Symp. Information Theory (ISIT2001), Washington, DC, June 2001, p. 303.
39. A. Sulivong, T. M. Cover. M. Chiang, and Y.-H. Kim, "Rate vs. distortion trade-off for channels with state information," in Proc. IEEE Int. Symp. Information Theory (ISIT 2002), Lausanne, Switzerland, June/July 2002, p. 226.
40. B. van Thanh, "Storage capacity of computer memories with defects," Probl. Contr. Inform. Theory, vol. 19, no. 5-6, pp. 423-434, 1990.
41. M. D. Trott, "Unequal error protection codes: Theory and practice," Proc. 1996 IEEE Information Theory Workshop, p. 11, June 1996.
42. H. Viswanathan, "Capacity of Markov channels with receiver CSI and delayed feedback," IEEE Trans. Inform. Theory, vol. 45, pp. 761-771, Mar. 1999.
43. A. D. Wyner, "On source coding with side information at the decoder," IEEE Trans. Inform. Theory, vol. IT-21, pp. 294-300, May 1975.
44. A. D. Wyner and J. Ziv, "The rate-distortion function for source coding with side information at the decoder," IEEE Trans. Inform. Theory, vol. IT-22, pp. 1-10, Jan. 1976.
45. W. Yu, A. Sutivong, D. Julian, T. M. Cover, and M. Chiang, "Writing on colored paper," in Proc. IEEE Int. Symp. Information Theory (ISIT 2001), Washington, DC, June 2001, p. 302.
46. R. Zamir, "The rate loss in the Wyner-Ziv problem," IEEE Trans. Inform. Theory, vol. 42, pp. 2073-2084, Nov. 1996.
47. R. Zamir, S. Shamai (Shitz), and U. Erez, "Nested linear/lattice codes for structured multi-terminal binning," IEEE Trans. Inform/Theory, vol. 48, pp. 1250-1276, June 2002.