The duality between information embedding and source coding with side information and some applications

IEEE Transactions on Information Theory

Volumn 49, Issue 5, 2003, Pages 1159-1180

  Barron, Richard J ^a   Chen, Brian ^a   Wornell, Gregory W ^a  

^a USA   (United States)

Author keywords

Coding with side information; Data hiding; Digital watermarking; Hybrid coding and transmission; Information embedding; Joint source channel coding; Slepian Wolf coding; Wyner Ziv coding

Indexed keywords

CHANNEL CAPACITY; CODES (SYMBOLS); COMMUNICATION CHANNELS (INFORMATION THEORY); DATA COMMUNICATION SYSTEMS; DATA STRUCTURES; DECODING; DIGITAL WATERMARKING; MARKOV PROCESSES; MATHEMATICAL MODELS; SIGNAL DISTORTION; SIGNAL RECEIVERS; SPURIOUS SIGNAL NOISE;

DATA HIDING; INFORMATION EMBEDDING; JOINT SOURCE CHANNEL CODING; SLEPIAN-WOLF CODING; WYNER-ZIV CODING;

SIGNAL ENCODING;

EID: 0037854454     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2003.810639     Document Type: Article

References (37)

1. R. J. Barron, "Systematic hybrid analog/digital signal coding," Ph.D. dissertation, MIT, Cambridge, MA, June 2000.
2. R. J. Barron, B. Chen, and G. W. Wornell, "The duality between information embedding and source coding with side information and some applications," in Proc. IEEE Int. Symp. Information Theory, Washington, DC, June 2001, p. 300.
3. R. J. Barron and A. V. Oppenheim, "Signal processing for hybrid channels," in Proc. ARL Fedlabs Symp., Feb. 1999, pp. 481-484.
4. "A systematic hybrid analog/digital audio coder," in Proc. Workshop Applications of Signal Processing to Audio, Acoustics, Mohonk, NY, Oct. 1999.
5. T. Berger, Rate Distortion Theory. Englewood Cliffs, NJ: Prentice-Hall, 1971.
6. B. Chen, "Design and analysis of digital watermarking, information embedding, and data hiding systems," Ph.D. dissertation, MIT, Cambridge, MA, June 2000.
7. B. Chen and G. W. Wornell, "Quantization index modulation: A class of provably good methods for digital watermarking and information embedding," IEEE Trans. Inform. Theory, vol. 47, pp. 1423-1443, May 2001.
8. ____, "Quantization index modulation methods for digital watermarking and information embedding of multimedia," J. VLSI Signal Processing Syst. for Signal, Image, and Video Technol., vol. 27, pp. 7-33, Feb. 2001.
9. M. Chiang and T. M. Cover, "Duality of channel capacity and rate distortion with side information," in Proc. Int. Symp. Information Theory and Its Applications, Nov. 2000.
10. J. Chou, S. S. Pradhan, and K. Ramchandran, "On the duality between distributed source coding and data hiding," in Proc. Asilomar Conf. Signals, Systems, Computers, Pacific Grove, CA, Oct. 1999, pp. 1503-1507.
11. A. S. Cohen, private communication.
12. A. S. Cohen and A. Lapidoth, "The Gaussian watermarking game: Parts I and II," IEEE Trans. Inform. Theory, vol. 48, pp. 1639-1667, June 2002.
13. J. H. Conway and N. J. A. Sloane, Sphere Packings, Lattices, and Groups. New York: Spring-Verlag, 1988.
14. M. H. Costa, "Writing on dirty paper," IEEE Trans. Inform. Theory, vol. IT-29, pp. 439-441, May 1983.
15. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
16. T. M. Cover and M. Chiang, "Duality between channel capacity and rate distortion with two-sided state information," IEEE Trans. Inform. Theory, vol. 48, pp. 1629-1638, June 2002.
17. M. Chiang and T. M. Cover, "Unified duality between channel capacity and rate distortion with state information," in Proc. IEEE Int. Symp. Information Theory, Washington, DC, June 2001, p. 301.
18. U. Erez, S. Shamai, and R. Zamir, "Capacity and lattice-strategies for cancelling known interference," in Proc. Int. Symp. Information Theory and Its Applications, Honolulu, HI, Nov. 2000, pp. 681-684.
19. U. Erez and R. Zamir, "Lattice decoding can achieve 1/2 log (1 + SNR) on the AWGN channel using nested codes," in Proc. IEEE Int. Symp. Information Theory, Washington, DC, June 2001, p. 125, Also, submitted to IEEE Trans. Inform. Theory.
20. S. I. Gel'fand and M. S. Pinsker, "Coding for channel with random parameters," Probl. Contr. Inform. Theory, vol. 9, no. 1, pp. 19-31, 1980.
21. R. M. Gray, "Conditional rate-distortion theory," Stanford Univ., Stanford, CA, Electronics Labortories Tech. Rep. 6502-2, Oct. 1972.
22. C. Heegard and A. El Gamal, "On the capacity of computer memory with defects," IEEE Trans. Inform. Theory, vol. IT-29, pp. 731-739, Sept. 1983.
23. P. Moulin and J. A. O'Sullivan, "Information-theoretic analysis of information hiding,", vol. 49, pp. 563-593, Mar. 2003.
24. S. S. Pradhan, J. Chou, and K. Ramchandran, "Duality between channel and source coding with side information," Univ. California, Berkeley, UCB/ERL Tech. Memo. M01/34, Dec. 2001.
25. ____, "A characterization of functional duality between source and channel coding," in Proc. IEEE Int. Symp. Information Theory, Lausanne, Switzerland, June 2002, p. 224.
26. S. S. Pradhan and K. Ramchandran, "Distributed source coding using syndromes (DISCUS): Design and construction," in Proc. Data Compression Conf. Snowbird, UT, Mar. 1999, pp. 158-167.
27. S. Servetto, "Lattice quantization with side information," in Proc. Data Compression Conf., Snowbird, UT, Mar. 2000, pp. 510-522.
28. S. Shamai (Shitz), S. Verdú, and R. Zamir, "Systematic lossy source/channel coding," IEEE Trans. Inform. Theory, vol. 44, pp. 564-579, Mar. 1998.
29. D. Slepian and J. K. Wolf, "Noiseless coding of correlated information sources," IEEE Trans. Inform. Theory, vol. IT-19, pp. 471-480, July 1973.
30. J. K. Su, J. J. Eggers, and B. Girod, "Illustration of the duality between channel coding and rate distortion with side information," in Proc. Asilomar Conf. Signals, Systems, Computers, Pacific Grove, CA, Nov. 2000.
31. J. Wolfowitz, Coding Theorems of Information Theory, 2nd ed. New York: Springer-Verlag, 1964.
32. A. D. Wyner, "Recent results in Shannon theory," IEEE Trans. Inform. Theory, vol. IT-20, pp. 2-9, Jan. 1974.
33. ____, "The rate-distortion function for source coding with side information at the decoder - II: General sources," Inform. Contr., vol. 38, pp. 60-80, 1978.
34. A. D. Wyner and J. Ziv, "The rate-distortion function for source coding with side information at the decoder," IEEE Trans. Inform. Theory, vol. IT-22, pp. 1-10, Jan. 1976.
35. R. Zamir and M. Feder, "On lattice quantization noise," IEEE Trans. Inform. Theory, vol. 42, pp. 1152-1159, July 1996.
36. R. Zamir and S. Shamai, "Nested linear/lattice codes for Wyner-Ziv encoding," in Proc. Inform. Theory Workshop, Kilarney, Ireland, June 1998, pp. 92-93.
37. R. Zamir, S. Shamai (Shitz), and U. Erez, "Nested linear/lattice codes for multiterminal binning," IEEE Trans. Inform. Theory, vol. 48, pp. 1250-1276, June 2002.