Source coding with limited-look-ahead side information at the decoder

IEEE Transactions on Information Theory

Volumn 52, Issue 12, 2006, Pages 5218-5239

  Weissman, Tsachy ^a,b   El Gamal, Abbas ^a,b  

^a IEEE   (United States)

^b Stanford University   (United States)

Author keywords

Causal source codes; Delay constrained coding; Gel'fand pinsker channel; Rate distortion function; Slepian Wolf coding; Wyner Ziv coding

Indexed keywords

CAUSAL SOURCE CODES; DELAY CONSTRAINED CODING; GEL'FAND-PINSKER CHANNEL; RATE DISTORTION FUNCTION; SLEPIAN-WOLF CODING; WYNER-ZIV CODING;

DECODING; FUNCTION EVALUATION; GRAPH THEORY; PROBLEM SOLVING; SIGNAL RECONSTRUCTION;

CHANNEL CODING;

EID: 33947390329     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2006.885500     Document Type: Article

References (43)

1. N. Alon and A. Orlitsky, "Source coding and graph entropies," IEEE Trans. Inf. Theory, vol. 42, no. 5, pp. 1329-1339, Sep. 1996.
2. T. Berger, Rate-Distortion Theory: A Mathematical Basis for Data Compression. Englewood Cliffs, N.J.: Prentice-Hall, 1971.
3. L. Breiman, Probability. Philadelphia, PA: SIAM, 1992.
4. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
5. I. Csiszar and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic, 1981.
6. A. Das and P. Narayan, "Capacities of time-varying multiple-access channels with side information," IEEE Trans. Inf. Theory, vol. 48, no. 1, pp. 4-25, Jan. 2002.
7. A. Dembo and T. Weissman, "The minimax distortion redundancy in noisy source coding," IEEE Trans. Inf. Theory, vol. 49, no. 11, pp. 3020-3030, Nov. 2003.
8. Y. Ephraim and N. Merhav, "Hidden Markov processes," IEEE Trans. Inf. Theory, vol. 48, no. 6, pp. 1518-1569, Jun. 2002.
9. U. Erez, S. Shamai (Shitz), and R. Zamir, "Capacity and lattice strategies for canceling known interference," IEEE Trans. Inf. Theory, vol. 51, no. 11, pp. 3820-3833, Nov. 2005.
10. T. Ericson, "A result on delay-less information transmission," in Proc. Int. Symp. Information Theory, Grignano, Italy, Jun. 1979.
11. N. T. Gaarder and D. Slepian, "On optimal finite-state digital transmission systems," IEEE Trans. Inf. Theory, vol. IT-28, no. 2, pp. 167-186, Mar. 1982.
12. S. I. Gel'fand and M. S. Pinsker, "Coding for channel with random parameters," Probl. Contr. and Inf. Theory, vol. 9, no. I, pp. 19-31, 1980.
13. R. M. Gray, D. L. Neuhoff, and P. C. Shields, "A generalization of Omstein's d-bar distance with applications to information theory," Ann. Probab., vol. 3, no. 2, pp. 315-328, Apr. 1975.
14. R. M. Gray, D. L. Neuhoff, and J. Omura, "Process definitions of distortion-rate functions and source coding theorems," IEEE Trans. Inf. Theory, vol. IT-21, no. 5, pp. 524-532, Sep. 1975.
15. C. Heegard and A. El Gamal, "On the capacity of computer memory with defects," IEEE Trans. Inf. Theory, vol. IT-29, no. 5, pp. 731-739, Sep. 1983.
16. T. Kailath, A. H. Sayed, and B. Hassibi, Linear Estimation. Upper Saddle River, NJ: Prentice-Hall, 2000.
17. J. Körner, "Coding of an information source having ambiguous alphabet and the entropy of graphs," in Proc. 6th Pargue Conf. Information Theory, 1973, Prague, Czech Republic, 2003, pp. 411-425.
18. J. Körner, "Fredman-Komlós bounds and information theory," SIAM J. Alg. Discr. Meth., vol. 7, pp. 560-570, 1986.
19. P. Koulgi, E. Tuncel, S. L. Regunathan, and K. Rose, "On zero-error source coding with decoder side information," IEEE Trans. Inf. Theory, vol. 49, no. 1, pp. 99-111, Jan. 2003.
20. T. Linder and G. Lugosi, "A zero-delay sequential scheme for lossy coding of individual sequences," IEEE Trans. Inf. Theory, vol. 47, no. 6, pp. 2533-2538, Sep. 2001.
21. T. Linder and R. Zamir, "Causal source coding of stationary sources and individual sequences with high resolution," IEEE Trans. Inf. Theory, accepted for publication.
22. S. Matloub and T. Weissman, "On competitive zero - delay joint source - channel coding," in Proc. Conf. Information Science and Systems, Princeton, NJ, 2004, pp. 555-559.
23. N. Merhav, "A comment on 'A rate of convergence result for a universal D-semifaithful code'," IEEE Trans. Inf. Theory, vol. 41, no. 4, pp. 1200-1202, Jul. 1995.
24. N. Merhav and I. Kontoyiannis, "Source coding exponents for zero-delay coding with finite memory," IEEE Trans. Inf. Theory, vol. 49, no. 3, pp. 609-625, Mar. 2003.
25. N. Merhav and T. Weissman, "Coding for the feedback Gel'fand-Pinsker channel and the feedforward Wyner-Ziv source," in Proc. IEEE Int. Symp. Information Theory, Adelaide, Australia, Sep. 2005, pp. 1506-1510.
26. D. L. Neuhoff and R. K. Gilbert, "Causal source codes," IEEE Trans. Inf. Theory, vol. IT-28, no. 5, pp. 701-713, Sep. 1982.
27. R. J. Pile, "The transmission distortion of a source as a function of the encoding block length," Bell Syst. Tech. J., vol. 47, pp. 827-885, 1968.
28. J. P. M. Schalkwijk, "A coding scheme for additive noise channels with feedback - II: Band-limited signals," IEEE Trans. Inf. Theory, vol. IT-12, no. 2, pp. 183-189, Apr. 1966.
29. J. P. M. Schalkwijk and T. Kailath, "A coding scheme for additive noise channels with feedback - I: No bandwidth constraint," IEEE Trans. Inf. Theory, vol. IT-12, no. 2, pp. 183-189, Apr. 1966.
30. C. E. Shannon, "The zero-error capacity of a noisy channel," IRE Trans. Inf. Theory, vol. IT-2, no. 3, pp. 8-19, Sep. 1956.
31. _, "Channels with side informational the transmitter," IBM J. Res. Dev., vol. 2, pp. 289-293, 1958.
32. D. Slepian and J. K. Wolf, "Noiseless coding of correlated information sources," IEEE Trans. Inf. Theory, vol. IT-19, no. 4, pp. 471-480, Jul. 1973.
33. D. Teneketzis, "Optimal real-time encoding-decoding of markov sources in noisy environments," in Proc. Math. Theory of Networks and Syst. (MTNS), Leuwen, Belgium, 2004.
34. J. C. Walrand and P. Varaiya, "Optimal causal coding-decoding problems," IEEE Trans. Inf. Theory, vol. IT-29, no. 6, pp. 814-820, Nov. 1983.
35. T. Weissman and N. Merhav, "On limited-delay lossy coding and filtering of individual sequences," IEEE Trans. Inf. Theory, vol. 48, no. 3, pp. 721-733, Mar. 2002.
36. _, "On causal source codes with side information," IEEE Trans. Inf. Theory, vol. 51, no. 11, pp. 4003-4013, Nov. 2005.
37. T. Weissman, E. Ordentlich, G. Seroussi, S. Verdú, and M. Weinberger, "Universal discrete denoising: Known channel," IEEE Trans. Inf. Theory, vol. 51, no. 1, pp. 5-28, Jan. 2005.
38. H. S. Witsenhausen, "On the structure of real-time source coders," Bell Syst. Tech. J., vol. 58, no. 6, pp. 1437-1451, Jul./Aug. 1979.
39. _, "On sequences of pairs of dependent random variables," SIAM J. Appl. Math., vol. 28, pp. 100-113, Jan. 1975.
40. _, "The zero-error side information problem and chromatic numbers," IEEE Trans. Inf. Theory, vol. IT-22, no. 5, pp. 592-593, Sep. 1976.
41. A. D. Wyner, "The rate distortion function for source coding with side information at the decoder - II: General sources," Inf. Contr., vol. 38, pp. 60-80, 1978.
42. A. D. Wyner and J. Ziv, "The rate distortion function for source coding with side information at the decoder," IEEE Trans. Inf. Theory, vol. IT-22, no. 1, pp. 1-10, Jan. 1976.
43. Z. Zhang, E. H. Yang, and V. K. Wei, "The redundancy of source coding with a fidelity criterion - Part I: Known statistics," IEEE Trans. Inf. Theory, vol. 43, no. 1, pp. 71-91, Jan. 1997.