Source coding exponents for zero-delay coding with finite memory

IEEE Transactions on Information Theory

Volumn 49, Issue 3, 2003, Pages 609-625

  Merhav, Neri ^a   Kontoyiannis, Ioannis ^b  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b Brown University   (United States)

Author keywords

Causal source codes; Finite memory codes; Large deviations; Sliding block codes; Source coding exponents; Time sharing; Zero delay source codes

Indexed keywords

ASYMPTOTIC STABILITY; BLOCK CODES; CODING ERRORS; DATA STORAGE EQUIPMENT; OPTIMIZATION; PROBABILITY; SIGNAL DISTORTION; TIME SHARING SYSTEMS;

CAUSAL SOURCE CODES; FINITE MEMORY CODES; SLIDING BLOCK CODES; SOURCE CODING EXPONENTS; ZERO DELAY SOURCE CODES;

ENCODING (SYMBOLS);

EID: 0037355963     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2002.808137     Document Type: Article

References (24)

1. T. Berger and K.-Y. Lau, "On binary sliding block codes," IEEE Trans. Inform. Theory, vol. IT-23, pp. 343-353, May 1977.
2. A. Dembo and I. Kontoyiannis, "The asymptotics of waiting times between stationary processes, allowing distortion," Ann. Appl. Probab., vol. 9, pp. 413-429, 1999.
3. A. Dembo and O. Zeitouni, Large Deviations Techniques and Applications. Boston, MA: Jones & Bartlett, 1993.
4. T. Ericson, "A result on delay-less information transmission," presented at the International Symposium on Information Theory, Grignano, Italy, June 1979.
5. N. T. Gaarder and D. Slepian, "On optimal finite-state digital transmission systems," presented at the International Symposium on Information Theory, Grignano, Italy, June 1979.
6. ____, "On optimal finite-state digital transmission systems," IEEE Trans. Inform. Theory, vol. IT-28, pp. 167-186, Mar. 1982.
7. R. K. Gilbert and D. L. Neuhoff, "Bounds to the performance of causal codes for markov sources," in Proc. Allerton Conf. Communication, Control and Computing, 1979, pp. 284-292.
8. R. M. Gray, "Sliding block source coding," IEEE Trans. Inform. Theory, vol. IT-21, pp. 357-368, July 1975.
9. W. Hoeffding, "Probability inequalities for sums of bounded random variables," J. Amer. Statist. Assoc., vol. 58, pp. 13-30, 1963.
10. S. Ihara and M. Kubo, "Error exponent for coding of memoryless Gaussian sources with a fidelity criterion," IEICE Trans. Fundamentals, vol. E83-A, no. 10, pp. 1891-1897, 2000.
11. R. Kiesel and U. Stadtmüller, "A large deviation principle for weighted sums of independent identically distributed random variables," J. Math. Anal. Appl., vol. 251, pp. 929-939, 2000.
12. I. Kontoyiannis, "An implementable lossy version of the Lempel-Ziv algorithm-Part I: Optimality for memoryless sources," IEEE Trans. Inform. Theory, vol. 45, pp. 2293-2305, Nov. 1999.
13. ____, "Pointwise redundancy in lossy data compression and universal lossy data compression," IEEE Trans. Inform. Theory, vol. 46, pp. 136-152, Jan. 2000.
14. T. Linder and G. Lugosi, "A zero-delay sequential scheme for lossy coding of individual sequences," IEEE Trans. Inform. Theory, vol. 47, pp. 2533-2538, Sept. 2001.
15. T. Linder and R. Zamir, "Causal source coding of stationary sources with high resolution," in Proc. 2001 Int. Symp. Information Theory, Washington, DC, June 2001, p. 28.
16. S. P. Lloyd, "Rate vs. fidelity for the binary source," Bell Syst. Tech. J., vol. 56, no. 3, pp. 427-437, Mar. 1977.
17. K. Marton, "Error exponent for source coding with a fidelity criterion," IEEE Trans. Inform. Theory, vol. IT-20, pp. 197-199, Mar. 1974.
18. D. L. Neuhoff and R. K. Gilbert, "Causal source codes," IEEE Trans. Inform. Theory, vol. IT-28, pp. 701-713, Sept. 1982.
19. P. Piret, "Causal sliding block encoders with feedback," IEEE Trans. Inform. Theory, vol. IT-25, pp. 237-240, Mar. 1979.
20. E. Sabbag and N. Merhav, in preparation.
21. I. G. Stiglitz, "A coding theorem for a class of unknown channels," IEEE Trans. Inform. Theory, vol. IT-13, pp. 217-220, Apr. 1967.
22. T. Weissman and N. Merhav, "On limited-delay lossy coding and filtering of individual sequences," IEEE Trans. Inform. Theory, vol. 48, pp. 721-733, Mar. 2002.
23. ____, "Tradeoffs between the excess code-length exponent and the excess distortion exponent in lossy source coding," IEEE Trans. Inform. Theory, vol. 48, pp. 396-415, Feb. 2002.
24. E.-H. Yang and Z. Zhang, "On the redundancy of lossy source coding with abstract alphabets," IEEE Trans. Inform. Theory, vol. 45, pp. 1092-1110, May 1999.