Causal coding of stationary sources and individual sequences with high resolution

IEEE Transactions on Information Theory

Volumn 52, Issue 2, 2006, Pages 662-680

  Linder, Tamás ^a,b   Zamir, Ram ^c  

^a QUEEN S UNIVERSITY   (Canada)

^b INSTITUTE OF EXPERIMENTAL MEDICINE   (Hungary)

^c TEL AVIV UNIVERSITY   (Israel)

Author keywords

Causal source codes; Differential entropy; Finite memory codes; Individual sequences; Lempel Ziv complexity; Stationary sources; Uniform quantizer

Indexed keywords

CODES (SYMBOLS); DIFFERENTIAL EQUATIONS; ENCODING (SYMBOLS); THEOREM PROVING; VECTOR QUANTIZATION;

CAUSAL SOURCE CODES; DIFFERENTIAL ENTROPY; FINITE MEMORY CODES; INDIVIDUAL SEQUENCES; LEMPEL-ZIV COMPLEXITY; STATIONARY SOURCES; UNIFORM QUANTIZER;

DATA COMPRESSION;

EID: 31744443412     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2005.862075     Document Type: Article

References (35)

1. T. Berger, Rate Distortion Theory. Englewood Cliffs, NJ: Prentice-Hall, 1971.
2. T. D. Lookabaugh and R. M. Gray, "High-resolution quantization theory and the vector quantizer advantage," IEEE Trans. Inf. Theory, vol. 35, no. 5, pp. 1020-1033, Sep. 1989.
3. H. Gish and J. N. Pierce, "Asymptotically efficient quantizing," IEEE Trans. Inf. Theory, vol. IT-14, no. 5, pp. 676-683, Sep. 1968.
4. T. Ericson, "A result on delayless information transmission," in Proc. IEEE Int. Symp. Information Theory, Grignano, Italy, 1979.
5. N. T. Gaarder and D. Slepian, "On optimal finite-state digital transmission systems," in Proc. IEEE Int. Symp. Information Theory, Grignano, Italy, 1979.
6. N. T. Gaarder and D. Slepian, "On optimal finite-state digital transmission systems," IEEE Trans. Inf. Theory, vol. IT-28, no. 2, pp. 167-186, Mar. 1982.
7. G. Gábor and Z. Györfi, Recursive Source Coding. New York: Springer-Verlag, 1986.
8. T. Linder and G. Lugosi, "A zero-delay sequential scheme for lossy coding of individual sequences," IEEE Trans. Inf. Theory, vol. 47, no. 6, pp. 2533-2538, Sep. 2001.
9. T. Weissman and N. Merhav, "On delay-limited lossy coding and filtering of individual sequences," IEEE Trans. Inf. Theory, vol. 48, no. 3, pp. 5721-733, Mar. 2002.
10. N. Merhav and I. Kontoyiannis, "Source coding exponents for zero-delay coding with finite memory" IEEE Trans. Inf. Theory, vol. 49, no. 3, pp. 609-625, Mar. 2003.
11. D. L. Neuhoff and R. K. Gilbert, "Causal source codes," IEEE Trans. Inf. Theory, vol. IT-28, no. 5, pp. 701-713, Sep. 1982.
12. J. Ziv and A. Lempel, "Compression of individual sequences via variable-rate coding," IEEE Trans. Inf. Theory, vol. IT-24, no. 5, pp. 530-536, Sep. 1978.
13. J. Ziv, "Distortion-rate theory for individual sequences," IEEE Trans. Inf. Theory, vol. IT-26, no. 2, pp. 137-143, Mar. 1980.
14. J. Ziv, "On universal quantization," IEEE Trans. Inf. Theory, vol. IT-31, no. 3, pp. 344-347, May 1985.
15. R. Zamir and M. Feder, "Rate distortion performance in coding band-limited sources by sampling and dithered quantization," IEEE Trans. Inf. Theory, vol. 41, no. 1, pp. 141-154, Jan. 1995.
16. T. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
17. R. M. Gray, Entropy and Information Theory. New York: Springer-Verlag, 1990.
18. I. Csiszár, "Generalized entropy and quantization problems," in Trans. 6th Prague Conf. Information Theory Statistical Decision Functions, Random Processes, Prague, Czechoslovakia, 1973, pp. 29-35.
19. P. A. Chou, T. Lookabaugh, and R. M. Gray, "Entropy-constrained vector quantization," IEEE Trans. Acoust. Speech, Signal Process., vol. 37, no. 1, pp. 31-42, Jan. 1989.
20. R. M. Gray and D. L. Neuhoff, "Quantization," IEEE Trans. Inf. Theory, (Special Commemorative Issue), vol. 44, no. 6, pp, 2325-2383, Oct. 1998.
21. L. Györfi, I. Páli, and E. C. van der Meulen, "On universal noiseless source coding for infinite source alphabets," Europ. Trans. Telecomm. Related Technol., vol. 4, pp. 125-132, Mar.-Apr. 1993.
22. Y. N. Linkov, "Evaluation of epsilon entropy of random variables for small epsilon," Probl. Inf. Transm., vol. 1, pp. 12-18, 1965. Translated from Probl. Pered. Inform., vol. 1, pp. 18-28.
23. T. Linder and R. Zamir, "On the asymptotic tightness of the Shannon lower bound," IEEE Trans. Inf. Theory, vol. 40, no. 6, pp. 2026-2031, Nov. 1994.
24. J. H. Conway and N. J. A. Sloane, Sphere Packings, Lattices and Groups. New York: Springer-Verlag, 1988.
25. R. Zamir and M. Feder, "On lattice quantization noise," IEEE Trans. Inf. Theory, vol. 42, no. 4, pp. 1152-1159, Jul. 1996.
26. T. Linder and K. Zeger, "Asymptotic entropy constrained performance of tessellating and universal randomized lattice quantization," IEEE Trans. Inf. Theory, vol. 40, no. 2, pp. 575-579, Mar. 1994.
27. P. Zador, "Topics in the Asymptotic Quantization of Continuous Random Variables," Bell Labs., Murray Hill, NJ, Tech. Memo., 1966.
28. P. Zador, "Asymptotic quantization error of continuous signals and the quantization dimension," IEEE Trans. Inf. Theory, vol. IT-28, no. 2, pp. 139-149, Mar. 1982.
29. P. Billingsley, Convergence of Probability Measures. New York: Wiley, 1968.
30. L. Schuchman, "Dither signals and their effect on quantization noise," IEEE Trans. Comm. Tech., vol. COM-12, no. 4, pp. 162-165, Dec. 1964.
31. D. S. Modha and D. P. de Farias, "Finite-state rate-distortion for individual sequences," in Proc. IEEE Int. Symp. Information Theory, Chicago, IL, Jun/Jul. 2005, p. 562.
32. E.-H. Yang and J. C. Kieffer, "Simple universal lossy data compression schemes derived from the Lempel-Ziv algorithm," IEEE Trans. Inf. Theory, vol. 42, no. 1, pp. 239-245, Jan. 1996.
33. R. M. Gray, T. Linder, and J. Li, "A Lagrangian formulation of Zador's entropy-constrained quantization theorem," IEEE Trans. Inf. Theory, vol. 48, no. 3, pp. 695-707, Mar. 2002.
34. R. M. Dudley, Real Analysis and Probability. New York: Chapman & Hall, 1989.
35. I. Csiszár, "On an extremum problem of information theory," Studia Scientiarum Mathematicarum Hungarica, vol. 9, pp. 57-70, 1974.