An information-spectrum approach to source coding theorems with a fidelity criterion

IEEE Transactions on Information Theory

Volumn 43, Issue 4, 1997, Pages 1145-1164

  Han, Te Sun ^a,b  

^a IEEE   (Japan)

^b UNIVERSITY OF ELECTRO COMMUNICATIONS   (Japan)

Author keywords

Information spectrum; Maximum distortion; Nonergodic source; Nonstationary source; Rate distortion; Variable rate coding

Indexed keywords

SIGNAL DISTORTION; SIGNAL ENCODING;

INFORMATION SPECTRUM; NONERGODIC SOURCE; RATE DISTORTION; VARIABLE RATE CODING;

INFORMATION THEORY;

EID: 0031185355     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.605576     Document Type: Article

References (22)

1. T. S. Han and S. Verdú, "Approximation theory of output statistics," IEEE Trans. Inform. Theory, vol. 39, pp. 752-772, May 1993.
2. Y. Steinberg and S. Verdú, "Simulation of random processes and rate-distortion theory," IEEE Trans. Inform. Theory, vol. 42, pp. 63-86, Jan. 1996.
3. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic, 1981.
4. S. Verdú and T. S. Han, "A general formula for channel capacity," IEEE Trans. Inform. Theory, vol. 40, pp. 1147-1157, July 1994.
5. K. M. Mackenthun and M. B. Pursley, "Strongly and weakly universal source coding," in Proc. 1977 Conf. on Information Science and Systems (Baltimore, MD, John Hopkins Univ., 1977), pp. 286-291.
6. R. M. Gray, Entropy and Information Theory. New York: Springer-Verlag, 1990.
7. J. C. Kieffer, "Sample converses in source coding theory," IEEE Trans. Inform. Theory, vol. 37, pp. 263-268, Mar. 1991.
8. S. Miyake and F. Kanaya, "Reduction of coding theorems from information spectrum to process definition representation," in Proc. 18th Symp. on Information Theory Applications (in Japanese) (Hanamaki, Japan, Oct. 24-27, 1995), pp. 135-138,
9. R. M. Gray and L. D. Davisson, "Source coding theorems without the ergodic assumption," IEEE Trans. Inform. Theory, vol. IT-20, pp. 502-516, 1974.
10. J. C. Kieffer, "A survey of the theory of source coding with a fidelity criterion," IEEE Trans. Inform. Theory, vol. 39, pp. 1473-1490, Sept. 1993.
11. J. Ziv, "Coding of source with unknown statistics - Part II: Distortion relative to a fidelity criterion," IEEE Trans. Inform. Theory, vol. IT-18, pp. 389-394, 1972.
12. K. M. Mackenthun and M. B. Pursley, "Variable-rate block source coding subject to a fidelity constraint," IEEE Trans. Inform. Theory, vol. IT-24, pp. 349-360, 1978.
13. J. C. Kieffer, "A unified approach to weak universal source coding," IEEE Trans. Inform. Theory, vol. IT-24, pp. 674-682, 1978.
14. _, "Strong converses in source coding relative to a fidelity criterion," IEEE Trans. Inform. Theory, vol. 37, pp. 257-262, Mar. 1991.
15. _, "On the optimal average distortion attainable by fixed-rate coding of a nonergodic source," IEEE Trans. Inform. Theory, vol. IT-21, pp. 190-193, Mar. 1975.
16. P. C. Shields, D. L. Neuhoff, L. D. Davisson, and F. Ledrappier, "The distortion-rate function for nonergodic sources," Ann. Probab., vol. 6, no. 1, pp. 138-143, 1978.
17. R. Garcia-Muñoz and D. L. Neuhoff, "Strong universal source coding subject to a rate-distortion constraint," IEEE Trans. Inform. Theory, vol. IT-28, pp. 285-295, Mar. 1982.
18. D. L. Neuhoff, R. M. Gray, and L. D. Davisson, "Fixed-rate universal block source coding with a fidelity criterion," IEEE Trans. Inform. Theory, vol. IT-21, pp. 511-523, Sept. 1975.
19. D. L. Neuhoff and P. Shields, "Fixed-rate universal codes for Markov source," IEEE Trans. Inform. Theory, vol. IT-24, pp. 360-369, May 1978.
20. M. B. Pursley and L. D. Davisson, "Variable rate coding for nonergodic sources and classes of ergodic sources subject to a fidelity constraint," IEEE Trans. Inform. Theory, vol. IT-22, pp. 324-337, May 1976.
21. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
22. P. Walters, An Introduction to Ergodic Theory. New York: Springer-Verlag, 1982.