Almost-sure variable-length source coding theorems for general sources

IEEE Transactions on Information Theory

Volumn 45, Issue 1, 1999, Pages 337-342

  Muramatsu, Jun ^a,b   Kanaya, Fumio ^a,b  

^a NTT Communication Science Laboratories   (Japan)

^b SHONAN INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

Almost sure sup entropy rate; General sources; Source coding theorems

Indexed keywords

DECODING; ENTROPY; PROBABILITY; SET THEORY; THEOREM PROVING;

CODING RATE;

ENCODING (SYMBOLS);

EID: 0032652505     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.746838     Document Type: Article

References (12)

1. A. R. Barren, "Logically smooth density estimation," Ph.D. dissertation, Stanford Univ., Stanford, CA, 1985.
2. L. Breiman, "The individual ergodic theorems of information theory," Ann. Math. Stat., vol. 28, pp. 809-811, 1957.
3. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
4. J. L. Doob, Stochastic Processes. New York: Wiley, 1953.
5. R. M. Gray, Probability, Random Processes, and Ergodic Properties. New York: Springer-Verlag, 1988
6. T. S. Han, Information-Spectrum Methods in Information Theory (Lec-ture Notes, Grad. School Inform. Syst., Univ. Electro-Commun., Japan), Mar. 1997
7. T. S. Han and S. Verdti, "Approximation theory of output statistics," IEEE Trans. Inform. Theory, vol. 39, pp. 752-772, May 1993.
8. J. C. Kieffer, "Finite-state adaptive block to variable-length noiseless coding of a nonstationary information source," IEEE Trans. Inform. Theory, vol. 35, pp. 1259-1263, Nov. 1989.
9. B. McMillan, "The basic theorems of information theory," Ann. Math. Stat., vol. 24, pp. 196-219, 1953.
10. S. Miyaké, private communication.
11. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pp. 379-423, 623-656, 1948.
12. S. Verdti and T. S. Han, "The role of the asymptotic equipartition property in noiseless source coding," IEEE Trans. Inform. Theory, vol. 43, pp. 847-857, May 1997.