The role of the asymptotic equipartition property in noiseless source coding

IEEE Transactions on Information Theory

Volumn 43, Issue 3, 1997, Pages 847-857

  Verdú, Sergio ^a,b   Han, Te Sun ^a,c  

^a IEEE   (United States)

^b Princeton University   (United States)

^c UNIVERSITY OF ELECTRO COMMUNICATIONS   (Japan)

Author keywords

Asymptotic equipartition property; Entropy; Fixed length source coding; Noiseless data compression; Shannon theory; Source coding theorem

Indexed keywords

ASYMPTOTIC STABILITY; DATA COMPRESSION; ENTROPY; INFORMATION THEORY; THEOREM PROVING;

SHANNON THEORY;

ENCODING (SYMBOLS);

EID: 0031143153     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.568696     Document Type: Article

References (9)

1. K. L. Chung, A Course in Probability Theory, 2nd ed. New York: Academic, 1974.
2. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
3. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic, 1981.
4. W. Feller, An Introduction to Probability Theory and its Applications, vol. 2, 2nd. ed. New York: Wiley, 1968.
5. R. G. Gallager, Information Theory and Reliable Communication. New York: Wiley, 1968.
6. T. S. Han and S. Verdú, "Approximation theory of output statistics," IEEE Trans. Inform. Theory, vol. 39, pp. 752-772, May 1993.
7. R. E. Krichevsky and V. K. Trofimov, "The performance of universal encoding," IEEE Trans. Inform. Theory, vol. IT-27, pp. 199-206, Mar. 1981.
8. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pp. 379-423, 623-656, July-Oct. 1948.
9. S. Verdú and T. S. Han, "A general formula for channel capacity," IEEE Trans. Inform. Theory, vol. 40, pp. 1147-1157, July 1994.