Second-order noiseless source coding theorems

IEEE Transactions on Information Theory

Volumn 43, Issue 4, 1997, Pages 1339-1341

  Kontoyiannis, I ^a  

^a Stanford University   (United States)

Author keywords

Coding variance; Convergence rates; Source coding theorems

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; ITERATIVE METHODS; MARKOV PROCESSES;

SOURCE CODING THEOREMS;

ENCODING (SYMBOLS);

EID: 0031191957     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.605604     Document Type: Article

References (12)

1. P. H. Algoet, "Log-optimal investment," Ph.D. dissertation, Dept. Elec. Eng., Stanford Univ., Stanford, CA, 1985.
2. A. R. Barron, "Logically smooth density estimation," Ph.D. dissertation, Dept. Elec. Eng., Stanford Univ., Stanford, CA, 1985.
3. B. C. Bradley, "Basic properties of strong mixing conditions," in Dependence in Probability and Statistics, E. Wileln and M. S. Taqqu, Eds. Boston, MA: Birkhäuser, 1986, pp. 165-192.
4. K. L. Chung, Markov Chains with Stationary Transition Probabilities. New York: Springer-Verlag, 1967.
5. I. A. Ibragimov, "Some limit theorems for stationary processes," Theory Probab. Appl., vol. 7, pp. 349-382, 1962.
6. J. C. Kieffer, "Sample converses in source coding theory," IEEE Trans. Inform. Theory, vol. 37, pp. 263-268, Mar. 1991.
7. I. Kontoyiannis, "Asymptotic recurrence and waiting times for stationary processes," NSF Tech. Rep. 92, Dept. Statist., Stanford Univ., Stanford, CA, submitted for publication, July 1996.
8. R. E. Krichevsky and V. K. Trofimov, "The performance of universal coding," IEEE Trans. Inform. Theory, vol. IT-27, pp. 199-207, Mar. 1981.
9. W. Phillipp and W. Stout, "Almost sure invariance principles for partial sums of weakly dependent random variables," in Memoirs AMS, vol. 2, issue 2, no. 161, 1975.
10. P. C. Shields, "String matching bounds via coding," Ann. Prob., vol. 25, pp. 329-336, 1997.
11. J. Shtarkov, "Coding of discrete sources with unknown statistics," in Topics in Information Theory (Coll. Math. Soc. J. Bolyai, no. 16), I. Csiszár and P. Elias, Eds. Amsterdam, The Netherlands: North Holland, 1977, pp. 559-574.
12. A. A. Yushkevich, "On limit theorems connected with the concept of the entropy of Markov chains," Usp. Mat. Nauk vol. 8, pp. 177-180, 1953 (in Russian).