The Markov approximation of the sequences of N -valued random variables and a class of small deviation theorems

Stochastic Processes and their Applications

Volumn 89, Issue 1, 2000, Pages 117-130

  Liu, Wen ^a   Yang, Weiguo ^b  

^a HEBEI UNIVERSITY OF TECHNOLOGY   (China)

^b Hebei Institute of Architectural Science and Technology   (China)

Author keywords

Entropy; Entropy density; Primary 94A17; Sample divergence rate; Secondary 60F15; Shannon McMillan theorem; Small deviation theorem

Indexed keywords

EID: 0038465692     PISSN: 03044149     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0304-4149(00)00016-8     Document Type: Article

References (17)

1. Algoet P.H., Cover T.M. A sandwich proof of the Shannon-McMillan-Breiman theorem. Ann. Probab. 16:1988;899-909.
2. Barron A.R. The strong ergodic theorem for densities: generalized Shannon-McMillan-Breiman theorem. Ann. Probab. 13:1985;1292-1303.
3. Billingsley P. Probability and Measure. 1986;Wiley, New York.
4. Breiman L. The individual ergodic theorem of information theory. Ann. Math. Statist. 28:1957;809-811.
5. Chung K.L. The ergodic theorem of information theory. Ann. Math. Statist. 32:1961;612-614.
6. Cover T.M., Thomas J.A. Elements of Information Theory. 1991;Wiley, New York.
7. Gray R.M. Entropy and Information Theory. 1990;Springer, New York.
8. Gray R.M., Kieffer J.G. Asymptotically mean stationary measure. Ann. Probab. 8:1980;962-973.
9. Kieffer, J.C., 1973. A counterexample to Perez's generalization of the Shannon-McMillan theorem. Ann. Probab. 1, 362-364. Correction 4, 153-154, 1976.
10. Kieffer, J.C., 1973. A counterexample to Perez's generalization of the Shannon-McMillan theorem. Ann. Probab. 1, 362-364. Correction 4, 153-154, 1976.
11. Kieffer J.C. A Simple proof of Moy-Perez generalization of Shannon-McMillan theorem. Pacific J. Math. 51:1974;203-204.
12. Karlin S., Taylor H.M. A First Course in Stochastic Processes. 1975;Academic Press, New York.
13. Laha R.G., Rohatgi V.K. Probability Theory. 1979;Wiley, New York.
14. Liu W. Relative entropy densities and a class of limit theorems of the sequence of. m -valued random variables Ann. Probab. 18:1990;829-839.
15. Liu W., Yang W. A extension of Shannon-McMillan theorem and some limit properties for nonhomogeneous Markov chains. Stochastic Process. Appl. 61:1996;129-145.
16. McMillan B. The basic theorems of information theory. Ann. Math. Statist. 24:1953;196-216.
17. Shannon, C., 1948. A mathematical theory of communication. Bell System Tech. J. 27 379-423, 623-656.