Entropy of hidden Markov processes via cycle expansion

Journal of Statistical Physics

Volumn 133, Issue 3, 2008, Pages 535-564

  Allahverdyan, Armen E ^a  

^a YEREVAN PHYSICS INSTITUTE   (Armenia)

Author keywords

Entropy; Generating function; Hidden Markov processes

Indexed keywords

EID: 54949158140     PISSN: 00224715     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10955-008-9613-0     Document Type: Article

References (36)

1. L.R. Rabiner 1989 Proc. IEEE 77 257 286
2. Y. Ephraim N. Merhav 2002 IEEE Trans. Inf. Theory 48 1518 1569
3. M. Crouse R. Nowak R. Baraniuk 1998 IEEE Trans. Signal Process. 46 886
4. Koski, T.: Hidden Markov Models for Bioinformatics. Kluwer Academic Publishers, Dordrecht (2001)
5. Baldi, P., Brunak, S.: Bioinformatics. MIT Press, Cambridge (2001)
6. Ash, R.: Information Theory. Interscience Publishers, New York (1965)
7. Cover, T.M., Thomas, J.A.: Elements of Information Theory. Wiley, New York (1991)
8. Blackwell, D.: The entropy of functions of finite-state Markov chains. In: Trans. First Prague Conf. Inf. Theory, Statistical Decision Functions, Random Processes, p. 13. Pub. House Chechoslovak Acad. Sci., Prague (1957)
9. Stratonovich, R.L.: Information Theory. Sovietskoe Radio, Moscow (1976). (in Russian)
10. Rezaeian, M.: Hidden Markov process: a new representation, entropy rate and estimation entropy. arXiv:cs.IT/0606114 (2006)
11. I.J. Birch 1962 Ann. Math. Stat. 33 930
12. Jacquet, P., Seroussi, G., Szpankowski, W.: On the entropy of a hidden Markov process. In: Int. Symp. Inf. Theory, p. 10. Chicago, IL, 2004
13. T. Holliday A. Goldsmith P. Glynn 2006 IEEE Trans. Inf. Theory 52 3509
14. E. Ordentlich T. Weissman 2006 IEEE Trans. Inf. Theory 52 19
15. Egner, S. et al.: On the entropy rate of a hidden Markov model. In: Int. Symp. Inf. Theory, p. 12. Chicago, IL, 2004
16. O. Zuk I. Kanter E. Domany 2005 J. Stat. Phys. 121 343
17. O. Zuk I. Kanter E. Domany M. Aizenman 2006 IEEE Signal Process. Lett. 13 517
18. Chigansky, P.: The entropy rate of a binary channel with slowly varying input. arXiv:cs/0602074
19. Horn, R.A., Johnson, C.R.: Matrix Analysis. Cambridge University Press, New Jersey (1985)
20. J.F.C. Kingman 1973 Ann. Probab. 1 883
21. J.M. Steele 1989 Ann. de l'I.H.P. B 25 93
22. Crisanti, A., Paladin, G., Vulpiani, A.: Products of random matrices in statistical physics. In: Springer Series in Solid State Sciences, vol. 104. Springer, Berlin (1993)
23. L.Y. Goldsheid G.A. Margulis 1989 Russ. Math. Surv. 44 11
24. S.A. Orszag P.L. Sulem I. Goldirsch 1987 Physica D 27 311
25. Kontorovich, L.: Measure concentration of hidden Markov processes. arXiv:math/0608064 (2006)
26. R. Artuso E. Aurell P. Cvitanovic 1990 Nonlinearity 3 325
27. P. Cvitanovic 1988 Phys. Rev. Lett. 61 2729
28. Ruelle, D.: Statistical Mechanics, Thermodynamic Formalism. Addison-Wesley, Reading (1978)
29. R. Mainieri 1992 Chaos 2 91
30. E. Aurell 1990 J. Stat. Phys. 58 967
31. Nielsen, J.: Lyapunov exponents for products of random matrices. Available at http://citeseer.ist.psu.edu/438423.html
32. L. Arnold V.M. Gundlach L. Demetrius 1994 Ann. Appl. Probab. 4 859
33. Y. Peres 1992 Ann. Inst. H. Poincare Probab. Statist. 28 131
34. G. Han B. Markus 2006 IEEE Trans. Inf. Theory 52 5251
35. L. Gurvits J. Ledoux 2005 Linear Algebra and Applications 404 85
36. Petersen, K.: Lectures on Ergodic Theory. Available from http://www.math.unc.edu/Faculty/petersen/lecturespdf.pdf