The entropy of a binary Hidden Markov Process

Journal of Statistical Physics

Volumn 121, Issue 3-4, 2005, Pages 343-360

  Zuk, Or ^a   Kanter, Ido ^b   Domany, Eytan ^a  

^a WEIZMANN INSTITUTE OF SCIENCE   (Israel)

^b BAR ILAN UNIVERSITY   (Israel)

Author keywords

Entropy; Hidden Markov Process; Random field Ising model

Indexed keywords

EID: 28644448733     PISSN: 00224715     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10955-005-7576-y     Document Type: Article

References (19)

1. Y. Ephraim and N. Merhav, Hidden Markov processes, IEEE Trans. Inform. Theory 48:1518-1569 (2002).
2. A. Schliep, A. Schönhuth, and C. Steinhoff, Using hidden Markov models to analyze gene expression time course data, Bioinformatics 19(Suppl. 1):i255-i263 (2003).
3. L. R. Rabiner, A tutorial on hidden Markov models and selected applications in speech recognition, Proc. IEEE 77:257-286 (1989).
4. I. Kanter, A. Frydman, and A. Ater, Is a multiple excitation of a single atom equivalent to a single ensemble of atoms? Europhys. Lett. 69(6):874-878 (2005).
5. I. Kanter, A. Frydman, and A. Ater, Utilizing hidden Markov processes as a new tool for experimental physics, Europhys. Lett. 69(5):798-804 (2005).
6. C. E. Shannon, A mathematical theory of communication, Bell Sys. Tech. J. 27:379-423 and 623-656 (1948).
7. T. Nattermann, Theory of the random field Ising model, in Spin Glasses and Random Fields, A. P. Young, ed. (World Scientific, 1997).
8. P. Jacquet, G. Seroussi, and W. Szpankowski, On the Entropy of a Hidden Markov Process, Data Compression Conference, Snowbird (2004).
9. E. Ordentlich and T. Weissman, New Bounds on the Entropy Rate of Hidden Markov Processes, San Antonio Information Theory Workshop (Oct. 2004).
10. A preliminary presentation of our results is given in O. Zuk, I. Kanter, and E. Domany, Asymptotics of the Entropy Rate for a Hidden Markov Process, Data Compression Conference, Snowbird (2005).
11. T. M. Cover and J. A. Thomas, Elements of Information Theory (Wiley, New York, 1991).
12. L. K. Saul and M. I. Jordan, Boltzmann Chains and Hidden Markov Models, Advances in Neural Information Processing Systems, Volume 7 (MIT Press, 1994).
13. D. J. C. MacKay, Equivalence of Boltzmann chains and Hidden Markov Models, Neural Comput. 8(1): 178-181 (1996).
14. B. Derrida, M. M. France, and J. Peyriere, Exactly solvable one-dimensional inhomogeneous models, J. of Stat. Phys. 45(3-4):439-449 (1986).
15. D. S. Fisher, P. Le Doussal, and P. Monthus, Nonequilibrium dynamics of random field Ising spin chains: Exact results via real space renormalization group, Phys. Rev. E 64(6):066-107 (2001).
16. G. Grinstein and D. Mukamel, Exact solution of a one-dimensional ising-model in a random magnetic field, Phys. Rev. B 27:4503-4506 (1983).
17. T. M. Nieuwenhuizen and J. M. Luck, Exactly soluble random field Ising models in one-dimension, J. Phys. A: Math. Gen. 19:1207-1227 (May 1986).
18. B. Derrida and H. J. Hilhorst, Singular behavior of certain infinite products of random 2×2 matrices, J. Phys. A 16:2641-2654 (1983).
19. http://www.maplesoft.com/