From finite-system entropy to entropy rate for a hidden Markov process

IEEE Signal Processing Letters

Volumn 13, Issue 9, 2006, Pages 517-520

  Zuk, Or ^a   Domany, Eytan ^a   Kanter, Ido ^b   Aizenman, Michael ^c  

^a WEIZMANN INSTITUTE OF SCIENCE   (Israel)

^b BAR ILAN UNIVERSITY   (Israel)

^c PRINCETON UNIVERSITY   (United States)

Author keywords

Entropy; Hidden markov process (HMP); Taylor series

Indexed keywords

ENTROPY; FINITE ELEMENT METHOD; MARKOV PROCESSES;

HIDDEN MARKOV PROCESS; POWER SERIES; TAYLOR SERIES;

SPURIOUS SIGNAL NOISE;

EID: 33747783917     PISSN: 10709908     EISSN: None     Source Type: Journal    
DOI: 10.1109/LSP.2006.874466     Document Type: Article

References (12)

1. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
2. Y. Ephraim and N. Merhav, "Hidden Markov processes," IEEE Trans. Inf. Theory, vol. 48, no. 6, pp. 1518-1569, Jun. 2002.
3. M. Crouse, R. Nowak, and R. Baraniuk, "Wavelet-based statistical signal processing using hidden Markov models," IEEE Tran. Signal Process., vol. 46, no. 4, pp. 886-902, Apr. 1998.
4. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pp. 379-423 (part 1) and pp. 623-656 (part 2), 1948.
5. T. M. Cover and J. A.Thomas, Elements of Information Theory. New York: Wiley, 1991.
6. P. Jacquet, G. Seroussi, and W. Szpankowski, "On the entropy of a hidden Markov process," in Proc. Data Computation Conf., Snowbird, UT, 2004, pp. 362-371.
7. E. Ordentlich and T. Weissman, "New bounds on the entropy rate of hidden Markov processes," in Proc. San Antonio Information Theory Workshop, 2004.
8. O. Zuk, I. Kanter, and E. Domany, "Asymptotics of the entropy rate for a hidden Markov process," in Proc. Data Computation Conf., Snowbird, UT, 2005, pp. 173-182.
9. G. Han and B. Marcus, "Analyticity of entropy rate in families of hidden Markov chains," IEEE Tran. Inf. Theory, submitted for publication.
10. J. Lorinczi, C. Maes, and K. Vande Velde, "Transformations of Gibbs measures," Prob. Theory Related Fields, vol. 112, pp. 121-147, 1998.
11. R. L. Dobrushin and S. B. Shlosman, "Completely analytical interactions: Constructive description," J. Stat. Phys., vol. 46, no. 5-6, pp. 983-1014, 1987.
12. O. Zuk, I. Kanter, E. Domany, and M. Aizenman, "Taylor series expansions for the entropy rate of hidden Markov processes," in Proc. IEEE Int. Conf. Communication, Istanbul, Turkey, 2006, accepted for publication.