Computing the entropy rate of information source with methods of statistical physics

Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology

Volumn 29, Issue 1, 2007, Pages 129-132

  Chen, Shuang Ping ^a   Zheng, Hao Ran ^a   Ma, Meng ^a,b   Zhang, Zhen Ya ^a   Wang, Xu Fa ^a  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b ANHUI UNIVERSITY   (China)

Author keywords

Entropy rate; Hidden Markov processes; Information source; Multi fractal

Indexed keywords

CHAOS THEORY; FRACTAL DIMENSION; FRACTALS;

ENTROPY RATE; INFORMATION SOURCE; STATISTICAL PHYSICS; STOCHASTIC PROCESSES;

MARKOV PROCESSES;

EID: 33947194347     PISSN: 10095896     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (11)

1. Ephraim Y and Merhav N. Hidden Markov processes. IEEE Trans. Inform. Theory, 2002, 48(6): 1518-1569.
2. Rabiner L R. A tutorial on hidden Markov models and selected applications in speech recognition. Proce. IEEE, 1989, 77(2): 257-286.
3. Jacquet P, Seroussi G, and Szpankowski W. On the entropy of a hidden Markov process. In: Proceeding of the Data Compression Conference, Snowbird, Oct. 2004: 362-371.
4. Chen S, Zheng H, Liu H, and Wang X. Estimators for the entropy rate of binary hidden Markov processes. http://prep.istic.ac.cn/docs/1111587263574.html, 2005.
5. Zhou Wei-xing, Wang Yan-jie, Yu Zun-hong. Geometrical characteristics of singularity spectra of multifractals: I. classical renyi definition. Journal of East China University of Science and Technology, 2000, 26(4): 385-389.
6. Zhou Wei-xing, Wang Yan-jie, Yu Zun-hong. Geometrical characteristics of singularity spectra of multifractals: II. partition function definition. Journal of East China University of Science and Technology, 2000, 26(4): 390-395.
7. Mach J, Mas F, and Sagues F. Two representations in multifractal analysis. Journal of Physics A: Mathematical and General, 1995, 28(19): 5607-5622.