Bayesian estimation of Shannon entropy

Communications in Statistics - Theory and Methods

Volumn 26, Issue 1, 1997, Pages 139-148

  Yuan, Lin ^a   Kesavan, H K ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Bayesian estimate; Dirichlet prior; Entropy; Frequency data

Indexed keywords

ESTIMATION; INFORMATION THEORY; PROBABILITY; STATISTICAL METHODS;

BAYESIAN ESTIMATE; DIRICHLET PRIOR; FREQUENCY DATA; INFORMATION MEASURE; SHANNON ENTROPY;

MATHEMATICAL MODELS;

EID: 0031387270     PISSN: 03610926     EISSN: None     Source Type: Journal    
DOI: 10.1080/03610929708831906     Document Type: Article

References (8)

1. Good, I. J. (1953). "The population frequencies of species and the estimation of population parameters," Biometrika, 40, 237-264.
2. Lindley, D. V. (1956). "On a measure of the information provided by an experiment," Ann. Math. Statist., 27, 986-1005.
3. Basharin, G. P. (1959). "On a statistical estimate for the entropy of a sequence of independent random variables," Theory of Prob. and Its Appl., 4, 333-336. (English translation)
4. Reza, F. M. (1961). An introduction to information theory, McGraw-Hill Book Company, Inc., New York.
5. Wilks, S. S. (1962). Mathematical statistics, Wiley, New York.
6. Pielou, E. C. (1967). "The use of information theory in the study of the diversity of biological populations," Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, 4, 163-177.
7. Spain, B. and Smith, M. G.(1970). Functions of mathematical physics, Van Nostrand Reinhold Company, London.
8. Hutcheson, K. and Shenton, L. R. (1974). "Some moments of an estimate of Shannon's measure of information," Communications in Statistics, 3, 89-94.