Entropy and effective support size

Entropy

Volumn 8, Issue 3, 2006, Pages 169-174

  Grendar, Marian ^a,b,c  

^a MATEJ BEL UNIVERSITY   (Slovakia)

^b INSTITUTE OF MEASUREMENT SCIENCE   (Slovakia)

^c Institute of Mathematics and Computer Science   (Slovakia)

Author keywords

Interpretation; Probability; R nyi's entropy; Shannon's entropy; Statistics; Support

Indexed keywords

EID: 33749452717     PISSN: 10994300     EISSN: 10994300     Source Type: Journal    
DOI: 10.3390/e8030169     Document Type: Article

References (9)

1. Aczél, J. Entropies Old and New (and Both New and Old) and Their Characterizations; in Bayesian Inference and Maximum Entropy Methods in Science and Engineering (G. Erickson and Y. Zhai, eds.) 2004, 119-127.
2. Cover, T. M. and Thomas, J. A. Elements of Information Theory; Wiley: New York, 1991, pp. 224-238.
3. Grendar, M. Effective Support Size. Online preprint, arXiv:math.ST/0605146. 2006.
4. Jaynes, E. T. Information Theory and Statistical Mechanics. Phys. Rev. 1957, 106 & 108, 620 & 171.
5. Khinchin, A. I. Mathematical Foundations of Information Theory; Dover: New York, 1957, pp. 9-13.
6. Shannon, C. E. The Mathematical Theory of Communication. Bell Syst. Techn. Journ. 1948, 27, 379-423, 623-656.
7. Smith, J. D. H. Some Observations on the Concepts of Information-Theoretic Entropy and Randomness. Entropy 2001, 3, 1-11.
8. Song, K.-S. Rényi Information, Loglikelihood and an Intrinsic Distribution Measure. Jour. Stat. Inference and Planning 2001, 93, 51-69.
9. Verdugo Lazo, A. C. G.; Rathie, P. N. On the Entropy of Continuous Probability Distributions. IEEE Trans. IT 1978, IT:24, 120-122.