The entropy of a mixture of probability distributions

Entropy

Volumn 7, Issue 1, 2005, Pages 15-37

  De Vos, Alexis ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

Bhattacharyya space; Hubert space; Mixture distribution; Probability distribution

Indexed keywords

COMPUTATION THEORY; FUNCTIONS; MATHEMATICAL MODELS; POLYNOMIALS; PROBABILITY DISTRIBUTIONS;

BHATTACHARYYA SPACES; GRAM-SCHMIDT ORTHONORMALIZATIONS; HILBERT SPACES; MIXTURE DISTRIBUTIONS;

ENTROPY;

EID: 17444422925     PISSN: 10994300     EISSN: 10994300     Source Type: Journal    
DOI: 10.3390/e7010015     Document Type: Article

References (15)

1. Cover, T.; Thomas, J. Elements of information theory; Wiley, New York, 1991.
2. Teicher, H. On the mixture of distributions. The Annals of Mathematical Statistics 1960, 31, 55-73.
3. Everitt, B.; Hand, D. Finite mixture distributions; Chapman and Hall, London, 1981.
4. Bhattacharyya, A. On a measure of divergence between two statistical populations defined by their probability distributions. Bulletin of the Calcutta Mathematical Society 1943, 35, 99-109.
5. Atkinson, C.; Mitchell, A. Rao's distance. Sankhyā: The Indian Journal of Statistics 1981, 43, 345-365.
6. Wootters, W. Statistical distance and Hilbert space. Physical Review D 1981, 23, 357-362.
7. Aherne, F.; Thacker, N.; Rockett, P. The Bhattacharyya metric as an absolute similarity measure for frequency coded data. Kybernetika 1998, 32, 363-368.
8. Diósi, L.; Salamon, P. From statistical distances to minimally dissipative processes. In Thermodynamics of energy conversion and transport; Sieniutycz, S.; De Vos, A., Eds.; Springer Verlag, New York, 2000; pp. 286-318.
9. Kendall, M. A course in the geometry of n dimensions; Charles Griffin & co, London, 1961.
10. Avery, J. Hyperspherical harmonics - applications in quantum theory; Kluwer Academic Publishers, Dordrecht, 1989.
11. De Vos, A. The expectation value of the entropy of a digital message. Open Systems & Information Dynamics 2002, 9, 97-113.
12. De Vos, A. Reversible computing. Progress in Quantum Electronics 1999, 23, 1-49.
13. Landauer, R. Irreversibility and heat generation in the computing process. IBM Journal of Research and Development 1961, 5, 183-191.
14. Bennett, C. The thermodynamics of computation - a review. International Journal of Theoretical Physics 1982, 21, 905-940.
15. Shannon, C. A mathematical theory of communication. Bell Systems Technical Journal 1948, 27, 379-423.