Entropy expressions for multivariate continuous distributions

IEEE Transactions on Information Theory

Volumn 46, Issue 2, 2000, Pages 709-712

  Darbellay, Georges A ^b   Vajda, Igor ^a,b  

^a IEEE   (Czech Republic)

^b INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

Author keywords

[No Author keywords available]

Indexed keywords

DIFFERENTIAL ENTROPY; MUTUAL INFORMATION;

PARAMETER ESTIMATION; PROBABILITY DISTRIBUTIONS; WEIBULL DISTRIBUTION;

INFORMATION THEORY;

EID: 0033903895     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.825848     Document Type: Article

References (12)

1. M. Abramowitz and I. Stegun, Handbook of Mathematical Functions, V. H. Deutsch, Ed. Frankfurt/Main, Germany: abridged version, 1984,.
2. N. A. Ahmed and D. V. Gokhale, "Entropy expressions and their estimators for multivariate distributions," IEEE Trans. Inform. Theory, vol. 35, pp. 688-692, May 1989.
3. B. C. Arnold, Pareto Distributions. Burtonsville, MD: Int. Coop. Publishing House, 1983.
4. J. Beirlant, E. J. Dudewicz, L. Györfi, and E. C. van der Meulen, "Non-parametric entropy estimation: An overview," Int. J. Math. Stat. Sci., vol. 6, pp. 17-39, June 1997.
5. L. D. Brown, Fundamentals of Statistical Exponential Families. Hayward, CA: Inst. Math. Statist., 1986, vol. 9. Lecture Notes.
6. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
7. G. A. Darbellay, "Predictability: An information-theoretic perspective," in Signal Analysis and Prediction, A. Procházka, J. Uhlíř, P. J. W. Rayner, and N. G. Kingsbury, Eds. Boston, MA: Birkhäuser-Verlag, 1998, pp. 249-262.
8. G. A. Darbellay and I. Vajda. (1998, Feb.) Entropy Expressions for Multivariate Continuous Distributions. UTIA, Academy of Sciences, Prague, Czech Republic. [Online]. Available: http://siprint.utia.cas. cz/darbellay
9. _, "Estimation of the mutual information with data-dependent partitions," IEEE Trans. Inform. Theory, vol. 45, pp. 1315-1320, May 1999.
10. S. Ihara, Information Theory for Continuous Systems. Singapore, Singapore: World Scientific, 1993.
11. N. L. Johnson and S. Kotz, Distributions in Statistics: Continuous Multivariate Distributions. New York: Wiley, 1972.
12. A. C. G. V. Lazo and P. N. Rathie, "On the entropy of continuous probability distributions," IEEE Trans. Inform. Theory, vol. IT-24, pp. 120-122, 1978.