Expressions for Rényi and Shannon entropies for multivariate distributions

Statistics and Probability Letters

Volumn 71, Issue 1, 2005, Pages 71-84

  Zografos, K ^a   Nadarajah, S ^b  

^a UNIVERSITY OF IOANNINA   (Greece)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Elliptically contoured distributions; R nyi entropy; Shannon entropy

Indexed keywords

EID: 27444437823     PISSN: 01677152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.spl.2004.10.023     Document Type: Article

References (21)

1. Ahmed, N.A., Gokhale, D.V., 1989. Entropy expressions and their estimators for multivariate distributions. IEEE Trans. Inform. Theory IT-35, 688-692.
2. Arndt, C., 2001. Information Measures. Springer, Berlin.
3. Aulogiaris, G., Zografos, K., 2004. A maximum entropy characterization of symmetric Kotz type and Burr multivariate distributions. Test, 13, 65-83.
4. Burbea, J., Rao, C.R., 1982. On the convexity of some divergence measures based on entropy functions. IEEE Trans. Inform. Theory IT-28, 489-495.
5. Cover, T.M., Thomas, J.A., 1991. Elements of Information Theory. Wiley, New York.
6. Darbellay, G.A., Vajda, I., 2000. Entropy expressions for multivariate continuous distributions. IEEE Trans. Inform. Theory IT-46, 709-712.
7. Golan, A., Perloff, J.M., 2002. Comparison of maximum entropy and higher-order entropy estimators. J. Econometrics 107, 195-211.
8. Golan, A., Judge, G., Miller, D., 1996. Maximum Entropy Econometrics: Robust Estimation with Limited Data. Wiley, New York.
9. Harris, B., 1982. Entropy. In: Kotz, S., Johnson, N.L. (Eds.), Encyclopedia of Statistical Sciences, vol. 2. Wiley, New York, pp. 512-516.
10. Kotz, S., Nadarajah, S., 2000. Extreme Value Distributions: Theory and Applications. Imperial College Press, London.
11. Kotz, S., Balakrishnan, N., Johnson, N.L., 2000. Continuous Multivariate Distributions, volume 1: Models and Applications, second ed. Wiley, New York.
12. Muirhead, R.J., 1982. Aspects of Multivariate Statistical Theory. Wiley, New York.
13. Nadarajah, S., Zografos, K., 2003. Formulas for Renyi information and related measures for univariate distributions. Information Sciences, 55, 119-138.
14. Pardo, L., 1997. Teoria de la Information Estadistica. Hesperides.
15. Peddada, S.D., Richards, D.S.P., 1991. Entropy inequalities for some multivariate distributions. J. Multivariate Anal. 39, 202-208.
16. Rényi, A., 1961. On measures of entropy and information. In: Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, vol. I, University of California Press, Berkeley, pp. 547-561.
17. Shannon, C.E., 1948. A mathematical theory of communication. Bell System Tech. J. 27, 379-432.
18. Song, K.-S., 2001. Rényi information, loglikelihood and an intrinsic distribution measure. J. Statist. Plann. Inference 93, 51-69.
19. Soon, E.S., 2000. Principal information theoretic approaches. J. Amer. Statist. Assoc. 95, 1349-1353.
20. Vajda, I., 1989. Theory of Statistical Inference and Information. Kluwer Academic Publishers, Dordrecht.
21. Zografos, K., 1999. On maximum entropy characterization of Pearson's type II and VII multivariate distributions. J. Multivariate Analysis 71, 67-75.