Expressions for Rényi and Shannon entropies for bivariate distributions

Information Sciences

Volumn 170, Issue 2-4, 2005, Pages 173-189

  Nadarajah, S ^a   Zografos, K ^b  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

^b UNIVERSITY OF IOANNINA   (Greece)

Author keywords

Elliptically contoured distributions; R nyi entropy; Shannon entropy

Indexed keywords

ENTROPY; INFORMATION THEORY; PROBABILITY; STATISTICS; VECTORS;

ELLIPTICALLY CONTOURED DISTRIBUTIONS; KOTZE TYPE DISTRIBUTION; SHANNON ENTROPIES;

INFORMATION SCIENCE;

EID: 13244291650     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2004.02.020     Document Type: Article

References (28)

1. Ahmed N.A., Gokhale D.V. Entropy expressions and their estimators for multivariate distributions. IEEE Transactions on Information Theory. IT-35:1989;688-692
2. Arndt C. Information Measures. 2001;Springer, Berlin
3. Arnold B.C., Castillo E., Sarabia J.M. Conditional Specification of Statistical Models. 1999;Springer Verlag, New York
4. Arnold B.C., Strauss D. Bivariate distributions with exponential conditionals. Journal of the American Statistical Association. 83:1988;522-527
5. G. Aulogiaris, K. Zografos, A maximum entropy characterization of symmetric Kotz type and Burr multivariate distributions, in press
6. Burbea J., Rao C.R. On the convexity of some divergence measures based on entropy functions. IEEE Transactions on Information Theory. IT-28:1982;489-495
7. Cuadras C.M., Augé J. A continuous general multivariate distribution and its properties. Communication in Statistics - Theory and Methods. 10:1981;339-353
8. Darbellay G.A., Vajda I. Entropy expressions for multivariate continuous distributions. IEEE Transactions on Information Theory. IT-46:2000;709-712
9. De Groot M.H. Optimal Statistical Decisions. 1970;McGraw-Hill, New York
10. Freund J. A bivariate extension of the exponential distribution. Journal of the American Statistical Association. 56:1961;971-977
11. Golan A., Judge G., Miller D. Maximum Entropy Econometrics: Robust Estimation with Limited Data. 1996;Wiley, New York
12. Golan A., Perloff J.M. Comparison of maximum entropy and higher-order entropy estimators. Journal of Econometrics. 107:2002;195-211
13. Gradshteyn I.S., Ryzhik I.M. Table of Integrals, Series and Products. sixth ed.:2000;Academic Press, San Diego
14. Harris B. Entropy. Kotz S., Johnson N.L. Encyclopedia of Statistical Sciences. vol. 2:1982;512-516 Wiley, New York
15. Kotz S. Multivariate distributions at a cross road. Patil G.P., Kotz S., Ord J.K. Statistical Distributions in Scientific Work. 1:1975;D. Reidel Publishing Company, Dordrecht
16. Kotz S., Balakrishnan N., Johnson N.L. Continuous Multivariate Distributions, volume 1: Models and Applications. second ed.:2000;Wiley, New York
17. Kotz S., Nadarajah S. Extreme Value Distributions: Theory and Applications. 2000;Imperial College Press, London
18. Lindley D.V., Singpurwalla N.D. Multivariate distributions for the life lengths of components of a system sharing a common parameter. Journal of Applied Probability. 23:1986;418-431
19. Marshall A.W., Olkin I. A generalized bivariate exponential distribution. Journal of Applied Probability. 4:1967;291-302
20. McKay A.T. Sampling from batches. Journal of the Royal Statistical Society, Supplement. 1:1934;207-216
21. Mihram G.A., Hultquist A.R. A bivariate warning-time/failure-time distribution. Journal of the American Statistical Association. 62:1967;589-599
22. Muliere P., Scarsini M. Characterization of a Marshall-Olkin type class of distributions. Annals of the Institute of Statistical Mathematics. 39:1987;429-441
23. Nadarajah S., Zografos K. Rényi information and an intrinsic distribution measure for univariate distributions. Information Sciences. 155:2003;119-138
24. Rényi A. On measures of entropy and information. Proceedings of the 4th Berkeley Symposium on Mathematical Statistics and Probability. vol. I:1961;547-561 University of California Press, Berkeley
25. Shannon C.E. A mathematical theory of communication. Bell System Technical Journal. 27:1948;379-432
26. Soofi E.S. Principal information theoretic approaches. Journal of the American Statistical Association. 95:2000;1349-1353
27. Vajda I. Theory of Statistical Inference and Information. 1989;Kluwer Academic Publishers
28. Zografos K. On maximum entropy characterization of Pearson's type II and VII multivariate distributions. Journal of Multivariate Analysis. 71:1999;67-75