Formulas for Rényi information and related measures for univariate distributions

Information Sciences

Volumn 155, Issue 1-2, 2003, Pages 119-138

  Nadarajah, S ^a   Zografos, K ^b  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

^b UNIVERSITY OF IOANNINA   (Greece)

Author keywords

R nyi entropy; Shannon entropy; Song's measure

Indexed keywords

ALGEBRA; ENTROPY; PROBABILITY; STATISTICAL METHODS;

SHANNON ENTROPY;

INFORMATION ANALYSIS;

EID: 0043237950     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0020-0255(03)00156-7     Document Type: Article

References (22)

1. Ahmed N.A., Gokhale D.V. Entropy expressions and their estimators for multivariate distributions. IEEE Transactions on Information Theory. IT-35:1989;688-692.
2. Bector C.R., Bhatia B.L. Nature of Rényi's entropy and associated divergence function. Naval Research Logistics Quarterly. 33:1986;741-746.
3. Ben-Bassat M. f-Entropies, probability of error, and feature selection Information and Control. 39:1978;227-242.
4. Burbea J., Rao C.R. On the convexity of some divergence measures based on entropy functions. IEEE Transactions on Information Theory. IT-28:1982;489-495.
5. Cover T.M., Thomas J.A. Elements of Information Theory. 1991;Wiley, New York.
6. Darbellay G.A., Vajda I. Entropy expressions for multivariate continuous distributions. IEEE Transactions on Information Theory. IT-46:2000;709-712.
7. Harris B. Entropy. Kotz S., Johnson N.L. Encyclopedia of Statistical Sciences. vol. 2:1982;512-516 Wiley, New York.
8. Joe H. Majorization, randomness and dependence for multivariate distributions. Annals of Probability. 15:1987;1217-1225.
9. Lazo A.C.G., Rathie P.N. On the entropy of continuous probability distributions. IEEE Transactions on Information Theory. IT-24:1978;120-122.
10. Marshall A.W., Olkin I. Inequalities: Theory of Majorization and its Applications. 1979;Academic Press, New York.
11. Menéndez M.L., Morales D., Pardo L., Salicrú M. (h, Φ)-Entropy differential metric Applications of Mathematics. 42:1997;81-98.
12. Morales D., Pardo L., Vajda I. Rényi statistics in directed families of exponential experiments. Statistics. 34:2000;151-174.
13. Nayak T.K. On diversity measures based on entropy functions. Communications in Statistics - Theory and Methods. 14:1985;203-215.
14. Perez A. Risk estimates in terms of generalized. f-entropies Proceedings of the Colloquium on Information Theory. vol. II:1967;299-315 János Bolyai Mathematical Society, Budapest.
15. Rényi A. On measures of entropy and information. Proceedings of the 4th Berkeley Symposium on Mathematical Statistics and Probability. vol. I:1961;547-561 University of California Press, Berkeley.
16. Shannon C.E. A mathematical theory of communication. Bell System Technical Journal. 27:1948;379-432.
17. Song K.-S. Rényi information, loglikelihood and an intrinsic distribution measure. Journal of Statistical Planning and Inference. 93:2001;51-69.
18. Soofi E.S. Principal information theoretic approaches. Journal of the American Statistical Association. 95:2000;1349-1353.
19. Teboulle M., Vajda I. Convergence of best. φ-entropy estimates IEEE Transactions on Information Theory. 39:1993;297-301.
20. Vajda I., Vašek K. Majorization, concave entropies, and comparison of experiments. Problems of Control and Information Theory. 14:1985;105-115.
21. Vajda I. Theory of Statistical Inference and Information. 1989;Kluwer Academic Publishers.
22. van Es B. Estimating functionals related to a density by a class of statistics based on spacings. Scandinavian Journal of Statistics. 19:1992;61-72.