(h, Φ)-entropy differential metric

Applications of Mathematics

Volumn 42, Issue 2, 1997, Pages 81-98

  Menendez M L ^a   Morales, D ^b   Pardo, L ^b   Salicrú, Madrid M ^c  

^a UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^b UNIVERSIDAD COMPLUTENSE DE MADRID   (Spain)

^c UNIVERSITY OF BARCELONA   (Spain)

Author keywords

(h, ) entropy measures; Asymptotic distributions; Cram r Rao inequality; Geodesic distance between probability distributions; Information metric; Maximum likelihood estimators

Indexed keywords

EID: 0043004717     PISSN: 08627940     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1022214326758     Document Type: Article

References (28)

1. S. I. Amari: A foundation of information geometry. Electronics and Communications in Japan 66-A (1983), 1-10.
2. C. Atkinson, A. F. S. Mitchell: Rao's distance measure. Sankhya 43 (1981), 345-365.
3. S. Arimoto: Information-theoretical considerations on estimation problems. Information and Control 19 (1971), 181-194.
4. J. Burbea: Informative geometry of probability spaces. Expositions Mathematicae 4 (1986), 347-378.
5. J. Burbea, C. R. Rao: Entropy differential metric, distance and divergence measures in probability spaces: A unified approach. J. Multivariate Analysis 12 (1982a), 575-590.
6. J. Burbea, C. R. Rao: On the convexity of some divergence measures based on entropy functions. IEEE Trans. on Information Theory IT-28 (1982b), no. 3, 489-495.
7. J. Burbea, C. R. Rao: On the convexity of higher order Jensen differences based on entropy functions. IEEE Trans. on Information Theory IT-28 (1982c), no. 6, 961-963.
8. N. N. Cencov: Statistical Decision Rules and Optimal Inference. Trans. of Mathematical Monographs 53, Amer. Math. Soc., Providence (1982).
9. I. Csiszár: Information-type measures of difference of probability distributions and indirect observations. Studia Scientiarum Mathematicarum Hungarica 2 (1967), 299-318.
10. K. Ferentinos, T. Papaioannou: New parametric measures of information. Information and Control 51 (1981), 193-208.
11. C. Ferreri: Hypoentropy and related heterogeneity divergence measures. Statistica 40 (1980), 55-118.
12. J. Havrda, F. Charvat: Concept of structural α-entropy. Kybernetika 3 (1967), 30-35.
13. D. Morales, L. Pardo, L. Salicrú, M. L. Menéndez: New parametric measures of information based on generalized R-divergences. Multivariate Analysis. Future directions 2. Editors C. M. Cuadras and C. R. Rao. North Holland (1993), 473-488.
14. R. J. Muirhead: Aspect of Multivariate Statistical Theory. John Wiley and Sons. Inc. (1982).
15. O. Onicescu: Energie Informationnelle. C. R. Acad. Sci. Paris. Ser A 263 (1966), 841-842.
16. C. R. Rao: Information and accuracy attainable in the estimation of statistical parameters. Bull. Calcuta Math. Soc. 37 (1945), 81-91.
17. C. R. Rao: Differential Metrics in probability spaces. Department of Mathematics and Statistics, University of Pittsburgh, Pittsburgh, PA (1987).
18. A. Rényi: On measures of entropy and information. Proc. 4th Berkeley Symp. Math. Statist. and Prob. 1 (1961), 547-561.
19. M. Salicrú, M. L. Menéndez. D. Morales, L. Pardo: Asymptotic distribution of (h, Φ)-entropies. Communications in Statistics (Theory and methods) 22(7) (1993), 2015-2031.
20. C. E. Shannon: A mathematical theory of communication. Bell Syst. Tech. J. 27 (1948), 379-423.
21. B. D. Sharma, I. J. Taneja: Entropy of type (α, β) and other generalized measures in information theory. Metrika 22 (1975), 205-215.
22. B. D. Sharma, P. Mittal: New non-additive measures of relative information. J. Comb. Inform. and Syst. Sci. 2 (1975), 122-133.
23. I. J. Taneja: A study of generalized measures in information theory. Ph. D. Thesis. University of Delhi (1975).
24. I. J. Taneja: On generalized information measures and their applications. Ad. Electronics and Electron Physics 76 (1989), 327-413.
25. I. Vajda, K. Vašek: Majorization, concave entropies and comparison of experiments. Probl. of Control and Inform. Theory 14 (1985), 105-115.
26. J. C. A. Van der Lubbe: R-norm information and a general class of measures for certainty and information. M. Sc. Thesis, Delf University of Technology, Dept. E.E., (1977). (In Dutch.)
27. J. C. A. Van der Lubbe: A generalized probabilistic theory of the measurement of certainty and information. Ph. D. Thesis, Delf University of Technology, Dept. E.E., (1981).
28. R. S. Varma: Generalizations of Renyi's entropy of order α. J. Math. Sci. 1 (1966), 34-48.