On metric divergences of probability measures

Kybernetika

Volumn 45, Issue 6, 2009, Pages 885-900

  Vajda, Igor ^a  

^a INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

Author keywords

Hellinger divergence; Information divergence; Jensen Shannon divergence; Le Cam divergence; Metric divergences; Total variation

Indexed keywords

EID: 77952578798     PISSN: 00235954     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (14)

1. I. Csiszár: Information-type measures of difference of probability distributions and indirect observations. Studia Sci. Math. Hungar. 2 (1967), 299-318.
2. I. Csiszár: On topological properties of f-divergences. Studia Sci. Math. Hungar. 2 (1967), 329-339.
3. B. Fuglede and T. Topsøe: Jensen-Shannon divergence and Hilbert space embedding. In: Proc. IEEE Internat. Symposium on Inform. Theory, IEEE Publications, New York 2004, p. 31.
4. P. Kafka, F. Österreicher, and I. Vincze: On powers of f-divergences defining a distance. Stud. Sci. Math. Hungar. 26 (1991), 329-339.
5. M. Khosravifard, D. Fooladivanda, and T. A. Gulliver: Confliction of the convexity and metric properties in f-divergences. IEICE Trans. on Fundamentals E90-A (2007), 1848-1853.
6. V. Kůs, D. Morales, and I. Vajda: Extensions of the parametric families of divergences used in statistical inference. Kybernetika 44 (2008), 95-112.
7. L. Le Cam: Asymptotic Methods in Statistical Decision Theory. Springer, New York 1986.
8. F. Liese and I. Vajda: Convex Statistical Distances. Teubner, Leipzig 1987.
9. F. Liese and I. Vajda: On divergence and informations in statistics and information theory. IEEE Trans. Inform. Theory 52 (2006), 4394-4412.
10. K. Matusita: Decision rules based on the distance for problems of fit, two samples and estimation. Ann. Math. Statist. 26 (1955), 631-640.
11. F. Öesterreicher: On a class of perimeter-type distances of probability distributions. Kybernetika 32 (1996), 389-393.
12. F. Österreicher and I. Vajda: A new class of metric divergences on probability spaces and its statistical applications. Ann. Inst. Statist. Math. 55 (2003), 639-653.
13. I. Vajda: On the f-divergence and singularity of probability measures. Period. Math. Hungar. 2 (1972), 223-234.
14. I. Vincze: On the concept and measure of information contained in an observation. In: Contributions to Probability (J. Gani and V. F. Rohatgi, eds.), Academic Press, New York 1981, pp. 207-214.