On divergences of finite measures and their applicability in statistics and information theory

Statistics

Volumn 44, Issue 2, 2010, Pages 169-187

  Stummer, Wolfgang ^a   Vajda, Igor ^b  

^a UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

^b INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

Author keywords

Differential power entropies; Divergences of finite measures; Divergences of finite measures; Local and global divergences of finite measures; Pinsker's inequality for finite measures; Statistical censoring

Indexed keywords

EID: 77951168324     PISSN: 02331888     EISSN: 10294910     Source Type: Journal    
DOI: 10.1080/02331880902986919     Document Type: Article

References (32)

1. I. Csiszár, Eine informationstheoretische Ungleichung und ihre Anwendung auf den Beweis der Ergodizität von Markoffschen Ketten, Publ. Math. Inst. Hung. Acad. Sci. Ser. A 8 (1963), pp. 85-108.
2. F. Liese and I. Vajda, Convex Statistical Distances, Teubner, Leipzig, 1987.
3. F. Liese and I. Vajda, On divergences and informations in statistics and information theory, IEEE Trans. Inform. Theory 52(10) (2006), pp. 4394-4412.
4. D. Morales, L. Pardo, M.C. Pardo, and I. Vajda, Rényi statistics for testing composite hypotheses in general exponential models, Statistics 38(2) (2004), pp. 133-147.
5. D. Morales, L. Pardo, and I. Vajda, Rényi statistics in directed families of exponential experiments, Statistics 34(1) (2000), pp. 151-174.
6. W. Stummer and I. Vajda, Optimal statistical decisions about some alternative financial models, J. Econom. 137 (2007), pp. 441-471.
7. W. Stummer, On a statistical information measure for a generalized Samuelson-Black-Scholes model, Statist. Decisions 19 (2001), pp. 289-314.
8. W. Stummer, Exponentials, Diffusions, Finance, Entropy and Information, Shaker, Aachen, 2004.
9. R. Miller, Survival Analysis, Wiley, NewYork, 1981.
10. M. Hollander, F. Proschan, and J. Sconing, Information, censoring, and dependence, in Topics in Statistical Dependence H.W. Block, A.R. Sampson, and T.H. Savits, eds., IMS, Hayward, 1990, pp. 257-268.
11. W. Stute, Strong consistency of the MLE under random censoring, Metrika 39 (1992), pp. 257-267.
12. W. Stute, The sequential probability ratio test under random censorship, Metrika 44 (1996), pp. 1-8.
13. Ch. Tsairidis, K. Ferentinos, and T. Papaioannou, Information and random censoring, Inform. Comput. Sci. 92 (1996), pp. 159-174.
14. Ch. Tsairidis, K. Zografos, K. Ferentinos, and T. Papaioannou, Information in quantal response data and random censoring, Ann. Inst. Statist. Math. 53(3) (2001), pp. 528-542.
15. A.A. Fedotov, P. Harremoës, and F. Topsøe, Refinements of Pinsker's inequality, IEEE Trans. Inform. Theory 49(6) (2003), pp. 1491-1498.
16. T.M. Cover and J.B. Thomas, Elements of Information Theory, Wiley, NewYork, 1991.
17. A.N. Kolmogorov, On the Shannon theory of information transmission in the case of continuous signals, IRE Trans. Inform. Theory 2 (1956), pp. 102-108.
18. J.D. Markel and A.H. Gray, Jr., Linear Prediction of Speech, Springer, Berlin, 1976.
19. A. Buzo, A.H. Gray, Jr., R.M. Gray, and J.D. Markel, Speech coding based upon vector quantization, IEEE Trans. Acoust Speech Signal Process. 28(5) (1980), pp. 562-574.
20. K.-Th. Sturm, On the geometry of metric measure spaces I, Acta Math. 196 (2006), pp. 65-131.
21. K.-Th. Sturm, On the geometry of metric measure spaces II, Acta Math. 196 (2006), pp. 133-177.
22. H. Dalton, The measurement of the inequality of incomes, Econ. J. 30 (1920), pp. 348-361.
23. H. Dalton, Some Aspects of the Inequality of Incomes in Modern Communities, 2nd ed. Routledge and Kegan Paul, London, 1925.
24. C. Gini, Variabilità e Mutabilità, Studo Economico-Giuridici della R. Univ. di Cagliari 3(2) (1912), p. 80.
25. E.H. Simpson, Measurement of diversity, Nature 163 (1949), p. 688.
26. I. Vajda, Bounds on the minimal error probability and checking a finite or countable number of hypotheses, Inform. Transmis. Probl. 4 (1968), pp. 9-17.
27. L. Devroye, L. Györfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition, Springer, Berlin, 1996.
28. J. Zvárová and I. Vajda, On genetic information, diversity and distance, Methods Inform.Med.2(2006),pp.173-179.
29. J. Havrda and F. Charvát, Concept of structural a-entropy, Kybernetika 3 (1967), pp. 30-35.
30. A. Rényi, On measures of entropy and information, in Proceedings of Fourth Berkeley Symposium on Probability and Statistics, Vol. 1, University of California Press, Berkeley, 1961, pp. 547-561.
31. I. Vajda and J. Zvárová, On generalized entropies, Bayesian decisions and statistical diversity, Kybernetika 43(5) (2007), pp. 675-696.
32. R.M. Gray, D. L. Neuhoff, and P. C. Shields, A generalization of Ornstein's d̄ distance with applications to information theory, Ann. Probab. 3(2) (1975), pp. 315-328.