On the Bahadur-efficient testing of uniformity by means of the entropy

IEEE Transactions on Information Theory

Volumn 54, Issue 1, 2008, Pages 321-331

  Harremoes, Peter ^a   Vajda, Igor ^b  

^a CWI   (Netherlands)

^b INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

Author keywords

Bahadur efficiency; Entropy; Goodness of fit; Index of coincidence; Information diagram; Power divergences

Indexed keywords

CRYPTOGRAPHY; EFFICIENCY; STATISTICAL TESTS; STATISTICS; TEXT PROCESSING;

BAHADUR EFFICIENCY; GOODNESS-OF-FIT; INDEX OF COINCIDENCE; INFORMATION OF DIAGRAM; POWER DIVERGENCES;

INFORMATION THEORY;

EID: 38349111087     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2007.911155     Document Type: Article

References (26)

1. F. Liese and I. Vajda, "On divergence and informations in statistics and information theory," IEEE Tranns. Inf. Theory, vol. 52, no. 10, pp. 4394-4412, Oct. 2006.
2. T. R. C. Read and N. Cressie, Goodness of Fit Statistics for Discrete Multivariate Data. Berlin, Germany: Springer, 1988.
3. P. Harremoës and F. Topsøe, "Inequalities between entropy and index of coincidence derived from information diagrams," IEEE Trans. Inf. Theory, vol. 47, no. 7, pp. 2944-2960, Nov. 2001.
4. R. J. Serfling, Approximation Theorems of Mathematical Statistics. New York: Wiley, 1980.
5. Y. Nikulin, Asymptotic Efficiency of Nonparametric Tests. Cambridge, U.K.: Cambridge Univ. Press, 1995.
6. M. P. Quine and J. Robinson, "Efficiencies of chi-square and likelihood ratio goodness-of-fit tests," Ann. Statist., vol. 13, pp. 727-742, 1985.
7. R. R. Bahadur, Some Limit Theorems in Statistics. Philadelphia, PA: SIAM, 1981.
8. S. H. Tumanyan, "On the asymptotic distribution of the chi-square criterion," (in Russian) Dokl. Akad. Nauk SSSR, vol. 94, pp. 1011-1012, 1954.
9. C. Morris, "Central limit theorems for multinomial sums," Ann. Statist., vol. 3, pp. 165-188, 1975.
10. T. Inglot, T. Jurlewicz, and T. Ledwina, "Asymptotics for multinomial goodness of fit tests for simple hypothesis," Theory Probability and its Applications, vol. 35, no. 4, pp. 797-803, 1990.
11. M. C. Pardo and I. Vajda, "On asymptotic properties of information-theoretic divergences," IEEE Trans. Inf. Theory, vol. 49, no. 7, pp. 1860-1867, Nov. 2003.
12. L. Györfi and I. Vajda, "Asymptotic distributions for goodness-of-fit statistics in a sequence of multinomial models," Probab. Statist. Lett., vol. 56, no. 1, pp. 57-67, 2002.
13. I. Vajda, "Asymptotic laws for stochastic disparity statistics," Tatra Mount. Math. Publ., vol. 26, pp. 269-280, 2003.
14. L. Holst, "Asymptotic normality and efficiency for certain goodness-of-fit tests," Biometrika, vol. 59, pp. 138-145, 1972.
15. G. I. Ivchenko and Y. I. Medvedev, "Separable statistics and hypotheses testing. the case of small samples," Theory Probability and its Applications, vol. 23, no. 4, pp. 764-775, 1978.
16. M. Menéndez, D. Morales, L. Pardo, and I. Vajda, "Asymptotic distributions of f-divergences of hypothetical and observed frequencies on refined partitions," Statistica Neerlandica, vol. 52, pp. 71-89, 1998.
17. J. Beirlant, L. Devroye, L. Györfi, and I. Vajda, "Large deviations of divergence measures on partitions," J. Statist. Planning and Infer., vol. 93, pp. 1-16, 2001.
18. L. Györfi, G. Morvai, and I. Vajda, "Asymptotic results for information-theoretic and statistical criteria of goodness of fit," Institute of Information Theory and Automation, Prague, Czech Republic, 2000, Res. Rep. 1961.
19. I. Vajda, "On convergence of information contained in quantized observations," IEEE Trans. Inf. Theory, vol. 48, no. 8, pp. 2163-2172, Aug. 2002.
20. W. C. M. Kallenberg, "On moderate and large deviations in multinomial distributions," Ann. Statist., vol. 13, pp. 1554-1580, 1985.
21. I. N. Sanov, "On the probability of large deviations of random variables," Matemat. Sbornik, vol. 42, pp. 11-44, 1957.
22. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic, 1981.
23. A. Dembo and O. Zeitouni, Large Deviations Techniques and Applications. Boston, MA: Jones and Bartlett, 1993.
24. L. Györfi, G. Morvai, and I. Vajda, "Information-theoretic methods in testing the goodness-of-fit," in Proc. IEEE Int. Symp. Information Theory, Sorrento, Italy, Jun. 2000, p. 28.
25. L. Györfi and I. Vajda, "A class of modified Pearson and Neyman statistics," Statist. and Decisions, vol. 19, pp. 239-251, 2001.
26. W. C. M. Kallenberg, J. Oosterhof, and B. F. Shriever, "The number of classes in chi-squared goodness-of-fit tests," J. Amer. Statist. Assoc., vol. 80, pp. 959-968, 1985.