Consistent nonparametric tests of independence

Journal of Machine Learning Research

Volumn 11, Issue , 2010, Pages 1391-1423

  Gretton, Arthur ^a,c   Györfi, László ^b  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^b BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Distribution free consistent test; Hypothesis test; Independence; Kernel methods; L1; Log likelihood

Indexed keywords

BENCHMARK DATA; DISTRIBUTION-FREE; EMPIRICAL DISTRIBUTIONS; HYPOTHESIS TESTS; INDEPENDENCE MEASURE; KERNEL METHODS; LARGE DEVIATIONS; LIMITING DISTRIBUTIONS; LOG LIKELIHOOD; NON-PARAMETRIC TEST; NULL HYPOTHESIS; RANDOM SAMPLE; SAMPLE SIZES; TYPE II ERROR; TYPE-I ERROR; ZERO VALUES;

ERROR STATISTICS; PROBABILITY DISTRIBUTIONS; RANDOM VARIABLES;

STATISTICAL TESTS;

EID: 77951966792     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (47)

1. F. R. Bach and M. I. Jordan. Kernel independent component analysis. Journal of Machine Learning Research, 3:1-48, 2002.
2. C. Baker. Joint measures and cross-covariance operators. Transactions of the American Mathematical Society, 186:273-289, 1973.
3. A.R.Barron. Uniformly powerful goodness of Attests. The Annals of Statistics, 17:107-124,1989.
4. A. R. Barron, L. Györfi, and E. C. van der Meulen. Distribution estimation consistent in total variation and in two types of information divergence. IEEE Transactions on Information Theory, 38:1437-1454, 1992.
5. M. S. Bartlett. The characteristic function of a conditional statistic. Journal of the London Mathematical Society, 13:62-67, 1938.
6. p-norms of empirical functionals. Mathematical Methods of Statistics, 4:1-19, 1995.
7. 2-errors in histogram density estimation. Canadian Journal of Statistics, 22:309-318, 1994.
8. J. Beirlant, L. Devroye, L. Györfi, and I. Vajda. Large deviations of divergence measures on partitions. Journal of Statistical Planning and Inference, 93:1-16, 2001.
9. 1-test statistic of homogeneity. IEEE Transactions on Information Theory, 51:3965-3973, 2005.
10. J. R. Blum, J. Kiefer, and M. Rosenblatt. Distribution free tests of independence based on the sample distribution function. The Annals of Mathematical Statistics, 32:485-498, 1961.
11. D. S. Cotterill and M. Csörgo. On the limiting distribution of and critical values for the Hoeffding, Blum, Kiefer, Rosenblatt independence criterion. Statistics and Decisions, 3:1-48, 1985.
12. I. Csiszár. Information-type measures of divergence of probability distributions and indirect observations. Studia Scientiarum Mathematicarum Hungarica, 2:299-318, 1967.
13. J. Dauxois and G. M. Nkiet. Nonlinear canonical analysis and independence tests. The Annals of Statistics, 26(4): 1254-1278, 1998.
14. A. Dembo and Y. Peres. A topological criterion for hypothesis testing. The Annals of Statistics, 22: 106-117, 1994.
15. A. Feuerverger. A consistent test for bivariate dependence. International Statistical Review, 61(3): 419-433, 1993.
16. K. Fukumizu, F. R. Bach, and M. I. Jordan. Dimensionality reduction for supervised learning with reproducing kernel Hubert spaces. Journal of Machine Learning Research, 5:73-99, 2004.
17. K. Fukumizu, F. Bach, and A. Gretton. Statistical consistency of kernel canonical correlation analysis. Journal of Machine Learning Research, 8:361-383, 2007. (Pubitemid 46309806)
18. K. Fukumizu, A. Gretton, X. Sun, and B. Schölkopf. Kernel measures of conditional dependence. In Advances in Neural Information Processing Systems 20, pages 489-496, Cambridge, MA, 2008. MIT Press.
19. A. Gretton and L. Györfi. Nonparametric independence tests: Space partitioning and kernel approaches. In Algorithmic Learning Theory: 19th International Conference, pages 183-198, Berlin, 2008. Springer.
20. A. Gretton, O. Bousquet, A. Smola, and B. Schölkopf. Measuring statistical dependence with Hilbert-Schmidt norms. In Algorithmic Learning Theory: 16th International Conference, pages 63-78, Berlin, 2005a. Springer.
21. A. Gretton, R. Herbrich, A. Smola, O. Bousquet, and B. Schölkopf. Kernel methods for measuring independence. Journal of Machine Learning Research, 6:2075-2129, 2005b.
22. A. Gretton, K. Fukumizu, C.-H. Teo, L. Song, B. Schölkopf, and A. Smola. A kernel statistical test of independence. In Advances in Neural Information Processing Systems 20, pages 585-592, Cambridge, MA, 2008. MIT Press.
23. L. Györfi and I. Vajda. Asymptotic distributions for goodness of fit statistics in a sequence of multinomial models. Statistics and Probability Letters, 56:57-67, 2002.
24. L. Györfi and E. C. van der Meulen. A consistent goodness of fit test based on the total variation distance. In G. Roussas, editor, Nonparametric Functional Estimation and Related Topics, pages 631-645. Kluwer, Dordrecht, 1990.
25. 2-divergence. Statistics, 32:31-57, 1998.
26. P. Hall. Central limit theorem for integrated square error of multivariate nonparametric density estimators. Journal of Multivariate Analysis, 14:1-16,1984.
27. W. Hoeffding. A nonparametric test for independence. The Annals of Mathematical Statistics, 19 (4):546-557, 1948.
28. W. Hoeffding. Probability inequalities for sums of bounded random variables. Journal of the American Statistical Association, 58:13-30, 1963.
29. T. Inglot, T. Jurlewitz, and T. Ledwina. Asymptotics for multinomial goodness of fit tests for a simple hypothesis. Theory of Probability and Its Applications, 35:797-803, 1990.
30. J. Jacod and P. Protter. Probability Essentials. Springer, New York, 2000.
31. W. C. M. Kallenberg. On moderate and large deviations in multinomial distributions. The Annals of Statistics, 13:1554-1580, 1985.
32. A. Kankainen. Consistent Testing of Total Independence Based on the Empirical Characteristic Function. PhD thesis, University of Jyväskylä, 1995.
33. J. H. B. Kemperman. An optimum rate of transmitting information. The Annals of Mathematical Statistics, 40:2156-2177, 1969.
34. S. Kullback. A lower bound for discrimination in terms of variation. IEEE Transactions on Information Theory, 13:126-127, 1967.
35. S. E. Leurgans, R. A. Moyeed, and B. W. Silverman. Canonical correlation analysis when the data are curves. Journal of the Royal Statistical Society, Series B (Methodological), 55(3):725-740, 1993.
36. C. McDiarmid. On the method of bounded differences. In Survey in Combinatorics, pages 148-188. Cambridge University Press, 1989.
37. C. Morris. Central limit theorems for multinomial sums. The Annals of Statistics, 3:165-188, 1975.
38. M.P. Quine and J. Robinson. Efficiencies of chi-square and likelihood ratio goodness-of-fit tests. The Annals of Statistics, 13:727-742, 1985.
39. C. R. Rao. Statistical Inference and its Applications. Wiley, New York, second edition, 1973.
40. T. Read and N. Cressie. Goodness-Of-Fit Statistics for Discrete Multivariate Analysis. SpringerVerlag, New York, 1988.
41. A. Rényi. On measures of dependence. Acta Mathematica Academiae Scientiarum Hungaricae, 10: 441-451, 1959.
42. M. Rosenblatt. A quadratic measure of deviation of two-dimensional density estimates and a test of independence. The Annals of Statistics, 3(1): 1-14, 1975.
43. R. Serfling. Approximation Theorems of Mathematical Statistics. Wiley, New York, 1980.
44. B. Sriperumbudur, A. Gretton, K. Fukumizu, G. Lanckriet, and B. Schölkopf. Injective hilbert space embeddings of probability measures. In Proceedings of the 21st Annual Conference on Learning Theory, pages 111-122, 2008.
45. I. Steinwart. On the influence of the kernel on the consistency of support vector machines. Journal of Machine Learning Research, 2:67-93, 2001.
46. G. Tusnády. On asymptotically optimal tests. The Annals of Statistics, 5:385-393, 1977.
47. N. Ushakov. Selected Topics in Characteristic Functions. Modern Probability and Statistics. Walter de Gray ter, Berlin, 1999.