A kernel test of goodness of fit

33rd International Conference on Machine Learning, ICML 2016

Volumn 6, Issue , 2016, Pages 3854-3867

  Chwialkowski, Kacper ^a   Strathmann, Heiko ^a   Gretton, Arthur ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING ALGORITHMS; LEARNING SYSTEMS; MARKOV PROCESSES; MAXIMUM LIKELIHOOD ESTIMATION; MONTE CARLO METHODS; STATISTICAL TESTS; TESTING;

EMPIRICAL ESTIMATE; MARKOV CHAIN MONTE CARLO METHOD; MODEL COMPLEXITY; NON-PARAMETRIC STATISTICAL TESTS; NONPARAMETRIC DENSITY ESTIMATION; NULL DISTRIBUTION; REPRODUCING KERNEL HILBERT SPACES; STATISTICAL MODELING;

STATISTICS;

EID: 84999016912     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (41)

1. Anderson, N., Hall, P., and Titterington, D. Two-sample test statistics for measuring discrepancies between two multivariate probability density functions using kernel- based density estimates. Journal of Multivariate Analysis, 50:41-54, 1994.
2. Bardenet, R., Doucet, A., and Holmes, C. Towards scaling up Markov Chain Monte Carlo: An adaptive subsampling approach. In ICML, pp. 405-413, 2014.
3. Baringhaus, L. and Henze, N. A consistent test for multivariate normality based on the empirical characteristic function. Metrika, 35:339-348, 1988.
4. Barron, A. R. Uniformly powerful goodness of fit tests. The Annals of Statistics, 17:107-124, 1989.
5. Beirlant, J., Gyorfi, L., and Lugosi, G. On the asymptotic normality of the li- and/2-errors in histogram density estimation. Canadian Journal of Statistics, 22:309-318, 1994.
6. Bowman, A.W. and Foster, RJ. Adaptive smoothing and density based tests of multivariate normality. J. Amer. Statist. Assoc, 88:529-537, 1993.
7. Bradley, R. et al. Basic properties of strong mixing conditions. a survey and some open questions. Probability surveys, 2(107-44):37, 2005.
8. Carmeli, Claudio, De Vito, Ernesto, Toigo, Alessandro, and Umanita, Veronica. Vector valued reproducing kernel hilbert spaces and universality. Analysis and Applications, 8(01): 19-61, 2010.
9. Chwialkowski, Kacper, Ramdas, Aaditya, Sejdinovic, Dino, and Gretton, Arthur. Fast two-sample testing with analytic representations of probability measures. In NIPS, pp. 1972-1980, 2015.
10. Chwialkowski, Kacper P, Sejdinovic, Dino, and-Gretton, Arthur. A wild bootstrap for degenerate kernel tests. In Advances in neural information processing systems, pp. 3608-3616, 2014.
11. Dedecker, J., Doukhan, P., Lang, G., Louhichi, S., and Prieur, C. Weak dependence: with examples and applications, volume 190. Springer, 2007.
12. Dedecker, Jerome and Prieur, Clementine. New dependence coefficients, examples and applications to statistics. Probability Theory and Related Fields, 132(2):203-236, 2005.
13. Fromont, M., Laurent, B, Lerasle, M, and Reynaud-Bouret, P. Kernels based tests with non-asymptotic bootstrap approaches for two-sample problems. In COLT, pp. 2310- 2322, 2012.
14. Gelman, A. and Rubin, D.B. Inference from iterative simulation using multiple sequences. Statistical science, pp. 457-472, 1992.
15. Gorham, J. and Mackey, L. Measuring sample quality with stein's method. In NIPS, pp. 226-234, 2015.
16. Gretton, A. and Gyorfi, L. Consistent nonparametric tests of independence. Journal of Machine Learning Research, 11:1391-1423, 2010.
17. Gretton, A., Fukumizu, K., Teo, C, Song, L., Scholkopf, B., and Smola, A. A kernel statistical test of independence. In MPS, volume 20, pp. 585-592, 2007.
18. Gretton, A., Borgwardt, K.M., Rasch, M.J., Scholkopf, B., and Smola, A. A kernel two-sample test. J. Mach. Learn. Res., 13:723-773, 2012.
19. Gyorfi, L. and Vajda, I. Asymptotic distributions for goodness of fit statistics in a sequence of multinomial models. Statistics and Probability Letters, 56:57-67, 2002.
20. Gyorfi, L. and van der Meulen, E. C. A consistent goodness of fit test based on the total variation distance. In Rous- sas, G. (ed.), Nonparametric Functional Estimation and Related Topics, pp. 631-645. Kluwer, Dordrecht, 1990.
21. Kolmogorov, A. Sulla determinazione empirica di una legge di distribuzione. G. 1st. Ital. Attuari, 4:83-91, 1933.
22. Korattikara, A., Chen, Y., and Welling, M. Austerity in MCMC Land: Cutting the Metropolis-Hastings Budget. In ICML, pp. 181-189, 2014.
23. Korattikara, Anoop, Chen, Yutian, and Welling, Max. Austerity in mcmc land: Cutting the metropolis-hastings budget. arXiv preprint arXiv:1304.5299, 2013.
24. Leucht, A. Degenerate U- and V-statistics under weak dependence: Asymptotic theory and bootstrap consistency. Bernoulli, 18(2):552-585, 2012.
25. Leucht, A. and Neumann, M.H. Dependent wild bootstrap for degenerate U- and V-statistics. Journal of Multivariate Analysis, 117:257-280, 2013. ISSN 0047-259X. doi: 10.1016/j.jmva.2013.03.003. URL http://www.sciencedirect.com/science/article/pii/S0047259X13000304.
26. Liu, Q., Lee, J., and Jordan, M. I. A kernelized stein discrepancy for goodness-of-fit tests and model evaluation. Technical report, ArXiv, 2016.
27. Lloyd, James R and Ghahramani, Zoubin. Statistical model criticism using kernel two sample tests. In NIPS, pp. 829-837, 2015.
28. Oates, C., Girolami, M and Chopin, N. Control functional for monte carlo integration. Technical Report arXiv:1410.2392v4, ArXiv, 2015.
29. Rahimi, A. and Recht, B. Random features for large-scale kernel machines. In NIPS, pp. 1177-1184, 2007.
30. Rizzo, M. L. New goodness-of-fit tests for pareto distributions. ASTIN Bulletin: Journal of the International Association of Actuaries, 39(2):691-715, 2009.
31. Sejdinovic, D., Sriperumbudur, B., Gretton, A., and Fukumizu, K. Equivalence of distance-based and RKHS- based statistics in hypothesis testing. 41(5):2263-2291, 2013.
32. Serfling, R. Approximation Theorems of Mathematical Statistics. Wiley, New York, 1980.
33. Shao, X. The dependent wild bootstrap. J. Amer. Statist. Assoc., 105(489):218-235, 2010.
34. Smirnov, N. Table for estimating the goodness of fit of empirical distributions. Annals of Mathematical Statistics, 19:279-281, 1948.
35. Sriperumbudur, B., Gretton, A., Fukumizu, K., Lanckriet, G., and Scholkopf, B. Hilbert space embeddings and metrics on probability measures. J. Mach. Learn. Res., 11:1517-1561, 2010.
36. Sriperumbudur, B., Fukumizu, K., Kumar, R., Gretton, A., and Hyvarinen, A. Density Estimation in Infinite Dimensional Exponential Families. arXiv preprint arXiv:1312.3516, 2014.
37. Stein, Charles. A bound for the error in the normal approximation to the distribution of a sum of dependent random variables. In Proceedings of the Sixth Berkeley Symposium on Mathematical Statistics and Probability, Volume 2: Probability Theory, pp. 583- 602, Berkeley, Calif., 1972. University of California Press. URL http://projecteuclid.org/euclid.bsmsp/1200514239.
38. Steinwart, I. and Christmann, A. Support vector machines. Information Science and Statistics. Springer, New York, 2008. ISBN 978-0-387-77241-7.
39. Strathmann, H., Sejdinovic, D., Livingstone, S., Szabo, Z., and Gretton, A. Gradient-free Hamiltonian Monte Carlo with Efficient Kernel Exponential Families. In NIPS, 2015.
40. Szekely, G. J. and Rizzo, M. L. A new test for multivariate normality. J. Multivariate Analysis, 93(1):58-80, 2005.
41. Welling, M. and Teh, Y.W. Bayesian Learning via Stochastic Gradient Langevin Dynamics. In ICML, pp. 681-688, 2011.