Non-parametric estimation of integral probability metrics

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2010, Pages 1428-1432

  Sriperumbudur, Bharath K ^a   Fukumizu, Kenji ^b   Gretton, Arthur ^b,c   Schölkopf, Bernhard ^d   Lanckriet, Gert R G ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b INSTITUTE OF STATISTICAL MATHEMATICS   (Japan)

^c Carnegie Mellon University ^*  (United States)

^d MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CLOSED FORM; CONVERGENCE BEHAVIORS; CONVERGENCE RATES; LINEAR PROGRAMS; NON-PARAMETRIC ESTIMATIONS; NONPARAMETRIC METHODS; PROBABILITY METRICS; WASSERSTEIN DISTANCE;

INFORMATION THEORY;

PARAMETER ESTIMATION;

EID: 77955705402     PISSN: 21578103     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2010.5513626     Document Type: Conference Paper

References (23)

1. S. M. Ali and S. D. Silvey, "A general class of coefficients of divergence of one distribution from another," Journal of the Royal Statistical Society, Series B (Methodological), vol. 28, pp. 131-142, 1966.
2. I. Csiszar, "Information-type measures of difference of probability distributions and indirect observations," Studia Scientiarium Mathematicarum Hungarica, vol. 2, pp. 299-318, 1967.
3. Q. Wang, S. R. Kulkarni, and S. Verdu, "Divergence estimation of continuous distributions based on data-dependent partitions," IEEE Trans. Information Theory, vol. 51, no. 9, pp. 3064-3074, 2005. (Pubitemid 41430975)
4. X. Nguyen, M. J. Wainwright, and M. I. Jordan, "Nonparametric estimation of the likelihood ratio and divergence functionals," in IEEE International Symposium on Information Theory, 2007.
5. -, "Estimating divergence functionals and the likelihood ratio by convex risk minimization," Department of Statistics, University of California, Berkeley, Tech. Rep. 764, 2008.
6. A. Muller, "Integral probability metrics and their generating classes of functions," Advances in Applied Probability, vol. 29, pp. 429-443, 1997.
7. R. M. Dudley, Real Analysis and Probability. Cambridge, UK: Cambridge University Press, 2002.
8. S. T. Rachev, "The Monge-Kantorovich mass transference problem and its stochastic applications," Theory of Probability and its Applications, vol. 29, pp. 647-676, 1985.
9. A. W. van der Vaart and J. A. Wellner, Weak Convergence and Empirical Processes. New York: Springer-Verlag, 1996.
10. R. M. Gray, D. L. Neuhoff, and P. C. Shields, "A generalization of Ornstein's d distance with applications to information theory," Annals of Probability, vol. 3, pp. 315-328, 1975.
11. S. T. Rachev, "On a class of minimum functionals in a space of probability measures," Theory of Probability and its Applications, vol. 29, pp. 41-48, 1984.
12. G. R. Shorack, Probability for Statisticians. New York: Springer-Verlag, 2000.
13. A. Gretton, K. M. Borgwardt, M. Rasch, B. Scholkopf, and A. Smola, "A kernel method for the two sample problem," in Advances in Neural Information Processing Systems 19, B. Scholkopf, J. Platt, and T. Hoffman, Eds. MIT Press, 2007, pp. 513-520.
14. N. Aronszajn, "Theory of reproducing kernels," Trans. Amer. Math. Soc, vol. 68, pp. 337-404, 1950.
15. A. Gretton, K. Fukumizu, C. H. Teo, L. Song, B. Scholkopf, and A. J. Smola, "A kernel statistical test of independence," in Advances in Neural Information Processing Systems 20, J. Platt, D. Koller, Y Singer, and S. Roweis, Eds. MIT Press, 2008, pp. 585-592.
16. K. Fukumizu, A. Gretton, X. Sun, and B. Scholkopf, "Kernel measures of conditional dependence," in Advances in Neural Information Processing Systems 20, J. Platt, D. Koller, Y Singer, and S. Roweis, Eds. Cambridge, MA: MIT Press, 2008, pp. 489-496.
17. S. P. Boyd and L. Vandenberghe, Convex Optimization. Cambridge University Press, 2004.
18. B. K. Sriperumbudur, K. Fukumizu, A. Gretton, B. Scholkopf, and G. R. G. Lanckriet, "On integral probability metrics, ø-divergences and binary classification," http://arxiv.org/abs/0901.2698v4, October 2009.
19. A. A. Fedotov, P. Harremoes, and F. Topsøe, "Refinements of Pinsker's inequality," IEEE Trans. Information Theory, vol. 49, no. 6, pp. 1491-1498, 2003.
20. A. Gretton, K. Borgwardt, M. Rasch, B. Scholkopf, and A. Smola, "A kernel method for the two sample problem," MPI for Biological Cybernetics, Tech. Rep. 157, 2008.
21. H. Wendland, Scattered Data Approximation. Cambridge, UK: Cambridge University Press, 2005.
22. L. Devroye and L. Gyorfi, Nonparametric Density Estimation: The L\ View. New York: Wiley, 1985.
23. L. Devroye, L. Gyorfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition. New York: Springer-Verlag, 1996.