Universality, characteristic kernels and RKHS embedding of measures

Journal of Machine Learning Research

Volumn 12, Issue , 2011, Pages 2389-2410

  Sriperumbudur, Bharath K ^a   Fukumizu, Kenji ^b   Lanckriet, Gert R G ^c  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b INSTITUTE OF STATISTICAL MATHEMATICS   (Japan)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Binary classification; Characteristic kernels; Conditionally strictly positive definite kernels; Hilbert space embeddings; Homogeneity testing; Integrally strictly positive definite kernels; Kernel methods; Radial kernels; Strictly positive definite kernels; Translation invariant kernels; Universal kernels

Indexed keywords

BINARY CLASSIFICATION; CHARACTERISTIC KERNELS; CONDITIONALLY STRICTLY POSITIVE DEFINITE KERNELS; HILBERT; HOMOGENEITY TESTING; KERNEL METHODS; POSITIVE DEFINITE KERNELS; RADIAL KERNELS; TRANSLATION INVARIANT KERNELS; UNIVERSAL KERNELS;

HILBERT SPACES;

LEARNING ALGORITHMS;

EID: 80052235767     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (32)

1. N. Aronszajn. Theory of reproducing kernels. Trans. Amer. Math. Soc, 68:337-404, 1950.
2. C. Berg, J. P. R. Christensen, and P. Ressel. Harmonic Analysis on Semigroups. Spring Verlag, New York, 1984.
3. A. Caponnetto, M. Pontil, C. Micchelli, and Y. Ying. Universal multi-task kernels. Journal of Machine Learning Research, 9:1615-1646, 2008.
4. C. Carmeli, E. De Vito, A. Toigo, and V. Umanita. Vector valued reproducing kernel Hilbert spaces and universality. Analysis and Applications, 8:19-61, 2010.
5. W. Dahmen and C. A. Micchelli. Some remarks on ridge functions. Approx. Theory Appl, 3: 139-143, 1987.
6. R. M. Dudley. Real Analysis and Probability. Cambridge University Press, Cambridge, UK, 2002.
7. N. Dunford and J. T. Schwartz. Linear Operators. I: General Theory. Wiley-Interscience, New York, 1958.
8. T. Evgeniou, M. Pontil, and T. Poggio. Regularization networks and support vector machines. Advances in Computational Mathematics, 13(1): 1-50, 2000.
9. G. B. Folland. Real Analysis: Modern Techniques and Their Applications. Wiley-Interscience, New York 1999.
10. K. Fukumizu, F. Bach, and M. Jordan. Dimensionality reduction for supervised learning with reproducing kernel Hilbert spaces. Journal of Machine Learning Research, 5:73-99, 2004.
11. K. Fukumizu, A. Gretton, X. Sun, and B. Schölkopf. Kernel measures of conditional dependence. In J.C. Platt, D. Koller, Y. Singer, and S. Roweis, editors, Advances in Neural Information Processing Systems 20, pages 489-496, Cambridge, MA, 2008. MIT Press.
12. K. Fukumizu, B. K. Sriperumbudur, A. Gretton, and B. Schölkopf. Characteristic kernels on groups and semigroups. In D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou, editors, Advances in Neural Information Processing Systems 21, pages 473-480, 2009.
13. A. Gretton, K. M. Borgwardt, M. Rasch, B. Schölkopf, and A. Smola. A kernel method for the two sample problem. In B. Schölkopf, J. Platt, and T. Hoffman, editors, Advances in Neural Information Processing Systems 19, pages 513-520. MIT Press, 2007.
14. A. Gretton, K. Fukumizu, C.-H. Teo, L. Song, B. Schölkopf, and A. Smola. A kernel statistical test of independence. In Advances in Neural Information Processing Systems 20, pages 585-592. MIT Press, 2008.
15. E. Hewitt. Linear functionals on spaces of continuous functions. Fundamenta Mathematicae, 37: 161-189, 1950.
16. G. S. Kimeldorf and G. Wahba. A correspondence between bayesian estimation on stochastic processes and smoothing by splines. Annals of Mathematical Statistics, 41(2):495-502, 1970.
17. V. A. Menegatto. Strictly positive definite kernels on the circle. Rocky Mountain Journal of Mathematics, 25(3):1149-1163, 1995.
18. C. A. Micchelli, Y. Xu, and H. Zhang. Universal kernels. Journal of Machine Learning Research, 7:2651-2667, 2006. (Pubitemid 44927394)
19. A. Pinkus. Strictly positive definite functions on a real inner product space. Adv. Comput. Math., 20:263-271, 2004. (Pubitemid 39072582)
20. W. Rudin. Functional Analysis. McGraw-Hill, USA, 1991.
21. B. Schölkopf and A. J. Smola. Learning with Kernels. MIT Press, Cambridge, MA, 2002.
22. th Annual Conference on Learning Theory, pages 416-426, 2001.
23. J. Shawe-Taylor and N. Cristianini. Kernel Methods for Pattern Analysis. Cambridge University Press, UK, 2004.
24. st Annual Conference on Learning Theory, pages 111-122, 2008.
25. B. K. Sriperumbudur, K. Fukumizu, A. Gretton, G. R. G. Lanckriet, and B. Schölkopf. Kernel choice and classifiability for RKHS embeddings of probability distributions. In Y. Bengio, D. Schuur-mans, J. Lafferty, C. K. I. Williams, and A. Culotta, editors, Advances in Neural Information Processing Systems 22, pages 1750-1758. MIT Press, 2009.
26. B. K. Sriperumbudur, K. Fukumizu, and G. R. G. Lanckriet. On the relation between universality, characteristic kernels and RKHS embedding of measures. In JMLR Workshop and Conference Proceedings, volume 9, pages 781-788. AISTATS, 2010a.
27. B. K. Sriperumbudur, A. Gretton, K. Fukumizu, B. Schölkopf, and G. R. G. Lanckriet. Hilbert space embeddings and metrics on probability measures. Journal of Machine Learning Research, 11:1517-1561, 2010b.
28. I. Steinwart. On the influence of the kernel on the consistency of support vector machines. Journal of Machine Learning Research, 2:67-93, 2001.
29. I. Steinwart and A. Christmann. Support Vector Machines. Springer, 2008.
30. J. Stewart. Positive definite functions and generalizations, an historical survey. Rocky Mountain Journal of Mathematics, 6(3):409-433, 1976.
31. Ch. Suquet. Reproducing kernel Hilbert spaces and random measures. In H. G. W. Begehr and F. Nicolosi, editors, Proc. of the 5th International ISAAC Congress, Catania, Italy, 25-30 July 2005, pages 143-152. World Scientific, 2009.
32. H. Wendland. Scattered Data Approximation. Cambridge University Press, Cambridge, UK, 2005.