Kernel embeddings of conditional distributions: A unified kernel framework for nonparametric inference in graphical models

IEEE Signal Processing Magazine

Volumn 30, Issue 4, 2013, Pages 98-111

  Song, Le ^a   Fukumizu, Kenji ^b   Gretton, Arthur ^c  

^a Georgia Institute of Technology   (United States)

^b INSTITUTE OF STATISTICAL MATHEMATICS   (Japan)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

GRAPHIC METHODS; LEARNING SYSTEMS; STATISTICAL METHODS;

COMPUTATIONAL BIOLOGY; CONDITIONAL DISTRIBUTION; DEPENDENCY STRUCTURES; HIGH-DIMENSIONAL; MODERN APPLICATIONS; NONPARAMETRIC INFERENCE; STATISTICAL FEATURES; UNIFIED KERNELS;

SIGNAL PROCESSING;

EID: 85032751252     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2013.2252713     Document Type: Review

References (29)

1. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Francisco, CA: Morgan Kaufman, 1988.
2. E. Sudderth, A. Ihler, W. Freeman, and A. Willsky, "Nonparametric belief propagation, " Commun. ACM, vol. 53, no. 10, pp. 95-103, 2010.
3. B. W. Silverman, Density Estimation for Statistical and Data Analysis (Monographs on Statistics and Applied Probability). London, U. K. : Chapman & Hall, 1986.
4. L. Song, J. Huang, A. J. Smola, and K. Fukumizu, "Hilbert space embeddings of conditional distributions, " in Proc. Int. Conf. Machine Learning, Montreal, Canada, 2009, pp. 961-968.
5. L. Song, A. Gretton, and C. Guestrin, "Nonparametric tree graphical models, " in Proc. Int. Conf. Artificial Intelligence and Statistics, Sardinia, Italy, 2010, pp. 765-772.
6. L. Song, B. Boots, S. Siddiqi, G. Gordon, and A. J. Smola, "Hilbert space embeddings of hidden Markov models, " in Proc. Int. Conf. Machine Learning, Haifa, Israel, 2010, pp. 991-998.
7. L. Song, A. Gretton, D. Bickson, Y. Low, and C. Guestrin, "Kernel belief propagation, " in Proc. Int. Conf. Artificial Intelligence and Statistics, Ft. Lauderdale, FL, 2011, pp. 707-715.
8. L. Song, A. Parikh, and E. P. Xing, "Kernel embeddings of latent tree graphical models, " in Proc. Neural Information Processing Systems, 2011, pp. 2708-2716.
9. S. Grunewalder, G. Lever, L. Baldassarre, M. Pontil, and A. Gretton, "Modeling transition dynamics in MDPs with RKHS embeddings, " in Proc. Int. Conf. Machine Learning, 2012, Ediburgh, Scotland, pp. 535-542.
10. Y. Nishiyama, A. Boularias, A. Gretton, and K. Fukumizu, "Hilbert space embeddings of POMDPs, " in Proc. Conf. Uncertainty Artificial Intelligence, Catalina Island, CA, 2012, pp. 644-653.
11. K. Fukumizu, L. Song, and A. Gretton, "Kernel Bayes' rule, " in Proc. Neural Information Processing Systems, Granada, Spain, 2011, pp. 1737-1745.
12. K. Fukumizu, L. Song, and A. Gretton, "Kernel Bayes' rule: Bayesian inference with positive definite kernels, " J. Mach. Learn. Res., to be published. [Online]. Available: http://arxiv.org/abs/1009. 5736
13. B. Schölkopf, K. Tsuda, and J.-P. Vert, Kernel Methods in Computational Biology. Cambridge, MA: MIT Press, 2004.
14. K. Fukumizu, F. R. Bach, and M. I. Jordan, "Dimensionality reduction for supervised learning with reproducing kernel Hilbert spaces, " J. Mach. Learn. Res., vol. 5, pp. 73-99, 2004.
15. A. Berlinet and C. Thomas-Agnan, Reproducing Kernel Hilbert Spaces in Probability and Statistics. Norwell, MA: Kluwer, 2004.
16. A. J. Smola, A. Gretton, L. Song, and B. Schölkopf, "A Hilbert space embedding for distributions, " in Proc. Int. Conf. Algorithmic Learning Theory, 2007, vol. 4754, pp. 13-31.
17. B. Sriperumbudur, A. Gretton, K. Fukumizu, G. Lanckriet, and B. Schölkopf, "Injective Hilbert space embeddings of probability measures, " in Proc. Annu. Conf. Computational Learning Theory, 2008, pp. 111-122.
18. B. Sriperumbudur, A. Gretton, K. Fukumizu, G. Lanckriet, and B. Schölkopf, "Hilbert space embeddings and metrics on probability measures, " J. Mach. Learn. Res., vol. 11, pp. 1517-1561, 2010.
19. A. Gretton, K. Borgwardt, M. Rasch, B. Schoelkopf, and A. Smola, "A kernel twosample test, " J. Mach. Learn. Res., vol. 13, pp. 723-773, 2012.
20. A. Gretton, K. Fukumizu, C.-H. Teo, L. Song, B. Schölkopf, and A. J. Smola, "A kernel statistical test of independence, " in Advances in Neural Information Processing Systems 20. Cambridge, MA: MIT Press, 2008, pp. 585-592.
21. A. Gretton, B. Sriperumbudur, D. Sejdinovic, S. Balakrishnan, M. Pontil, K. Fukumizu, and H. Strathmann, "Optimal kernel choice for large-scale two-sample tests, " in Proc. Neural Information Processing Systems, 2012, pp. 1214-1222.
22. S. K. Zhou and R. Chellappa, "From sample similarity to ensemble similarity: Probabilistic distance measures in reproducing kernel Hilbert space, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 6, pp. 917-929, 2006.
23. S. Fine and K. Scheinberg, "Efficient SVM training using low-rank kernel representations, " J. Mach. Learn. Res., vol. 2, pp. 243-264, 2001.
24. S. Grunewalder, G. Lever, L. Baldassarre, S. Patterson, A. Gretton, and M. Pontil, "Conditional mean embeddings as regressors, " in Proc. Int. Conf. Machine Learning, Edinburgh, Scotland, 2012, pp. 1823-1830.
25. S. Mika, B. Schölkopf, A. J. Smola, K.-R. Müller, M. Scholz, and G. Rätsch, "Kernel PCA and de-noising in feature spaces, " in Advances in Neural Information Processing Systems 11, M. S. Kearns, S. A. Solla, and D. A. Cohn, Eds. Cambridge, MA: MIT Press, 1999, pp. 536-542.
26. A. Ihler and D. McAllester, "Particle belief propagation, " in Proc. Int. Conf. Artificial Intelligence and Statistics, 2009, pp. 256-263.
27. C. Andrieu, N. de Freitas, A. Doucet, and M. I. Jordan, "An introduction to MCMC for machine learning, " Mach. Learn., vol. 50, no. 1-2, pp. 5-43, 2003.
28. A. Saxena, M. Sun, and A. Y. Ng, "Make3d: Learning 3d scene structure from a single still image, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 5, pp. 824-840, 2009.
29. S. J. Julier and J. K. Uhlmann, "New extension of the Kalman filter to nonlinear systems, " in Proc. AeroSense'97, pp. 182-193.