Hilbert space embeddings of pomdps

Uncertainty in Artificial Intelligence - Proceedings of the 28th Conference, UAI 2012

Volumn , Issue , 2012, Pages 644-653

  Nishiyama, Yu ^a   Boularias, Abdeslam ^b   Gretton, Arthur ^b,c   Fukumizu, Kenji ^a  

^a INSTITUTE OF STATISTICAL MATHEMATICS   (Japan)

^b MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BELLMAN EQUATIONS; FEATURE SPACE; NONPARAMETRIC APPROACHES; OPTIMAL VALUE FUNCTIONS; POLICY LEARNING; REPRODUCING KERNEL HILBERT SPACES; VALUE FUNCTIONS; VALUE ITERATION;

ARTIFICIAL INTELLIGENCE;

EID: 84879146831     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Even-dar, 2005] Eyal Even-dar. Reinforcement learning in POMDPs without resets. IJCAI, 690-695, 2005.
2. Fine and Scheinberg, 2001] S. Fine and K. Scheinberg. Efficient SVM training using low-rank kernel representations. JMLR, 2:243-264, 2001.
3. Fukumizu et al., 2008] K. Fukumizu, A. Gretton, X. Sun, and B. Scholkopf. Kernel measures of conditional dependence. In NIPS2008.
4. Fukumizu et al., 2011] K. Fukumizu, L. Song, and A. Gretton. Kernel Bayes' Rule. In NIPS2011.
5. Fukumizu et al., 2011] K. Fukumizu, L. Song, and A. Gretton. Kernel bayes rule: Bayesian inference with positive definite kernels. arXiv:1009.5736.
6. Gretton et al., 2007] A. Gretton, K. Borgwardt, M. Rasch, B. Scholkopf, and A. Smola. A kernel method for the two-sample-problem. In NIPS2007.
7. Gretton et al., 2008] A. Gretton, K. Fukumizu, C. Teo, L. Song, B. Scholkopf, and A. Smola. A kernel statistical test of independence. In NIPS2008.
8. Gretton et al., 2012] A. Gretton, K. Borgwardt, M. Rasch, B. Scholkopf and A. Smola. A Kernel Two-Sample Test. JMLR, 13, 671-721, 2012.
9. Grunewalder et al., 2012] S. Grunewalder, G. Lever, L. Baldassarre, M. Pontil and A. Gretton. Modelling transition dynamics in MDPs with RKHS embeddings. In ICML2012.
10. Hauskrecht, 2000] M. Hauskrecht. Value-Function Approximations for Partially Observable Markov Decision Processes. In JAIR, vol 13, pages 33-94, 2000.
11. Littman, 1995] M. Littman, A. Cassandra, and L. Kaelbling. Learning policies for partially observable environments: Scaling up. In ICML1995.
12. Pineau et al., 2003] J. Pineau, G. Gordon, and S. Thrun. Point-based value iteration: an anytime algorithm for POMDPs. In ICJAI, pages 1025-1032, 2003.
13. Porta. et al., 2006] J. M. Porta, N. Vlassis, and P. Poupart. Point-based value iteration for continuous POMDPs. JMLR, 7:2329-2367, 2006.
14. Poupart et al., 2006] Pascal Poupart, Nikos A. Vlassis, Jesse Hoey, and Kevin Regan. An analytic solution to discrete Bayesian reinforcement learning. ICML2006.
15. Ross et al., 2008] S. Ross, J. Pineau, S. Paquet, and B. Chaib-draa. Online planning algorithms for POMDPs. JAIR, 32(1):663-704, 2008.
16. Silver and Veness, 2010] David Silver and Joel Veness. Monte-Carlo Planning in Large POMDPs. NIPS2010.
17. Smith and Simmons, 2004] T. Smith and R. Simmons. Heuristic search value iteration for POMDPs. In UAI2004.
18. Smola et al., 2007] A. Smola, A. Gretton, L. Song, and B. Scholkopf. A Hilbert space embedding for distributions. In ALT2007.
19. Sondik, 1971] E. J. Sondik. The Optimal Control of Partially Observable Markov Processes. PhD thesis, Stanford University, 1971.
20. Song et al., 2009] L. Song, J. Huang, A. Smola, and K. Fukumizu. Hilbert space embeddings of conditional distributions with applications to dynamical systems. In ICML2009.
21. Song et al., 2010] L. Song, B. Boots, S. Siddiqi, G. Gordon, and A. Smola. Hilbert space embeddings of hidden Markov models. In ICML2010.
22. Song et al., 2010] L. Song, A. Gretton, and C. Guestrin. Nonparametric tree graphical models via kernel embeddings. In AISTATS, pages 765-772, 2010.
23. Song et al., 2011] L. Song, A. Gretton, D. Bickson, Y. Low, and C. Guestrin. Kernel Belief Propagation. In AISTATS, 2011.
24. Spaan and Vlassis, 2005] M. T. J. Spaan and N. Vlassis. Perseus: Randomized point-based value iteration for POMDPs. JAIR, 24:195-220, 2005.
25. Sriperumbudur et al., 2010] B. Sriperumbudur, A. Gretton, K. Fukumizu, G. Lanckriet, and B. Scholkopf. Hilbert space embeddings and metrics on probability measures. JMLR, 11:1517-1561, 2010.
26. Thrun, 2000] S. Thrun. Monte Carlo POMDPs. In NIPS2000.