Variational methods for reinforcement learning

Journal of Machine Learning Research

Volumn 9, Issue , 2010, Pages 241-248

  Furmston, Thomas ^a   Barber, David ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATE SOLUTION; BAYESIAN ALTERNATIVES; EXPECTATION PROPAGATION; MARKOV DECISION PROCESSES; OPTIMAL DECISIONS; POINT ESTIMATE; TRANSITION MATRICES; TRANSITION MODEL; VARIATIONAL BAYES; VARIATIONAL METHODS;

ARTIFICIAL INTELLIGENCE; ESTIMATION; MARKOV PROCESSES; REINFORCEMENT LEARNING;

UNCERTAINTY ANALYSIS;

EID: 84862273812     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (15)

1. P. Abbeel, A. Coates, M. Quigley, and A. Ng. An Application of Reinforcement Learning to Aerobatic Helicopter Flight. NIPS, 19:1-8, 2007.
2. M. J. Beal and Z. Ghahramani. The Variational Bayesian EM Algorithm for Incomplete Data: with Application to Scoring Graphical Model Structures. In Bayesian Statistics, volume 7, pages 453-464. Oxford University Press, 2003.
3. R. Crites and A. Barto. Improving Elevator Performance Using Reinforcement Learning. NIPS, 8: 1017-1023, 1995.
4. P. Dayan and G. E. Hinton. Using Expectation-Maximization for Reinforcement Learning. Neural Computation, 9:271-278, 1997.
5. R. Dearden, N. Friedman, and S. Russell. Bayesian Q learning. AAAI, 15:761-768, 1998.
6. M. Duff. Optimal Learning: Computational Procedures for Bayes-Adaptive Markov Decision Processes. PhD thesis, University of Massachusetts Amherst, 2002.
7. T. Furmston and D. Barber. Solving deterministic policy (PO)MPDs using Expectation-Maximisation and Antifreeze. European Conference on Machine Learning (ECML), 1:50-65, 2009. Workshop on Learning and data Mining for Robotics.
8. M. Hoffman, A. Doucet, N. de Freitas, and A. Jasra. Trans-dimensional MCMC for Bayesian Policy Learning. NIPS, 20:665-672, 2008.
9. J. Kober and J. Peters. Policy search for motor primitives in robotics. NIPS, 21:849-856, 2009.
10. F. R. Kschischang, B. J. Frey, and H-A. Loeliger. Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory, 47:498-519, 2001.
11. T. P. Minka. Expectation Propagation for approximate Bayesian inference. In UAI '01: Proceedings of the 17th Conference in Uncertainty in Artificial Intelligence, pages 362-369, 2001.
12. C. Rasmussen and M. Deisenroth. Probabilistic inference for fast learning in control. In S. Girgin, M. Loth, R. Munos, P. Preux, and D. Ryabko, editors, Recent Advances in Reinforcement Learning, pages 229-242, 2008.
13. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, 1998.
14. M. Toussaint, S. Harmeling, and A. Storkey. Probabilistic inference for solving (PO)MDPs. Research Report EDI-INF-RR-0934, University of Edinburgh, School of Informatics, 2006.
15. M. J. Wainwright and M. I. Jordan. Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1(1-2):1-305, 2008.