Reinforcement learning with guided policy search using Gaussian processes

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2012, Pages

  Jakab, Hunor S ^a   Csató, Lehel ^a  

^a BABE BOLYAI UNIVERSITY   (Romania)

Author keywords

[No Author keywords available]

Indexed keywords

CONTINUOUS STATE-ACTION SPACES; CONTROL POLICY; CONTROL TASK; ESTIMATED STATE; GAUSSIAN PROCESSES; GRADIENT BASED; GRADIENT ESTIMATES; ONLINE LEARNING; POLICY SEARCH; PROBABILISTIC MODELS; VALUE FUNCTION APPROXIMATION; VALUE FUNCTIONS;

ALGORITHMS; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); NEURAL NETWORKS; REINFORCEMENT LEARNING;

UNCERTAINTY ANALYSIS;

EID: 84865063694     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2012.6252509     Document Type: Conference Paper

References (23)

1. András Antos, Rémi Munos, and Csaba Szepesvári. Fitted q-iteration in continuous action-space MDPs. In John C. Platt, Daphne Koller, Yoram Singer, and Sam T. Roweis, editors, NIPS. MIT Press, 2007.
2. J. Andrew Bagnell and Jeff Schneider. Autonomous helicopter control using reinforcement learning policy search methods. In Proceedings of the International Conference on Robotics and Automation 2001. IEEE, May 2001.
3. Leemon Baird. Residual algorithms: Reinforcement learning with function approximation. In In Proceedings of the Twelfth International Conference on Machine Learning, pages 30-37. Morgan Kaufmann, 1995.
4. Steven J. Bradtke, Andrew G. Barto, and Pack Kaelbling. Linear least-squares algorithms for temporal difference learning. In Machine Learning, pages 22-33, 1996.
5. Lehel Csató. Gaussian Processes - Iterative Sparse Approximation. PhD thesis, Neural Computing Research Group, March 2002.
6. Lehel Csató and Manfred Opper. Sparse on-line Gaussian Processes. Neural Computation, 14(3):641-669, 2002.
7. Marc P. Deisenroth and Carl E. Rasmussen. PILCO: A Model-Based and Data-Efficient Approach to Policy Search. In L. Getoor and T. Scheffer, editors, Proceedings of the 28th International Conference on Machine Learning, Bellevue, WA, USA, June 2011.
8. Marc Peter Deisenroth, Carl Edward Rasmussen, and Jan Peters. Gaussian process dynamic programming. Neurocomputing, 72(7-9):1508-1524, 2009.
9. Mohammad Ghavamzadeh and Yaakov Engel. Bayesian policy gradient algorithms. In B. Schölkopf, J. Platt, and T. Hoffman, editors, NIPS '07: Advances in Neural Information Processing Systems 19, pages 457-464, Cambridge, MA, 2007. MIT Press.
10. G.S. Hornby, S. Takamura, J. Yokono, O. Hanagata, T. Yamamoto, and M. Fujita. Evolving robust gaits with aibo. In IEEE International Conference on Robotics and Automation (ICRA2000), pages 3040-3045, 2000.
11. J. A. Ijspeert, J. Nakanishi, and S. Schaal. Movement imitation with nonlinear dynamical systems in humanoid robots. In IEEE International conference on robotics and automation (ICRA2002), 2002.
12. Hunor Jakab and Lehel Csató. Improving Gaussian process value function approximation in policy gradient algorithms. In Timo Honkela, Włodzisław Duch, Mark Girolami, and Samuel Kaski, editors, Artificial Neural Networks and Machine Learning - ICANN 2011, volume 6792 of Lecture Notes in Computer Science, pages 221-228. Springer, 2011.
13. Sham Kakade. A natural policy gradient. volume 2, pages 1531-1538, Cambridge, MA, 2002. MIT Press.
14. Min Sub Kim and William Uther. Automatic gait optimisation for quadruped robots. In In Australasian Conference on Robotics and Automation, 2003.
15. Nate Kohl and Peter Stone. Policy gradient reinforcement learning for fast quadrupedal locomotion. In in Proceedings of the IEEE International Conference on Robotics and Automation, pages 2619- 2624, 2004.
16. Radford M. Neal. MCMC using Hamiltonian dynamics. In Steve Brooks, Andrew Gelman, Galin Jones, and Xiao-Li Meng, editors, Handbook of Markov Chain Monte Carlo. Chapman & Hall/CRC Press, 2010.
17. Jan Peters and Stefan Schaal. Reinforcement learning of motor skills with policy gradients. Neural Networks, 21(4):682-697, 2008.
18. Martin L. Puterman. Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley & Sons, Inc., New York, NY, 1994.
19. Carl Edward Rasmussen and Christopher Williams. Gaussian Processes for Machine Learning. MIT Press, 2006.
20. S Schaal, P. Mohajerian, and A. Ijspeert. Dynamics systems vs. optimal control - a unifying view. Progress In Brain Research, 165:425-445, 2007.
21. Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction. MIT Press, 1998.
22. Richard S. Sutton, David A. McAllester, Satinder P. Singh, and Yishay Mansour. Policy gradient methods for reinforcement learning with function approximation. In Sara A. Solla, Todd K. Leen, and Klaus- Robert Müller, editors, NIPS '99: Advances in Neural Information Processing Systems, pages 1057-1063, 1999.
23. Ronald J. Williams. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning, 8:229-256, 1992.