Hierarchical relative entropy policy search

Journal of Machine Learning Research

Volumn 22, Issue , 2012, Pages 273-281

  Daniel, Christian ^a   Neumann, Gerhard ^a   Peters, Jan ^a,b  

^a DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

^b MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

ESTIMATION PROBLEM; HIERARCHICAL POLICY; HIERARCHICAL STRUCTURES; LATENT VARIABLE; LEARNING SPEED; POLICY SEARCH; REAL-WORLD PROBLEM; RELATIVE ENTROPY;

ENTROPY;

EID: 84870924061     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (26)

1. J. Bagnell, "Covariant Policy Search, " International Joint Conference on Artificial Intelligence (ICJAI), 2003.
2. R. Sutton, D. McAllester, and S. Singh, "Policy gradient methods for reinforcement learning with function Approximation, " Advances in Neural Information Processing Systems (NIPS), 2000.
3. P. Stone, "Scaling Reinforcement Learning Toward RoboCup Soccer, " International Conference on Machine Learning (ICML), 2001.
4. J. A. Bagnell and J. G. Schneider, "Autonomous Helicopter Control using Reinforcement Learning Policy Search Methods, " in International Conference on Robotics and Automation (ICRA).
5. M. Rosenstein, "Robot Weightlifting by Direct Policy Search, " International Joint Conference on Artificial Intelligence (ICJAI), 2001.
6. N. Kohl, "Policy Gradient Reinforcement Learning for Fast Quadrupedal Locomotion, " International Conference on Robotics and Automation (ICRA), 2004.
7. J. Kober and J. Peters, "Policy Search for Motor Primitives in Robotics, " Machine Learning, 2008.
8. M. Strens, "Policy Search Using Paired Comparisons, " Journal ofMachine Learning Research (JMLR), 2003.
9. J. Baxter, "Infinite-horizon Policy-gradient Estimation, " Journal of Artificial Intelligence Research (JAIR), 2001.
10. J. Peters and S. Vijayakumar, "Natural Actor-Critic, " European Conference on Machine Learning (ECML), 2005.
11. M. Deisenroth, "PILCO: A Model-based and Data-efficient Approach to Policy Search, " in International Conference on Machine Learning (ICML), 2011.
12. J. Kober, K. Mulling, and O. Kramer, "Movement Templates for Learning of Hitting and Batting, " International Conference on Robotics and Automation (ICRA), 2010.
13. G. Endo, J. Morimoto, T. Matsubara, J. Nakan-ishi, and G. Cheng, "Learning CPG-based Biped Locomotion with a Policy Gradient Method: Application to a Humanoid Robot, " International Journal ofRobotics Research, 2008.
14. P. Kormushev, S. Calinon, and D. G. Cald-Well, "Robot Motor Skill Coordination with EM-based Reinforcement Learning, " in International Conference on Intelligent Robots and Systems (IROS), 2010.
15. A. Barto, "Recent Advances in Hierarchical Reinforcement Learning, " Discrete Event Dynamic Systems, 2003.
16. G. Neumann, W. Maass, and J. Peters, "Learning Complex Motions by Sequencing Simpler Motion Templates, " in International Conference on Machine Learning (ICML), 2009.
17. J. Peters, K. Mulling, and Y. Altun, "Relative Entropy Policy Search, " in National Conference on Artificial Intelligence (AAAI), 2010.
18. S. Still and D. Precup, "An Information-theoretic Approach to Curiosity-driven Reinforcement Learning, " International Conference on Hu-manoid Robotics, 2011.
19. M. G. Azar, V. Gomez, and H. J. Kap-Pen, "Dynamic Policy Programming, " arXiv.org, vol. cs.LG, Apr. 2010.
20. K. Rawlik, M. Toussaint, and S. Vijayakumar, "Approximate Inference and Stochastic Optimal Control, " arXiv.org, vol. cs.LG, Sept. 2010.
21. G. Neumann, "Variational Inference for Policy Search in Changing Situations, " in International Conference on Machine Learning (ICML), 2011.
22. Sutton, R.S. and Barto, A.G., Reinforcement Learning: An Introduction. Cambridge Univ Press, 1998.
23. R. Sutton and D. Precup, "Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning, " Artificial intelligence (AI), 1999.
24. R. Sutton, "Generalization in Reinforcement Learning: Successful Examples Using Sparse Coarse Coding, " Advances in Neural Information Processing Systems (NIPS), 1996.
25. S. Schaal, J. Peters, J. Nakanishi, and A. J. Ijspeert, "Learning Movement Primitives, " in International Symposium on Robotics Research (ISRR), 2003.
26. "http://www.buylifetime.com/products/blt/pid-90029.aspx."