Hierarchical reinforcement learning with movement primitives

IEEE-RAS International Conference on Humanoid Robots

Volumn , Issue , 2011, Pages 231-238

  Stulp, Freek ^a   Schaal, Stefan ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX TASK; HIERARCHICAL REINFORCEMENT LEARNING; PLANNING AND CONTROL; SEARCH SPACES; TASK DECOMPOSITION; TEMPORAL ABSTRACTION;

ABSTRACTING; ANTHROPOMORPHIC ROBOTS; REINFORCEMENT; ROBOT PROGRAMMING;

REINFORCEMENT LEARNING;

EID: 84856330231     PISSN: 21640572     EISSN: 21640580     Source Type: Conference Proceeding    
DOI: 10.1109/Humanoids.2011.6100841     Document Type: Conference Paper

References (18)

1. A. Barto and S. Mahadevan. Recent advances in hierarchical reinforcement learning. Discrete event systems, 13(1-2):41-77, 2003.
2. J. R. Flanagan, M. C. Bowman, and R. S. Johansson. Control strategies in object manipulation tasks. Current Opinion in Neurobiology, 2006.
3. S. Hart and R. Grupen. Learning generalizable control programs. IEEE Transactions on Autonomous Mental Development, 2010.
4. H. Hoffmann, P. Pastor, Dae-H. Park, and S. Schaal. Biologically-inspired dynamical systems for movement generation: Automatic real-time goal adaptation and obstacle avoidance. In IEEE International Conference on Robotics and Automation, 2009.
5. M. Huber and R. A. Grupen. Learning robot control - using control policies as abstract actions. In NIPS'98 Workshop : Abstraction and Hierarchy in Reinforcement Learning, 1998.
6. A. J. Ijspeert, J. Nakanishi, and S. Schaal. Movement imitation with nonlinear dynamical systems in humanoid robots. In Proc. of the IEEE International Conference on Robotics and Automation (ICRA), 2002.
7. J. Kober, O. Kroemer, C. H. Lampert, B. Schölkopf, and J. Peters. Movement templates for learning of hitting and batting. In International Conference on Robotics and Automation, pages 853-858, 2010.
8. P. Kormushev, S. Calinon, R. Saegusa, and G. Metta. Learning the skill of archery by a humanoid robot icub. In Proc. IEEE Intl Conf. on Humanoid Robots (Humanoids), Nashville, TN, USA, December 2010.
9. J. Morimoto and K. Doya. Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning. Robotics and Autonomous Systems, 36(1):37-51, 2001. (Pubitemid 32610235)
10. K. Mülling, J. Kober, and J. Peters. Simulating human table tennis with a biomimetic robot setup. In From Animals to Animats 11. Springer Berlin / Heidelberg, 2010.
11. B. Nemec, M. Tamosiunaite, F. Wörgöter, and A. Ude. Task adaptation thorough exploration and action sequencing. In 9th IEEE-RAS International Conference on Humanoid Robots, 2009.
12. R.Y. Rubinstein and D.P. Kroese. The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning. Springer-Verlag, 2004.
13. S. Schaal. The SL simulation and real-time control software package. Technical report, University of Southern California, 2009.
14. A. Schubö, A. Maldonado, S. Stork, and M. Beetz. Subsequent actions influence motor control parameters of a current grasping action. In IEEE 17th International Symposium on Robot and Human Interactive Communication (RO-MAN), Muenchen, Germany, 2008.
15. F. Stulp and M. Beetz. Refining the execution of abstract actions with learned action models. Journal of Artificial Intelligence Research (JAIR), 32, June 2008.
16. F. Stulp, J. Buchli, E. Theodorou, and S. Schaal. Reinforcement learning of full-body humanoid motor skills. In 10th IEEE-RAS International Conference on Humanoid Robots, 2010. Best paper finalist.
17. E. Theodorou, J. Buchli, and S. Schaal. A generalized path integral approach to reinforcement learning. Journal of Machine Learning Research, 11(Nov):3137-3181, 2010.
18. A. Ude, A. Gams, T. Asfour, and J. Morimoto. Task-specific generalization of discrete and periodic dynamic movement primitives. IEEE Transactions on Robotics, 26(5):800-815, 2010.