Learning motor primitives for robotics

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2009, Pages 2112-2118

  Kober, Jens ^a   Peters, Jan ^a  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

AGRICULTURAL ROBOTS; LEARNING SYSTEMS; REINFORCEMENT LEARNING; ROBOTICS;

HUMAN LEARNING; MACHINE LEARNING TECHNIQUES; MOTOR PRIMITIVES; MOTOR SKILLS; RHYTHMIC TASKS; ROBOT ARMS; START-UP PHASE;

LEARNING ALGORITHMS;

EID: 85060321083     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROBOT.2009.5152577     Document Type: Conference Paper

References (26)

1. T. Flash and B. Hochner, "Motor primitives in vertebrates and invertebrates," Current Opinions in Neurobiology, vol. 15, pp. 660-666, 2005.
2. A. J. Ijspeert, J. Nakanishi, and S. Schaal, "Learning attractor landscapes for learning motor primitives," in Advances in Neural Information Processing Systems (NIPS), S. Becker, S. Thrun, and K. Obermayer, Eds., vol. 15. Cambridge, MA: MIT Press, 2003, pp. 1547-1554.
3. S. Schaal, J. Peters, J. Nakanishi, and A. J. Ijspeert, "Control, planning, learning, and imitation with dynamic movement primitives," in Proceedings of the Workshop on Bilateral Paradigms on Humans and Humanoids, IEEE 2003 International Conference on Intelligent RObots and Systems (IROS), 2003.
4. S. Schaal, P. Mohajerian, and A. J. Ijspeert, "Dynamics systems vs. optimal control - a unifying view," Progress in Brain Research, vol. 165, no. 1, pp. 425-445, 2007.
5. J. Kober, B. Mohler, and J. Peters, "Learning perceptual coupling for motor primitives," in Proceedings of the IEEE/RSJ 2008 International Conference on Intelligent RObots and Systems (IROS), 2008, pp. 834-839.
6. J. Peters and S. Schaal, "Policy gradient methods for robotics," in Proceedings of the IEEE/RSJ 2006 International Conference on Intelligent RObots and Systems (IROS), 2006, pp. 2219-2225.
7. D. Pongas, A. Billard, and S. Schaal, "Rapid synchronization and accurate phase-locking of rhythmic motor primitives," in Proceedings of the IEEE 2005 International Conference on Intelligent RObots and Systems (IROS), 2005, pp. 2911-2916.
8. J. Nakanishi, J. Morimoto, G. Endo, G. Cheng, S. Schaal, and M. Kawato, "Learning from demonstration and adaptation of biped locomotion," Robotics and Autonomous Systems (RAS), vol. 47, no. 2-3, pp. 79-91, 2004.
9. F. Guenter, M. Hersch, S. Calinon, and A. Billard, "Reinforcement learning for imitating constrained reaching movements," Advanced Robotics, Special Issue on Imitative Robots, vol. 21, no. 13, pp. 1521-1544, 2007.
10. H. Urbanek, A. Albu-Schäffer, and P.V.D. Smagt, "Learning from demonstration repetitive movements for autonomous service robotics," in Proceedings of the IEEE/RSL 2004 International Conference on Intelligent RObots and Systems (IROS), 2004, pp. 3495-3500.
11. P. Abbeel and A. Y. Ng, "Apprenticeship learning via inverse reinforcement learning," in Proceedings of the Twenty-First International Conference on Machine Learning (ICML). ACM, 2004.
12. J. Kober and J. Peters, "Policy search for motor primitives in robotics," in Advances in Neural Information Processing Systems (NIPS), 2008.
13. D.-H. Park, H. Hoffmann, P. Pastor, and S. Schaal, "Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields," in IEEE International Conference on Humanoid Robots (HUMANOIDS), 2008.
14. R. E. Bellman, Dynamic Programming. Princeton, NJ: Princeton University Press, 1957.
15. R. Sutton and A. Barto, Reinforcement Learning. MIT PRESS, 1998.
16. J. Peters and S. Schaal, "Reinforcement learning for operational space," in Proceedings of the International Conference on Robotics and Automation (ICRA), Rome, Italy, 2007.
17. R. J. Williams, "Simple statistical gradient-following algorithms for connectionist reinforcement learning," Machine Learning, vol. 8, pp. 229-256, 1992.
18. C. G. Atkeson, "Using local trajectory optimizers to speed up global optimization in dynamic programming," in Advances in Neural Information Processing Systems 6 (NIPS), J. E. Hanson, S. J. Moody, and R. P. Lippmann, Eds. Morgan Kaufmann, 1994, pp. 503-521.
19. T. Rückstieß, M. Felder, and J. Schmidhuber, "State-dependent exploration for policy gradient methods," in Proceedings of the European Conference on Machine Learning (ECML), 2008, pp. 234-249.
20. C. Andrieu, N. de Freitas, A. Doucet, and M. I. Jordan, "An introduction to MCMC for machine learning," Machine Learning, vol. 50, no. 1, pp. 5-43, 2003.
21. Wikipedia, "Ball-in-a-cup," January 2009. [Online]. Available: http://en.wikipedia.org/wiki/Ball-in-a-cup
22. K. Takenaka, "Dynamical control of manipulator with vision : "cup and ball" game demonstrated by robot," Transactions of the Japan Society of Mechanical Engineers. C, vol. 50, no. 458, pp. 2046-2053, 1984.
23. S. Sato, T. Sakaguchi, Y. Masutani, and F. Miyazaki, "Mastering of a task with interaction between a robot and its environment : "kendama" task," Transactions of the Japan Society of Mechanical Engineers. C, vol. 59, no. 558, pp. 487-493, 1993.
24. T. Shone, G. Krudysz, and K. Brown, "Dynamic manipulation of kendama," Research Project, Rensselaer Polytechnic Institute, Tech. Rep., 2000.
25. H. Miyamoto, S. Schaal, F. Gandolfo, H. Gomi, Y. Koike, R. Osu, E. Nakano, Y. Wada, and M. Kawato, "A kendama learning robot based on bi-directional theory," Neural Networks, vol. 9, no. 8, pp. 1281-1302, 1996.
26. S. Chiappa, J. Kober, and J. Peters, "Using bayesian dynamical systems for motion template libraries," in Advances in Neural Information Processing Systems (NIPS). Cambridge, MA: MIT Press, 2009.