Policy search for motor primitives in robotics

Advances in Neural Information Processing Systems 21 - Proceedings of the 2008 Conference

Volumn , Issue , 2009, Pages 849-856

  Kober, Jens ^a   Peters, Jan ^a  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ANTHROPOMORPHIC ROBOTS; GRADIENT METHODS; LEARNING ALGORITHMS;

HIGH-DIMENSIONAL; HUMANOID ROBOTICS; IMITATION LEARNING; LEARNING PROBLEM; MOTOR LEARNING; MOTOR PRIMITIVES; MOTOR SKILLS; POLICY LEARNING; POLICY SEARCH; REINFORCEMENT LEARNINGS;

REINFORCEMENT LEARNING;

EID: 84858754385     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. R. Sutton and A. Barto. Reinforcement Learning. MIT Press, 1998.
2. J. Bagnell, S. Kadade, A. Ng, and J. Schneider. Policy search by dynamic programming. In Advances in Neural Information Processing Systems (NIPS), 2003.
3. A. Ng and M. Jordan. PEGASUS: A policy search method for large MDPs and POMDPs. In International Conference on Uncertainty in Artificial Intelligence (UAI), 2000.
4. F. Guenter, M. Hersch, S. Calinon, and A. Billard. Reinforcement learning for imitating constrained reaching movements. RSJ Advanced Robotics, 21, 1521-1544, 2007. (Pubitemid 47529845)
5. M. Toussaint and C. Goerick. Probabilistic inference for structured planning in robotics. In International Conference on Intelligent Robots and Systems (IROS), 2007.
6. M. Hoffman, A. Doucet, N. de Freitas, and A. Jasra. Bayesian policy learning with transdimensional MCMC. In Advances in Neural Information Processing Systems (NIPS), 2007.
7. R. J. Williams. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning, 8:229-256, 1992.
8. R. S. Sutton, D. McAllester, S. Singh, and Y. Mansour. Policy gradient methods for reinforcement learning with function approximation. In Advances in Neural Information Processing Systems (NIPS), 2000.
9. J. Bagnell and J. Schneider. Covariant policy search. In International Joint Conference on Artificial Intelligence (IJCAI), 2003.
10. J. Peters and S. Schaal. Policy gradient methods for robotics. In International Conference on Intelligent Robots and Systems (IROS), 2006.
11. G. Lawrence, N. Cowan, and S. Russell. Efficient gradient estimation for motor control learning. In International Conference on Uncertainty in Artificial Intelligence (UAI), 2003.
12. H. Attias. Planning by probabilistic inference. In Ninth International Workshop on Artificial Intelligence and Statistics (AISTATS), 2003.
13. J. Binder, D. Koller, S. Russell, and K. Kanazawa. Adaptive probabilistic networks with hidden variables. Machine Learning, 29:213-244, 1997. (Pubitemid 127510039)
14. G. Wulf. Attention and motor skill learning. Human Kinetics, Champaign, IL, 2007.
15. D. E. Kirk. Optimal control theory. Prentice-Hall, Englewood Cliffs, New Jersey, 1970.
16. G. J. McLachan and T. Krishnan. The EM Algorithm and Extensions. Wiley Series in Probability and Statistics. John Wiley & Sons, 1997.
17. P. Dayan and G. E. Hinton. Using expectation-maximization for reinforcement learning. Neural Computation, 9(2):271-278, 1997. (Pubitemid 127635391)
18. J. Peters and S. Schaal. Reinforcement learning by reward-weighted regression for operational space control. In International Conference on Machine Learning (ICML), 2007.
19. T. Rückstieß, M. Felder, and J. Schmidhuber. State-dependent exploration for policy gradient methods. In European Conference on Machine Learning (ECML), 2008.
20. M. Kawato, F. Gandolfo, H. Gomi, and Y. Wada. Teaching by showing in kendama based on optimization principle. In International Conference on Artificial Neural Networks, 1994.
21. C. G. Atkeson. Using local trajectory optimizers to speed up global optimization in dynamic programming. In Advances in Neural Information Processing Systems (NIPS), 1994.
22. A. Ijspeert, J. Nakanishi, and S. Schaal. Learning attractor landscapes for learning motor primitives. In Advances in Neural Information Processing Systems (NIPS), 2003.
23. S. Schaal, P. Mohajerian, and A. Ijspeert. Dynamics systems vs. optimal control-a unifying view. Progress in Brain Research, 165(1):425-445, 2007. (Pubitemid 47513886)
24. Wikipedia, May 31, 2008. http://en.wikipedia.org/wiki/Ball-in-a-cup
25. J. Kober, B. Mohler, and J. Peters. Learning perceptual coupling for motor primitives. In International Conference on Intelligent RObots and Systems (IROS), 2008.