Optimal control with learned local models: Application to dexterous manipulation

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 2016-June, Issue , 2016, Pages 378-383

  Kumar, Vikash ^a   Todorov, Emanuel ^a   Levine, Sergey ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ITERATIVE METHODS; REINFORCEMENT LEARNING;

ADAPTIVE OPTIMAL CONTROL; DEXTEROUS MANIPULATION; EFFICIENT LEARNING; INTERMITTENT-CONTACTS; MODEL-BASED REINFORCEMENT LEARNING; OPTIMAL CONTROLS; PHYSICAL SYSTEMS; TRAJECTORY OPTIMIZATION;

ROBOTICS;

EID: 84977506735     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2016.7487156     Document Type: Conference Paper

References (26)

1. S. Levine and P. Abbeel, "Learning neural network policies with guided policy search under unknown dynamics, " in Advances in Neural Information Processing Systems (NIPS), 2014.
2. Z. X. V. Kumar and E. Todorov, "Fast, strong and compliant pneumatic actuation for dexterous tendon-driven hands, " in International Conference on Robotics and Automation (ICRA), 2013.
3. R. Bellman and R. Kalaba, "A mathematical theory of adaptive control processes, " Proceedings of the National Academy of Sciences, vol. 8, no. 8, pp. 1288-1290, 1959.
4. R. Sutton and A. Barto, Reinforcement Learning: An Introduction. MIT Press, 1998.
5. G. Tesauro, "Td-gammon, a self-teaching backgammon program, achieves master-level play, " Neural computation, vol. 6, no. 2, pp. 215-219, 1994.
6. V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski et al., "Human-level control through deep reinforcement learning, " Nature, vol. 518, no. 7540, pp. 529-533, 2015.
7. K. J. Åström and B. Wittenmark, Adaptive control. Courier Corporation, 2013.
8. D. Mitrovic, S. Klanke, and S. Vijayakumar, "Adaptive optimal feedback control with learned internal dynamics models, " in From Motor Learning to Interaction Learning in Robots, 2010, vol. 264, pp. 65-84.
9. S. Levine, N. Wagener, and P. Abbeel, "Learning contact-rich manipulation skills with guided policy search, " in International Conference on Robotics and Automation (ICRA), 2015.
10. R. Tedrake, T. Zhang, and H. Seung, "Stochastic policy gradient reinforcement learning on a simple 3d biped, " in International Conference on Intelligent Robots and Systems (IROS), 2004.
11. J. Kober, E. Oztop, and J. Peters, "Reinforcement learning to adjust robot movements to new situations, " in Robotics: Science and Systems (RSS), 2010.
12. P. Pastor, H. Hoffmann, T. Asfour, and S. Schaal, "Learning and generalization of motor skills by learning from demonstration, " in International Conference on Robotics and Automation (ICRA), 2009.
13. M. Deisenroth, C. Rasmussen, and D. Fox, "Learning to control a low-cost manipulator using data-efficient reinforcement learning, " in Robotics: Science and Systems (RSS), 2011.
14. J. Kober, J. A. Bagnell, and J. Peters, "Reinforcement learning in robotics: A survey, " International Journal of Robotic Research, vol. 32, no. 11, pp. 1238-1274, 2013.
15. M. Deisenroth, G. Neumann, and J. Peters, "A survey on policy search for robotics, " Foundations and Trends in Robotics, vol. 2, no. 1-2, pp. 1-142, 2013.
16. R. Lioutikov, A. Paraschos, G. Neumann, and J. Peters, "Samplebased information-theoretic stochastic optimal control, " in International Conference on Robotics and Automation (ICRA), 2014.
17. W. Li and E. Todorov, "Iterative linear quadratic regulator design for nonlinear biological movement systems, " in ICINCO (1), 2004, pp. 222-229.
18. S. Levine and V. Koltun, "Guided policy search, " in International Conference on Machine Learning (ICML), 2013.
19. J. A. Bagnell and J. Schneider, "Covariant policy search, " in International Joint Conference on Artificial Intelligence (IJCAI), 2003.
20. J. Peters and S. Schaal, "Reinforcement learning of motor skills with policy gradients, " Neural Networks, vol. 21, no. 4, pp. 682-697, 2008.
21. J. Peters, K. Mülling, and Y. Altün, "Relative entropy policy search, " in AAAI Conference on Artificial Intelligence, 2010.
22. S. Boyd and L. Vandenberghe, Convex Optimization. New York, NY, USA: Cambridge University Press, 2004.
23. J. R. Amend Jr, E. Brown, N. Rodenberg, H. M. Jaeger, and H. Lipson, "A positive pressure universal gripper based on the jamming of granular material, " Robotics, IEEE Transactions on, vol. 28, no. 2, pp. 341-350, 2012.
24. E. Todorov, T. Erez, and Y. Tassa, "Mujoco: A physics engine for model-based control, " in Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on. IEEE, 2012, pp. 5026-5033.
25. C. Atkeson and J. Morimoto, "Nonparametric representation of policies and value functions: A trajectory-based approach, " in Advances in Neural Information Processing Systems (NIPS), 2002.
26. S. Levine, C. Finn, T. Darrell, and P. Abbeel, "End-to-end training of deep visuomotor policies, " arXiv preprint arXiv:1504. 00702, 2015.