Variable impedance control: A reinforcement learning approach

Robotics: Science and Systems

Volumn 6, Issue , 2011, Pages 153-160

  Buchli, Jonas ^a   Theodorou, Evangelos ^a   Stulp, Freek ^a   Schaal, Stefan ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84959487415     PISSN: None     EISSN: 2330765X     Source Type: Conference Proceeding    
DOI: 10.15607/rss.2010.vi.020     Document Type: Conference Paper

References (26)

1. T. Basar and P. Bernhard. H-Infinity Optimal Control and Related Minimax Design Problems: A Dynamic Game Approach. Birkhäuser, Boston, 1995.
2. J. Buchli, M. Kalakrishnan, M. Mistry, P. Pastor, and S. Schaal. Compliant quadruped locomotion over rough terrain. In IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 814-820, 2009.
3. Todorov E. Efficient computation of optimal actions. Proc Natl Acad Sci USA, 106(28): 11478-83, 2009.
4. R. Fletcher. Practical Methods of Optimization, Volume 2. Wiley, 1981.
5. N. Hogan. Impedance control - an approach to manipulation. ASME, Transactions, Journal of Dynamic Systems, Measurement, and Control, 107: 1-24, 1985.
6. A.J. Ijspeert. Vertebrate locomotion. In M.A. Arbib, editor, The handbook of brain theory and neural networks, pages 649-654. MIT Press, 2003.
7. D. H. Jacobson and D. Q. Mayne. Differential Dynamic Programming. Optimal Control. Elsevier Publishing Company, New York, 1970.
8. H. J. Kappen. Linear theory for control of nonlinear stochastic systems. Phys Rev Lett, 95(20): 200201, 2005.
9. H.J. Kappen. Path integrals and symmetry breaking for optimal control theory. Journal of Statistical Mechanics: Theory and Experiment, 2005(11): P11011, 2005.
10. G. Lantoine and R.P. Russell. A hybrid differential dynamic programming algorithm for robust low-thrust optimization. In AAS/AIAA Astrodynamics Specialist Conference and Exhibit, 2008.
11. W. Li and E. Todorov. Iterative linear quadratic regulator design for nonlinear biological movement systems. In Proceedings of the 1st International Conference on Informatics in Control, Automation and Robotics, pages 222-229, 2004.
12. J. Morimoto and C. Atkeson. Minimax differential dynamic programming: An application to robust biped walking. In In Advances in Neural Information Processing Systems 15, pages 1563-1570. MIT Press, Cambridge, MA, 2002.
13. B. K. Oksendal. Stochastic differential equations: an introduction with applications. Springer, Berlin, New York, 6th edition, 2003.
14. S. Schaal. The SL simulation and real-time control software package. Technical report, University of Southern California, 2007.
15. L. Sciavicco and B. Siciliano. Modelling and Control of Robot Manipulators. Springer, London, New York, 2000.
16. R.F. Stengel. Optimal Control and Estimation. Dover Publications, New York, 1994.
17. Y. Tassa, T. Erez, and W. Smart. Receding horizon differential dynamic programming. In Advances in Neural Information Processing Systems 20, pages 1465-1472. MIT Press, Cambridge, MA, 2008.
18. E. Theodorou, J. Buchli, and S. Schaal. Reinforcement learning in high dimensional state spaces: A path integral approach. Journal of Machine Learning Research, 2010. Accepted for publication.
19. E. Theodorou, J. Buchli, and S. Schaal. Reinforcement learning of motor skills in high dimensions: A path integral approach. In Proceedings of the IEEE International Conference on Robotics and Automation, 2010.
20. E. Todorov. Linearly-solvable markov decision problems. In Advances in Neural Information Processing Systems 19, pages 1369-1376. MIT Press, Cambridge, MA, 2007.
21. E. Todorov. General duality between optimal control and estimation. In Proc. of the 47th IEEE Conference on Decision and Control, 2008.
22. B. van den Broek, W. Wiegerinck, and B. Kappen. Graphical model inference in optimal control of stochastic multi-agent systems. Journal of Artificial Intelligence Research, 32: 95-122, 2008.
23. T. Vincent and W. Grantham. Non Linear And Optimal Control Systems. John Wiley & Sons Inc., 1997.
24. S. Yakowitz. The stagewise Kuhn-Tucker condition and differential dynamic programming. IEEE Transactions on Automatic Control, 31(1): 25-30, 1986.
25. J. Yong. Relations among ODEs, PDEs, FSDEs, BSDEs, and FBSDEs. In Proceedings of the 36th IEEE Conference on Decision and Control, 1997, Volume 3, pages 2779-2784, Dec 1997.
26. M. Zefran, V. Kumar, and C.B. Croke. On the generation of smooth three-dimensional rigid body motions. IEEE Transactions on Robotics and Automation, 14(4): 576-589, 1998.