Toward fast policy search for learning legged locomotion

IEEE International Conference on Intelligent Robots and Systems

Volumn , Issue , 2012, Pages 1787-1792

  Deisenroth, Marc Peter ^a   Calandra, Roberto ^a   Seyfarth, Andre ^a   Peters, Jan ^a,b  

^a DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

^b MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

FEEDBACK CONTROLLER; FORWARD MODELS; HIGH-DIMENSIONAL; HUMANOID ROBOT; LEARNING CONTROLLERS; LEGGED LOCOMOTION; MECHANICAL DESIGN; POLICY SEARCH; REAL WORLD DATA;

ANTHROPOMORPHIC ROBOTS; BIOMECHANICS; INTELLIGENT SYSTEMS;

ROBOTICS;

EID: 84872355784     PISSN: 21530858     EISSN: 21530866     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2012.6385955     Document Type: Conference Paper

References (28)

1. J. A. Bagnell and J. G. Schneider. Autonomous Helicopter Control using Reinforcement Learning Policy Search Methods. In ICRA, 2001.
2. C. M. Bishop. Pattern Recognition and Machine Learning. Springer- Verlag, 2006.
3. K. Byl and R. Tedrake. Approximate Optimal Control of the Compass Gait on Rough Terrain. In ICRA, 2008.
4. M. P. Deisenroth and C. E. Rasmussen. PILCO: A Model-Based and Data-Efficient Approach to Policy Search. In ICML, 2011.
5. M. P. Deisenroth, C. E. Rasmussen, and D. Fox. Learning to Control a Low-Cost Manipulator using Data-Efficient Reinforcement Learning. In RSS, 2011.
6. J. Fan and J. Lv. Sure Independence Screening for Ultrahigh Dimensional Feature Space. J. of the Roy. Stat. Soc., 70(5):849-911, 2008.
7. H. Geyer and H. M. Herr. A Muscle-Reflex Model that Encodes Principles of Legged Mechanics Produces Human Walking Dynamics and Muscle Activities. IEEE Trans. on Neur. Systm and Rehab. Eng., 18(3):263-273, 2010.
8. X. Guo, L. Chen, Y. Zhang, P. Yang, and L. Zhang. A Study on Control Mechanism of above Knee Robotic Prosthesis based on CPG Model. In RoBio, pp. 283-287, 2010.
9. F. Iida and R. Tedrake. Minimalistic Control of Biped walking in Rough Terrain. Aut. Rob., 28(3):355-368, 2010.
10. S. Kajita, F. Kanehiro, K. Kaneko, K. Yokoi, and H. Hirukawa. The 3D Linear Inverted Pendulum Mode: A Simple Modeling for a Biped Walking Pattern Generation. In IROS, 2001.
11. J. Ko and D. Fox. GP-BayesFilters: Bayesian Filtering using Gaussian Process Prediction and Observation Models. In IROS, 2008.
12. D. Kraus. Concepts in Modern Biology. Globe Book Company, 1993.
13. T. McGeer. Passive Dynamic Walking. IJRR, 9(2):62-82, 1990.
14. J. Morimoto and C. G. Atkeson. Learning Biped Locomotion. IEEE Robotics Automation Magazine, 14(2):41-51, 2007.
15. J. Morimoto, G. Zeglin, and C. G. Atkeson. Minimax Differential Dynamic Programming: Application to a Biped Walking Robot. In IROS, 2003.
16. J. Peters and S. Schaal. Policy Gradient Methods for Robotics. In IROS, 2006.
17. F. Peuker, C. Maufroy, and A. Seyfarth. Leg-Adjustment Strategies for Stable Running in Three Dimensions. Bioinspiration & Biomimetics, 7(3), 2012.
18. J. E. Pratt and G. A. Pratt. Intuitive Control of a Planar Bipedal Walking Robot. In ICRA, 1998.
19. C. E. Rasmussen and C. K. I. Williams. Gaussian Processes for Machine Learning. The MIT Press, 2006.
20. N. Ratliff, J. A. Bagnell, and S. S. Srinivasa. Imitation Learning for Locomotion and Manipulation. In Humanoids, 2007.
21. P. Saltiel, K. Wyler-Duda, A. D'Avella, M. C. Tresch, and E. Bizzi. Muscle Synergies Encoded Within the Spinal Cord: Evidence From Focal Intraspinal NMDA Iontophoresis in the Frog. J. of Neurophys., 85(2):605-619, 2001.
22. M. Sato, Y. Nakamura, and S. Ishii. Reinforcement Learning for Biped Locomotion. In ICANN, 2002.
23. J. A. Smith and A. Seyfarth. Autonome Mobile Systeme, chapter Exploring Toe Walking in a Bipedal Robot. Springer-Verlag, 2007.
24. R. Tedrake, T. Zhang, and H. Seung. Stochastic Policy Gradient Reinforcement Learning on a Simple 3D Biped. In IROS, 2004.
25. M. Vukobratovic and B. Borovac. Zero-Moment Point-Thirty Five Years of its Life. IJHR, 1(1):157-173, 2004.
26. D. M. Wolpert, R. C. Miall, and M. Kawato. Internal Models in the Cerebellum. Trends in Cognitive Sciences, 2(9):338-347, 1998.
27. S. L.-Y. Woo, R. E. Debski, J. D. Withrow, and M. A. Janaushek. Biomechanics of Knee Ligaments. Am. J. on Sports Medicine, 27(4):533-543, 1999.
28. F. E. Zajac, R. R. Neptune, and S. A. Kautz. Biomechanics andMuscle Coordination of Human Walking: Part I: Introduction to Concepts, Power Transfer, Dynamics and Simulations. Gait & Posture, 16(3):215-232, 2002.