Reinforcement learning for quasi-passive dynamic walking of an unstable biped robot

Robotics and Autonomous Systems

Volumn 54, Issue 12, 2006, Pages 982-988

  Hitomi, Kentarou ^a   Shibata, Tomohiro ^a   Nakamura, Yutaka ^a   Ishii, Shin ^a  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

2D biped; Adaptive control; Passive dynamic walk; Reinforcement learning

Indexed keywords

ACTUATORS; ADAPTIVE CONTROL SYSTEMS; BIPED LOCOMOTION; COMPUTER SIMULATION; ROBOTS; ROBUSTNESS (CONTROL SYSTEMS);

2D BIPED MOTION; PASSIVE DYNAMIC WALK (PDW); REINFORCEMENT LEARNING;

LEARNING SYSTEMS;

EID: 33846004800     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2006.05.014     Document Type: Article

References (17)

1. McGeer T. Passive dynamics walking. International Journal of Robotics Research 9 2 (1990) 62-82
2. Y. Sugimoto, K. Osuka, Motion generate and control of quasi-passive-dynamic-walking based on the concept of delayed feedback control, in: Proceedings of 2nd International Symposium on Adaptive Motion of Animals and Machines, 2003
3. T. Takuma, S. Nakajima, K. Hosoda, M. Asada, Design of self-contained biped walker with pneumatic actuators, in: SICE Annual Conference, 2004, pp. 2520-2524
4. M. Wisse, J. Frankenhuyzen, Design and construction of mike; a 2d autonomous biped based on passive dynamic walking, in: 2nd International Symposium on Adaptive Motion of Animals and Machines, 2003
5. R. Tedrake, T.W. Zhang, H.S. Seung, Stochastic policy gradient reinforcement learning on a simple 3d biped, in: Proceedings of the IEEE International Conference on Intelligent Robots and Systems, 2004, pp. 2849-2854
6. Kimura H., and Kobayashi S. Reinforcement learning for continuous action using stochastic gradient ascent. Intelligent Autonomous Systems (1998) 288-295
7. H. Kimura, S. Kobayashi, An analysis of actor/critic algorithms using eligibility traces: Reinforcement learning with imperfect value function, in: 15th International Conference on Machine Learning, 1998, pp. 278-286
8. Kimura H., Aramaki T., and Kobayashi S. A policy representation using weighted multiple normal distribution. Journal of the Japanese Society for Artificial Intelligence 18 6 (2003) 316-324
9. ODE, http://ode.org/
10. Newell K.M., and Vaillancourt D.E. Dimensional change in motor learning. Human Movement Science 20 (2001) 695-715
11. Bernstein N. The Coordination and Regulation of Movements (1968), Pergamon
12. Pahapill P.A., and Lozano A.M. The pedunculopontine nucleus and Parkinson's disease. Brain 123 9 (2000) 1767-1783
13. Miller C.A., and Verstraete M.C. Determination of the step duration of gait initiation using a mechanical energy analysis. Journal of Biomechanics 29 9 (1996) 1195-1199
14. Basmajian J. The human bicycle: An ultimate biological convenience. Orthopedic Clinics of North America 7 4 (1976) 1027-1029
15. Collins S., Ruina A., Tedrake R., and Wisse M. Efficient bipedal robots based on passive-dynamic walkers. Science 307 (2005) 1082-1085
16. Y. Nakamura, T. Mori, S. Ishii, Natural policy gradient reinforcement learning for a cpg control of a biped robot, in: Proceedings of International conference on parallel problem solving from nature, 2004, pp. 972-981
17. V. Dietz, R. Muller, G. Colombo, Locomotor activity in spinal man: Significance of afferent input from joint and load receptors, Brain 125 2626-2634