Reinforcement learning control for biped robot walking on uneven surfaces

IEEE International Conference on Neural Networks - Conference Proceedings

Volumn , Issue , 2006, Pages 4173-4178

  Wang, Shouyi ^a   Braaksma, Jelmer ^a   Babuška, Robert ^a   Hobbelen, Daan ^b  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

BIPED LOCOMOTION; DYNAMICAL SYSTEMS; ENERGY EFFICIENCY; ROBOTICS; TWO TERM CONTROL SYSTEMS;

DYNAMIC WALKING ROBOTS; LEARNING CONTROLLERS; MECHANICAL PROTOTYPES;

REINFORCEMENT LEARNING;

EID: 40649093079     PISSN: 10987576     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. T. McGeer, "Passive dynamic walking," International Journal of Robotics Research, vol. 2, pp. 62-82, 1990.
2. H. Benbrahim and J. Franklin, "Biped dynamic walking using reinforce ment learning," Robotics and Autonomous Systems, vol. 22, pp. 283-302, 1997.
3. J. Morimoto, J. Nakanishi, G. Endo, G. Cheng, C. Atkeson, and G. Zeglin, "Poincarémapbased reinforcement learning for biped walk ing," in Proceedings IEEE International Conference on Robotics and Automation, Barcelona, Spain, Apr. 2005, pp. 2381-2386.
4. R. L. Tedrake, "Applied optimal control for dynamically stable legged locomotion," PhD Dissertation, Massachusetts Institute of Technology, 2004.
5. J. Morimoto, G. Endo, G. Cheng, S. Schaal, and M. Kawato, "Learning from demonstration and adaptation of biped locomotion," Robotics and Autonomous Systems, vol. 47, pp. 79-91, 2004.
6. M. Vukobratovic, "Zeromomentpoint - thirty five years of its life," International Journal of Humanoid Robotics, vol. 1, no. 1, pp. 157-173, 2004.
7. T. Mori, Y. Nakamura, M. aki Sato, and S. Ishii, "Reinforcement learning for CPGdriven biped robot," in Proceedings Nineteenth National Conference on Artificial Intelligence, Sixteenth Conference on Innovative Applications of Artificial Intelligence, San Jose, USA, July 2004, pp. 623-630.
8. C. Zhou, "Robot learning with GAbased fuzzy reinforcement learning agents," Information Sciences, vol. 145, no. 12, pp. 45-68, 2002.
9. C. Zhou and Q. Meng, "Dynamic balance of a biped robot using fuzzy reinforcement learning agents," Fuzzy Sets and Systems, vol. 134, no. 1, pp. 169-187, 2003.
10. C.M. Chew and G. A. Pratt, "A general control architecture for dynamic bipedal walking," in Proceedings 2000 IEEE International Conference on Robotics & Automation, San Francisco, USA, Apr. 2000, pp. 3989-3995.
11. S. Collins, A. Ruina, R. Tedrake, and M. Wisse, "Efficient bipedal robots based on passivedynamic walkers," Science, vol. 307, pp. 1082-1085, 2005.
12. M. Wisse, "Essentials of dynamic walking: analysis and design of two legged robots," PhD Dissertation, Delft University of Technology, Delft, the Netherlands, 2004.
13. R. Sutton and A. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
14. G. Rummery and M. Niranjan, "Online Qlearning using connectionist systems," Cambridge University, Engineering Department, Tech. Rep., Oct 1994.
15. S. P. Singh and R. S. Sutton, "Reinforcement learning with replacing eligibility traces," Machine Learning, vol. 22, pp. 123-158, 1996.
16. A. Kølle, "The nature of learning - a study of reinforcement learning methodology," PhD Dissertation, University of Copenhagen, Denmark, 2003.