A simple reinforcement learning algorithm for biped walking

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 2004, Issue 3, 2004, Pages 3030-3035

  Morimoto, Jun ^a   Cheng, Gordon ^a   Atkeson, Christopher G ^b   Zeglin, Garth ^b  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; AUTOMATION; COMPUTER SIMULATION; DECISION MAKING; INTELLIGENT ROBOTS; LEARNING ALGORITHMS; MATHEMATICAL MODELS; PARAMETER ESTIMATION; ROBOTICS;

BIPED ROBOTS; BIPED WALKING; POINCARE MAP; REINFORCEMENT LEARNING ALGORITHM; ROBOT DYNAMICS;

BIPED LOCOMOTION;

EID: 3042678716     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/robot.2004.1307522     Document Type: Conference Paper

References (24)

1. H. Benbrahim and J. Franklin. Biped dynamic walking using reinforcement learning. Robotics and Autonomous Systems, 22:283-302, 1997.
2. C. Chew and G. A. Pratt. Dynamic bipedal walking assisted by learning. Robotica, 20:477-491, 2002.
3. R. Q. Van der Linde. Passive bipedal walking with phasic muscle contraction. Biological Cybernetics, 82:227-237, 1999.
4. K. Doya. Reinforcement Learning in Continuous Time and Space. Neural Computation, 12(1):219-245, 2000.
5. P. Dyer and S. R. McReynolds. The Computation and Theory of Optimal Control. Academic Press, New York, NY, 1970.
6. T. Flash and N. Hogan. The coordination of arm movements: An experimentally confirmed mathematical model. The Journal of Neuroscience, 5:1688-1703, 1985.
7. M. Garcia, A. Chatterjee, A. Ruina, and M. J. Coleman. The simplest walking model: stability, complexityu. and scaling. ASME Jounal of Biomechanical Engineering, 120(2):281-288, 1998.
8. K. Hirai, M. Hirose, and T. Takenaka. The Development of Honda Humanoid Robot. In Proceedings of the 1998 IEEE International Conference on Robotics and Automation, pages 160-165, 1998.
9. D. H. Jacobson and D. Q. Mayne. Differential Dynamic Programming. Elsevier, New York, NY, 1970.
10. J. Morimoto and C. G. Atkeson. Robust low-torque biped walking using differential dynamic programming with a minimax criterion. In Philippe Bidaud and Faiz Ben Amar, editors, Proceedings of the 5th International Conference on Climbing and Walking Robots, pages 453-459. Professional Engineering Publishing, Bury St Edmunds and London, UK, 2002.
11. J. Morimoto and C. G. Atkeson. Minimax differential dynamic programming: An application to robust biped walking. In Suzanna Becker, Sebastian Thrun, and Klaus Obermayer, editors, Advances in Neural Information Processing Systems 15, pages 1563-1570. MIT Press, Cambridge, MA, 2003.
12. K. Nagasaka, M. Inaba, and H. Inoue. Stabilization of dynamic walk on a humanoid using torso position compliance control. In Proceedings of 17th Annual Conference on Robotics Society of Japan, pages 1193-1194, 1999.
13. Y. Nakamura, M. Sato, and S. Ishii. Reinforcement learning for biped robot. In Proceedings of the 2nd International Symposium on Adaptive Motion of Animals and Machines. pages ThP-II-5, 2003.
14. J. Nakanishi, J. Morimoto, G. Endo. O. Cheng, S. Schaal, and M. Kawato. Learning from demonstration and adaptation of biped locomotion with dynamical movement primitives. In Workshop on Robot Programming by Demonstration, IEEE/RSJ International Conference on Intelligent Robots and Systems, Las Vegas, NV. USA, 2003.
15. J. Nakanishi, J. Morimoto, G. Endo, G. Cheng, S. Schaal, and M. Kawato. Learning from demonstration and adaptation of biped locomotion. Robotics and Autonomous Systems (to appear), 2004.
16. S. Schaal and C. G. Atkeson. Constructive incremental learning from only local information. Neural Computation, 10(8):2047-2084, 1998.
17. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. The MIT Press, Cambridge, MA, 1998.
18. R. S. Sutton, D. Precup, and S. Singh. Between MDPs and semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning. Artificial Intelligence. 112:181-211, 1999.
19. K. Tsuchiya, S. Aoi, and K. Tsujita. Locomotion control of a biped locomotion robot using nonlinear oscillators. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems. pages 1745-1750, Las Vegas, NV. USA, 2003.
20. J. Vucobratovic, B. Borovac, D. Surla, and D. Stokic. Biped Locomotion: Dynamics, Stability, Control and Applications. Springer-Verlag, Berlin, 1990.
21. Y. Wada and M. Kawato. A theory for cursive handwriting based on the minimization principle. Biological Cybernetics, 73:3-15, 1995.
22. J. Yamaguchi, A. Takanishi, and I. Kato. Development of a biped walking robot compensating for three-axis moment by trunk motion. Journal of the Robotics Society of Japan, 11(4):581-586, 1993.
23. K. Yamane and Y. Nakamura. Dynamics filter - concept and implementation of on-line motion generator for human figures. In Proceedings of the 2000 IEEE International Conference on Robotics and Automation, pages 688-693, 2000.
24. T. Yamasaki, T. Nomura, and S. Sato. Possible functional roles of phase resetting during walking. Biological Cybernetics, 88(6):468-496, 2003.