Poincaré-map-based reinforcement learning for biped walking

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 2005, Issue , 2005, Pages 2381-2386

  Morimoto, Jun ^a,b   Nakanishi, Jun ^a,b   Endo, Gen ^b,c   Cheng, Gordon ^a,b   Atkeson, Christohper G ^d   Zeglin, Garth ^d  

^a Japan Science and Technology Agency   (Japan)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^c SONY CORPORATION   (Japan)

^d CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Biped walking; Poincar map; Reinforcement learning

Indexed keywords

BIPED LOCOMOTION; COMPUTER SIMULATION; CONFORMAL MAPPING; LEARNING ALGORITHMS; MATHEMATICAL MODELS; WALKING AIDS;

BIPED WALKING; POINCARÉ MAP; REINFORCEMENT LEARNING; WALKING TRAJECTORIES;

LEARNING SYSTEMS;

EID: 33846149670     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROBOT.2005.1570469     Document Type: Conference Paper

References (22)

1. H. Benbrahim and J. Franklin. Biped dynamic walking using reinforcement learning. Robotics and Autonomous Systems, 22:283-302, 1997.
2. C. Chew and G. A. Pratt. Dynamic bipedal walking assisted by learning. Robotica, 20:477-491, 2002.
3. K. Doya. Reinforcement Learning in Continuous Time and Space. Neural Computation, 12(1):219-245, 2000.
4. P. Dyer and S. R. McReynolds. The Computation and Theory of Optimal Control. Academic Press, New York, NY, 1970.
5. Y. Ehara and S. Yamamoto. Introduction to Body-Dynamics - Analysis of Gait and Gait Initiation. Ishiyaku Publishers, 2002 (in Japanese).
6. T. Flash and N. Hogan. The coordination of arm movements: An experimentally confirmed mathematical model. The Journal of Neuroscience, 5:1688-1703, 1985.
7. K. Hirai, M. Hirose, and T. Takenaka. The Development of Honda Humanoid Robot. In Proceedings of the 1998 IEEE International Conference on Robotics and Automation, pages 160-165, 1998.
8. D. H. Jacobson and D. Q. Mayne. Differential Dynamic Programming. Elsevier, New York, NY, 1970.
9. J. Morimoto and C. G. Atkeson. Robust low-torque biped walking using differential dynamic programming with a minimax criterion. In Philippe Bidaud and Faiz Ben Amar, editors, Proceedings of the 5th International Conference on Climbing and Walking Robots, pages 453-459. Professional Engineering Publishing, Bury St Edmunds and London, UK, 2002.
10. J. Morimoto and C. G. Atkeson. Minimax differential dynamic programming: An application to robust biped walking. In Suzanna Becker, Sebastian Thrun, and Klaus Obermayer, editors, Advances in Neural Information Processing Systems 15, pages 1563-1570. MIT Press, Cambridge, MA, 2003.
11. J. Morimoto, G. Cheng, C. G. Atkeson, and G. Zeglin. A Simple Reinforcememtn Learning Algorithm For Biped Walking. In Proceedings of the 2004 IEEE International Conference on Robotics and Automation, pages 3030-3035, 2004.
12. Y. Nakamura, M. Sato, and S. Ishii. Reinforcement learning for biped robot. In Proceedings of the 2nd International Symposium on Adaptive Motion of Animals and Machines, pages ThP-II-5, 2003.
13. J. Nakanishi, J. Morimoto, G. Endo, G. Cheng, S. Schaal, and M. Kawato. Learning from demonstration and adaptation of biped locomotion. Robotics and Autonomous Systems, 47:79-91, 2004.
14. M. H. Raibert. Legged Robots That Balance. The MIT Press, Cambridge, MA, 1986.
15. S. Schaal and C. G. Atkeson. Constructive incremental learning from only local information. Neural Computation, 10(8):2047-2084, 1998.
16. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. The MIT Press, Cambridge, MA, 1998.
17. R. S. Sutton, D. McAllester, S. Singh, and Y. Mansour. Policy Gradient Methods for Reinforcement Learning with Function Approximation. In. Advances in Neural Information Processing Systems 12, pages 1057-1063, Cambridge, MA, 2000. MIT Press.
18. R. S. Sutton, D. Precup, and S. Singh. Between MDPs and semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning. Artificial Intelligence, 112:181-211, 1999.
19. R. Tedrake, T. W. Zhang, and H. S. Seung. Stochastic policy gradient reinforcement learning on a simple 3d biped. In Proceedings of the 2004 IEEE/RSJ International Conference on Intelligen Robots and Systems, page (to appear), 2004.
20. K. Tsuchiya, S. Aoi, and K. Tsujita. Locomotion control of a biped locomotion robot using nonlinear oscillators. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 1745-1750, Las Vegas, NV, USA, 2003.
21. Y. Wada and M. Kawato. A theory for cursive handwriting based on the minimization principle. Biological Cybernetics, 73:3-15, 1995.
22. J. Yamaguchi, A. Takanishi, and I. Kato. Development of a biped walking robot compensating for three-axis moment by trunk motion. Journal of the Robotics Society of Japan, 11(4):581-586, 1993.