Reinforcement learning of humanoid rhythmic walking parameters based on visual information

Advanced Robotics

Volumn 18, Issue 7, 2004, Pages 677-697

  Ogino, Masaki ^a   Katoh, Yutaka ^b   Aono, Masahiro ^a   Asada, Minoru ^a   Hosoda, Koh ^a  

^a OSAKA UNIVERSITY   (Japan)

^b Honda Motor   (Japan)

Author keywords

Humanoid; Reinforcement learning; Rhythmic walking; Robot soccer; Vision

Indexed keywords

COMPUTER VISION; CONTROL EQUIPMENT; LEARNING SYSTEMS; MOBILE ROBOTS; REINFORCEMENT; SENSORS; TRAJECTORIES; VISUAL COMMUNICATION;

HUMANOIDS; REINFORCEMENT LEARNING; RHYTHMIC WALKING; VISUAL INFORMATION;

ROBOTICS;

EID: 4544333988     PISSN: 01691864     EISSN: None     Source Type: Journal    
DOI: 10.1163/1568553041719519     Document Type: Article

References (14)

1. J. Yamaguchi, N. Kinoshita, A. Takanishi and I. Kato, Development of a dynamic biped walking system for humanoid - development of a biped walking robot adapting to the human's living floor, in: Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Osaka, pp. 232-239 (1996).
2. S. Kajita and K. Tani, Adaptive gait control of a biped robot based on realtime sensing of the ground profile, in: Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Osaka, pp. 570-577 (1996).
3. G. Taga, Y. Yamaguchi and H. Shimizu, Self-organized control of bipedal locomotion by neural oscillators in unpredictable environment, Biol. Cybernet. 65, 147-159 (1991).
4. S. Grillner, Neurobiological bases of rhythmic motor acts in vertebrates, Science 228, 143-149 (1985).
5. S. Miyakoshi, G. Taga, Y. Kuniyoshi and A. Nagakubo, Three-dimensional bipedal stepping motion using neural oscillators - towards humanoid motion in the real world, in: Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Victoria, BC, pp. 84-89 (1998).
6. J. Pratt, Exploiting Inherent robustness and natural dynamics in the control of bipedal walking robots, Doctoral thesis, MIT, Cambridge, MA (2000).
7. K. Tsuchiya, K. Tsujita, K. Manabu and S. Aoi, An emergent control of gait patterns of legged locomotion robots, in: Proc. Symp. on Intelligent Autonomous Vehicles, Sapporo, pp. 271-276 (2001).
8. G. Taga, A model of the neuro-musculo-skeletal system for anticipatory adjustment of human locomotion during obstacle avoidance, Biol. Cybernet. 78, 9-17 (1998).
9. H. Kimura, Y. Fukuoka and H. Nakamura, Biologically inspired adaptive dynamic walking of the quadruped on irregular terrain, in: Proc. 9th Int. Symp. on Robotics Research, Salt Lake City, UT, pp. 271-278 (1999).
10. H. Kitano and M. Asada, The RoboCup humanoid challenge as the millennium challenge for advanced robotics, Advanced Robotics 13, 723-736 (2000).
11. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. MIT Press/Bradford Books, Cambridge, MA (1998).
12. M. Laurent and J. A. Thomson, The role of visual information in control of a constrained locomotor task, J. Motor Behavior 20, 17-37 (1988).
13. Y. Murase, Y. Yasukawa and K. Sakai, Design of a compact humanoid robot as a platform, in: Proc. 19th Conf. of the Robotics Society of Japan, Tokyo, pp. 789-790 (2001).
14. M. Asada, S. Noda, S. Tawaratumida and K. Hosoda, Purposive behavior acquisition for a real robot by vision-based reinforcement learning, Machine Learning 23, 279-303 (1996).