Dynamic bipedal walking assisted by learning

Robotica

Volumn 20, Issue 5, 2002, Pages 477-491

  Chew, Chee Meng ^a   Pratt, Gill A ^b  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b FRANKLIN W OLIN COLLEGE OF ENGINEERING   (United States)

Author keywords

Bipedal walking; CMAC; Q learning; Reinforcement learning; Virtual model control

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; CONTROL THEORY; MOTION CONTROL; ROBOT LEARNING; ROBOTICS; SPEED CONTROL;

REINFORCEMENT LEARNING; VIRTUAL MODEL CONTROL;

BIPED LOCOMOTION;

EID: 0036708925     PISSN: 02635747     EISSN: None     Source Type: Journal    
DOI: 10.1017/S0263574702004290     Document Type: Article

References (31)

1. F. Gubina and H. Hemami R.B. McGhee, "On the dynamic stability of biped locomotion", IEEE Transactions on Biomedical Engineering BME-21, No. 2, 102-108 (Mar., 1974).
2. S. Arimoto and F. Miyazaki, Biped locomotion robots", Japan Annual Review in Electronics, Computers and Telecommunications 12, 194-205 (1984).
3. F. Miyazaki and S. Arimoto, "A control theoretic study on dynamical biped locomotion", ASME Journal of Dynamic Systems, Measurement, and Control 102, 233-239 (1980).
4. H. Miura and I. Shimoyama, "Dynamic walk of a biped", Int. J. Robotic Research 3, No. 2, 60-74 (1984).
5. J.S. Bay and H. Hemami, "Modeling of a neural pattern generator with coupled nonlinear oscillators", IEEE Transactions on Biomedical Engineering BME-34, No. 4, 297-306 (April, 1987).
6. K. Hirai, M. Hirose, Y. Haikawa and T. Takenaka, "The development of honda humanoid robot", IEEE International Conference on Robotics and Automation (1998) pp. 1321-1326.
7. Y. Hurmuzlu, "Dynamics of bipedal gait: Part i - objective functions and the contact event of a planar five-link biped", Journal of Applied Mechanics 60, 331-336 (1993).
8. Shuuji Kajita, Tomio Yamaura and Akira Kobayashi, "Dynamic walking control of a biped robot along a potential energy conserving orbit", IEEE Transactions on Robotics and Automation 6, No. 1, 431-438 (1992).
9. J.A. Golden and Y.F. Zheng, "Gait synthesis for the sd-2 biped robot to climb stairs", Int. J. Robotics and Automation 5 No. 4, 149-159 (1990).
10. Gill A. Pratt, "Legged robots at mit - what's new since raibert", 2nd International Conference on Climbing and Walking Robots (1999) pp 29-33.
11. S. Kawamura, T. Kawamura, D. Fujino and S. Arimoto, "Realization of biped locomotion by motion pattern learning", Journal of the Robotics Society of Japan 3, No. 3, 177-187 (1985).
12. Jin'ichi Yamaguchi, Atsuo Takanish and Ichiro Kato, "Development of a biped walking robot compensating for three-axis moment by trunk motion", IEE International Conference on Intelligent Robots and Systems (1993) pp 561-566.
13. H. Wang, T.T. Lee and W.A. Grover, "A neuromorphic controller for a three-link biped robot", IEEE Transactions on Systems, Man, and Cybernetics 22, No. 1, 164-169 (Jan./Feb., 1992).
14. Thomas W. Miller, "Real time neural network control of a biped walking robot", IEEE Control Systems Magazine 41-48 (Feb., 1994).
15. H. Benbrahim and J.A. Franklin, "Biped dynamic walking using reinforcement learning", Robotics and Autonomous Systems 22 283-302 (1997).
16. Gill A. Pratt and Matthew M. Williamson, "Series elastic actuators", IEEE International Conference on Intelligent Robots and Systems (1995) Vol. 1, pp. 399-406.
17. D.E. Rosenthal and M.A. Sherman, "High performance multibody simulations via symbolic equation manipulation and kane's method", Journal of Astronautical Sciences 34, No. 3, 223-239 (1986).
18. J. Pratt, C.-M. Chew, A. Torres, P. Dilworth and G. Pratt, "Virtual model control: An intuitive approach for bipedal locomotion", Int. J. Robotics Research 20, No. 2, 129-143 (2001).
19. M. Vukobratovic, B. Borovac, D. Surla and D. Stokic, Biped Locomotion: Dynamics, Stability, Control, and Applications (Springer-Verlag, Berlin, 1990).
20. C.J.C.H. Watkins and P. Dayan, "Q-learning", Machine Learning 8, 279-292 (1992).
21. John N. Tsitsiklis, "Asynchronous stochastic approximation and q-learning", Machine Learning 16, No. 3, 185-202 (1994).
22. T. Jaakkola, S.P. Singh and M.I. Jordan, "On the convergence of stochastic iterative dynamics programming algorithms", Neural Computation 6, 1185-1201 (1994).
23. R.S. Sutton and A.G. Barto, Reinforcement Learning An Introduction (MIT Press, Cambridge, MA, 1998).
24. D. Bertsekas and J. Tsitsiklis, Neuro-Dynamic Programming (Athena Scientific, Belmont, MA, 1996).
25. J.S. Albus, Brain, Behavior and Robotics (BYTE Books, McGraw-Hill, Peterborough, NH, 1981). Chapter 6, pp. 139-179.
26. W.T. Miller, F.H. Glanz and M.J. Carter, "Cmac: An associative neural network alternative to backpropagation", IEEE Proceedings No. 78, 1561-1567 (1990).
27. Thomas W. Miller and Filson H. Glanz, "The university of new hampshire implementation of the cerebellar model arithmetic computer - cmac", Unpublished reference guide to a CMAC program (August, 1994).
28. T. Flash and N. Hogan, "The coordination of arm movements: An experimentally confirmed mathematical model", Journal of Neuroscience 5, No. 7, 1688-1703 (1985).
29. Chee-Meng Chew and Gill A. Pratt, "Adaptation to load variations of a planar biped: Height control using robust adaptive control", Robotics and Autonomous Systems 35, No. 1, 1-22 (2001).
30. Jean-Jacques E. Slotine and Weiping Li, Appiled Nonlinear Control (Prentice-Hall, Cambridge, MA, 1991).
31. Chee-Meng Chew, "Dynamic Bipedal Walking Assisted by Learning", PhD dissertation (Massachusetts Institute of Technology, Sept 2000).