Improving humanoid locomotive performance with learnt approximated dynamics via Gaussian processes for regression

IEEE International Conference on Intelligent Robots and Systems

Volumn , Issue , 2007, Pages 4234-4240

  Morimoto, Jun ^a   Atkeson, Christopher G ^b   Endo, Gen ^c   Cheng, Gordon ^a  

^a JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

GAUSSIAN PROCESSES; INTERNATIONAL CONFERENCES;

GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); INTELLIGENT ROBOTS; INTELLIGENT SYSTEMS; LOCOMOTIVES; PROBABILITY DISTRIBUTIONS; REINFORCEMENT; REINFORCEMENT LEARNING; ROBOTICS; TRELLIS CODES;

ROBOTS;

EID: 51349148802     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2007.4399485     Document Type: Conference Paper

References (21)

1. H. Benbrahim and J. Franklin, "Biped dynamic walking using reinforcement learning," Robotics and Autonomous Systems, vol. 22, pp. 283-302, 1997.
2. R. Tedrake, T. W. Zhang, and H. S. Seung, "Stochastic policy gradient reinforcement learning on a simple 3d biped," in Proceedings of the 2004 IEEE/RSJ International Conference on Intelligen Robots and Systems, 2004, p. (to appear).
3. J. Morimoto, J. Nakanishi, G. Endo, G. Cheng, C. G. Atkeson, and G. Zeglin, "Poincare-Map-Based Reinforcement Learning For Biped Walking," in Proceedings of the 2005 IEEE International Conference on Robotics and Automation, 2005, pp. 2392-2397.
4. T. Matsubara, J. Morimoto, J. Nakanishi, M. Sato, and K. Doya, "Learning Sensory Feedback to CPG with Policy Gradient for Biped Locomotion," in Proceedings of the 2005 IEEE International Conference on Robotics and Automation, 2005, pp. 4175-4180.
5. G. Endo, J. Morimoto, J. Nakanishi, T. Matsubara, and G. Cheng, "Learning CPG Sensory Feedback with Policy Gradient for Biped Locomotion for a Full-body Humanoid," in The Twentieth National Conference on Artificial Intelligence, 2005, pp. 1267-1273.
6. G. Cheng, S. Hyon, J. Morimoto, A. Ude, J. G. Hale, G. Colvin, W. Scroggin, and S. C. Jacobsen, "CB: A Humanoid Research Platform for Exploring NeuroScience," Advanced Robotics, vol. 21, no. 10, 2007.
7. J. Morimoto, G. Endo, J. Nakanishi, S. Hyon, G. Cheng, C. G. Atkeson, and D. Bentivegna, "Modulation of Simple Sinusoidal Patterns by a Coupled Oscillator Model for Biped Walking," in Proceedings of the 2006 IEEE International Conference on Robotics and Automation, 2006, pp. 1579-1584.
8. L. Kuvayev and R. Sutton, "Model-based reinforcement learning with an approximate, learned model," in Proceedings of the Ninth Yale Workshop on Adaptive and Learning Systems, 1996, pp. 101-105.
9. F. Miyazaki and S. Arimoto, "Implementation of a hierarchical control for biped locomotion," in 8th IFAC, 1981, pp. 43-48.
10. H. Miura and I. Shymoyama, "Dynamical walk of biped locomotion," Int. J. of Robotics Research, vol. 3, no. 2, pp. 60-74, 1984.
11. T. Sugihara and Y. Nakamura, "Whole-body Cooperative COG Control through ZMP Mnipulation for Humanoid Robots," in IEEE Int. Conf. on Robotics and Automation, Washington DC, USA, 2002.
12. S. Hyon and G. Cheng, "Passivity-based full-Body force control for humanoids and application to dynamic balancing and locomotion," in IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China, 2006, pp. 4915-4922.
13. S. H. Strogatz, Nonlinear Dynamics and Chaos. Addison-Wesley Publishing Company, 1994.
14. C. K. I. Williams and C. E. Rasmussen, "Gaussian processses for regression," in Advances in Neural Information Processing Systems, vol. 8. The MIT Press, 1996, pp. 514-520.
15. H. Kimura and S. Kobayashi, "An analysis of actor/critic algorithms using eligibility traces: Reinforcement learning with imperfect value functions," in Proceedings of the 15th Int. Conf. on Machine Learning, 1998, pp. 284-292.
16. K. Doya, "Reinforcement Learning in Continuous Time and Space," Neural Computation, vol. 12, no. 1, pp. 219-245, 2000.
17. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: The MIT Press, 1998.
18. C. G. Atkeson and S. Schaal, "Robot learning from demonstration," in Proc. 14th International Conference on Machine Learning. Morgan Kaufmann, 1997, pp. 12-20. [Online]. Available: citeseer.ist.psu.edu/atkeson97robot.html
19. C. G. Atkeson, "Nonparametric model-based reinforcement learning," in Advances in neural information processing systems 10, M. K. M. I. Jordan and S. Solla, Eds. MIT Press, 1998, pp. 1008-1014.
20. P. Abbeel, M. Quigley, and A. Y. Ng, "Using inaccurate models in reinforcement learning," in Proceedings of the 23rd international conference on Machine learning. ACM Press, 2006, pp. 1-8.
21. C. E. Rasmussen and M. Kuss, "Gaussian processses in Reinforcement Learning," in Advances in Neural Information Processing Systems, vol. 16. The MIT Press, 2004, pp. 751-759.