Legs that can walk: Embodiment-based modular reinforcement learning applied

Proceedings of IEEE International Symposium on Computational Intelligence in Robotics and Automation, CIRA

Volumn , Issue , 2005, Pages 365-372

  Jacob, David ^a   Polani, Daniel ^a   Nehaniv, Chrystopher L ^a  

^a UNIVERSITY OF HERTFORDSHIRE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; INTELLIGENT AGENTS; LEARNING SYSTEMS; SENSORS;

LEGGED ROBOTS; MODULAR DECOMPOSITION; PHYSICAL AGENTS;

MOBILE ROBOTS;

EID: 28444438497     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Turgay Akay, Sebastian Haehn, Josef Schmitz, and Ansgar Büschges. Signals from load sensors underlie interjoint coordination during stepping movements of the stick insect leg. Neurophysiology, 92:42-51, 2003.
2. H. Benbrahim and Judy Franklin. Biped dynamic walking using reinforcement learning. Robotics and Autonomous Systems, December 1997.
3. Michael Brady, editor. Robotics Science, chapter 16, "Legged Robots", Marc H. Raibert. MIT Press, 1989.
4. R. Brooks. From earwigs to humans. Robotics and Autonomous Systems, 20(2 - 4):291 - 304, June 1997.
5. J. Buchli and A. J. Ijspeert. Distributed central pattern generator model for robotics application based on phase sensitivity analysis. In The First International Workshop on Biologically-Inspired Approaches to Advanced Information Technology (Bio-ADIT 2004), 2004.
6. Stephen Budiansky. The Nature of Horses. The Free Press, New York, 1997.
7. H. Cruse, U. Mueller-Wilm, and J. Dean. Artificial neural nets for controlling a 6-legged walking system. In From Animals to Animals 2: Proceedings of the Second International Conference on Simulation of Adaptive Behavior, pages 108-115, 1992.
8. T. G. Dietterich. Hierarchical reinforcement learning with the maxq value function decomposition. Artificial Intelligence Research, 13:227 - 303, 2000.
9. M. Frik, M. Guddat, D.C. Losch, and M. Karatas. Terrain adaptive control of the walking machine tarry ii. In European Mechanics Colloquium, Euromech 375 - Biology and Technology of Walking, pages 108-115, 1998.
10. David Jacob, Daniel Polani, and Chrystopher L. Nehaniv. Ember: Learning with embodiment-based modular reinforcement. Technical Report 398, University of Hertfordshire, Faculty of Engineering and Information Sciences, Hatfield, UK, January 2004.
11. David Jacob, Daniel Polani, and Chrystopher L. Nehaniv. Improving learning for embodied agents in dynamic environments by state factorisation. In TAROS 2004, Towards Autonomous Robotic Systems, September 2004.
12. Nate Kohl and Peter Stone. Policy gradient reinforcement learning for fast quadrupedal locomotion. In Proceedings of the IEEE International Conference on Robotics and Automation, May 2004.
13. Pattie Maes and Rodney A. Brooks. Learning to coordinate behaviors. In National Conference on Artificial Intelligence, pages 796-802, 1990.
14. Andrew K. McCallum. Reinforcement Learning with Selective Perception and Hidden State. PhD thesis, University of Rochester, New York, 1996.
15. T Mori, Y Nakamura, Masa-aki Sato, and S. Ishii. Reinforcement learning for a cpg-driven biped robot. In Nineteenth National Conference on Artificial Intelligence (AAAI), pages 623-630, 2004.
16. J. Morimoto and K. Doya. Reinforcement learning of dynamic motor sequence: Learning to stand up. In IEEE/RSJ International Conference on Intelligent Robots and Systems, volume 3, pages 1721 - 1726, 1998.
17. K.N. Murphy and M.H. Raibert. Trotting and bounding in a planar two-legged model. In Fifth Symposium on Theory and Practice of Robots and Manipulators. MIT Press, 1985.
18. Ronald Parr and Stuart Russell. Reinforcement learning with hierarchies of machines. In Advances in Neural Information Processing Systems, volume 10, 1997.
19. William D. Smart and Leslie P. Kaelbling. Effective reinforcement learning for mobile robots. In International Conference on Robotics and Automation, May 2002.
20. Russell Smith. Open dynamics engine. WEB: www.ode.org, 2004.
21. R. S. Sutton, D. Precup, and S. Singh. Between mdps and semi-mdps: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence, 112:181-211, 1999.
22. Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
23. C. J. C. H. Watkins. Learning from Delayed Rewards. PhD thesis, Cambridge University, 1989.