Reinforcement learning with multiple heterogeneous modules: A framework for developmental robot learning

Proceedings of 2005 4th IEEE International Conference on Development and Learning

Volumn 2005, Issue , 2005, Pages 87-92

  Uchibe, Eiji ^a   Doya, Kenji ^b  

^a OKINAWA INSTITUTE OF SCIENCE AND TECHNOLOGY GRADUATE UNIVERSITY   (Japan)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE ALGORITHMS; BEHAVIORAL RESEARCH; INTELLIGENT ROBOTS; LARGE SCALE SYSTEMS; MODULA (PROGRAMMING LANGUAGE); ROBOT LEARNING; SAMPLING;

HETEROGENEOUS MODULES; LEARNING MODULES; REINFORCEMENT LEARNING METHOD (RL); SAMPLING RATES;

LEARNING SYSTEMS;

EID: 33745461872     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DEVLRN.2005.1490949     Document Type: Conference Paper

References (13)

1. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, MIT Press / Bradford Books, 1998.
2. M. Asada, K. F. MacDorman, H. Ishiguro, and Y. Kuniyoshi, "Cognitive developmental robotics as a new paradigm for the design of humanoid robots," Robotics and Autonomous Systems, vol. 37, pp. 185-193, 2001.
3. M. Lungarella, G. Metta, R. Pfeifer, and G. Sandini, "Developmental Robotics: A Survey," Connection Science, Vol. 4, pp. 151-190, 2003.
4. J. Weng, "Developmental robotics: Theory and experiments," International Journal of Humanoid Robotics, vol. 1, no. 2, pp. 199-236, 2004.
5. S. Tanaka, K. Doya, G. Okada, K. Ueda, Y. Okamoto, and S. Yamawaki, "Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops," Nature Neuroscience, vol. 7, pp. 887-893, 2004.
6. E. Uchibe and K. Doya, "Competitive-Cooperative-Concurrent Reinforcement Learning with Importance Sampling," in Proc. of International Conference on Simulation of Adaptive Behavior: From Animals to Animals, 2004, pp. 287-296.
7. R. Rubinstein, Simulation and the Monte Carlo method, New York: Wiley, 1981.
8. K. Doya and E. Uchibe, "The Cyber Rodent project: Exploration of adaptive mechanisms for self-preservation and self-reproduction," Adaptive Behavior, (in press).
9. J. Baxter and P. L. Bartlett, "Infinite-horizon gradient-based policy search," Journal of Artificial Intelligence Research, vol. 15, 2001, pp. 319-350.
10. R. S. Sutton, D. McAllester, S. Sing and Y. Mansour, "Policy gradient methods for reinforcement learning with function approximation," Advances in Neural Information Processing Systems 12, 2000, pp. 1057-1063.
11. M. L. Puterman, "Markov Decision Problems," Wiley, New York, 1994.
12. D. Fox, W. Burgard, and S. Thrun, "Active Markov localization for mobile robots," Robotics and Autonomous Systems, vol. 25, no. 3-4, pp. 195-207, 1998.
13. O. Trullier, S. I. Wiener, A. Berthoz and J.-A. Meyer, "Biologically-based artificial navigation systems: Review and prospects," Progress in Neurobiology, vol. 51, pp. 483-544, 1997.