Training and delayed reinforcements in Q-learning agents

International Journal of Intelligent Systems

Volumn 12, Issue 10, 1997, Pages 695-724

  Caironi, Pierguido V C ^a   Dorigo, Marco ^b  

^a POLITECNICO DI MILANO   (Italy)

^b UNIVERSITÉ LIBRE DE BRUXELLES   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; LEARNING SYSTEMS; ROBOTS;

DELAYED REINFORCEMENTS; Q LEARNING ALGORITHMS; TRAINING REINFORCEMENTS;

LEARNING ALGORITHMS;

EID: 0031257934     PISSN: 08848173     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1098-111X(199710)12:10<695::AID-INT1>3.0.CO;2-T     Document Type: Article

References (23)

1. S.D. Whitehead, A Study of Cooperative Mechanisms for Faster Reinforcement Learning, TR-365, Computer Science Dept., University of Rochester, NY, 1991.
2. R.S. Sutton, "Learning to predict by the methods of temporal differences," Mach. Learn., 3, 9-44 (1988).
3. R.S. Sutton, "Temporal credit assignment in reinforcement learning," Ph.D. Thesis, Department of Computer and Information Science, University of Massachusetts, Amherst, MA, 1984.
4. A.G. Barto, R.S. Sutton, and C.J.C.H. Watkins, "Learning and sequential decision making," in Learning and Computational Neuroscience: Foundations of Adaptive Network, M. Gabriel and J. W. Moore, Eds. MIT Press, Bradford Books, Cambridge, MA, 1990.
5. L. Booker, D.E. Goldberg, and J.H. Holland, "Classifier systems and genetic algorithms," Artif. Intell., 40, 235-282 (1989).
6. C.J.C.H. Watkins, "Learning with delayed rewards," Ph.D. Dissertation, Psychology Department, University of Cambridge, England, 1989.
7. S.D. Whitehead, "A complexity analysis of cooperative mechanisms in reinforcement learning," Proceeding of the Ninth National Conference on Artificial Intelligence (AAAI-91), 1991, pp. 607-613.
8. S.B. Thrun, Efficient Exploration in Reinforcement Learning, Technical Report CMU-CS-92-102, Carnegie Mellon University, Pittsburgh, PA, 1992.
9. M. Dorigo and M. Colombetti, Robot Shaping: An Experiment in Behavior Engineering, MIT Press, Bradford Books, Cambridge, MA, 1997.
10. M. Dorigo, "ALECSYS and the autonoMouse: Learning to control a real robot by distributed classifier systems," Mach. Learn., 19, 209-240 (1995).
11. M. Dorigo and M. Colombetti, "Robot shaping: Developing autonomous agents through learning," Artif. Intell., 71, 321-370 (1994).
12. M. Dorigo and M. Colombetti, "The role of the trainer in reinforcement learning," Proceedings of the MLC-COLT '94 Workshop on Robot Learning, New Brunswick, NJ, 1994, pp. 37-45.
13. R.S. Sutton, "Integrated architectures for learning, planning, and reacting based on approximating dynamic programming," Proceedings of the Seventh International Conference on Machine Learning, Morgan Kaufmann, San Mateo, CA, 1990, pp. 216-224.
14. L-J. Lin, "Reinforcement learning for robots using neural networks," Ph.D. Thesis, Carnegie Mellon University, Pittsburgh, PA, 1993.
15. L-J. Lin, "Self-improving reactive agents based on reinforcement learning, planning and teaching," Mach. Learn., 8, 293-322 (1992).
16. S. Siegel and N.J. Castellan, Nonparametric Statistics for the Behavioral Sciences, McGraw-Hill, 1956.
17. M. Asada, S. Noda, S. Tawaratsumida, and K. Hosoda, "Purposive behavior acquisition for a real robot by vision-based reinforcement learning," Mach. Learn., 23, 279-303 (1996).
18. S. Mahadevan and J. Connell, "Automatic programming of behavior-based robots using reinforcement learning," Artif. Intell., 55, 311-365 (1992).
19. J.C. Santamaria, R.S. Sutton, and A. Ram, "Experiments with reinforcement learning in problems with continuous state and action spaces," Technical Report UM-CS-1966-088, Department of Computer Science, University of Massachusetts, Amherst, MA, 1996.
20. P.-Y. Glorennec, "Fuzzy Q-learning and dynamical fuzzy Q-learning," Proceedings of the Third IEEE International Conference on Fuzzy Systems, IEEE Press, Piscataway, NJ, 1994, pp. 474-479.
21. H.R. Berenji, P.S. Khedkar, and A. Malkani, "Refining linear fuzzy rules by reinforcement learning," Proceedings of the Fifth IEEE International Conference on Fuzzy Systems, IEEE Press, Piscataway, NJ, 1996, pp. 1750-1756.
22. J.F. Shepanski and S.A. Macy, "Manual training techniques of autonomous systems based on artificial neural networks," Proceedings of the IEEE First Annual International Conference on Neural Networks, IEEE Press, Piscataway, NJ, 1987, pp. 697-704.
23. U. Nehmzow and B. McGonigle, "Achieving rapid adaptations in robots by means of external tuition," Proceedings of From Animal to Animats, Third International Conference on Simulation of Adaptive Behaviour (SAB94), MIT Press, Cambridge, MA, 1994, pp. 301-308.