A generic architecture for adaptive agents based on reinforcement learning

Information Sciences

Volumn 161, Issue 1-2, 2004, Pages 37-55

  Preux, Philippe ^a,b   Delepoulle, Samuel ^a   Darcheville, Jean Claude ^b  

^a UNIVERSITÉ DU LITTORAL CÔTE D OPALE   (France)

^b UNIV LILLE   (France)

Author keywords

Adaptive systems; Dynamics of behavior; Modeling; Reinforcement learning

Indexed keywords

COMPUTER SIMULATION; DYNAMICS; ENGINEERING RESEARCH; LEARNING SYSTEMS; MATHEMATICAL MODELS;

ADAPTIVE AGENTS; REINFORCEMENT LEARNING;

INTELLIGENT AGENTS;

EID: 1642333557     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2003.03.005     Document Type: Article

References (35)

1. Ferber J. Multi-Agent Systems. 1999;Addison-Wesley.
2. Skinner B. Selection by consequences. Science. 213:1981;501-514.
3. Thorndike E. Animal intelligence: an experimental study of the associative process in animals. Psychology Monographs. 2:1911.
4. Toates F. What is cognitive and what is not cognitive. Cliff D., Husbands P., Meyer J.-A., Wilson S.W. From Animals to Animats 3, Proceedings of the Third International Conference on Simulation of Adaptive Behavior. 1994;102-107 MIT Press.
5. Spier E., McFarland D. Learning to do without cognition. Pfeifer R., Blumberg B., Meyer J.-A., Wilson S. Proceedings of Fifth International Conference on Simulation of Adaptive Behavior (SAB 5). 1998;38-47 MIT Press.
6. Reeke G., Sporns O., Edelman G. Synthetic neural modelling: comparisons of population and connectionist approaches. Pfeifer R., Schreter Z., Fogelman-Soulié F., Steels L. Connectionism in Perspective. 1989;Elsevier Science Publishers.
7. Frezza-Buet H., Alexandre F. From a biological to a computational model for the autonomous behavior of ana animat. Information Sciences. 144:2002;1-43.
8. S. Delepoulle, Coopération centre agents adaptatifs ; étude de la sélection des comportements sociaux, expérimentations et simulations, Ph.D. Thesis, Université de Lille 3, URECA, Villeneuve d'Ascq, thèse de doctorat de Psychologie, October 2000.
9. S. Delepoulle, P. Preux, J.-C. Darcheville, Dynamique de l'interaction, in: B. Chaib-Dra, P. Enjalbert (Eds.), Proc. Modèles Formels de l'Interaction, Toulouse, 2001, pp. 141-150.
10. Sutton R., Barto A. Reinforcement Learning: An Introduction. 1998;MIT Press.
11. Samuel A. Some studies in machine learning using the game of checkers. IBM Journal of Research and Development. 3:1959;211-229. (reprinted in E.A. Feigenbaum, J. Feldman (Eds), Computers and Thought, pp. 71-105, Mc Graw-Hill, New York, 1963).
12. Samuel A. Some studies in machine learning using the game of checkers. IBM Journal of Research and Development. 3:1959;211-229. (reprinted in E.A. Feigenbaum, J. Feldman (Eds), Computers and Thought, pp. 71-105, Mc Graw-Hill, New York, 1963).
13. W. Zhang, T. Dietterich, A reinforcement learning approach to job-shop scheduling.
14. J. Rennie, A. McCallum, Using reinforcement learning to spider the web efficiently, in: Proceedings of ECML, 1999.
15. Tesauro G. Temporal difference learning and TD-Gammon. Communications of the ACM. 38:1995;58-68.
16. Bertsekas D., Tsitsiklis J. Neuro-Dynamic Programming. 1996;Athena Scientific.
17. C. Watkins, Learning from delayed rewards, Ph.D. Thesis, King's College, Cambridge, UK, 1989.
18. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science. 275:1997;1593-1599.
19. Suri R., Schultz W. Temporal difference model reproduces anticipatory neural activity. Neural Computation. 13(4):2001;487-494.
20. Thelen E., Smith L. A Dynamic Systems Approach to the Developement of Cognition and Action. 1994;MIT Press.
21. Dorigo M., Colombetti M. Robot Shaping: An Experiment in Behavior Engineering. 1998;MIT Press.
22. C. Cassagnabère, Modeling and simulation of the adaptive behavior of a virtual arm during a reaching movement, Master's thesis, Université du Littoral Côte d'Opale, Computer Science Dpt, France, 2001.
23. Thelen E., Smith L. A Dynamic Systems Approach to the Developement of Cognition and Action. 1994;MIT Press.
24. C. Boyer, J.-C. Darcheville, Interaction organisation-environnement dans l'émergence de la saisie chez le nourissons, in: Congrès National de la Société Française de Psychologie, 1999.
25. Brooks R. Cambrian Intelligence: The Early History of the New AI. 1999;MIT Press.
26. Kodjobachian J., Meyer J. Evolution and development of neural controllers for locomotion, gradient-following, and obstacle avoidance in artificial insects. IEEE Transactions in Neural Networks. 9:1998;796-812.
27. G. Metta, R. Manzotti, F. Panerai, G. Sandini, Development: is it the right way towards humanoid robotics? in: IAS-6, 2000.
28. Andry P., Moga S., Gaussier P., Revel A., Nadel J. Imitation: learning and communication. Meyer J.-A., Berthoz A., Floreano D., Roitblatt H., Wilson S. Proceedings of from Animals to Animate Conference: Simulated Adaptive Behavior. 2000;353-362 MIT Press.
29. Berthier N. Analysis of reaching for stationary and moving objects in the human infant, Neural Networks Models of Complex Behavior - Behavioral Foundations. 1997;Elsevier. pp. 283-301.
30. Littman M. Markov games as a framework for multi-agent reinforcement learning. Proceedings of the 11th International Conference on Machine Learning (ICML-94). 1994;157-163 Morgan Kaufmann, New Brunswick, NJ.
31. T. Sandholm, R. Crites, On multiagent Q -learning in a semi-competitive domain, in: Workshop on Adaptation and Learning in Multiagent Systems at the 14th International Joint Conference on Artificial Intelligence (IJCAI-95), Montreal, Canada, 1995, pp. 71-77.
32. J. Hu, M. Wellman, Multiagent reinforcement learning in stochastic games, submitted for publication.
33. Tan M. Multi-agent reinforcement learning: Independent vs. cooperative learning. Huhns M.N., Singh M.P. Readings in Agents. 1997;487-494 Morgan Kaufmann, San Francisco, CA, USA.
34. von Hofsten C. Eye-hand coordination in newborns. Developmental Psychology. 18:1982;450-461.
35. Ennouri K., Dubon K., Notides C., Bloch H. Visual control upon hand reaching movements in neonates. Infant Behavior and Development. 17:1994.