Analyzing multi-agent reinforcement learning using evolutionary dynamics

Lecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science)

Volumn 3201, Issue , 2004, Pages 168-179

  'T Hoen, Pieter Jan ^a   Tuyls, Karl ^b  

^a CWI   (Netherlands)

^b VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; DYNAMICS; ERROR ANALYSIS; GAME THEORY; MULTI AGENT SYSTEMS; RANDOM PROCESSES; ARTIFICIAL INTELLIGENCE; BEHAVIORAL RESEARCH; INTELLIGENT AGENTS; LEARNING ALGORITHMS; LEARNING SYSTEMS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

EVOLUTIONARY DYNAMICS; REINFORCEMENT LEARNING (RL); REPLICATOR DYNAMICS (RD); STOCHASTIC GAMES;

LEARNING SYSTEMS; REINFORCEMENT LEARNING;

CO-OPERATIVE BEHAVIORS; COLLECTIVE INTELLIGENCES; COOPERATIVE TASKS; EVOLUTIONARY DYNAMICS; EVOLUTIONARY STABLE STRATEGIES; MULTI-AGENT REINFORCEMENT LEARNING; NASH EQUILIBRIUM; STOCHASTIC GAME;

EID: 22944478374     PISSN: 03029743     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. B. Banerjee and J. Peng. Adaptive policy gradient in multiagent learning. In AAMAS, 2003.
2. A. Barto and S. Mahadevan. Recent advances in hierarchical reinforcement learning. Discrete-Event Systems journal, Special issue on Reinforcement Learning, 13:41-77, 2003.
3. R. Becker, S. Zilberstein, V. Lesser, and C. V. Goldman. Transition-independent decentralized Markov decision problems. In AAMAS, 2003.
4. C. Claus and G. Boutilier. The dynamics of reinforcement learning in cooperative multiagent systems. In AAAI/IAAI, pages 746-752, 1998.
5. C. Gintis. Game Theory Evolving. Princeton University Press, 2000.
6. T. Grenager, R. Powers, and Y. Shoham. Dispersion games: general definitions and some specific learning results. In AAAI 2002, 2002.
7. C. Guestrin, D. Koller, C. Gearhart, and N. Kanodia. Generalizing plans to new environments in relational MDPs. In International Joint Conference on Artificial Intelligence (IJCAI-03), 2003.
8. J. Hofbauer and K. Sigmund. Evolutionary Games and Population Dynamics. Cambridge University Press, 1998.
9. P. Huang and K. Sycara. Multi-agent learning in extensive games with complete information. In AAMAS, 2003.
10. H. Jung and M. Tambe. Performance model for large scale multiagent systems. In AAMAS, 2003.
11. M. Lauer and M. Riedmiller. An algorithm for distributed reinforcement learning in cooperative multi-agent systems. In Proc. 17th International Conf. on Machine Learning, pages 535-542. Morgan Kaufmann, San Francisco, CA, 2000.
12. M. Osborne and A. Rubinstein. A Course in Game Theory. The MIT Press, Cambridge, MA, 1994.
13. L. Samuelson. Evolutionary Games and Equilibrium Selection. MIT Press, Cambridge, MA, 1997.
14. T. Schneider. Evolution of biological information. journal of NAR, volume 28, pages 2794 - 2799., 2000.
15. D. Stauffer. Life, love and death: Models of biological reproduction and aging. Institute for Theoretical physics, Köln, Euroland, 1999.
16. R. Sutton and A. Barto. Reinforcement learning: An introduction. MIT-press, Cambridge, MA, 1998.
17. P. 't Hoen and S. Bohte. COllective INtelligence with sequences of actions. In 14th European Conference on Machine Learning, Lecture Notes in Artificial Intelligence, LNAI 2837. Springer, 2003.
18. P. 't Hoen and S. Bohte. COllective INtelligence with task assignment. In Proceedings of CDOCS03, fortcoming. Also available as TR, Lecture Notes in Artificial Intelligence. Springer, 2003.
19. K. Tumer and D. Wolpert. COllective INtelligence and Braess' paradox. In Proceedings of the Sixteenth National Conference on Artificial Intelligence, pages 104-109, Austin, Aug. 2000.
20. K. Tuyls, D. Heytens, A. Nowe, and B. Manderick. Extended replicator dynamics as a key to reinforcement learning in multi-agent systems. In ECML, Lecture Notes in Artificial Intelligence, LNAI 2837, 2003.
21. K. Tuyls, K. Verbeeck, and T. Lenaerts. A selection-mutation model for Q-learning in multi-agent systems. In AAMAS, The ACM International Conference Proceedings Series, 2003.
22. Watkins and Dayan. Q-learning. Machine Learning, 8:279-292, 1992.
23. J. Weibull. Evolutionary Game Theory. The MIT Press, Cambridge, 1995.
24. D. Wolpert and K. Tumer. Optimal payoff functions for members of collectives. Advances in Complex Systems, 4(2/3):265-279, 2001.
25. D. H. Wolpert, K. Turner, and J. Frank. Using collective intelligence to route internet traffic. In Advances in Neural Information Processing Systems-11, pages 952-958, Denver, 1998.
26. D. H. Wolpert, K. R. Wheeler, and K. Turner. General principles of learning-based multi-agent systems. In O. Etzioni, J. P. Müller, and J. M. Bradshaw, editors, Proceedings of the Third Annual Conference on Autonomous Agents (AGENTS-99), pages 77-83, New York, May 1-5 1999. ACM Press.