Frequency adjusted multi-agent Q-learning

Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

Volumn 1, Issue , 2010, Pages 309-315

  Kaisers, Michael ^a   Tuyls, Karl ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Evolutionary game theory; Multi agent learning; Q learning; Replicator dynamics

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; AUTONOMOUS AGENTS; DYNAMICAL SYSTEMS; GAME THEORY; INTELLIGENT AGENTS; MULTI AGENT SYSTEMS;

EVOLUTIONARY GAME THEORY; EVOLUTIONARY MODELS; LEARNING AGENTS; MULTI-AGENT LEARNING; MULTI-AGENT Q-LEARNING; Q-LEARNING; REPLICATOR DYNAMICS; THEORETICAL FRAMEWORK;

VIRTUAL REALITY;

EID: 84899425732     PISSN: 15488403     EISSN: 15582914     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Dan Ariely. Predictably Irrational: The Hidden Forces Thal, Shape Our Decisions. Harper Collins, February 2008.
2. Monica Babes, Michael Wunder, and Michael Littman. Q-learning in two-player two-action games. In Autonomous Learning Agents Workshop at the 8th Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS 2009), May 2009.
3. T. Borgers and R. Sarin. Learning through reinforcement and replicator dynamics. Journal of Economic Theory, 77(1), November 1997.
4. Michael Bowling. Convergence problems of general-sum multiagent reinforcement learning. In In Proceedings of the Seventeenth International Conference on Machine Learning, pages 89-94. Morgan Kaufmann, 2000.
5. Michael Bowling and Manuela Veloso. Multiagent learning using a variable learning rate. Artificial Intelligence, 136:215-250, 2002.
6. Bruce Bueno de Mesquita. Game theory, political economy, and the evolving study of war and peace. American Political Science Review, 100(4):637-642, November 2006.
7. C. M. Gintis. Game Theory Evolving. University Press, Princeton. June 2000.
8. Eduardo Gomes and Ryszard Kowalczyk. Modelling the dynamics of multiagent q-learning with f-greedy exploration (short paper). In Sierra Decker, Sichman and Castelfranchi, editors, Proc. of 8th Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS 2009), pages 1181-1182, Budapest, Hungary, May 10-15, 2009.
9. Morris W. Hirsch, Stephen Smale, and Robert Dcvaney. Differential Equations, Dynamical Systems, and an Introduction to Chaos. Academic Press, 2002.
10. Josef Hofbauer and Karl Sigmund. Evolutionary Games and Population Dynamics. Cambridge University Press, 2002.
11. Shlomit Hon-Snir, Dov Monderer, and Aner Sela. A learning approach to auctions. Journal of Economic Theory. 82:65-88, November 1998.
12. Michael Kaisers, Karl Tuyls, Simon Parsons, and Frank Thuijsman. An evolutionary model of multi-agent learning with a varying exploration rate. In AAMAS '09: Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems, pages 1255-1256, Richland, SC, 2009. International Foundation for Autonomous Agents and Multiagent Systems.
13. J. Maynard-Smith. Evolution and the Theory of Games. Cambridge University Press. December 1982.
14. Shervin Nouyan, Roderich Groß, Michael Bonani. Francesco Mondada, and Marco Dorigo. Teamwork in self-organized robot colonies. Transactions on Evolutionary Computation, 13(4):695-711, August 2009.
15. L. Panait and S. Luke. Cooperative multi-agent learning: The state of the art. Autonomous Agents and Multi-Agent Systems, 11(3):387-434, November 2005.
16. S. Phelps. M. Marcinkiewicz, and S. Parsons. A novel method for automatic strategy acquisition in n-player non-zero-sum games. In AAMAS '06: Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems, pages 705-712, Hakodate, Japan, 2006. ACM.
17. Y. Shoham, R. Powers, and T. Grenager. If multi-agent learning is the answer, what is the question? Artificial Intelligence, 171(7):365-377, 2007.
18. R. Sutton and A. Barto. Reinforcement Learning: An introduction. MA: MIT Press. Cambridge, 1998.
19. P. D. Taylor and L. Jonker. Evolutionarily stable strategies and game dynamics. Mathematical Biosciences, 40:145-156, 1978.
20. K. Tuyls and S. Parsons. What evolutionary game theory tells us about multiagent learning. Artificial Intelligence, 171(7):406-416, 2007.
21. K. Tuyls, P. J. 't Hoen, and B. Vaiischoenwinkcl. An evolutionary dynamical analysis of multi-agent learning in iterated games. Autonomous Agents and Multi-Agent Systems, 12:115-153, 2005.
22. Karl Tuyls, Katja Verbeeck, and Tom Lenaerts. A selection-mutation model for q-learning in multi-agent systems. In AAMAS '03: Proceedings of the second international joint conference on Autonomous agents and multiagent systems, pages 693-700. New York, NY, USA, 2003. ACM.
23. C. J. C. H. Watkins and P. Dayan. Q-learning. Machine Learning, 8(3):279-292, 1992.