Evolutionary game theory and multi-agent reinforcement learning

Knowledge Engineering Review

Volumn 20, Issue 1, 2005, Pages 63-90

  Tuyls, Karl ^a   Nowé, Ann ^b  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

EVOLUTIONARY ALGORITHMS; LEARNING SYSTEMS; MULTI AGENT SYSTEMS;

EVOLUTIONARY GAME THEORY; REINFORCEMENT LEARNING;

GAME THEORY;

EID: 28544446213     PISSN: 02698889     EISSN: 14698005     Source Type: Journal    
DOI: 10.1017/S026988890500041X     Document Type: Article

References (61)

1. Anderson, CW, 1987, Strategy Learning with multilayer connectionist representations. In Proceedings of the 4th International Conference on Machine Learning, pp. 103-114.
2. Barto, A, Sutton, R and Anderson, C, 1983, Neuron-like adaptive elements that can solve difficult learning control problems. IEEE Transactions on Systems, Man and Cybernetics 13(5), 834-846.
3. Bazzan, ALC and Klugl, F, 2003, Learning to behave socially and avoid the Braess paradox in a commuting scenario. In Proceedings of the 1st International Workshop on Evolutionary Game Theory for Learning in MAS, Melbourne Australia, 14 July 2003.
4. Bazzan, ALC, 1997, A game-theoretic approach to coordination of traffic signal agents. PhD thesis. University of Karlsruhe.
5. Bellman, RE and Dreyfuss SE, 1962, Applied Dynamical Programming. Princeton, NJ: Princeton University Press.
6. Bertsekas, DP, 1976, Dynamic Programming and Stochastic Control (Mathematics in Science and Engineering, 125). Reading, MA: Academic Press.
7. Bjornerstedt, J and Weibull, J, 1995, Nash equilibrium and evolution by imitation. In Arrow, K et al. (ed.). The Rational Foundations of Economic Behavior. London: MacMillan.
8. Borgers, T and Sarin, R, 1997, Learning through reinforcement and replicator dynamics. Journal of Economic Theory 77(1), November.
9. Bush, RR and Mosteller, F, 1955, Stochastic Models for Learning. New York: Wiley.
10. Cassandra, AR, Kaelbling, LP. and Littman, ML, 1994, Acting optimally in partially observable stochastic domains. In Proceedings of the 12th National Conference on Artificial Intelligence, Seattle, WA.
11. Claus, C and Boutilier, C, 1998, The dynamics of reinforcement learning in cooperative multi-agent systems. In Proceedings of the 15th International Conference on Artificial Intelligence, pp. 746-752.
12. Gintis, CM, 2000, Game Theory Evolving. Princeton, NJ: Princeton University Press.
13. Grenager, T, Powers, R and Shoham, Y, 2002, Dispersion Games: General Definitions and Some Specific Learning Results. Menlo Park, CA: AAAI Press.
14. Hirsch, MW and Smale, S, 1974, Differential Equations, Dynamical Systems and Linear Algebra. Reading, MA: Academic Press.
15. Hoen, PJ and Tuyls, K, 2004, Engineering multi-agent reinforcement learning using evolutionary dynamics. In Proceedings of the 15th European Conference on Machine Learning (ECML'04) (Lecture Notes in Artificial Intelligence, 3201), Pisa, Italy, 20-24 September 2004. Berlin: Springer.
16. Hofbauer, J and Sigmund, K, 1998, Evolutionary Games and Population Dynamics. Cambridge: Cambridge University Press.
17. Hu, J and Welhnan, MO, 1999, Multiagent Reinforcement Learning in Stochastic Games. Cambridge: Cambridge University Press.
18. Jafari, C, Greenwald, A, Gondek, D and Ercal, G, 2001, On no-regret learning, fictitious play, and Nash equilibrium. In Proceedings of the 18th International Conference on Machine Learning, pp. 223-226.
19. Kaelbling, LP, Littman, ML and Moore, AW, Reinforcement learning: a survey. Journal of Artificial Intelligence Research.
20. Kapetanakis, S and Kudenko, D, 2002, Reinforcement Learning of Coordination in Cooperative Multi-agent Systems. Menlo Park, CA: AAAI Press.
21. Kapetanakis, S, 2004, Independent learning of coordination in cooperative single-stage games. PhD dissertation, University of York.
22. Kononen, V, 2004, Multiagent reinforcement learning in Markov games: asymmetric and symmetric approaches. PhD dissertation, Helsinki University of Technology.
23. Lauer, M and Riedmiller, M, 2000, An algorithm for distributed reinforcement learning in cooperative multi-agent systems. In Proceedings of the 17th International Conference on Machine Learning.
24. Littman, ML, 1994, Markov games as a framework for multi-agent reinforcement learning. In Proceedings of the 11th International Conference on Machine Learning, pp. 157-163.
25. Loch, J and Singh, S, 1998, Using eligibility traces to find the best memoryless policy in a partially observable Markov process. In Proceedings of the 15th International Conference on Machine Learning, San Francisco, CA.
26. Maynard-Smith, J, 1982, Evolution and the Theory of Games. Cambridge: Cambridge University Press.
27. Maynard Smith, J and Price, GR, 1973, The logic of animal conflict. Nature 146, 15-18.
28. Mukherjee, R and Sen, S, 2001, Towards a Pareto optimal solution in general-sum games. Working Notes of the 5th Conference on Autonomous Agents, pp. 21-28.
29. Narendra, K and Thathacher, M, 1974, Learning automata: a survey. IEEE Transactions on Systems, Man, and Cybernetics 14, 323-334.
30. Narendra, K and Thathacher, M, 1989, Learning Automata: An Introduction. Englewood Cliffs, NJ: Prentice-Hall.
31. Nowé, A, Parent, J and Verbeeck, K, 2001, Social agents playing a periodical policy. In Proceedings of the 12th European Conference on Machine Learning, pp. 382-393.
32. Nowé, A and Verbeeck, K, 1999, Distributed reinforcement learning, loadbased routing a case study. Notes of the Neural, Symbolic and Reinforcement Methods for Sequence Learning Workshop at IJCAI99, Stockholm, Sweden.
33. von Neumann, J and Morgenstern, O, 1944, Theory of Games and Economic Behaviour. Princeton, NJ: Princeton University Press.
34. Osborne JO and Rubinstein, A, 1994, A Course in Game Theory. Cambridge, MA: MIT Press.
35. Maarten, P, 2003, A Study of Reinforcement Learning Techniques for Cooperative Multi-agent Systems. Computational Modeling Lab, Vrije Universiteit Brussel.
36. Pendrith MD and McGarity MJ, 1998, An analysis of direct reinforcement learning in non-Markovian domains. In Proceedings of the 15th International Conference on Machine Learning, San Francisco, CA.
37. Perkins TJ and Pendrith MD, 2002, On the existence of fixed points for Q-learning and Sarsa in partially observable domains. In Proceedings of the International Conference on Machine Learning (ICML02).
38. Redondo, FV, 2001, Game Theory and Economics. Cambridge: Cambridge University Press.
39. Samuelson, L, 1997, Evolutionary Games and Equilibrium Selection. Cambridge, MA: MIT Press.
40. Schneider, TD, 2000, Evolution of biological information. Journal of Nucleic Acids Research 28, 2794-2799.
41. Stauffer, D, 1999, Life, Love and Death: Models of Biological Reproduction and Aging. Institute for Theoretical Physics, Köln, Euroland.
42. Steenhaut, K, Nowé, A, Fakir, M and Dirkx, E, 1997, Towards a hardware implementation of reinforcement learning for call admission control in networks for integrated services. In Proceedings of the International Workshop on Applications of Neural Networks and other Intelligent Techniques to Telecommunications, 3, Melbourne.
43. Sutton, RS, 1988, Learning to predict by the methods of temporal differences. Machine Learning, vol. 3. Boston, MA: Kluwer Academic, pp. 9-44.
44. Sutton, RS and Barto, AG, 1998, Reinforcement Learning: An introduction. Cambridge, MA: MIT Press.
45. Stone P, 2000, Layered Learning in Multi-agent Systems. Cambridge, MA: MIT Press.
46. Thathacher, MAL and Sastry, PS, 2002, Varieties of learning automata: an overview. IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics 32(6).
47. Tsetlin, ML, 1962, On the behavior of finite automata in random media. Automation and Remote Control 22, 1210-1219.
48. Tsetlin, ML, 1973, Theory and Modeling of Biological Systems. New York: Academic.
49. Tsitsiklis, JN, 1993, Asynchronous stochastic approximation and Q-learning. Internal Report, Laboratory for Information and Decision Systems and the Operation Research Center, MIT, Cambridge, MA.
50. Tuyls, K, Lenaerts, T, Verbeeck, K, Maes, S and Manderick, B, 2002, Towards a relation between learning agents and evolutionary dynamics. In Proceedings of the Belgium-Netherlands Artificial Intelligence Conference 2002 (BNAIC). Belgium: KU Leuven.
51. Tuyls, K, Verbeeck, K and Maes, S, On a dynamical analysis of reinforcement learning in games: emergence of Occam's Razor. Multi-agent Systems and Applications III (Central and Eastern European conference on Multi- Agent Systems 2003), Prague, 16-18 June 2003, Czech Republic (Lecture Notes in Artificial Intelligence, 2691). Berlin, Springer.
52. Tuyls, K, Verbeeck, K and Lenaerts, T, 2003, A selection-mutation model for Q-leaming in multi-agent systems. In The ACM International Conference Proceedings Series, Autonomous Agents and Multi-agent Systems 2003, Melbourne, Australia 14-18 July 2003. New York: ACM Press.
53. Tuyls, K, Heytens, D, Nowé, A and Manderick, B, 2003, Extended replicator dynamics as a key to reinforcement learning in multi-agent systems. In Proceedings of the European Conference on Machine Learning '03 (Lecture Notes in Artificial Intelligence), Cavtat-Dubrovnik, Croatia 22-26 September 2003. Berlin: Springer.
54. Verbeeck, K, Nowé, A, Lenaerts, T and Parent, J, 2002, Learning to reach the Pareto optimal Nash equilibrium as a team. In Proceedings of the 15th Australian Joint Conference on Artificial Intelligence (Lecture Notes in Artificial Intelligence, 2557). Berlin: Springer, pp. 407-418.
55. Watkins, C and Dayan, P, 1992, Q-learning. Machine Learning 8(3). 279-292.
56. Weibull, JW, Evolutionary Game Theory. Cambridge, MA: MIT Press.
57. Weibull, JW, 1998, What we have learned from evolutionary game theory so far? Stockhohn School of Economics and I.U.I, 7 May 1998.
58. Weiss, G, 1999, In Weiss, G (ed.), Multiagent Systems. A Modern Approach to Distributed Artificial Intelligence. Cambridge, MA: MIT Press.
59. Wolpert, DH, Turner, K and Frank, J, 1998, Using collective intelligence to route internet traffic. Advances in Neural Information Processing Systems, Denver, CO, 1998, pp. 952-958.
60. Wolpert, DH, Wheller, KR and Tumer, K, 1999, General principles of learning-based multi-agent systems. In Proceedings of the 3rd International Conference on Autonomous Agents (Agents'99), Seattle, W A. New York: ACM Press.
61. Wooldridge, M, 2002, An Introduction to MultiAgent Systems. Chichester: Wiley.