Exploring selfish reinforcement learning in repeated games with stochastic rewards

Autonomous Agents and Multi-Agent Systems

Volumn 14, Issue 3, 2007, Pages 239-269

  Verbeeck, Katja ^a   Nowé, Ann ^a   Parent, Johan ^a   Tuyls, Karl ^b  

^a VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

^b MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Learning automata; Multi agent reinforcement learning; Non zero sum games

Indexed keywords

EID: 34247642270     PISSN: 13872532     EISSN: 15737454     Source Type: Journal    
DOI: 10.1007/s10458-006-9007-0     Document Type: Article

References (26)

1. Aumann, R. (1974). Subjectivity and correlation in randomized strategies. Journal of Mathematical Economics, 1, 67-96.
2. Brafman, R., & Tennenholtz, M. (2003). Learning to coordinate efficiently: A model-based approach. Journal on Artificial Intelligence Research (JAIR), 19, 11-23.
3. Carpenter, M., & Kudenko, D. (2004). Baselines for joint-action reinforcement learning of coordination in cooperative multi-agent systems. In Proceedings of the 4th symposium on adaptive agents and multi-agent systems, (AISB04) Society for the study of Artificial Intelligence and Simulation of Behaviour (pp. 10-19).
4. Claus, C., & Boutilier, C. (1998). The dynamics of reinforcement learning in cooperative multiagent systems. In Proceedings of the 15th national conference on artificial intelligence (pp. 746-752).
5. Geist, A., & Beguelin, A. (1994). PVM: Parallel virtual machine. MIT Press.
6. Gintis, H. (2000). Game theory evolving: A problem-centered introduction to modeling strategic behavior. Princeton, New Jersey: Princeton University Press.
7. Greenwald, A., & Hall, K. (2003). Correlated q-learning. In Proceedings of the twentieth international conference on machine learning (pp. 242-249).
8. Hu, J., & Wellman, M. (2003). Nash q-learning for general-sum stochastic games. Journal of Machine Learning Research, 4, 1039-1069.
9. Kapetanakis, S., & Kudenko, D. (2002). Reinforcement learning of coordination in cooperative multi-agent systems. In Proceedings of the 18th national conference on artificial intelligence (pp. 326-331).
10. Kapetanakis, S., Kudenko, D., & Strens, M. (2003). Learning to coordinate using commitment sequences in cooperative multi-agent systems. In Proceedings of the 3rd symposium on adaptive agents and multi-agent systems, (AISB03) Society for the study of Artificial Intelligence and Simulation of Behaviour.
11. Lauer, M., & Riedmiller, M. (2000). An algorithm for distributed reinforcement learning in cooperative multi-agent systems. In Proceedings of the 17th international conference on machine learning (pp. 535-542).
12. Littman, M. (1994). Markov games as a framework for multi-agent reinforcement learning. In Proceedings of the 11th international conference on machine learning (pp. 322-328).
13. Littman, M. (2001). Friend-or-foe q-learning in general-sum games. In Proceedings of the 18th international conference on machine learning (pp. 157-163).
14. Littman, M., & Szepesvári, C. (1996). A generalized reinforcement-learning model: Convergence and applications. In Proceedings of the 13th international conference on machine learning (pp. 310-318).
15. Narendra, K., & Thathachar, M. (1989). Learning automata: An introduction. Prentice-Hall International, Inc.
16. Nash, J. (1950). Equilibrium points in n-person games. Proceedings of the national academy of siences 36, 48-49.
17. Nowé, A., Parent, J., & Verbeeck, K. (2001). Social agents playing a periodical policy. In Proceedings of the 12th European conference on machine learning pp. 382-393. Freiburg, Germany: Springer-Verlag LNAI2168.
18. Osborne, J., & Rubinstein, A. (1994). A course in game theory. Cambridge, MA: MIT Press.
19. Samuelson, L. (1997). Evolutionary games and equilibrium selection. Cambridge, MA: MIT Press.
20. Sastry, P., Phansalkar, V., & Thathachar, M. (1994). Decentralized learning of nash equilibria in multi-person stochastic games with incomplete information. IEEE Transactions on Systems, Man, and Cybernetics, 24(5), 769-777.
21. Sutton, R., & Barto, A. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
22. Thathachar, M., & Sastry, P. (2002). Varieties of learning automata: An overview. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 32(6), 711-722.
23. Tsitsiklis, J. (1994). Asynchronous stochastic approximation and q-learning. Machine Learning, 16, 185-202.
24. Tuyls, K. (2004). Multiagent reinforcement learning: A game theoretic approach. PhD Thesis, Computational Modeling Lab, Vrije Universiteit Brussel, Belgium.
25. Verbeeck, K. (2004). Coordinated exploration in multi-agent reinforcement learning. PhD Thesis, Computational Modeling Lab, Vrije Universiteit Brussel, Belgium.
26. Verbeeck, K., Nowé, A., & Parent, J. (2002). Homo egualis reinforcement learning agents for load balancing. In Proceedings of the 1st NASA workshop on radical agent concepts, pp. 81-91. Springer-Verlag LNAI 2564.