Multiagent reinforcement social learning toward coordination in cooperative multiagent systems

ACM Transactions on Autonomous and Adaptive Systems

Volumn 9, Issue 4, 2014, Pages

  Hao, Jianye ^a   Leung, Ho Fung ^b   Ming, Zhong ^c  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^c SHENZHEN UNIVERSITY   (China)

Author keywords

Cooperative games; Multiagent coordination; Multiagent social learning

Indexed keywords

GAME THEORY; LEARNING ALGORITHMS; PARETO PRINCIPLE; STOCHASTIC SYSTEMS;

AMOUNT OF INFORMATION; COMPLEX ENVIRONMENTS; COOPERATIVE ENVIRONMENT; COOPERATIVE GAME; COOPERATIVE MULTIAGENT SYSTEMS; MULTI-AGENT COORDINATIONS; MULTI-AGENT REINFORCEMENT; SOCIAL LEARNING;

MULTI AGENT SYSTEMS;

EID: 84938057635     PISSN: 15564665     EISSN: 15564703     Source Type: Journal    
DOI: 10.1145/2644819     Document Type: Article

References (26)

1. Albertus Agung and Ford Lumban Gaol. 2012. Game artificial intelligence based using reinforcement learning. Procedia Engineering 50(2012), 555-565.
2. R. I. Brafman and M. Tennenholtz. 2004. Efficient learning equilibrium. Artificial Intelligence 159(2004), 27-47.
3. Georgios C. Chasparis, Jeff S. Shamma, and Anders Rantzer. 2011. Perturbed learning automata in potential games. In Proceedings of 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC). 2453-2458.
4. C. Claus and C. Boutilier. 1998. The dynamics of reinforcement learning in cooperative multiagent systems. In Proceedings of AAAI'98. 746-752.
5. R. C. Eberhart, Y. H. Shi, and J. Kennedy. 2001. Swarm Intelligence. Elsevier.
6. I. Foster and C. Kesselman. 2003. The Grid 2: Blueprint for a New Computing Infrastructure. Morgan Kaufmann.
7. N. Fulda and D. Ventura. 2007. Predicting and preventing coordination problems in cooperative learning systems. In Proceedings of IJCAI'07. 780-785.
8. Ali Jadbabaie, Pooya Molavi, Alvaro Sandroni, and Alireza Tahbaz-Salehi. 2012. Non-Bayesian social learning. Games and Economic Behavior 76, 1(2012), 210-225.
9. Leslie Pack Kaelbling, Michael L. Littman, and Andrew W. Moore. 1996. Reinforcement learning: A survey. Artificial Intelligence Research (1996), 237-285.
10. S. Kapetanakis and D. Kudenko. 2002. Reinforcement learning of coordination in cooperative multiagent systems. In Proceedings of AAAI'02. 326-331.
11. Ratul Lahkar and Robert M. Seymour. 2013. Reinforcement learning in population games. Games and Economic Behavior 80(2013), 10-38.
12. M. Lauer and M. Riedmiller. 2000. An algorithm for distributed reinforcement learning in cooperative multiagent systems. In Proceedings of ICML'00. 535-542.
13. N. E. Leonard, T. Shen, B. Nabet, L. Scardovi, I. D. Couzin, and S. A. Levin. 2012. Decision versus compromise for animal groups in motion. In Proceedings of the National Academy of Sciences. 227-232.
14. L. Matignon, G. J. Laurent, and N. Le For-Piat. 2008. A study of FMQ heuristic in cooperative multi-agent games. In AAMAS'08 Workshop: MSDM. 77-91.
15. L. Matignon, G. J. Laurent, and N. Le For-Piat. 2012. Independent reinforcement learners in cooperative Markov games: A survey regarding coordination problems. Knowledge Engineering Review 27(2012), 1-31.
16. L. Matignon, G. J. Laurent, and N. Le Fort-Piat. 2007. Hysteretic q-learning: An algorithm for dynamic reinforcement learning in cooperative multiagent teams. In Proceedings of IROS'07. 64-69.
17. M. Mauve, J. Widmer, and H. Hartenstein. 2001. A survey on position-based routing in mobile ad hoc networks. Network, IEEE 15, 6(2001), 30-39.
18. L. Panait and S. Luke. 2005. Cooperative multi-agent learning: The state of the art. JAAMAS 11(3) (2005), 387-434.
19. L. Panait, K. Sullivan, and S. Luke. 2006. Lenient learners in cooperative multiagent systems. In Proceedings of AAMAS'06. 801-803.
20. L. Rendell, R. Boyd, D. Cownden, M. Enquist, K. Eriksson, M. W. Feldman, L. Fogarty, S. Ghirlanda, T. Lillicrap, and K. N. Laland. 2010. Why copy others? Insights from the social learning strategies tournament. Science 328(5975) (2010), 208-213.
21. S. Sen and S. Airiau. 2007. Emergence of norms through social learning. In Proceedings of IJCAI'07. 1507-1512.
22. K. Sigmund, H. D. Silva, A. Traulsen, and C. Hauert. 2010. Social learning promotes institutions for governing the commons. Nature 466(2010), 7308.
23. D. Villatoro, J. Sabater-Mir, and S. Sen. 2011. Social instruments for robust convention emergence. In Proceedings of IJCAI'11. 420-425.
24. D. Villatoro, J. Sabater-Mir, and S. Sen. 2013. Robust convention emergence in social networks through self-reinforcing structures dissolution. ACM Transactions on Autonomous and Adaptive Systems (TAAS) 8, 1(2013), 2.
25. X. Wang and T. Sandholm. 2002. Reinforcement learning to play an optimal Nash equilibrium in team Markov games. In Proceedings of NIPS'02. 1571-1578.
26. C. J. C. H. Watkins and P. D. Dayan. 1992. Q-learning. Machine Learning (1992), 279-292.