The dynamics of reinforcement social learning in networked cooperative multiagent systems

Engineering Applications of Artificial Intelligence

Volumn 58, Issue , 2017, Pages 111-122

  Hao, Jianye ^a   Huang, Dongping ^b   Cai, Yi ^b   Leung, Ho fung ^c  

^a TIANJIN UNIVERSITY   (China)

^b SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

^c CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Cooperative games; Multiagent coordination; Multiagent social learning

Indexed keywords

LEARNING ALGORITHMS; TOPOLOGY;

COOPERATIVE ENVIRONMENT; COOPERATIVE GAME; COOPERATIVE MULTIAGENT SYSTEMS; LEARNING PERFORMANCE; MULTI-AGENT COORDINATIONS; OPTIMAL COORDINATION; SOCIAL LEARNING; TOPOLOGY PARAMETERS;

MULTI AGENT SYSTEMS;

EID: 85006041139     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2016.11.008     Document Type: Article

References (32)

1. Airiau, S., Sen, S., Villatoro, D., Emergence of conventions through social learning. Auton. Agents Multi-Agent Syst. 28:5 (2014), 779–804.
2. Albert, R., Barabási, A.-L., Statistical mechanics of complex networks. Rev. Mod. Phys. 74:1 (2002), 47–97.
3. Aldosari, S.A., Moura, J.MF., 2006. Topology of sensor networks in distributed detection. In: Acoustics, Speech and Signal Processing, 2006. In: Proceedings of the 2006 IEEE International Conference on ICASSP 2006. vol. 5, IEEE, pages V–V.
4. Barabási, A.-L., Albert, R., Jeong, H., Scale-free characteristics of random networks: the topology of the world-wide web. Physica A: Stat. Mech. Appl. 281:1 (2000), 69–77.
5. Brafman, R.I., Tennenholtz, M., Efficient learning equilibrium. Artif. Intell. 159 (2004), 27–47.
6. Claus, C., Boutilier, C., 1998. The dynamics of reinforcement learning in cooperative multiagent systems. In: Proceedings of AAAI'98, 1998, pp. 746–752.
7. Fulda, N., Ventura, D., 2007. Predicting and preventing coordination problems in cooperative learning systems. In: Proceedings of IJCAI'07, 2007, pp. 780–785.
8. Hao, J.Y., Leung, H.F., 2013. The dynamics of reinforcement social learning in cooperative multiagent systems. In: IJCAI'13, AAAI Press, pp. 184–190.
9. Hao, J.Y., Leung, H.-F., Ming, Z., Multiagent reinforcement social learning toward coordination in cooperative multiagent systems. ACM Trans. Auton. Adapt. Syst. (TAAS), 9(4), 2014, 20.
10. Hao, J.Y., Huang, D.P., Cai, Y., Leung, H.-F., 2014. Reinforcement sociallearning of coordination in networked cooperative multiagent systems. In: AAAI workshop on multiagent interaction without prior coordination (MIPC 2014).
11. Hao, J.Y., Sun, J., Huang, D.P., Cai, Y., Yu, C., 2015. Heuristic collective learning for efficient and robust emergence of social norms. In: Proceedings of AAMAS'15, pp. 1647–1648.
12. Hao, J.Y., Sen, S., Yu, C., Yang, T.P., Meng, Z.P., 2016. Accelerating norm emergence through hierarchical heuristic learning. In: Proceedings of the 22nd European Conference on Artificial Intelligence (ECAI).
13. Jadbabaie, A., Molavi, P., Sandroni, A., Tahbaz-Salehi, A., Non-bayesian social learning. Games Econ. Behav. 76:1 (2012), 210–225.
14. Jhaveri, R.H., Patel, N.M., Mobile ad-hoc networking with aodv: a review. Int. J. -Gener. Comput. 6:3 (2015), 165–191.
15. Kapetanakis, S., Kudenko, D., 2002. Reinforcement learning of coordination in cooperative multiagent systems. In: Proceedings of AAAI'02, pp. 326–331.
16. Lauer, M., Riedmiller, M., 2000. An algorithm for distributed reinforcement learning in cooperative multi-agent systems. In: Proceedings of ICML'00, pp. 535–542.
17. Leonard, N.E., Shen, T., Nabet, B., Scardovi, L., Couzin, I.D., Levin, S.A., 2012. Decision versus compromise for animal groups in motion. In: Proceedings of the National Academy of Sciences, pp. 227–232.
18. Matignon, L., Laurent, G.J., Le Fort-Piat, N., 2007. Hysteretic q-learning: an algorithm for dynamic reinforcement learning in cooperative multiagent teams. In: Proceeding of IROS'07, pp. 64–69.
19. Matignon, L., Laurent, G.J., Le For-Piat, N., 2008. A study of fmq heuristic in cooperative multi-agent games. In: AAMAS'08 workshop: MSDM, pp. 77–91.
20. Matignon, L., Laurent, G.J., Le For-Piat, N., Independent reinforcement learners in cooperative markov games: a survey regarding coordination problems. Knowl. Eng. Rev. 27 (2012), 1–31.
21. Modeling, B., Thomas, K., 2015. Reward-based Learning in Cooperative Games.
22. Panait, L., Sullivan, K., Luke, S., 2006. Lenient learners in cooperative multiagent systems. In: Proceedings of AAMAS'06, pp. 801–803.
23. Peng, Jiajie, Li, Hongxiang, Liu, Yongzhuang, Juan, Liran, Jiang, Qinghua, Wang, Yadong, Chen, Jin, Intego2: a web tool for measuring and visualizing gene semantic similarities using gene ontology. BMC Genom., 17, 2016, 530.
24. Villatoro, D., Sabater-Mir, J., Sen, S., Robust convention emergence in social networks through self-reinforcing structures dissolution. ACM Trans. Auton. Adapt. Syst., 8(1), 2013, 2.
25. Wang, X.F., Chen, G.R., Complex networks: small-world, scale-free and beyond. Circuits Syst. Mag. 3:1 (2003), 6–20.
26. Wang, X., Sandholm, T., 2002. Reinforcement learning to play an optimal nash equilibrium in team markov games. In: Proceedings of NIPS'02, pp. 1571–1578.
27. Watkins, C.J.C.H., Dayan, P.D., 1992. Q-learning. Machine Learning, pp. 279–292.
28. Yan, E., Ding, Y., Scholarly network similarities: how bibliographic coupling networks, citation networks, cocitation networks, topical networks, coauthorship networks, and coword networks relate to each other. J. Assoc. Inf. Sci. Technol. 63:7 (2012), 1313–1326.
29. Yang, T.P., Meng, Z.P., Hao, J.Y., Sen, S., Yu, C., 2016. Accelerating norm emergence through hierarchical heuristic learning. In: Proceedings of ECAI'16.
30. Yu, C., Zhang, M.J., Ren, F.H., Collective learning for the emergence of social norms in networked multiagent systems. IEEE Trans. Cybern. 44:12 (2014), 2342–2355.
31. Yu, C., Lv, H.T., Ren, F.H., Bao, H.L., Hao, J.Y., 2015. Hierarchical learning for emergence of social norms in networked multiagent systems. In: Proceedings of the AI'15: Advances in Artificial Intelligence, Springer, pp. 630–643.
32. Yu, C., Lv, H.T., Sen, S., Hao, J.Y., Ren, F.H., Liu, R., 2016. An adaptive learning framework for efficient emergence of social norms. In: Proceedings of AAMAS'16, pp. 1307–1308.