Emergence of conventions through social learning: Heterogeneous learners in complex networks

Autonomous Agents and Multi-Agent Systems

Volumn 28, Issue 5, 2014, Pages 779-804

  Airiau, Stéphane ^a   Sen, Sandip ^b   Villatoro, Daniel ^c  

^a UNIVERSITÉ PARIS DAUPHINE   (France)

^b UNIVERSITY OF TULSA   (United States)

^c ARTIFICIAL INTELLIGENCE RESEARCH INSTITUTE IIIA CSIC   (Spain)

Author keywords

Conventions; Emergence; Norms

Indexed keywords

ELECTRIC NETWORK TOPOLOGY; MULTI AGENT SYSTEMS;

CONVENTIONS; EMERGENCE; INTERACTING AGENTS; LEARNING MECHANISM; MULTI-AGENT LEARNING; NORMS; POPULATION SIZES; SCALE FREE NETWORKS;

POPULATION STATISTICS;

EID: 84901658379     PISSN: 13872532     EISSN: 15737454     Source Type: Journal    
DOI: 10.1007/s10458-013-9237-x     Document Type: Article

References (46)

1. Airiau, S., Saha, S., & Sen, S. (2007). Evolutionary tournament-based comparison of learning and non-learning algorithms for iterated games. Journal of Artificial Societies and Social Simulation, 10(3), 1-7.
2. Axelrod, R. (1986). An evolutionary approach to norms. The American Political Science Review, 80(4), 1095-1111.
3. Axelrod, R. (1997). The complexity of cooperation: Agent-based models of conflict and cooperation. Princeton, NJ: Princeton University Press.
4. Banerjee, D., & Sen, S. (2007). Reaching pareto-optimality in prisoner's dilemma using conditional joint action learning. Autonomous Agents and Multi-Agent Systems, 15, 91-108.
5. Barabási, A., & Albert, R. (1999). Emergence of scaling in random networks. Science, 286, 509-512.
6. Boella, G., & Lesmo, L. (2002). A game theoretic approach to norms and agents. Cognitive Science Quarterly, 2(2-3), 492-512.
7. Boella, G., & van der Torre, L. (2003). Norm governed multiagent systems: The delegation of control to autonomous agents. In IAT '03: Proceedings of the IEEE/WIC International Conference on Intelligent Agent Technology (p. 329). Washington, DC, USA: IEEE Computer Society.
8. Bowling, M. (2005). Convergence and no-regret in multiagent learning. Advances in Neural Information Processing Systems, 17, 209-216.
9. Bowling, M. H., & Veloso, M. M. (2002). Multiagent learning using a variable learning rate. Artificial Intelligence, 136(2), 215-250.
10. Coleman, J. S. (1998). Foundations of social theory. Cambridge, MA: Harvard University Press.
11. Crandall, J. W., & Goodrich, M. A. (2005). Learning to compete, compromise, and cooperate in repeated general-sum games. In Proceedings of the 22nd International Conference on, Machine Learning (pp. 161-168).
12. Delgado, J. (2002). Emergence of social conventions in complex networks. Artificial Intelligence, 141(1-2), 171-185.
13. Dignum, F., Kinny, D., & Sonenberg, L. (2002). From desires, obligations and norms to goals. Cognitive Science Quarterly, 2(3-4), 407-430.
14. Epstein, J. M. (2001). Learning to be thoughtless: Social norms and individual computation. Computational Economics, 18(1), 9-24.
15. Fudenberg, D., & Levine, D. K. (1998). The theory of learning in games. Cambridge, MA: MIT Press.
16. García-Camino, A., Rodríguez-Aguilar, J. A., Sierra, C., & Vasconcelos, W. (2006). A rule-based approach to norm-oriented programming of electronic institutions. SIGecom Exchanges, 5(5), 33-40.
17. Genesereth, M. R., Ginsberg, M. L., & Rosenschein, J. S. (1988). Cooperation without communication. Distributed Artificial Intelligence, 220-226.
18. Hales, D., & Arteconi, S. (2006). Slacer: A self-organizing protocol for coordination in p2p networks. IEEE Intelligent Systems, 21(29), 35.
19. Kandori, M., & Rob, R. (1995). Evolution of equilibria in the long run: A general theory and applications. Journal of Economic Theory, 65(2), 383-414.
20. Kittock, J. E. (1995). Emergent conventions and the structure of multi-agent systems. In Proceedings of the 1993 Santa Fe Institute Complex Systems Summer School. Santa Fe Institute Studies in the Sciences of Complexity Lecture. Santa Fe Institute.
21. Lakkaraju, K., & Gasser, L. (2006). Population and agent based models for language convergence. In Proceedings of the 21st National Conference on Artificial Intelligence, AAAI'06 (Vol. 2, pp. 1887-1888). Menlo Park: AAAI Press.
22. Lewis, D. K. (1969). Convention: A philosophical study. Cambridge, MA: Harvard University Press.
23. Montanari, A., & Saberi, A. (2010). The spread of innovations in social networks. Proceedings of the National Academy of Sciences, 107(47), 20196-20201.
24. Mukherjee, P., Airiau, S., & Sen, S. (2008). Norm emergence under constrained interactions in diverse societies. In Proceedings of the Seventh International Conference on Autonomous Agents and Multiagent Systems (AAMAS-08) (pp. 779-786). Estoril, Portugal.
25. Myerson, R. B. (1991). Game theory: Analysis of conflict. Cambridge, MA: Harvard University Press.
26. Nowak, M. A., & May, R. M. (1992). Evolutionary games and spatial chaos. Nature, 359, 826-829.
27. Nudelman, E., Wortman, J., Shoham, Y., & Leyton-Brown, K. (2004). Run the gamut: A comprehensive approach to evaluating game-theoretic algorithms. In S. A (Ed.), Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS '04) (pp. 880-887). Washington, DC, USA: IEEE Computer Society.
28. Panait, L., & Luke, S. (2005). Cooperative multi-agent learning: The state of the art. Autonomous Agents and Multi-Agent Systems, 11(3), 387-434.
29. Powers, R., Shoham, Y., & Vu, T. (2007). A general criterion and an algorithmic framework for learning in multi-agent systems. Machine Learning, 67(1-2), 45-76.
30. Schelling, T. C. (1960). The strategy of conflict. Cambridge, MA: Harvard University Press.
31. Schweitzer, F., Zimmermann, J., & Mühlenbein, H. (2002). Coordination of decisions in a spatial agent model. Physica A, 303(1-2), 189-216.
32. Sen, S., & Airiau, S. (2007). Emergence of norms through social learning. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence (IJCAI'07) (pp. 1057-1512).
33. Shoham, Y., & Tennenholtz, M. (1997). On the emergence of social conventions: Modeling, analysis, and simulations. Artificial Intelligence, 94(1-2), 139-166.
34. Tinnemeier, N., Dastani, M., & Meyer, J.-J. (2010). Programming norm change. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS '10) (Vol. 1, pp. 957-964). Richland, SC: International Foundation for Autonomous Agents and Multiagent Systems.
35. Tuyls, K., & Nowé, A. (2005). Evolutionary game theory and multi-agent reinforcement learning. Knowledge Engineering Review, 20(1), 63-90.
36. Urbano, P., Balsa, J., Antunes, L., & Moniz, L. (2009). Force versus majority: A comparison in convention emergence efficiency. In Coordination, Organizations, Institutions and Norms in Agent Systems IV: COIN 2008 International Workshops, COIN@AAMAS 2008, Estoril, Portugal, May 12, 2008 (pp. 48-63). Berlin: Springer.
37. Vázquez-Salceda, J., Aldewereld, H., & Dignum, F. P. M. (2005). Norms in multiagent systems: From theory to practice. International Journal of Computer Systems Science & Engineering, 20(4), 225- 236.
38. Verhagen, H. (2001). Simulation of the learning of norms. Social Science Computer Review, 19(3), 296-306.
39. Villatoro, D., Sen, S., & Sabater-Mir, J. (2009). Topology and memory effect on convention emergence. In S. A (Ed.), Proceedings of the International Conference of Intelligent Agent Technology (IAT). Hoboken, NJ: IEEE Press.
40. Villatoro, D., Sen, S., & Sabater-Mir, J. (2010). Of social norms and sanctioning: A game theoretical overview. International Journal of Agent Technologies and Systems, 2, 1-15.
41. Vu, T., Powers, R., & Shoham, Y. (2006). Learning against multiple opponents. In AAMAS '06: Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems (pp. 752-759). New York, NY, USA: ACM.
42. Walker, A., & Wooldridge, M. (1995). Understanding the emergence of conventions in multi-agent systems. In Proceedings of the First International Conference on Multi-Agent Systems (ICMAS95) (pp. 384-389). San Francisco.
43. Watkins, C. J. C. H., & Dayan, P. (1992). Q-learning. Machine Learning, 8(3-4), 279-292.
44. Wolpert, D. H., & Tumer, K. (2002). Collective intelligence, data routing and Braess' paradox. Journal of Artificial Intelligence Research, 16, 359-387.
45. Young, P. H. (1993). The evolution of conventions. Econometrica, 61(1), 57-84.
46. Young, P. H. (1996). The economics of convention. The Journal of Economic Perspectives, 10(2), 105-122.