Collective learning for the emergence of social norms in networked multiagent systems

IEEE Transactions on Cybernetics

Volumn 44, Issue 12, 2014, Pages 2342-2355

  Yu, Chao ^a   Zhang, Minjie ^a   Ren, Fenghui ^a  

^a UNIVERSITY OF WOLLONGONG   (Australia)

Author keywords

Consensus; Distributed multiagent systems; Emergent behaviors; Ensemble learning; Multiagent learning; Social networks; Social norms

Indexed keywords

AGGLOMERATION; DECISION MAKING; ELECTRIC NETWORK TOPOLOGY; LEARNING SYSTEMS; MULTI AGENT SYSTEMS; SENSOR NETWORKS; SOCIAL NETWORKING (ONLINE);

CONSENSUS; DISTRIBUTED MULTIAGENT SYSTEMS; EMERGENT BEHAVIORS; ENSEMBLE LEARNING; MULTI-AGENT LEARNING; SOCIAL NORM;

NETWORKED CONTROL SYSTEMS;

ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; GAME; HUMAN; HUMAN RELATION; LEARNING; PSYCHOLOGICAL MODEL; SOCIAL BEHAVIOR; SOCIAL PSYCHOLOGY;

ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; GAME THEORY; HUMANS; INTERPERSONAL RELATIONS; LEARNING; MODELS, PSYCHOLOGICAL; SOCIAL BEHAVIOR; SOCIAL CONFORMITY;

EID: 84911927447     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2014.2306919     Document Type: Article

References (42)

1. Z. Wu, H. Fang, and Y. She, "Weighted average prediction for improving consensus performance of second-order delayed multi-agent systems," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 5, pp. 1501-1508, Oct. 2012.
2. E. Posner, Law and Social Norms. Cambridge, MA, USA: Harvard Univ. Press, 2002.
3. B. Savarimuthu, R. Arulanandam, and M. Purvis, "Aspects of active norm learning and the effect of lying on norm emergence in agent societies," in Proc. PRIMA, LNCS 7047. 2011, pp. 36-50.
4. N. Criado, E. Argente, A. Garrido, J. Gimeno, F. Igual, V. Botti, et al., "Norm enforceability in electronic institutions?" in Proc. COIN, LNCS 6541. 2011, pp. 250-267.
5. A. Artikis, M. Sergot, and J. Pitt, "Specifying norm-governed computational societies," ACM Trans. Comput. Log., vol. 10, no. 1, pp. 1-42, Jan. 2009.
6. A. Artikis, L. Kamara, J. Pitt, and M. Sergot, "A protocol for resource sharing in norm-governed ad hoc networks," Lect. Notes Comput. Sci., vol. 3476, no. 44, pp. 221-238, 2005.
7. B. Savarimuthu and S. Cranefield, "Norm creation, spreading and emergence: A survey of simulation models of norms in multi-agent systems," Multiagent Grid Syst., vol. 7, no. 1, pp. 21-54, 2011.
8. J. Delgado, "Emergence of social conventions in complex networks," Artif. Intell., vol. 141, no. 1, pp. 171-185, Oct. 2002.
9. S. Mahmoud, N. Griffiths, J. Keppens, and M. Luck, "Efficient norm emergence through experiential dynamic punishment," in Proc. 20th Eur. Conf. Artif. Intel., 2012, pp. 576-581.
10. H. Franks, N. Griffiths, and A. Jhumka, "Manipulating convention emergence using influencer agents," Auton. Agent Multi-Agent Syst., vol. 26, no. 3, pp. 315-353, May 2013.
11. S. Sen and S. Airiau, "Emergence of norms through social learning," in Proc. 20th Int. Joint Conf. Artif. Intel., 2007, pp. 1507-1512.
12. D. Villatoro, J. Sabater-Mir, and S. Sen, "Social instruments for robust convention emergence," in Proc. 22nd Int. Joint Conf. Artif. Intel., 2011, pp. 420-425.
13. Y. Shoham and M. Tennenholtz, "On the emergence of social conventions: Modeling, analysis, and simulations," Artif. Intell., vol. 94, no. 1, pp. 139-166, 1997.
14. P. Mukherjee, S. Sen, and S. Airiau, "Norm emergence under constrained interactions in diverse societies," in Proc. 7th Int. Joint Conf. Auton. Agent Multiagent Syst., 2008, pp. 779-786.
15. H. Ohtsuki, C. Hauert, E. Lieberman, and M. Nowak, "A simple rule for the evolution of cooperation on graphs and social networks," Nature, vol. 441, no. 7092, pp. 502-505, May 2006.
16. O. Sen and S. Sen, "Effects of social network topology and options on norm emergence," in Proc. COIN, LNCS 6069. 2010, pp. 211-222.
17. D. Villatoro, S. Sen, and J. Sabater-Mir, "Topology and memory effect on convention emergence," in Proc. IEEE/WIC/ACM Int. Joint Conf. Web Intel. Agent Tech., 2009, pp. 233-240.
18. R. Polikar, "Ensemble based systems in decision making," IEEE Circuits Syst. Mag., vol. 6, no. 3, pp. 21-45, Sep. 2006.
19. L. Busoniu, R. Babuska, and B. De Schutter, "A comprehensive survey of multiagent reinforcement learning," IEEE Trans. System., Man, Cybern. C, Appl. Rev., vol. 38, no. 2, pp. 156-172, Mar. 2008.
20. L. Hofmann, N. Chakraborty, and K. Sycara, "The evolution of cooperation in self-interested agent societies: A critical study," in Proc. 10th Int. Conf. Auton. Agent Multiagent Syst., 2011, pp. 685-692.
21. G. Szabo and G. Fáth, "Evolutionary games on graphs," Phys. Rep., vol. 446, nos. 4-6, pp. 97-216, Jul. 2007.
22. S. Mahmoud, N. Griffiths, and J. Keppens, "Norm emergence: Overcoming hub effects in scale free networks," in Proc. AAMAS, 2012, pp. 123-140.
23. R. Axelrod, "An evolutionary approach to norms," Amer. Polit. Sci. Rev., vol. 80, no. 4, pp. 1095-1111, Dec. 1986.
24. Y. Shoham, B. Powers, and T. Grenager, "If multi-agent learning is the answer, what is the question?" Artif. Intell., vol. 171, pp. 365-377, May 2007.
25. M. Bowling and M. Veloso, "Multiagent learning using a variable learning rate," Artif. Intell., vol. 136, pp. 215-250, Apr. 2002.
26. M. Littman and P. Stone, "A polynomial-time nash equilibrium algorithm for repeated games," Decis. Support Syst., vol. 39, no. 1, pp. 55-66, Mar. 2005.
27. C. Yu, M. Zhang, and F. Ren, "Coordinated learning by exploiting sparse interaction in multiagent systems," Concurr. Comput. Pract. Experience, vol. 26, no. 1, pp. 51-70, Jan. 2014.
28. C. Guestrin, M. Lagoudakis, and R. Parr, "Coordinated reinforcement learning," in Proc. 19th Int. Conf. Mach. Learn., 2002, pp. 227-234.
29. R. Sun and T. Peterson, "Multi-agent reinforcement learning: Weighting and partitioning," Neural Netw., vol. 12, nos. 4-5, pp. 727-753, Jun. 1999.
30. C. Watkins and P. Dayan, "Q-learning," Mach. Learn., vol. 8, no. 3, pp. 279-292, May 1992.
31. J. Jiang, "A framework for aggregation of multiple reinforcement learning algorithms," Ph.D. dissertation, Dep. Elect. Comput. Eng., Univ. Waterloo, Waterloo, ON, Canada, 2007.
32. M. Wiering and H. van Hasselt, "Ensemble algorithms in reinforcement learning," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 930-936, Aug. 2008.
33. R. Albert and A. Barabási, "Statistical mechanics of complex networks," Rev. Mod. Phys., vol. 74, pp. 47-97, Jan. 2002.
34. S. Redner, "How popular is your paper? An empirical study of the citation distribution," Eur. Phys. J. B, vol. 4, no. 2, pp. 131-134, Jul. 1998.
35. H. Young, "The economics of convention," J. Econ. Perspectives, vol. 10, no. 2, pp. 105-122, Mar. 1996.
36. L. Brooks, W. Iba, and S. Sen, "Modeling the emergence and convergence of norms," in Proc. 22nd Int. Joint Conf. Artif. Intel., 2011, pp. 97-102.
37. R. Sutton and A. Barto, Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT Press, 1998.
38. S. Faußer and F. Schwenker, "Ensemble methods for reinforcement learning with function approximation," in Proc. 10th Workshop Multi. Classifier Syst., 2011, pp. 56-65.
39. A. Hans and S. Udluft, "Ensembles of neural networks for robust reinforcement learning," in Proc. 9th Int. Conf. Mach. Learn. Appl., 2010, pp. 401-406.
40. Y. Jiang and T. Ishida, "A model for collective strategy diffusion in agent social law evolution," in Proc. 20th Int. Joint Conf. Artif. Intel., 2007, pp. 1353-1358.
41. D. Watts and S. Strogatz, "Collective dynamics of 'small-world' networks," Nature, vol. 393, no. 6684, pp. 440-442, Jun. 1998.
42. D. Fudenberg and D. Levine, The Theory of Learning in Games. Cambridge, MA, USA: MIT Press, 1998.