Techniques to understand computer simulations: Markov chain analysis

JASSS

Volumn 12, Issue 1, 2009, Pages

  Izquierdo, Luis R ^a   Izquierdo, Segismundo S ^a   Galán, José Manuel ^a   Santos, José Ignacio ^a  

^a NONE

Author keywords

Analysis; Computer Modelling; Markov; Re Implementation; Simulation; Stochastic Processes

Indexed keywords

EID: 62549103780     PISSN: 14607425     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (82)

1. AMENGUAL, P and Toral, R (2006) Truels, or Survival of the Weakest. Computing in Science and Engineering 8(5), pp. 88-95.
2. ARTHUR, W B (1989) Competing technologies, increasing returns, and lock-in by historical events. Economic Journal 99(394), pp. 116-131.
3. AXELROD, R (1984). The Evolution of Cooperation. New York, Basic Books USA.
4. AXELROD, R (1986) An Evolutionary Approach to Norms. American Political Science Review 80(4), pp. 1095-1111.
5. AXELROD, R (1997) The dissemination of culture: A model with local convergence and global polarization. Journal of Conflict Resolution 41(2), pp. 203-226.
6. AXELROD, R and Bennett, D S (1993) A Landscape Theory of Aggregation. British Journal of Political Science 23(2), pp. 211-233.
7. AXELROD, R and Hamilton, W D (1981) The evolution of cooperation. Science 211(4489), pp. 1390-1396.
8. AXELROD, R M, Mitchell, W, Thomas, R E, Bennett, D S and Bruderer, E (1995) Coalition Formation in Standard-Setting Alliances. Management Science 41(9), pp. 1493-1508.
9. AXTELL, R (2000). Why agents? On the varied motivations for agent computing in the social sciences. In Macal, C M and Sallach, D (eds.), Proceedings of the Workshop on Agent Simulation: Applications, Models, and Tools : 3-24. Argonne, IL, Argonne National Laboratory.
10. AYDINONAT, N E (2007) Models, conjectures and exploration: An analysis of Schelling's checkerboard model of residential segregation. Journal of Economic Methodology 14(4), pp. 429-454.
11. BALZER, W, Brendel, K R and Hofmann S (2001) Bad Arguments in the Comparison of Game Theory and Simulation in Social Studies. Journal of Artificial Societies and Social Simulation 4(2) 1. http://jasss.soc.surreyac.uk/4/2/1.html
12. BENENSON, I and Torrens, P M (2004). Geosimulation: automata-based modeling of urban phenomena. Chichester, UK, John Wiley and Sons.
13. BHAVNANI, R (2003) Adaptive agents political institutions and Civic Traditions in Modern Italy. Journal of Artificial Societies and Social Simulation 6(4) 1. http://jasss.soc.surreyac.uk/6/4/1.html
14. BÖHM, C and Jacopini, G (1966) Flow diagrams, turing machines and languages with only two formation rules. Communications of the ACM 9(5), pp. 366-371.
15. BUZING, P, Eiben, A and Schut, M (2005) Emerging communication and cooperation in evolving agent societies. Journal of Artificial Societies and Social Simulation 8(1) 2. http://jasss.soc.surreyac.uk/8/1/2.html
16. CASTELLANO, C, Marsili, M and Vespignani, A (2000) Nonequilibrium phase transition in a model for social influence. Physical Review Letters 85(16), pp. 3536-3539.
17. CENTOLA, D, González-Avella, J C, Eguíluz, V M and San Miguel, M (2007) Homophily Cultural Drift and the Co-Evolution of Cultural Groups. Journal of Conflict Resolution 51(6), pp. 905-929.
18. COHEN, M D, Riolo, R L and Axelrod, R (1999). "The Emergence of Social Organization in the Prisoners' Dilemma: How Context-Preservation and other Factors Promote Cooperatio." Santa Fe Institute Working Paper 99-01-002.
19. COLMAN, A M (1995). Game Theory and Its Applications in the Social and Biological Sciences. Oxford, UK, Butterworth-Heinemann.
20. CUTLAND, N (1980). Computability: An Introduction to Recursive Function Theory. Cambridge University Press.
21. CHING, W-K and Ng, M (2006). Markov Chains: Models Algorithms and Applications. New York Springer.
22. DAWES, R M (1980) Social Dilemmas. Annual Review of Psychology 31 pp. 169-193.
23. DE JONG, K A (2006). Evolutionary computation. A unified approach. Cambridge Mass., MIT Press.
24. DE MARCHI, S (2005). Computational and Mathematical Modeling in the Social Sciences. Cambridge University Press.
25. DOEBELI, M and Hauert, C (2005) Models of cooperation based on the Prisoner's Dilemma and the Snowdrift game. Ecology Letters 8 pp. 748-766.
26. EDMONDS, B and Hales, D (2005) Computational simulation as theoretical experiment. Journal of Mathematical Sociology 29(3), pp. 209-232.
27. ELLISON, G (2000) Basins of Attraction Long Run Equilibria and the Speed of Step-by-Step Evolution. Review of Economic Studies 67 pp. 17-45.
28. EPSTEIN, J M (1999) Agent-based computational models and generative social science. Complexity 4(5), pp. 41-60.
29. EPSTEIN, J M (2006). Remarks on the Foundations of Agent-Based Generative Social Science. In Amman, H M, Kendrick, D A and Rust, J (eds.), Handbook of Computational Economics 2:1585-1604. North-Holland.
30. EPSTEIN, J M and Axtell, R L (1996). Growing Artificial Societies: Social Science from the Bottom Up. The MIT Press.
31. ESHEL, I and Cavalli-Sforza, L L (1982) Assortment of Encounters and Evolution of Cooperativeness. Proceedings of the National Academy of Sciences of the United States of America 79(4), pp. 1331-1335.
32. FLACHE, A and Hegselmann, R (2001) Do Irregular Grids make a Difference? Relaxing the Spatial Regularity Assumption in Cellular Models of Social Dynamics. Journal of Artificial Societies and Social Simulation 4(4) 6. http://jasss.soc.surreyac.uk/4/4/6.html
33. FLACHE, A and Macy, M W (2002) Stochastic collusion and the power law of learning: A general reinforcement learning model of cooperation. Journal of Conflict Resolution 46(5), pp. 629-653.
34. FLENTGE, F Polani, D and Uthmann, T (2001) Modelling the emergence of possession norms using memes. Journal of Artificial Societies and Social Simulation 4(4) 3. http://jasss.soc.surreyac.uk/4/4/3.html
35. FORT, H and Pérez, N (2005) The Fate of Spatial Dilemmas with Different Fuzzy Measures of Success. Journal of Artificial Societies and Social Simulation 8(3) 1. http://jasss.soc.surreyac.uk/8/3/1.html
36. FOSTER and Young (1990) Stochastic evolutionary game dynamics. Theoretical Population Biology 38 pp. 219-232.
37. GALAM, S (1996) Fragmentation versus stability in bimodal coalitions. Physica A: Statistical Mechanics and its Applications 230(1-2), pp. 174-188.
38. GALAN, J M and Izquierdo, L R (2005) Appearances can be deceiving: Lessons learned reimplementing Axelrod's 'evolutionary approach to norms'. Journal of Artificial Societies and Social Simulation 8(3) 2. http://jasss.soc.surreyac.uk/8/3/2.html
39. GATHERER, D (2002) Identifying cases of social contagion using memetic isolation: Comparison of the dynamics of a multisociety simulation with an ethnographic data set. Journal of Artificial Societies and Social Simulation 5(4) 5. http://jasss.soc.surreyac.uk/5/4/5.html
40. GENZ, A and Kwong, K-S (2000) Numerical evaluation of singular multivariate normal distributions. Journal of Statistical Computation and Simulation 68(1), pp. 1-21.
41. GILBERT, N (2007) Agent-Based Models. Series: Quantitative Applications in the Social Sciences. Sage Publications: London.
42. GONZÁLEZ-AVELLA, J, Cosenza, M G, Klemm, K, Eguíluz, V M and San Miguel M (2007) Information feedback and mass media effects in cultural dynamics. Journal of Artificial Societies and Social Simulation 10(3) 9. http://jasss.soc.surrey.ac.uk/10/3/9.html
43. GOTTS, N M, Polhill, J G, and Law, a N R (2003) Agent-based simulation in the study of social dilemmas. Artificial Intelligence Review 19(1), pp. 3-92.
44. HAREL, D (1980) On folk theorems. Communications of the ACM 23(7), pp. 379-389.
45. HAUERT, C and Doebeli, M (2004) Spatial structure often inhibits the evolution of cooperation in the snowdrift game. Nature 428(6983), pp. 643-646.
46. HEGSELMANN, R and Flache, A (1998) Understanding Complex Social Dynamics: A Plea For Cellular Automata Based Modelling. Journal of Artificial Societies and Social Simulation 1(3) 1. http://jasss.soc.surreyac.uk/1/3/1.html
47. IZQUIERDO, L R, Izquierdo, S S, Gotts, N M and Polhill, J G (2007) Transient and asymptotic dynamics of reinforcement learning in games. Games and Economic Behavior 61(2), pp. 259-276
48. IZQUIERDO, S S, Izquierdo, L R and Gotts, N M (2008) Reinforcement learning dynamics in social dilemmas. Journal of Artificial Societies and Social Simulation 11(2) 1. http://jasss.soc.surrey.ac.uk/11/2/1.html
49. JANSSEN, J and Manca, R (2006). Applied Semi-Markov Processes. New York, NY, USA, Springer.
50. JOYCE, D, Kennison, J, Densmore, O, Guerin, S, Barr, S, Charles, E and Thompson, N S (2006) My Way or the Highway: a More Naturalistic Model of Altruism Tested in an Iterative Prisoners' Dilemma. Journal of Artificial Societies and Social Simulation 9(2) 4. http://jasss.soc.surreyac.uk/9/2/4.html
51. KARR, A F (1990). Markov Processes. In Heyman, D P and Sobel M J (eds.), Stochastic Models. Handbooks in Operations Research and Management Science 2: 95-123. Elsevier Science Publishers B.V. (North-Holland).
52. KILGOUR, D M (1971) The simultaneous truel. International Journal of Game Theory 1(1), pp. 229-242.
53. KILGOUR, D M (1975) The Sequential Truel. International Journal of Game Theory 4(3), pp. 151-174.
54. KILGOUR, D M (1977) Equilibrium points of Infinite Sequential Truels. International Journal of Game Theory 6(3), pp. 167-180.
55. KINNAIRD, C (1946). Encyclopedia of Puzzles and Pastimes. Secaucus NJ Citadel.
56. KLEMM, K, Eguíluz, V M, Toral, R and San Miguel, M (2003a) Global culture: A noise-induced transition in finite systems. Physical Review E 67(4), Article 045101.
57. KLEMM, K, Eguíluz, V M, Toral, R and San Miguel, M (2003b) Nonequilibrium transitions in complex networks: A model of social interaction. Physical Review E 67(2), Article 026120.
58. KLEMM, K Eguíluz, V M, Toral, R and San Miguel, M (2003c) Role of dimensionality in Axelrod's model for the dissemination of culture. Physica A 327 pp. 1-5.
59. KLEMM, K Eguíluz, V M, Toral, R and San Miguel, M (2005) Globalization polarization and cultural drift. Journal of Economic Dynamics and Control 29(1-2), pp. 321-334.
60. KULKARNI, V G (1995). Modeling and Analysis of Stochastic Systems. Chapman & Hall/CRC.
61. KULKARNI, V G (1999). Modeling Analysis Design and Control of Stochastic Systems. New York, Springer-Verlag.
62. LEOMBRUNI, R and Richiardi, M (2005) Why are economists sceptical about agent-based simulations? Physica A: Statistical Mechanics and its Applications 355(1), pp. 103-109.
63. LEYDESDORFF, L (2001) Technology and culture: The dissemination and the potential 'lock-in' of new technologies. Journal of Artificial Societies and Social Simulation 4(3) 5. http://jasss.soc.surreyac.uk/4/3/5.html
64. MACY, M W and Flache, A (2002) Learning dynamics in social dilemmas. Proceedings of the National Academy of Sciences of the United States of America 99 pp. 7229-7236.
65. MILLER, J H and Page, S E (2007). Complex Adaptive Systems: An Introduction to Computational Models of Social Life. Princeton University Press.
66. MILLER, J H and Page, S E (2004) The standing ovation problem. Complexity 9(5), pp. 8-16.
67. NÉMETH, A and Takács, K (2007) The Evolution of Altruism in Spatially Structured Populations. Journal of Artificial Societies and Social Simulation 10(3) 4. http://jasss.soc.surrey.ac.uk/10/3/4.html
68. NOWAK, M A and May, R M (1992) Evolutionary games and spatial chaos. Nature 359(6398), pp. 826-829.
69. NOWAK, M A and Sigmund, K (1998) Evolution of indirect reciprocity by image scoring. Nature 393(6685), pp. 573-577.
70. RICHIARDI, M Leombruni, R Saam, N and Sonnessa, M (2006) A common protocol for agentbased social simulation. Journal of Artificial Societies and Social Simulation 9(1) 15. http://jasss.soc.surrey.ac.uk/9/1/15.html
71. SAKODA, J M (1971) The Checkerboard Model of Social Interaction. The Journal of Mathematical Sociology 1(1), pp. 119-132.
72. SCHELLING, T C (1969) Models of segregation. American Economic Review 59(2), pp. 488-493.
73. SCHELLING, T C (1971) Dynamic Models of Segregation. The Journal of Mathematical Sociology 1(2), pp. 143-186.
74. SCHELLING, T C (1978). Micromotives and Macrobehavior. New York, Norton.
75. SELTEN, R (1975) Reexamination of the perfectness concept for equilibrium points in extensive games. International Journal of Game Theory 4(1), pp. 25-55.
76. SUBER, P (2007) Formal Systems and Machines: An Isomorphism. Hand-out for "Logical Systems". Earlham College.
77. TAKAHASHI, N (2000) The emergence of generalized exchange. American Journal of Sociology 10(4), pp. 1105-1134.
78. TORAL, R and Amengual, P (2005). Distribution of winners in truel games. In Garrido, P L, Marro, J and Muñoz, M A (eds.), Modelling Cooperative Behavior in the Social Sciences Vol. 779 of AIP Conf. Proc.: 128-141. American Institute of Physics.
79. VEGA-REDONDO, F (2003) Economics and the Theory of Games. Cambridge University Press.
80. WIKIPEDIA, C (2007). Structured program theorem. Wikipedia The Free Encyclopedia, Available from http://en.wikipedia.org/w/index.php?title=Structured_program_theorem&oldid=112885072.
81. WILENSKY, U (1999). NetLogo. Evanston IL Center for Connected Learning and Computer-Based Modeling Northwestern University. http://ccl.northwestern.edu/netlogo/.
82. YOUNG, H P (1993) The Evolution of Conventions. Econometrica 61(1), pp. 57-84.