Network formation by reinforcement learning: The long and medium run

Mathematical social sciences

Volumn 48, Issue 3, 2004, Pages 315-327

  Pemantle, Robin ^a   Skyrms, Brian ^b  

^a OHIO STATE UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Absorption; Discount; Exponential time; Friedman; Meta stable; Potential well; Quasi stable; Stag Hunt; Stochastic approximation; Three player game; Trap; Urn; Urn model

Indexed keywords

EID: 5444225464     PISSN: 01654896     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.mathsocsci.2004.03.007     Document Type: Article

References (25)

1. Beggs A. On the convergence of reinforcement learning Preprint Oxford Discussion Paper 96 2002 1-34
2. Benaim M. Recursive algorithms, urn processes and chaining number of chain-recurrent sets Ergodic Theory and Dynamical Systems 18 1998 53-87
3. Benaim M. Dynamics of Stochastic approximation algorithms Seminaires de Probabilités XXXIII, Springer Lec. Notes in Math. 1709 1999 1-68
4. Benaim M. Hirsch M. Dynamics of Morse-Smale urn processes Ergodic Theory and Dynamical Systems 15 1995 1005-1030
5. Bereby-Meyer Y. Erev I. On learning to become a successful loser: a comparison of alternative abstractions of learning processes in the loss domain Journal of Mathematical Psychology 42 1998 266-286
6. Bonacich P. Liggett T. Asymptotics of a matrix-valued Markov chain arising in sociology Stochastic Processes and their Applications 104 2003 155-171
7. Busemeyer J. Stout J. A contribution of cognitive decision models to clinical assessment: decomposing performance on the Bechara Gambling Task Psychological Assessment 14 2002 253-262
8. Busemeyer J. Townsend J. Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment Psychological Review 100 1993 432-459
9. Bush R. Mosteller F. Stochastic Models for Learning 1955 Wiley New York
10. Camerer C. Ho T. Experience-weighted attraction in games Econometrica 64 1999 827-874
11. Coppersmith, D., Diaconis, P., 1997. Unpublished manuscript.
12. Davis B. Reinforced random walk Probability Theory and Related Fields 84 1990 203-229
13. Davis B. Reinforced and perturbed random walks. Random Walks Bolyai Society Mathematical Studies 9 1999 113-126 (Budapest, 1998)
14. Eggenberger F. Pólya G. Uber die Statistik verketter vorgäge Zeitschrift für Angewandte Mathematik und Mechanik 1 1923 279-289
15. Erev I. Roth A. Predicting how people play games: reinforcement learning in experimental games with unique mixed-strategy equilibria American Economic Review 88 1998 848-881
16. Herrnstein R.J. On the law of effect Journal of the Experimental Analysis of Behavior 13 1970 243-266
17. Limic, V., 2001. Attracting edge property for a class of reinforced random walks. Preprint. http://www.math.cornell.edu/limic/.
18. Luce D. Individual Choice Behavior 1959 Wiley New York
19. Pemantle R. Phase transition in reinforced random walk and RWRE on trees Annals of Probability 16 1988 1229-1241
20. Pemantle R. Vertex-reinforced random walk Probability Theory and Related Fields 92 1992 117-136
21. Pemantle R. Skyrms B. Reinforcement Schemes May Take a Long Time to Exhibit Limiting Behavior 2003 In preparation
22. Pemantle R. Skyrms B. Time to absorption in discounted reinforcement models Stochastic Processes and their Applications 109 2004 1-12
23. Roth A. Erev I. Learning in extensive form games: experimental data and simple dynamic models in the intermediate term Games and Economic Behavior 8 1995 164-212
24. Skyrms B. Pemantle R. A dynamic model of social network formation Proceedings of the National Academy of Sciences of the United States of America 97 2000 9340-9346
25. Suppes P. Atkinson R. Markov Learning Models for Multiperson Interactions 1960 Stanford Univ. Press Palo Alto