A survey of random processes with reinforcement

Probability Surveys

Volumn 4, Issue 1, 2007, Pages 1-79

  Pemantle, Robin ^a  

^a NONE

Author keywords

Agent based model; Dynamical system; ERRW; Evo lutionary game theory; Exchangeability; Learning; Lyapunov function; olya's urn; Reinforced random walk; Self avoiding walk; Stochas tic approximation; Urn model; Urn scheme; VRRW

Indexed keywords

EID: 64549146385     PISSN: None     EISSN: 15495787     Source Type: Journal    
DOI: 10.1214/07-PS094     Document Type: Article

References (203)

1. B. Arthur, Y. Ermoliev, and Y. Kaniovskii. A generalized urn problem and its applications. Cybernetics, 19:61-71, 1983.
2. B. Arthur, Y. Ermoliev, and Y. Kaniovskii. Path dependent processes and the emergence of macro-structure. Eur. J. Oper. Res., 30:294-303, 1987.
3. J. Alford, J. Hibbing, and K. Smith. The challenge evolutionary biology poses for rational choice. Paper presented at the annual meeting of the APSA, 2005.
4. K. Athreya and S. Karlin. Embedding of urn schemes into continuous time Markov branching processes and related limit theorems. Ann. Math. Statist., 39:1801-1817, 1968. MR0232455
5. D. Aldous. The random walk construction of uniform spanning trees and uniform labelled trees. SIAM J. Disc. Math., 3:450-465, 1990. MR1069105
6. J. Alexander. Artificial virtue: the structural evolution of morality. Preprint, 2005.
7. D. Amit, G. Parisi, and L. Peliti. Asymptotic behavior of the 'true' self avoiding walk. Phys. Rev. B, 27:1635-1645, 1983. MR0690540
8. B. Arthur. Positive feedbacks in the economy. Scientific American, pages 92-99, 1990.
9. K. Athreya. Some results on multitype continuous time Markov branching processes. Ann. Math. Statist., 38:347-357, 1968. MR0221600
10. A.-L. Baŕabasi and R. Albert. Emergence of scaling in random networks. Science, 286:509-512, 1999. MR2091634
11. B. Barsky. The Beta-spline: a Local Representation Based on Shape Parameters and Fundamental Geometric Measures. Doctoral Dissertation. University of Utah, 1981.
12. M. Baracho and I. Baracho. An analysis of the spontaneous mutation rate measurement in filamentous fungi. Genetics and Molec. Biol., 26:83-87, 2003.
13. A. Banerjee, P. Burlina, and F. Alajaji. Image segmentation and labeling using the Polya urn model. IEEE Transactions on Image Processing, 8:1243-1253, 1999.
14. M. Benäim. Sur la nature des ensembles limites des trajectoires des algorithmes d'approximation stochastiques de type Robbins- Monro. C. R. Acad. Sci. Paris śer. I Math., 317:195-200, 1993. MR1231421
15. M. Benäim. Vertex-reinforced radnom walks and a conjecture of Pemantle. Ann. Probab., 25:361-392, 1997. MR1428513
16. M. Benäim. Dynamics of stochastic approximation algorithms. In Seminaires de Probabilit́es XXXIII, volume 1709 of Lecture notes in mathematics, pages 1-68. Springer-Verlag, Berlin, 1999. MR1767993
17. M. Benäim. Convergence with probability 1 of stochastic approximation algorithms whose average is cooperative. Nonlinearity, 13:601-616, 2000. MR1758990
18. M. Benäim and M. Hirsch. Dynamics of Morse-Smale urn processes. Ergodic Theory Dynam. Systems, 15:1005-1030, 1995. MR1366305
19. M. Benäim and M. Hirsch. Asymptotic pseudotrajectories and chain-recurrent flows, with applications. J. Dynam. Differential Equations, 8:141-176, 1996. MR1388167
20. M. Benäim andM. Hirsch. Mixed equilibria and dynamical systems arising from fictitious play in repeated games. Games and Econ. Beh., 29:36-72, 1999. MR1729309
21. M. Benäim and M. Hirsch. Stochastic approximation algorithms with constant step size whose average is cooperative. Ann. Appl. Probab., 9:216-241, 1999. MR1682576
22. M. Benäim, J. Hofbauer, and S. Sorin. Stochastic approximations and differential inclusions, I. SIAM Journal on Optimization and Control, 44:328-348, 2005. MR2177159
23. M. Benäim, J. Hofbauer, and S. Sorin. Stochastic approximations and differential inclusions, II. In Press, 2006. MR2177159
24. R. Bradt, R. Johnson, and S. Karlin. On sequential designs for maximizing the sum of n observations. Ann. Math. Statist., 31:1060-1074, 1962. MR0087288
25. D. Blackwell and D. Kendall. The Martin boundary for ṕolya's urn scheme. Journal of Applied Probability, 1:284-296, 1964. MR0176518
26. P. Bonacich and T. Liggett. Asymptotics of a matrix valued Markov chain arising in sociology. Stochastic Process. Appl., 104:155-171, 2003. MR1956477
27. M. Benäim, M. Ledoux, and O. Raimond. Self-interacting diffusions. Prob. Theory Related Fields, 122:1-41, 2002. MR1883716
28. R. Bush and F. Mosteller. Stochastic Models for Learning. John Wiley, New York, 1955. MR0070143
29. D. Blackwell and J. McQueen. Ferguson distributions via ṕolya urn schemes. Ann. Statist., 1:353-355, 1973. MR0362614
30. A. Benveniste, M. ḿetivier, and P. Priouret. Stochastic Approx- imation and Adaptive Algorithms, volume 22 of Applications of Mathematics. Springer-Verlag, New York, 1990.
31. E. Bonabeau. Agent-based modeling: Methods and techniques for simulating human systems. Proc. Nat. Acad. Sci. U.S.A., 99 (Supplement 3):7280-7287, 2002.
32. R. Bowen. ?-limit sets of axiom A diffeomorphisms. J. Diff. Eq., 18:333-339, 1975. MR0413181
33. A. Bagchi and A. Pal. Asymptotic normality in the generalized ṕolya-Eggenberger urn model, with an application to computer data structures. SIAM J. Alg. Disc. Meth., 6:394-405, 1985. MR0791169
34. M. Benäim and O. Raimond. On self-attracting/repelling diffusions. Comptes Rendus Acad. Sci. Paris, ser. I, 335:541-544, 2002. MR1936828
35. M. Benäim and O. Raimond. Self-interacting diffusions, II: convergence in law. Ann. Inst. H. Poincaŕe, prob. stat., 39:1043-1055, 2003. MR2010396
36. M. Benäim and O. Raimond. Self-interacting diffusions, III: symmetric interactions. Ann. Probab., 33:1716-1759, 2005.MR2165577
37. O. Brandière. Some pathological traps for stochastic approximation. SIAM J. on Control and Optimization, 36:1293-1314, 1998. MR1618037
38. G. Brown. Iterative solutions of games by fictitious play. In T. C. Koopmans, editor, Activity Analysis of Production and Allocation. John Wiley & Sons, New York, 1951. MR0056265
39. B. Bollob́as, O. Riordan, J. Spencer, and G. Tusńady. The degree sequence of a scale-free random graph process. Random Structures and Algorithms, 18:279-290, 2001. MR1824277
40. A. Beretti and A. Sokal. New Monte Carlo method for the selfavoiding walk. J. Statist. Phys., 40:483-531, 1985. MR0806712
41. J. Busemeyer and J. Stout. A contribution of cognitive decision models to clinical assessment: decomposing performance on the Bechara Gambling Task. Psychological Assessment, 14:253-262, 2002.
42. M. Benäim, S. Schreiber, and P. Tarrès. Generalized urn models of evoutionary processes. Ann. Appl. Prob, 14:1455-1478, 2004. MR2071430
43. I. Benjamini and D. Wilson. Excited random walk. Elec. Comm. Prob., 8:paper 9, 2003. MR1987097
44. D Coppersmith and P. Diaconis. Random walk with reinforcement. Unpublished manuscript, 1987.
45. F. Chung and L. Lu. Average distances in random graphs with given expected degrees. Internet Mathematics, 1:91-114, 2003. MR2076728
46. F. Chung and L. Lu. Complex Graphs and Networks. CBMS Regional Conference Series in Mathematics. American Mathematical Society, Providence, 2006. MR2248695
47. C. Cotar and V. Limic. Attraction time for strongly reinforced random walks. arXiv, math.PR/0612048:27, 2006.
48. M. Cranston and Y. Le Jan. Self-attracting diffusions: two case studies. Math. Ann., 303:87-93, 1995. MR1348356
49. M. Cranston and T. Mountford. The strong law of large numbers for a Brownian polymer. Ann. Probab., 24:1300-1323, 1996. MR1411496
50. J. Cohen. Irreproducible results in the breeding of pigs. Bioscience, 26:241-245, 1976.
51. A. Collevecchio. Limit Theorems for Reinforced Random Walks on Trees. Doctoral Dissertation. Purdue University, 2004.
52. A. Collevecchio. Limit theorems for reinforced random walks on certain trees. Prob. Theory Related Fields, 136:81-101, 2006. MR2240783
53. A. Collevecchio. On the transience of processes defined on galtonwatson trees. Ann. Probab., 34:870-878, 2006. MR2243872
54. C. Conley. Isolated Invariant Sets and the Morse Index, volume 38 of CBMS Regional Conference Series in Mathematics. American Mathematical Society, Providence, 1978. MR0511133
55. R. Carmona, F. Petit, and M. Yor. Beta variables as time spent in [0,8] by certain perturbed reflecting Brownian motions. J. London Math. Soc., 58:239-256, 1998. MR1670130
56. B. Davis. Reinforced random walk. Prob. Theory Related Fields, 84:203-229, 1990. MR1030727
57. B. Davis. Weak limits of perturbed random walks and the equation Yt = Bt + a sup{Ys : s = t} + β inf{Ys : s = t}. Ann. Probab., 24:2007-2023, 1996. MR1415238
58. B. Davis. Reinforced and perturbed random walks. In Random Walks, volume 9 of Bolyai Soc. Math. Stud., pages 113-126. j́anosbolyai Math. Soc., Budapest, 1999. MR1752892
59. B. de Finetti. Sur la question d'equivalence partielle. Actualites Scientifiques et Industrielles, 79, 1938.
60. L. Dubins and D. Freedman. Random distribution functions. Proc. Fifth Berkeley Symp. Math. Statist. Prob., 2:183-214, 1966. MR0214109
61. P. Diaconis and D. Freedman. de Finetti's theorem for Markov chains. Ann. Probab., 8:115-130, 1980. MR0556418
62. E. Di Giuseppe, D. Vento, C. Epifani, and S. Esposito. Analysis of dry and wet spells from 1870 to 2000 in four italian sites. Geophysical Research Abstracts, 7:6, 2005.
63. P. Diaconis. Recent progress on de Finetti's notion of exchangeability. In J. Bernardo, M. de Groot, D. Lindley, and A. Smith, editors, Bayesian Statistics, pages 111-125. Oxford University Press, Oxford, 1988. MR1008047
64. J. Die. A once edge-reinforced random walk on a Galton- Watson tree is transient. Statist. Probab. Lett., 73:115-124, 2005. MR2159246
65. G. Dirienzo. Using urn models for the design of clinical trials. Indian Journal of Statistics, 62:43-69, 2000. MR1789790
66. R. Durrett, H. Kesten, and V. Limic. Once edge-reinforced random walk on a tree. Prob. Theor. Rel. Fields, 122:567-592, 2002. MR1902191
67. R. Durrett and L. C. G. Rogers. Asymptotic behavior of Brownian polymers. Prob. Theor. Rel. Fields, 92:337-349, 1992. MR1165516
68. P. Diaconis and S. Rolles. Bayesian analysis for reversible Markov chains. Annals of Statistics, 34:1270-1292, 2006.
69. M. Duflo. Algorithmes Stochastiques. Springer, Berlin, 1996. MR1612815
70. R. Durrett. Probability: Theory and Examples. Duxbury Press, Belmont, CA, third edition, 2004. MR1609153
71. M. Drmota and V. Vatutin. Limiting distributions in branching processes with two types of particles. In Classical and modern branching processes, volume 84 of IMA volumes in Mathemat- ics and Applications, pages 89-110. Springer, New York, 1997. MR1601709
72. B. Davis and S. Volkov. Continuous time vertex-reinforced jump processes. Prob. Theory Related Fields, 123:281-300, 2002. MR1900324
73. B. Davis and S. Volkov. Vertex-reinforced jump processes on trees and finite graphs. Prob. Theory Related Fields, 128:42-62, 2004. MR2027294
74. P. Ehrenfest and T. Ehrenfest. über zwei bekannte Einwände gegen das Boltzmannsche H-theorem. Physikalische Zeitschrift, 8:311-314, 1907.
75. B. Eidelson and I. Lustick. Vir-pox: An agent-based analysis of smallpox preparedness and response policy. Journal of Artificial Societies and Social Simulation, 7, 2004.
76. G. Ellison. Learning, local interaction, and coordination. Econo- metrica, 61:1047-1071, 1993. MR1234793
77. F. Eggenberger and G. ṕolya. über die Statistik vorketter vorgänge. Zeit. Angew. Math. Mech., 3:279-289, 1923.
78. W. Estes and J. Straughan. Analysis of a verbal conditioning situation in terms of statistical choice behavior under extended training with shifting probabilities of reinforcement. J. Experimental Psy- chology, 47:225-234, 1954.
79. D. Feldman. Contributions to the "two-armed bandit" problem. Ann. Statist., 33:847-856, 1962. MR0145625
80. W. Feller. An Introduction to Probability Theory and its Applica- tions, vol. I. John Wiley & Sons, New York, third edition, 1968. MR0228020
81. W. Feller. An Introduction to Probability Theory and its Applica- tions, vol. II. John Wiley & Sons, New York, second edition, 1971. MR0270403
82. T. Ferguson. A Bayesian analysis of some nonparamteric problems. Ann. Statist., 1:209-230, 1973. MR0350949
83. T. Ferguson. Prior distributions on spaces of probability measures. Ann. Statist., 2:615-629, 1974. MR0438568
84. P. Flajolet, J. Gabarŕo, and H. Pekari. Analytic urns. Ann. Probab., 33:1200-1233, 2005. MR2135318
85. D. Fudenberg and D. Kreps. Learning mixed equilibria. Games and Econ. Beh., 5:320-367, 1993. MR1227915
86. P. Flory. The configuration of a real polymer chain. J. Chem. Phys., 17:303-310, 1949.
87. A. Flache and M. Macy. Stochastic collusion and the power law of learning. J. Conflict Res., 46:629-653, 2002.
88. D. Freedman. Bernard Friedman's urn. Ann. Math. Statist., 36:956-970, 1965. MR0177432
89. B. Friedman. A simple urn model. Comm. Pure Appl. Math., 2:59-70, 1949. MR0030144
90. J. Fabius and W. van Zwet. Some remarks on the two-armed bandit. Ann. Math. Statist., 41:1906-1916, 1970. MR0278454
91. R. Goldman. ṕolya's urn model and computer-aided geometric design. SIAM J. Alg. Disc. Meth., 6:1-28, 1985. MR0772172
92. R. Goldman. Urn models and beta-splines. Constructive approxi- mation, 4:265-288, 1988. MR0940295
93. R. Goldman. Urn models, approximations and splines. J. Approx. Theory, 54:1-66, 1988. MR0951029
94. I. J. Good. The Estimation of Probabilities: An Essay on Modern Bayesian Methods, volume 30 of Research Monographs. M.I.T. Press, Cambridge, MA, 1965. MR0185724
95. D. Greenberg. Modeling criminal careers. Criminology, 29:17-46,
96. M. Greenwood and U. Yule. Inquiry into the nature of frequency distributions representative of multiple happenings with particular reference to the occurrence of multiple attacks of disease or repeated accidents. J. Royal. Stat. Soc., 83:255-279, 1920.
97. J. Harsanyi. Games with randomly disturbed payoffs: a new rationale for mixed-strategy equilibrium points. Int. J. Game Theory, 2:1-16, 1973. MR0323363
98. R. Herrnstein. On the law of effect. J. Anal. Exp. Behav., 13:243- 266, 1970.
99. B. Hill, D. Lane, and W. Sudderth. A strong law for some generalized urn processes. Ann. Probab., 8:214-226, 1980. MR0566589
100. J. Hammersley and K. Morton. Poor man's Monte Carlo. J. Royal Stat. Soc. B, 16:23-38, 1954. MR0064475
101. J. Hofbauer and K. Sigmund. The Theory of Evolution and Dy- namical Systems. Cambridge University Press, Cambridge, 1988. MR1071180
102. J. Hofbauer and K. Sigmund. Evolutionary Games and Popula- tion Dynamics. Cambridge University Press, Cambridge, 1998. MR1635735
103. J. Hofbauer and W. Sandholm. On the global convergence of stochastic fictitious play. Econometrica, 70:2265-2294, 2002. MR1939897
104. N. Ikeda, M. Nagasawa, and S. Watanabe. A construction of branching Markov processes. Proceedings of the Japan Academy, 42:380-384, 1966. MR0202198
105. K. Janardhan. Correlation between the numbers of two types of children in a family using the Markov-ṕolya model. Math. Biosci., 62:123-136, 1982. MR0684815
106. S. Janson. Functional limit theorems for multitype branching processes and generalized ṕolya urns. Stochastic Process. Appl., 110:177-245, 2004. MR2040966
107. S. Janson. Limit theorems for triangular urn schemes. Prob. Theory Related Fields, 134:417-452, 2005. MR2226887
108. J. Jordan. Three problems in learning mixed-strategy Nash equilibria. Games and Economic Behavior, 5:368-386, 1993. MR1227916
109. H. Kushner and D. Clark. Stochastic Approximation for Con- strained and Unconstrained Systems, volume 26 of Applied Mathe- matical Sciences. Springer-Verlag, New York, 1978. MR0499560
110. H. Kesten. On the number of self-avoiding walks. J. Math. Phys., 4:960-969, 1963. MR0152026
111. J. F. C. Kingman. Martingales in the OK corral. Bull. London Math. Soc., 31:601-606, 1999. MR1703841
112. K. Khanin and R. Khanin. A probabilistic model for establishment of neuron polarity. J. Math. Biol., 42:26-40, 2001. MR1820779
113. S. Kakade, M. Kearns, L. Ortiz, R. Pemantle, and S. Suri. Economic properties of social networks. In L. Saul, Y. Weiss, and L. Bottou, editors, Proceedings of NIPS (2004), volume 17 of Ad- vances in Neural Information Processing Systems. M. I. T. Press, Cambridge, MA, 2005.
114. M. Kandori, G. Mailath, and R. Rob. Learning, mutation, and long run equilibria in games. Econometrica, 61:29-56, 1993.MR1201702
115. S. Kotz, H. Mahmoud, and P. Robert. On generalized ṕolya urn models. Stat. Prob. Let., 49:163-173, 2000. MR1790166
116. M. Keane and S. Rolles. Edge-reinforced random walk on finite graphs. In Infinite Dimensional Stochastic Analysis, volume 52 of Verhandelingen, Afdeling Natuurkunde. Eerste Reeks. Koninklijke Nederlandse Akademie van Wetenschappen. [Proceedings, Physics Section. Series 1. Royal Netherlands Academy of Arts and Sci- ences], pages 217-234. R. Neth. Acad. Arts Sci., Amsterdam, 1999. MR1832379
117. J. F. C. Kingman and S. Volkov. Solution to the OK Corral problem via decoupling of Friedman's urn. J. Theoret. Probab., 16:267-276, 2003. MR1956831
118. G. Lawler. A self-avoiding random walk. Duke Math. J., 47:655-693, 1980. MR0587173
119. G Lawler. Intersections of Random Walks. Probability and its Applications. Birkhäuser, Boston, 1991. MR1117680
120. V. Limic. Attracting edge property for a class of reinforced random walks. Ann. Probab., 31:1615-1654, 2003. MR1989445
121. L. Ljung. Analysis of recursive stochastic algorithms. IEEE Trans- actions on Automatic Control, AC-22:551-575, 1977. MR0465458
122. K. l̈owner. Untersuchungen über schlichte konforme Abbildungen des Einheitskreises, I. Math. Ann., 89:103-121, 1923. MR1512136
123. D. Lamberton, G. Paǵes, and P. Tarŕes. When can the two-armed bandit algorithm be trusted? Ann. Appl. Prob., 14:1424-1454, 2004. MR2071429
124. H. Levine and A. Sleeman. A system of reaction-diffusion equations arising in the theory of reinforced random walks. SIAM J. Appl. Math., 57:683-730, 1997. MR1450846
125. G. Lawler, O. Schramm, and W. Werner. A self-avoiding random walk. Ann. Probab., 32:939-995, 2004. MR2044671
126. V. Limic and P. Tarŕes. Attracting edge and strongly edge reinforced random walks. Preprint, page 25, 2006.
127. H. Mahmoud. On rotations in fringe-balanced binary trees. Infor- mation Processing Letters, 65:41-46, 1998. MR1606251
128. H. Mahmoud. ṕolya urn models and connections to random trees: a review. J. Iranian. Stat. Soc., 2:53-114, 2003.
129. H. Mahmoud. ṕolya-type urn models with multiple drawings. J. Iranian Stat. Soc., 3:165-173, 2004.
130. H. Minikata. A geometrical aspect of multiplicity distribution and elastic diffraction scattering. Prg. Theor. Phys., 51:1481-1487,
131. M. Mitzenmacher. A brief history of generative models for power law and lognormal distributions. Internet Mathematics, 1:226-251, 2003. MR2077227
132. K. Miyasawa. On the convergence of the learning process in a 2×2 non-zero sum two-person game. Economic Research Program, Research Memorandom number 33, 1961.
133. D. Mackerro and H. Lawson. Weather limitations on the applications of dinoseb-in-oil for cane vigour control in raspberry. Ann. Appl. biol., 100:527-538, 1982.
134. P. Milgrom and J. Roberts. Rationalizability, learning, and equilibrium in games with strategic complementarities. Econometrica, 58:1255-1278, 1990. MR1080810
135. F. Merkl and S. Rolles. Edge-reinforced random walk on a ladder. Ann. Probab., 33:2051-2093, 2005. MR2184091
136. F. Merkl and S. Rolles. Linearly edge-reinforced random walks. In Dynamics & Stochastics: Festschrift in honor of M. S. Keane, volume 48 of IMS Lecture Notes - Monograph Series, pages 66-77. Institute of Mathematical Statistics Press, Hayward, CA, 2006.
137. F. Merkl and S. Rolles. A random environment for linearly edgereinforced random walks on infinite graphs. Prob. Theor. Rel. Fields, To appear, 2007.
138. J. Maynard Smith. The theory of games and the evolution of animal conflicts. J. Theoret. Biol, 47:209-221, 1974. MR0444115
139. J.Maynard Smith. Evolution and the Theory of Games. Cambridge University Press, Cambridge, 1982.
140. H. Mahmoud and R. Smythe. Asymptotic joint normality of outdegrees of nodes in random recursive trees. Rand. Struc. Alg., 3:255-266, 1992. MR1164839
141. N. Madras and G. Slade. The Self-Avoiding Walk. Probability and its Applications. Birkhäuser, Boston, 1993. MR1197356
142. H. Mahmoud and R. Smythe. Probabilistic analysis of bucket recursive trees. Theor. Comp. Sci., 144:221-249, 1995. MR1337759
143. D. Monderer and L. Shapley. Fictitious play property for games with identical interests. J. Econ. Theory, 68:258-265, 1996. MR1372400
144. J. Maynard Smith and G. Price. The logic of animal conflict. Nature, 246:15-18, 1973.
145. D. Mauldin, W. Sudderth, and S. Williams. ṕolya trees and random distributions. Ann. Statist., 20:1203-1221, 1992. MR1186247
146. P. Muliere, P. Secchi, and S. Walker. Urn schemes and reinforced random walks. Stoch. Proc. Appl., 88:59-78, 2000. MR1761692
147. M. F. Norman. Markovian learning processes. SIAM Review, 16:143-162, 1974. MR0343372
148. C. Newman and K Ravishankar. Convergence of the t́oth lattice filling curve to the t́oth-Werner plane filling curve. Alea, 1:333-346, 2006. MR2249660
149. J. Norris, L. C. G. Rogers, and D. Williams. Self-avoiding random walk: a Brownian motion with local time drift. Prob. Theory Related Fields, 74:271-287, 1987. MR0871255
150. J. Orbell, T. Morikawa, J. Hartwig, J. Hanley, and N. Allen. Machiavellian intelligence as a basis for the evolution of cooperative dispositions. American Political Science Review, 98:1-15, 2004.
151. H. Othmer and A. Stevens. Aggregation, blowup, and collapse: the abc's of taxis in reinforced random walks. SIAM J. Math. Appl., 57:1044-1081, 1997. MR1462051
152. R. Oliveira and J. Spencer. Avoiding defeat in a balls-in-bins process with feedback. arXiv, math.PR/0510663:30, 2005.MR2193157
153. R. Pemantle. Phase transition of reinforced random walk and RWRE on trees. Ann. Probab., 16:1229-1241, 1988. MR0942765
154. R. Pemantle. Random processes with reinforcement. Doctoral Dissertation. M.I.T., 1988.
155. R. Pemantle. Nonconvergence to unstable points in urn models and stochastic approximations. Ann. Probab., 18:698-712, 1990. MR1055428
156. R. Pemantle. A time-dependent version of ṕolya's urn. J. Theoret. Probab., 3:627-637, 1990. MR1067672
157. R. Pemantle. When are touchpoints limits for generalized Polya urns? Proceedings of the American Mathematical Society, 113:235- 243, 1991. MR1055778
158. G. ṕolya. Sur quelques points de la théorie des probabilit́es. Ann. Inst. H. Poincaŕe, 1:117-161, 1931.
159. R. Pemantle and S. Volkov. Vertex-reinforced random walk on Z has finite range. Ann. Probab., 27:1368-1388, 1999. MR1733153
160. O. Raimond. Self-attracting diffusions: case of the constant interaction. Prob. Theory Related Fields, 107:177-196, 1997. MR1431218
161. A. Roth and I. Erev. Learning in extensive-form games: experimental data and simple dynamic models in the intermediate term. Games and Econ. Beh., 8:164-212, 1995. MR1315993
162. H. Robbins and S. Monro. A stochastic approximation method. Ann. Math. Statist., 22:400-407, 1951. MR0042668
163. J. Robinson. An iterative method of solving a game. Ann. Math., 54:296-301, 1951. MR0043430
164. H. Robbins. Some aspects of the sequential design of experiments. Bull. AMS, 58:525-535, 1952. MR0050246
165. H. Robbins. A sequential decision problem with a finite memory. Proc. Nat. Acad. Sci. U.S.A., 42:920-923, 1956. MR0082762
166. A. Rosenblatt. Sur le concept de contagion de M. G. ṕolya dans le calcul des probabilit́es. Proc. Acad. Nac. Cien. Exactas, Fis. Nat., Peru, 3:186-204, 1940. MR0004397
167. W. Rosenberger. New directions in adaptive designs. Stat. Sci., 11:137-149, 1996.
168. D. Randall and A. Sinclair. Self-testing algorithms for self-avoiding walks. J. Math. Phys., 41:1570-1584, 2000. MR1757970
169. S. Rohde and O. Schramm. Basic properties of SLE. Ann. Math., 161:883-924, 2005. MR2153402
170. S. Samuels. Randomized rules for the two-armed bandit with finite memory. Ann. Math. Stat., 39:2103-2107, 1968. MR0234573
171. O. Schramm. Scaling limits of loop-erased random walks and uniform spanning trees. Israel J. Math., 118:221-288, 2000. MR1776084
172. S. Schreiber. Urn models, replicator processes, and random genetic drift. SIAM J. Appl. Math., 61:2148-2167, 2001. MR1856886
173. T. Sellke. Reinforced random walk on the d-dimensional integer lattice. Purdue University Technical Report, #94-26, 1994.
174. T. Sellke. Recurrence of reinforced random walk on a ladder. Elec. J. Prob., 11:301-310, 2006. MR2217818
175. L. Shapley. Some topics in two-person games. In M. Dresher, L. Shapley, and A. Tucker, editors, Advances in Game Theory. Princeton University Press, Princeton, 1964. MR0198990
176. B. Skyrms. The Stag Hunt and the Evolution of Social Structure. Cambridge University Press, Cambridge, 2004.
177. B. Sinervo and C. Liverly. The rock-paper-scissors game and the evolution of alternative male strategies. Nature, 380:240-243, 1996.
178. G. Slade. Self-avoiding walks. Math. Intelligencer, 16:29-35, 1994. MR1251665
179. R. Smythe. Central limit theorems for urn models. Stoch. Proc. Appl., 65:115-137, 1996. MR1422883
180. C. Smith and R. Pyke. The Robbins-Isbell two-armed bandit problem with finite memory. Ann. Math. Stat., 36:1375-1386, 1965. MR0182107
181. R. Shull and S. Pliskoff. Changeover delay and concurrent performances: some effects on relative performance measures. Journal of the Experimental Analysis of Behavior, 10:517-527, 1967.
182. B. Skyrms and R. Pemantle. A dynamic model of social network formation. Proc. Nat. Acad. Sci. U.S.A., 97:9340-9346, 2000.
183. P. Schuster and K. Sigmund. Replicator dynamics. J. Theor. Biol., 100:533-538, 1983. MR0693413
184. D. Siegmund and B. Yakir. An urn model of Diaconis. Ann. Probab., 33:2036-2042, 2005. MR2165586
185. P. Tarŕes. Vertex-reinforded random walk on Z eventually gets stuck on five points. Ann. Probab., 32:2650-2701, 2004. MR2078554
186. E. Thorndike. Animal intelligence: an experimental study of the associative process in animals. Psychol. Monogr., 2, 1898.
187. P. Taylor and L. Jonker. Evolutionary stable strategies and game dynamics. Math. Biosci., 40:145-146, 1978. MR0489983
188. B. t́oth. 'True' self-avoiding walks with generalized bond repulsionon Z. J. Stat. Phys., 77:17-33, 1994. MR1300526
189. B. t́oth. The 'true' self-avoiding random walk with bond repulsion on Z: limit theorems. Ann. Probab., 23:1723-1756, 1995.
190. B. t́oth. Generalized Ray-Knight theory and limit theorems for self-interacting random walks on Z. Ann. Probab., 24:1324-1367, 1996. MR1411497
191. B. t́oth. Limit theorems for weakly reinforced random walks on Z. Stud. Sci. Math. Hungar., 33:321-337, 1997. MR1454118
192. B. t́oth. Self-interacting random motions - a survey. In P. ŕevész and B. t́oth, editors, Random Walks, volume 9 of Bolyai Society Mathematical Studies, pages 349-384. j́anos Bolyai Mathematical Society, Budapest, 1999. MR1752900
193. B. t́oth and W. Werner. The true self-repelling motion. Prob. Theory Related Fields, 111:375-452, 1998. MR1640799
194. W. Vogel. Asymptotic minimax theorem for the two-armed bandit problem. Ann. Math. Stat., 31:444-451, 1962. MR0116443
195. W. Vogel. A sequential design for the two-armed bandit. Ann. Math. Stat., 31:430-443, 1962. MR0116442
196. S. Volkov. Vertex-reinforced random walk on arbitrary graphs. Ann. Probab., 29:66-91, 2001. MR1825142
197. S. Volkov. Excited random walk on trees. Elec. J. Prob., 8:paper 23, 2003. MR2041824
198. L. Wei and S. Durham. The randomized play-the-winner rule in medical trials. J. Amer. Stat. Assoc., 73:840-843, 1978.
199. D. Williams and P. McIlroy. The OK Corral and the power of the law (a curious Poisson kernel for a parabolic equation). Bull. London Math. Soc., 30:166-170, 1998. MR1489328
200. D. Watts and S. Strogatz. Collective dynamics of small-world networks. Nature, 393:440-442, 1998.
201. K. Yokoyama, H. Minikata, and M. Namiki. Multiplicity distribution model based on cluster assumption in high-energy hadronic collisions. Prog. Theor. Phys., 51:212-223, 1974.
202. M. Zerner. Recurrence and transience of excited random walk on Zd and strips. Elec. Comm. Prob., 11:paper 12, 2006. MR2231739
203. T. Zhu. A survey of urn models. Masters Thesis. University of Pennsylvania, 2005.