A randomly reinforced urn

Journal of Statistical Planning and Inference

Volumn 136, Issue 6, 2006, Pages 1853-1874

  Muliere, Pietro ^a   Paganoni, Anna Maria ^b   Secchi, Piercesare ^b  

^a BOCCONI UNIVERSITY   (Italy)

^b POLITECNICO DI MILANO   (Italy)

Author keywords

Asymptotic exchangeability; Gambling theory; Reinforced processes; Sequential clinical trials; Two armed bandit problems; Urn schemes

Indexed keywords

EID: 32044461620     PISSN: 03783758     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jspi.2005.08.009     Document Type: Article

References (25)

1. Aldous, D.J., 1985. Exchangeability and related topics. In: École d'été de probabilités de Saint-Flour, XIII-1983. Lecture Notes in Mathematics, vol. 1117. Springer, Berlin, pp. 1-198.
2. K.B. Athreya S. Karlin Embedding of urn schemes into continuous times Markov branching processes and related limit theorems Ann. Math. Statist. 39 1968 1801-1817
3. Beggs, A.W., 2005. On the convergence of reinforced learning. J. Econom. Theory, 122 (1), 1-36.
4. D.A. Berry B. Fristedt Bandit Problems: Sequential Allocation of Experiments 1985 Chapman & Hall New York
5. M.K. Chattopadhyay Two-armed Dirichlet bandits with discounting Ann. Statist. 22 3 1994 1212-1221
6. M.K. Clayton D.A. Berry Bayesian nonparametric bandits Ann. Statist. 13 4 1985 1523-1534
7. Dubins, L., Savage, L.J., 1965. How to gamble if you must: Inequalities for Stochastic Processes, second ed. MacGraw-Hill, New York, 1976, Dover, New York.
8. S.C. Durham N. Flournoy W. Li A sequential design for maximizing the probability of a response Canad. J. Statist. 26 3 1998 479-495
9. T.S. Ferguson A Bayesian analysis of some nonparametric problems Ann. Statist. 1 1973 209-230
10. B.M. Hill D. Lane W. Sudderth A strong law for some generalized urn processes Ann. Probab. 8 2 1980 214-226
11. B.M. Hill D. Lane W. Sudderth Exchangeable urn processes Ann. Probab. 15 4 1987 1586-1592
12. Hopkins, E., Posch, M., 2004. Attainability of boundary points under reinforcement learning. IDEAS, Department of Economics of the University of Connecticut, preprint.
13. F. Hu W.F. Rosenberger Optimality, variability, power: Evaluating response-adaptive randomization procedures for treatment comparison J. Amer. Statist. Assoc. 98 463 2003 671-678
14. F. Hu L.X. Zhang Asymptotic properties of doubly adaptive coin design for multitreatment clinical trials Ann. Statist. 32 1 2004 268-301
15. W. Li S.D. Durham N. Flournoy Randomized Pólya urn design Proceedings of the Biometrics Section of the American Statistical Association 1997 166-170
16. A. Maitra D.W. Sudderth Discrete Gambling and Stochastic Games 1996 Springer New York
17. May, C., Paganoni, A.M., Secchi, P., 2002. On a two-color generalized Pólya urn. Quaderno di Dipartimento n. 505/P, Aprile 2002, Dipartimento di Matematica, Politecnico di Milano.
18. A.M. Paganoni P. Secchi Interacting reinforced urn systems Adv. in Appl. Probab. 36 3 2004 791-804
19. R. Pemantle S. Volkov Vertex-reinforced random walk on Z has finite range Ann. Probab. 27 3 1999 1368-1388
20. W.F. Rosenberger Randomized urn models and sequential design Sequential Anal. 21 1&2 2002 1-28
21. W.F. Rosenberger J.M. Lachin Randomization in Clinical Trials: Theory and Practice 2002 Wiley New York
22. W.D. Sudderth On measurable gambling problems Ann. Math. Stat 42 1971 260-269
23. S. Walker P. Muliere Beta-Stacy processes and a generalization of the Polya urn scheme Ann. Statist. 25 4 1997 1762-1780
24. Walker, S.G., Muliere, P., 2003. Reinforcement and finite exchangeability. Studi Statistici, N. 71, Istituto di Metodi Quantitativi, Università Bocconi, Milano.
25. L.J. Wei The generalized Pólya's urn design for sequential medical trials Ann. Statist. 7 2 1979 291-296