Reinforcement Learning in Repeated Interaction Games

B.E. Journal of Theoretical Economics

Volumn 1, Issue 1, 2001, Pages

  Bendor, Jonathan ^a   Mookherjee, Dilip ^b   Ray, Debraj ^c  

^a STANFORD UNIVERSITY   (United States)

^b BOSTON UNIVERSITY   (United States)

^c NEW YORK UNIVERSITY   (United States)

Author keywords

aspirations; bounded rationality; cooperation; coordination; reinforcement learning

Indexed keywords

EID: 0038660317     PISSN: None     EISSN: 19351704     Source Type: Journal    
DOI: 10.2202/1534-5963.1008     Document Type: Article

References (60)

1. B. Arthur, "On Designing Economic Agents that Behave Like Human Agents, " Journal of Evolutionary Economics 3, 1993, 1-22.
2. J. Bendor, D. Mookherjee and D. Ray, "Aspirations, Adaptive Learning and Cooperation in Repeated Games", Discussion Paper, Planning Unit, Indian Statistical Institute, New Delhi, 1992.
3. J. Bendor, D. Mookherjee and D. Ray, "Aspirations, Adaptive Learning and Cooperation in Repeated Games", Discussion Paper No. 9442, Center for Economic Research, Tilburg University, May 1994. Revised, mimeo, Department of Economics, Boston University, 1995.
4. J. Bendor, D. Mookherjee and D. Ray, "Aspiration-Based Reinforcement Learning in Repeated Games: An Overview, " mimeo, Department of Economics, Boston University, 2000.
5. K. Binmore and L. Samuelson, "Muddling Through: Noisy Equilibrium Selection, " Journal of Economic Theory, 74, 1997, 235-265.
6. T. Börgers and R. Sarin, "Learning through Reinforcement and Replicator Dynamics, " Journal of Economic Theory 77, 1997, 1-14.
7. T. Börgers and R. Sarin, , "Naive Reinforcement Learning with Endogenous Aspirations, " International Economic Review 41, 2000, 921-950.
8. T. Börgers, A. Morales and R. Sarin, "Simple Behavior Rules which Lead to Expected Payoff Maximizing Choices, " mimeo, University College, London, 1998.
9. R. Bush and F. Mosteller, Stochastic Models of Learning, New York: John Wiley and Sons, 1955.
10. R. Bush, F. Mosteller and G. Thompson, "A Formal Structure For Multiple Choice Situations, " in Decision Processes, edited by R.M. Thrall, C.H. Coombs and R.L. Davis, 1954, New York: Wiley.
11. C. Camerer and T. Ho, "Experience-weighted Attraction Learning in Normal Form Games, " Econometrica, 67(4), 1999, 827-874.
12. J. Cross, "A Stochastic Learning Model of Economic Behavior, " Quarterly Journal of Economics, 87 (1973), 239-266.
13. R. Cyert and J. March, A Behavioral Theory of the Firm. Englewood-Cliffs, NJ: Prentice-Hall, 1963.
14. H.D. Dixon, "Keeping up with the Joneses: Competition and the Evolution of Collusion", Journal of Economic Behavior and Organization, 2000, forthcoming. I. Erev and A. Roth, "On the Need for Low Rationality, Cognitive Game Theory: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria, " working paper, August 1995, Department of Economics, University of Pittsburgh.
15. H.D. Dixon, "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique Mixed Strategy Equilibria, " American Economic Review, 88, 1998, 848-881.
16. W. Estes, "Individual Behavior in Uncertain Situations: An Interpretation in Terms of Statistical Association Theory, " in Decision Processes, edited by R.M. Thrall, C.H. Coombs and R.L. Davis, 1954, New York: Wiley.
17. I. Gilboa and D. Schmeidler, "Case-based Decision Theory, " Quarterly Journal of Economics, 110, 1995, 605-640.
18. I. Gilboa and D. Schmeidler, "Case-based Optimization, " Games and Economic Behavior, 15 (1996), 1-26.
19. R. Karandikar, D. Mookherjee, D. Ray and F. Vega-Redondo, "Evolving Aspirations and Cooperation, ", Journal of Economic Theory, 80, 1998, 292-331.
20. Y. Kim, "Satisficing, Cooperation and Coordination, " mimeo, Department of Economics, Queen Mary and Westfield College, University of London, 1995a.
21. Y. Kim, "A Satisficing Model of Learning in Extensive Form Games, " mimeo, Department of Economics, Yonsei University, Seoul, 1995b.
22. B. Lipman (1991), "How to Decide How to Decide How to ..: Modeling Limited Rationality, " Econometrica 59, 1105-1125.
23. R. Duncan Luce (1959), Individual Choice Behavior, John Wiley.
24. S.P. Meyn and R.L. Tweedie (1993) Markov Chains and Stochastic Stability, London, New York: Springer-Verlag.
25. D. Mookherjee and B. Sopher, "Learning Behavior in an Experimental Matching Pennies Game, " Games and Economic Behavior 7, 1994, 62-91.
26. D. Mookherjee and B. Sopher, "Learning and Decision Costs in Experimental Constant Sum Games, " Games and Economic Behavior 19, 1997, 97-132.
27. K. Narendra and P. Mars, "The Use of Learning Algorithms in Telephone Traffic Routing: A Methodology, " Automatica, 19(5), 1983, 495-502.
28. K. Narendra and M. Thathachar, Learning Automata: An Introduction, Englewood Cliffs: Prentice Hall, 1989.
29. R. Nelson and Winter, S. An Evolutionary Theory of Economic Change. Cambridge, Massachussetts: Harvard University Press, 1982.
30. I. Erev and A. Roth, "On the Need for Low Rationality, Cognitive Game Theory: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria, " working paper, August 1995, Department of Economics, University of Pittsburgh.
31. I. Erev and A. Roth, "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique Mixed Strategy Equilibria, " American Economic Review, 88, 1998, 848-881.
32. W. Estes, "Individual Behavior in Uncertain Situations: An Interpretation in Terms of Statistical Association Theory, " in Decision Processes, edited by R.M. Thrall, C.H. Coombs and R.L. Davis, 1954, New York: Wiley.
33. I. Gilboa and D. Schmeidler, "Case-based Decision Theory, " Quarterly Journal of Economics, 110, 1995, 605-640.
34. I. Gilboa and D. Schmeidler, "Case-based Optimization, " Games and Economic Behavior, 15 (1996), 1-26.
35. R. Karandikar, D. Mookherjee, D. Ray and F. Vega-Redondo, "Evolving Aspirations and Cooperation, ", Journal of Economic Theory, 80, 1998, 292-331.
36. Y. Kim, "Satisficing, Cooperation and Coordination, " mimeo, Department of Economics, Queen Mary and Westfield College, University of London, 1995a.
37. Y. Kim, "A Satisficing Model of Learning in Extensive Form Games, " mimeo, Department of Economics, Yonsei University, Seoul, 1995b.
38. B. Lipman (1991), "How to Decide How to Decide How to ..: Modeling Limited Rationality, " Econometrica 59, 1105-1125.
39. R. Duncan Luce (1959), Individual Choice Behavior, John Wiley.
40. S.P. Meyn and R.L. Tweedie (1993) Markov Chains and Stochastic Stability, London, New York: Springer-Verlag.
41. D. Mookherjee and B. Sopher, "Learning Behavior in an Experimental Matching Pennies Game, " Games and Economic Behavior 7, 1994, 62-91.
42. D. Mookherjee and B. Sopher, "Learning and Decision Costs in Experimental Constant Sum Games, " Games and Economic Behavior 19, 1997, 97-132.
43. K. Narendra and P. Mars, "The Use of Learning Algorithms in Telephone Traffic Routing: A Methodology, " Automatica, 19(5), 1983, 495-502.
44. K. Narendra and M. Thathachar, Learning Automata: An Introduction, Englewood Cliffs: Prentice Hall, 1989.
45. R. Nelson and Winter, S. An Evolutionary Theory of Economic Change. Cambridge, Massachussetts: Harvard University Press, 1982.
46. M. F. Norman, Markov Processes and Learning Models, New York and London: Academic Press, 1972.
47. F. Palomino and F. Vega-Redondo, "Convergence of Aspirations and (Partial) Cooperation in the Prisoner?s Dilemma", International Journal of Game Theory, 28(4), 1999, 465-488.
48. G. Papavassilopoulos, "Learning Algorithms for Repeated Bimatrix Nash Games with Incomplete Information, " Journal of Optimization Theory and Applications, 62(3), 1989, 467-488.
49. K. R. Parthasarathy (1967), Probability Measures on Metric Spaces, New York: Academic Press.
50. A. Pazgal, "Satisficing Leads to Cooperation in Mutual Interest Games", International Journal of Game Theory, 26, 1997, 439-453.
51. A. Robson and F. Vega-Redondo, "Efficient Equilibrium Selection in Evolutionary Games with Random Matching, " Journal of Economic Theory, 70(1), 1996, 65-92.
52. A. Roth and I. Erev, Learning in extensive-form games: experimental data and simple dynamic models in the intermediate term, " Games Econ. Behav. 8, 1995, 164-212.
53. R. Selten, "The Chain Store Pradaox, " Theory and Decision, 9, 1978, 127-159.
54. R. Selten, "Evolution, Learning and Economic Behavior, " Games and Economic Behavior 3 (1991), 3-24.
55. R. Selten and R. Stoecker, End behavior in sequences of finite Prisoners? Dilemma supergames, " J. Econ. Behav. Organ.7 (1986), 47-70.
56. H. Simon, "A Behavioral Model of Rational Choice, " Quarterly Journal of Economics, 69 (1955), 99-118.
57. H. Simon, Models of Man, 1957, New York.
58. H. Simon, "Theories of Decision Making in Economics and Behavioral Science, " American Economic Review, 49(1), 1959, 253-283.
59. P. Suppes and R. Atkinson, "Markov Learning Models for Multiperson Interactions, " Stanford: Stanford University Press, 1960.
60. P. Young, "The Evolution of Conventions, " Econometrica, 61(1), 1993, 57-84.