Maximization, learning, and economic behavior

Proceedings of the National Academy of Sciences of the United States of America

Volumn 111, Issue SUPPL.3, 2014, Pages 10818-10825

  Erev, Ido ^a,b   Roth, Alvin E ^c  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b UNIVERSITY OF WARWICK   (United Kingdom)

^c STANFORD UNIVERSITY   (United States)

Author keywords

Contingencies of reinforcements; Decisions from experience; Experience description gap; Mechanism design; Reinforcement learning

Indexed keywords

BEHAVIOR; BEHAVIORAL ECONOMICS; COMPREHENSION; COORDINATION; DECISION MAKING; DESCRIPTIVE RESEARCH; ECONOMIC ASPECT; EXPLORATORY BEHAVIOR; FEEDBACK SYSTEM; FIELD EXPERIMENT; GAME; HUMAN; LEARNING; LIFE EVENT; PERSONAL EXPERIENCE; PREDICTION; PRIORITY JOURNAL; PROBABILITY; PSYCHOLOGIST; PUNISHMENT; REINFORCEMENT; REVIEW; RISK ASSESSMENT; TASK PERFORMANCE; THEORETICAL MODEL;

CONTINGENCIES OF REINFORCEMENTS; DECISIONS FROM EXPERIENCE; EXPERIENCE-DESCRIPTION GAP; MECHANISM DESIGN; REINFORCEMENT LEARNING;

ADAPTATION, PSYCHOLOGICAL; CHOICE BEHAVIOR; DECISION MAKING; FEEDBACK, PHYSIOLOGICAL; GAME THEORY; HUMANS; LEARNING; REINFORCEMENT (PSYCHOLOGY);

EID: 84904623675     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1402846111     Document Type: Review

References (85)

1. Allais M (1953) Le comportement de l'homme rationnel devant le risque: Critique des postulats et axiomes de l'école Américaine. Econometrica 21(4):503-546.
2. Kahneman D, Tversky A (1979) Prospect theory: An analysis of decision under risk. Econometrica 47:263-291.
3. Ariely D (2008) Predictably Irrational (HarperCollins, New York).
4. Bernoulli D (1738) Specimen theoriae novae de mensura sortis. Papers Imp Acad Sci St Petersburg 5:175-192.
5. von Neumann J, Morgenstern O (1947) Theory of Games and Economic Behavior (Princeton Univ Press, Princeton), 2nd Ed.
6. Savage LJ (1954) The Foundations of Statistics (Wiley, New York).
7. Wakker PP (2010) Prospect Theory: For Risk and Ambiguity (Cambridge Univ Press, Cambridge, UK), Vol 44.
8. Fehr E, Schmidt KM (1999) A theory of fairness, competition, and cooperation. Q J Econ 114(3):817-868.
9. Bolton GE, Ockenfels A (2000) ERC: A theory of equity, reciprocity, and competition. Am Econ Rev 90(1):166-193.
10. Gigerenzer G, Selten R (2002) Bounded Rationality: The Adaptive Toolbox (Mit Press, Cambridge, MA).
11. Binmore K, Shaked A (2010) Experimental economics: Where next? J Econ Behav Organ 73(1):87-100.
12. Ert E, Erev I (2013) On the descriptive value of loss aversion in decisions under risk: Six clarifications. Judgm Decis Mak 8:214-235.
13. Skinner BF (1953) Science and Human Behavior (Simon and Schuster, New York).
14. Gonzalez C, Lerch JF, Lebiere C (2003) Instance-based learning in dynamic decision making. Cogn Sci 27(4):591-635. (Pubitemid 36742409)
15. Gilboa I, Schmeidler D (1995) Case-based decision theory. Q J Econ 110(3):605-639.
16. Güth W, Schmittberger R, Schwarze B (1982) An experimental analysis of ultimatum bargaining. J Econ Behav Organ 3(4):367-388.
17. Harrison GW, Hirshleifer J (1989) An experimental evaluation of weakest link/best shot models of public goods. J Polit Econ 97(1):201-225.
18. Prasnikar V, Roth AE (1992) Considerations of fairness and strategy: Experimental data from sequential games. Q J Econ 107(3):865-888.
19. Selten R (1975) Reexamination of the perfectness concept for equilibrium points in extensive games. Int J Game Theory 4(1):25-55.
20. Roth AE, Erev I (1995) Learning in extensive form games: Experimental data and simple dynamic models in the intermediate term. Games Econ Behav 8:164-212.
21. Gale J, Binmore KG, Samuelson L (1995) Learning to be imperfect: The ultimatum game. Games Econ Behav 8(1):56-90.
22. Fudenberg D, Levine DK (1997) Measuring players ' losses in experimental games. Q J Econ 112(2):507-536. (Pubitemid 127077769)
23. Jehiel P (2005) Analogy-based expectation equilibrium. J Econ Theory 123(2):81-104.
24. Erev I, Haruvy E (2013) Learning and the economics of small decisions. The Handbook of Experimental Economics, eds Kagel JH, Roth AE (Princeton Univ Press, Princeton), in press. Available at www.utdallas.edu/?eeh017200/papers/ LearningChapter.pdf. Accessed May 16, 2014.
25. Nevo I, Erev I (2012) On surprise, change, and the effect of recent outcomes. Front Cogn Sci 3:24.
26. Teoderescu K, Amir M, Erev I (2013) The experience-description gap and the role of the inter decision interval. Decision Making: Neural and Behavioural Approaches, eds Pammi C, Srinivasan N (Elsevier, Amsterdam).
27. Barron G, Erev I (2003) Small feedback based decisions and their limited correspondence to description based decisions. J Behav Decis Making 16:215-233.
28. Barkan R, Zohar D, Erev I (1998) Accidents and decision making under uncertainty: A comparison of four models. Organ Behav Hum Decis Process 74(2):118-144. (Pubitemid 128347349)
29. Hertwig R, Barron G, Weber E, Erev I (2004) Decisions from experience and the weighting of rare events. Psychol Sci 15(8):534-539. (Pubitemid 39080417)
30. Ungemach C, Chater N, Stewart N (2009) Are probabilities overweighted or underweighted when rare outcomes are experienced (rarely)? Psychol Sci 20(4):473-479.
31. Rakow T, Newell BR (2010) Degrees of uncertainty: An overview and framework for future research on experience-based choice. J Behav Decis Making 23:1-14.
32. Taleb NN (2007) The Black Swan: The Impact of the Highly Improbable Fragility (Random House, New York).
33. Erev I, Ert E, Roth AE (2010) A choice prediction competition for market entry games: An introduction. Games 1:117-136.
34. Shafir S, Reich T, Tsur E, Erev I, Lotem A (2008) Perceptual accuracy and conflicting effects of certainty on risk-taking behaviour. Nature 453(7197):917-920. (Pubitemid 351832558)
35. Di Guida S, Marchiori D, Erev I (2012) Decisions among defaults and the effect of the option to do nothing. Econ Lett 117(3):790-793.
36. Busemeyer JR, Townsend JT (1993) Decision field theory: A dynamic-cognitive approach to decision making in an uncertain environment. Psychol Rev 100(3):432-459.
37. Weinstock S (1958) Acquisition and extinction of a partially reinforced running response at a 24-hour intertrial interval. J Exp Psychol 56(2):151-158.
38. Bereby-Meyer Y, Roth AE (2006) The speed of learning in noisy games: Partial reinforcement and the sustainability of cooperation. Am Econ Rev 96(4):1029-1042.
39. Erev I, Barron G (2005) On adaptation, maximization, and reinforcement learning among cognitive strategies. Psychol Rev 112(4):912-931. (Pubitemid 41677523)
40. Estes WK (1950) Toward a statistical theory of learning. Psychol Rev 57(2):94-107.
41. Erev I, et al. (2010) A choice prediction competition, for choices from experience and from description. J Behav Decis Making 23:15-47.
42. Chen W, Liu SY, Chen CH, Lee YS (2011) Bounded memory, inertia, sampling and weighting model for market entry games. Games 2(1):187-199.
43. Fiedler K (2000) Beware of samples! A cognitive-ecological sampling approach to judgment biases. Psychol Rev 107(4):659-676.
44. Kareev Y (2000) Seven (indeed, plus or minus two) and the detection of correlations. Psychol Rev 107(2):397-402.
45. Hertwig R, Pleskac TJ (2010) Decisions from experience: Why small samples? Cognition 115(2):225-237.
46. Plonsky O, Teodorescu K, Erev I (2014) Reliance on small samples, sensitivity to signals and maximization. Working Paper (Technion, Haifa, Israel).
47. Denrell J, March JG (2001) Adaptation as information restriction: The hot stove effect. Organ Sci 12(5):523-538.
48. Einhorn HJ, Hogarth RM (1978) Confidence in judgment: Persistence of the illusion of validity. Psychol Rev 85(5):395.
49. Hertwig R, Erev I (2009) The description-experience gap in risky choice. Trends Cogn Sci 13(12):517-523.
50. Lejarraga T, Gonzalez C (2011) Effects of feedback and complexity on repeated decisions from description. Organ Behav Hum Decis Process 116(2):286-295.
51. Yechiam E, Barron G, Erev I (2005) The role of personal experience in contributing to different patterns of response to rare terrorist attacks. J Conflict Resolut 49(3):430-439. (Pubitemid 40856027)
52. Jessup RK, Bishara AJ, Busemeyer JR (2008) Feedback produces divergence from prospect theory in descriptive choice. Psychol Sci 19(10):1015-1022.
53. Barron G, Leider S, Stack J (2008) The effect of safe experience on a warnings' impact: Sex, drugs, and rock-n-roll. Organ Behav Hum Decis Process 106(2):125-142.
54. Battalio R, Samuelson L, Van Huyck J (2001) Optimization incentives and coordination failure in laboratory stag hunt games. Econometrica 69(3):749-764. (Pubitemid 32514249)
55. Skyrms B (2004) The Stag Hunt and the Evolution of Social Structure (Cambridge Univ Press, Cambridge, UK).
56. Erev I, Grainer B, The 1-800 critique, counter-examples, and the future of behavioral economics. The Handbook on Methods of Modern Experimental Economics, eds Frechette G, Schotter A (Oxford Univ Press, Oxford), in press.
57. Marchiori D, Di Guida S, Erev I (2014) Noisy retrieval models of over- and under-sensitivity to rare events. Working Paper (University of Southern Denmark, Odense, Denmark).
58. Fudenberg D, Levine DK (1993) Self-confirming equilibrium. Econometrica 61(3):523-545.
59. Erev I, Rodensky D (2004) [Gentle enforcement of safety rules. A Final Report of a Research Supported by the Committee for Accident Prevention in the Israeli Ministry of Industry & Commerce] (Technion, Haifa, Israel). Hebrew.
60. Erev I, et al. (2010) The value of gentle enforcement on safe medical procedures. Qual Saf Health Care 19(5):1-3.
61. Schurr A, Erev I, Rodensky D (2014) The effect of unpleasant experiences on evaluation and behavior. Working Paper (Technion, Haifa, Israel).
62. Gneezy U, Rustichini A (2000) Fine is a price, a. J Legal Stud 29:1.
63. Meyer J (2004) Conceptual issues in the study of dynamic hazard warnings. Hum Factors 46(2):196-204.
64. Miron-Shatz T, Barron G, Hanoch Y, Gummerum M, Doniger GM (2010) To give or not to give: Parental experience and adherence to the Food and Drug Administration warning about over-the-counter cough and cold medicine usage. Judgm Decis Mak 5(6):428-436.
65. Milgrom P (1998) Putting Auction Theory to Work (Cambridge Univ Press, Cambridge, UK).
66. Engelbrecht-Wiggans R, Katok E (2007) Regret in auctions: Theory and evidence. Econ Theory 33(1):81-101.
67. Kagel JH, Harstad RM, Levin D (1987) Information impact and allocation rules in auctions with affiliated private values: A laboratory study. Econometrica 55(6):1275-1304.
68. Ariely D, Ockenfels A, Roth AE (2005) An experimental analysis of ending rules in internet auctions. RAND J Econ 36(4):891-908.
69. Ockenfels A, Roth AE (2002) The timing of bids in internet auctions: Market design, bidder behavior, and artificial agents. AI Mag 23(3):79.
70. Abdulkadiroǧlu A, Pathak PA, Roth AE, Sönmez T (2005) The Boston public school match. Am Econ Rev 95(2):368-371.
71. Abdulkadiroǧlu A, Sönmez T (2003) School choice: A mechanism design approach. Am Econ Rev 93(3):729-747.
72. Abdulkadiroglu A, Pathak PA, Roth AE (2009) Strategy-Proofness Versus Efficiency in Matching with Indifferences: Redesigning the New York City High School Match (National Bureau of Economic Research, Cambridge, MA), No. w14864.
73. Gale D, Shapley LS (1962) College admissions and the stability of marriage. Am Math Mon 69(1):9-15.
74. Roth AE (2008) What have we learned from market design? Econ J 118(527):285-310.
75. Seligman ME (1972) Learned helplessness. Annu Rev Med 23:407-412.
76. Beck AT, Rush AJ, Shaw BF, Emery G (1979) Cognitive Therapy of Depression (Guilford, New York).
77. Gopher D, Weil M, Bareket T (1994) Transfer of skill from a computer game trainer to flight. Hum Factors 36(3):387-405. (Pubitemid 24328316)
78. Yechiam E, Erev I, Gopher D (2001) On the potential value and limitations of emphasis change and other exploration-enhancing training methods. J Exp Psychol Appl 7(4):277-285. (Pubitemid 33598028)
79. Teodorescu K, Erev I (2014) On the decision to explore new alternatives: The coexistence of under- and over-exploration. J Behav Decis Making 27(2):109-123.
80. Young HP (1993) The evolution of conventions. Econometrica 61(1):57-84.
81. Erev I, Ingram P, Raz O, Shany D (2010) Continuous punishment and the potential of gentle rule enforcement. Behav Processes 84(1):366-371.
82. Becker GS (1968) Crime and punishment: An economic approach. J Polit Econ 76:169-217.
83. Schrank DL, Lomax TJ (2007) The 2007 Urban Mobility Report (Texas A&M Transportation Institute, College Station, TX).
84. Rapoport A, Seale DA, Erev I, Sundali JA (1998) Equilibrium play in large group market entry games. Manage Sci 44(1):119-141. (Pubitemid 128569646)
85. Sandholm WH (2002) Evolutionary implementation and congestion pricing. Rev Econ Stud 69(3):667-689.