Measuring beliefs and rewards: A neuroeconomic approach

Quarterly Journal of Economics

Volumn 125, Issue 3, 2010, Pages 923-960

  Caplin, Andrew ^a   Dean, Mark ^b   Glimcher, Paul W ^a   Rutledge, Robb B ^a  

^a NEW YORK UNIVERSITY   (United States)

^b BROWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77956586665     PISSN: 00335533     EISSN: 15314650     Source Type: Journal    
DOI: 10.1162/qjec.2010.125.3.923     Document Type: Article

References (46)

1. Abler, Birgit, Henrik Walter, Susanne Erk, Hannes Kammerer, and Manfred Spitzer, "Prediction Error as a Linear Function of Reward Probability Is Coded in Human Nucleus Accumbens," NeuroImage, 31 (2006), 790-795.
2. Bayer, Hannah M., and Paul W. Glimcher, "Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal," Neuron, 47 (2005), 129-141.
3. Bayer, Hannah M., Brian Lau, and Paul W. Glimcher, "Statistics of Midbrain Dopamine Neuron Spike Trains in the Awake Primate," Journal of Neurophysiology, 98 (2007), 1428-1439.
4. Bernheim, B. Douglas, "On the Potential of Neuroeconomics: A Critical (but Hopeful) Appraisal," American Economic Journal: Microeconomics, 1 (2009), 1-41.
5. Bernheim, B.Douglas, and Antonio Rangel, "Addiction and Cue-TriggeredDecision Processes," American Economic Review, 94 (2004), 1558-1590.
6. Berridge, Kent C., and Terry E. Robinson, "What Is the Role of Dopamine in Reward: Hedonic Impact, Reward Learning, or Incentive Salience?" Brain Research Reviews, 28 (1998), 309-369.
7. Bossaerts, Peter, Kerstin Preuschoff, and Ming Hsu, "The Neurobiological Foundations of Valuation in Human Decision-Making under Uncertainty," in Neuroeconomics: Decision Making and the Brain, PaulW. Glimcher, Colin F. Camerer, Ernst Fehr, and Russell A. Poldrack, eds. (New York: Academic Press, 2008).
8. Caplin, Andrew, and Mark Dean, "Axiomatic Methods, Dopamine and Reward Prediction Error," Current Opinion in Neurobiology, 18 (2008a), 197-202.
9. Caplin, Andrew, and Mark Dean, "Axiomatic Neuroeconomics," in Neuroeconomics: Decision Making and the Brain, Paul W. Glimcher, Colin F. Camerer, Ernst Fehr, and Russell A. Poldrack, eds. (New York: Academic Press, 2008b).
10. Caplin, Andrew, and Mark Dean, "Dopamine, Reward Prediction Error, and Economics," Quarterly Journal of Economics, 123 (2008c), 663-702.
11. Charness, Gary, and Dan Levin, "When Optimal Choices Feel Wrong: A Laboratory Study of Bayesian Updating, Complexity, and Affect," American Economic Review, 95 (2005), 1300-1309.
12. Cheung, Yin-Wong, and Daniel Friedman, "Individual Learning in Normal Form Games: Some Laboratory Results," Games and Economic Behavior, 19 (1997), 46-76.
13. D'Ardenne, Kimberlee, Samuel M. McClure, Leigh E. Nystrom, and Jonathan D. Cohen, "BOLD Responses Reflecting Dopaminergic Signals in the Human Ventral Tegmental Area," Science, 319 (2008), 1264-1267.
14. Daw, Nathaniel D., Sham Kakade, and Peter Dayan, "Opponent Interactions between Serotonin and Dopamine," Neural Networks, 15 (2002), 603-616.
15. Dayan, Peter, and Quentin J. M. Huys, "Serotonin in Affective Control," Annual Review of Neuroscience, 32 (2009), 95-126.
16. Delgado, Mauricio R., Melinda M. Miller, Souheil Inati, and Elizabeth A. Phelps, "An fMRI Study of Reward-Related Probability Learning," NeuroImage, 24 (2005), 862-873.
17. Fudenberg, Drew, and David Levine, "Learning in Games: Where Do We Stand?" European Economic Review, 42 (1998), 631-639.
18. Gallistel, C. Randy, and John Gibbon, "Time, Rate and Conditioning," Psychological Review, 107 (2000), 289-344.
19. Hollerman, Jeffrey R., and Wolfram Schultz, "Dopamine Neurons Report an Error in the Temporal Prediction of Reward during Learning," Nature Neuroscience, 1 (1998), 304-309.
20. Huber, Peter J., "The Behavior of Maximum Likelihood Estimates under Nonstandard Conditions," in Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1 (Berkeley: University of California Press, 1967).
21. Huettel, Scott A., Allen W. Song, and Gregory McCarthy, Functional Magnetic Resonance Imaging (Sunderland, MA: Sinauer Associates, 2004).
22. Kahneman, Daniel, and Amos Tversky, "Prospect Theory: An Analysis of Decision under Risk," Econometrica, 47 (1979), 263-292.
23. Knutson, Brian, and Sasha E. B. Gibbs, "Linking Nucleus Accumbens Dopamine and Blood Oxygenation," Psychopharmacology, 191 (2007), 813-822.
24. Knutson, Brian, and Richard Peterson, "Neurally Reconstructing Expected Utility," Games and Economic Behavior, 52 (2005), 305-315.
25. Köszegi, Botond, and Matthew Rabin, "'A Model of Reference-Dependent Preferences," Quarterly Journal of Economics, 121 (2006), 1133-1165.
26. Li, Jian, Samuel M. McClure, Brooks King-Casas, and P. Read Montague, "Policy Adjustment in a Dynamic Economic Game," PlosONE, 20 (2006), 103-113.
27. McClure, Samuel M., Gregory S. Berns, and P. Read Montague, "Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum," Neuron, 38 (2003), 339-346.
28. McClure, Samuel M., David I. Laibson, George Loewenstein, and Jonathan D. Cohen, "Separate Neural Systems Value Immediate and Delayed Monetary Rewards," Science, 306 (2004), 503-507.
29. Mirenowicz, Jacques, and Wolfram Schultz, "Importance of Unpredictability for Reward Responses in Primate Dopamine Neurons," Journal of Neurophysiology, 72 (1994), 1024-1027.
30. Montague, P. Read, Peter Dayan, and Terrence J. Sejnowski, "A Framework for Mesencephalic Dopamine Systems Based on Predictive Hebbian Learning," Journal of Neuroscience, 16 (1996), 1936-1947.
31. Neto, Lia L., Edson Oliveira, Francisco Correia, and António G. Ferreira, "The Human Nucleus Accumbens: Where Is It? A Stereotactic, Anatomical and Magnetic Resonance Imaging Study," Neuromodulation, 11 (2008), 13-22.
32. Nyarko, Yaw, and Andrew Schotter, "An Experimental Study of Belief Learning Using Real Beliefs," Econometrica, 70 (2002), 971-1005.
33. O'Doherty, John P., Peter Dayan, Karl J. Friston, Hugo D. Critchley, and Raymond J. Dolan, "Temporal Difference Models and Reward-Related Learning in the Human Brain," Neuron, 38 (2003), 329-337.
34. O'Doherty, John P., Peter Dayan, Johannes Schultz, Ralf Deichmann, Karl Friston, and Raymond J. Dolan, "Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning," Science, 304 (2004), 452-454.
35. Pessiglione, Mathias, Ben Seymour, Guillaume Flandin, Raymond J. Dolan, and Chris D. Frith, "Dopamine-Dependent Prediction Errors Underpin Reward-Seeking Behavior in Humans," Nature, 442 (2006), 1042-1045.
36. Phillips, Paul E. M., Garret D. Stuber, Michael L. A. V. Heien, R. MarkWightman, and Regina M. Carelli, "Subsecond Dopamine Release Promotes Cocaine Seeking," Nature, 422 (2003), 614-618.
37. Redgrave, Peter, and Kevin Gurney, "The Short-Latency Dopamine Signal: A Role in Discovering Novel Actions?" Nature Reviews Neuroscience, 7 (2006), 967-975.
38. Rutström, E. Elisabet, and Nathaniel T. Wilcox, "Stated Beliefs versus Empirical Beliefs: A Methodological Inquiry and Experimental Test" (http://www.uh.edu/econpapers/RePEc/hou/wpaper/2006-02.pdf, 2006).
39. Samuelson, William, and Richard Zeckhauser, "Status Quo Bias in Decision Making," Journal of Risk and Uncertainty, 1 (1988), 7-59.
40. Schultz, Wolfram, Paul Apicella, and Tomas Ljungberg, "Responses of Monkey Dopamine Neurons to Reward and Conditioned Stimuli during Successive Steps of Learning a Delayed Response Task," Journal of Neuroscience, 13 (1993), 900-913.
41. Schultz, Wolfram, Peter Dayan, and P. Read Montague, "A Neural Substrate of Prediction and Reward," Science, 275 (1997), 1593-1599.
42. Stahl, Dale, and Paul Wilson, "On Players' Models of Other Players: Theory and Experimental Evidence," Games and Economic Behavior, 10 (1995), 218-254.
43. Talairach, Jean, and Pierre Tournoux, Co-planar Stereotaxic Atlas of the Human Brian (New York: Thieme Medical Publishers, 1988).
44. White, Halbert, "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, 48 (1980), 817-830.
45. Wise, Roy A., "Dopamine, Learning, and Motivation," Nature Reviews Neuroscience, 5 (2004), 1-12.
46. Zink, Caroline F., Giuseppe Pagnoni, Megan E. Martin, Mukeshwar Dhamala, and Gregory S. Berns, "Human Striatal Response to Salient Nonrewarding Stimuli," Journal of Neuroscience, 23 (2003), 8092-8097.