Dopamine reward prediction error responses reflect marginal utility

Current Biology

Volumn 24, Issue 21, 2014, Pages 2491-2500

  Stauffer, William R ^a   Lak, Armin ^a   Schultz, Wolfram ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE;

ANIMAL; DECISION MAKING; HIGH RISK BEHAVIOR; MALE; METABOLISM; PHYSIOLOGY; PROBABILITY; PSYCHOLOGY; REWARD; RHESUS MONKEY; STATISTICS;

ANIMALS; CHOICE BEHAVIOR; DOPAMINE; MACACA MULATTA; MALE; PROBABILITY; REWARD; RISK-TAKING; STOCHASTIC PROCESSES;

EID: 84913603811     PISSN: 09609822     EISSN: 18790445     Source Type: Journal    
DOI: 10.1016/j.cub.2014.08.064     Document Type: Article

References (50)

1. D. Bernoulli Exposition of a new theory on the measurement of risk Econometrica 22 1954 23 36
2. A. Mas-Colell, M.D. Whinston, and J.R. Green Microeconomic Theory 1995 Oxford University Press Oxford
3. J. Von Neumann, and O. Morgenstern Theory of Games and Economic Behavior 1944 Princeton University Press Princeton
4. G. Debreu Cardinal utility for even-chance mixtures of pairs of sure prospects Rev. Econ. Stud. 26 1959 174 177
5. J.M. Perloff Microeconomics Fifth Edition 2009 Pearson Boston
6. M.L. Platt, and P.W. Glimcher Neural correlates of decision variables in parietal cortex Nature 400 1999 233 238
7. C. Padoa-Schioppa, and J.A. Assad Neurons in the orbitofrontal cortex encode economic value Nature 441 2006 223 226
8. J.W. Kable, and P.W. Glimcher The neural correlates of subjective value during intertemporal choice Nat. Neurosci. 10 2007 1625 1633
9. P.N. Tobler, P.C. Fletcher, E.T. Bullmore, and W. Schultz Learning-related human brain activations reflecting individual finances Neuron 54 2007 167 175
10. S. Kobayashi, and W. Schultz Influence of reward delays on responses of dopamine neurons J. Neurosci. 28 2008 7837 7846
11. S. Kim, J. Hwang, and D. Lee Prefrontal coding of temporally discounted values during intertemporal choice Neuron 59 2008 161 172
12. A. Pine, B. Seymour, J.P. Roiser, P. Bossaerts, K.J. Friston, H.V. Curran, and R.J. Dolan Encoding of marginal utility across time in the human brain J. Neurosci. 29 2009 9575 9581
13. I. Levy, J. Snell, A.J. Nelson, A. Rustichini, and P.W. Glimcher Neural representation of subjective value under risk and ambiguity J. Neurophysiol. 103 2010 1036 1047
14. D.J. Levy, and P.W. Glimcher Comparing apples and oranges: using reward-specific and reward-general subjective value representation in the brain J. Neurosci. 31 2011 14693 14707
15. N. So, and V. Stuphorn Supplementary eye field encodes reward prediction error J. Neurosci. 32 2012 2950 2963
16. F. Grabenhorst, I. Hernádi, and W. Schultz Prediction of economic choice by primate amygdala neurons Proc. Natl. Acad. Sci. USA 109 2012 18950 18955
17. A. Lak, W.R. Stauffer, and W. Schultz Dopamine prediction error responses integrate subjective value from different reward dimensions Proc. Natl. Acad. Sci. USA 111 2014 2343 2348
18. W. Schultz, P. Dayan, and P.R. Montague A neural substrate of prediction and reward Science 275 1997 1593 1599
19. H. Nakahara, H. Itoh, R. Kawagoe, Y. Takikawa, and O. Hikosaka Dopamine neurons can represent context-dependent prediction error Neuron 41 2004 269 280
20. H.M. Bayer, and P.W. Glimcher Midbrain dopamine neurons encode a quantitative reward prediction error signal Neuron 47 2005 129 141
21. R.S. Sutton, and A.G. Barto Reinforcement Learning: An Introduction 1998 The MIT Press Cambridge
22. F. Gul A theory of disappointment aversion Econometrica 59 1991 667 686
23. B. Koszegi, and M. Rabin A model of reference dependent preferences Q. J. Econ. 121 2006 1133 1165
24. T. Caraco, S. Martindale, and T. Whittam An empirical demonstration of risk-sensitive foraging preferences Anim. Behav. 28 1980 820 830
25. M. Machina Choice under uncertainty: problems solved and unsolved Econ. Perspect. 1 1987 121 154
26. D.R. Luce Utility of Gains and Losses: Measurement-Theoretic and Experimental Approached 2000 Lawerence Erlbaum Associates Mahwah
27. H. Markowitz The utility of wealth J. Polit. Econ. 60 1952 151 158
28. D. Prelec, and G. Loewenstein Decision making over time and under uncertainty: a common approach Manage. Sci. 37 1991 770 786
29. P.J.H. Schoemaker The expected utility model: its variants, purposes, evidence and limitations J. Econ. Lit. 20 1982 529 563
30. M. Rothschild, and J. Stiglitz Increasing risk: I. A definition J. Econ. Theory 2 1970 225 243
31. P. Fishburn Convex stochastic dominance with continuous distribution functions J. Econ. Theory 7 1974 143 158
32. H. Yamada, A. Tymula, K. Louie, and P.W. Glimcher Thirst-dependent risk preferences in monkeys identify a primitive form of wealth Proc. Natl. Acad. Sci. USA 110 2013 15788 15793
33. M. Friedman, and L. Savage The utility analysis of choices involving risk J. Polit. Econ. 56 1948 279 304
34. A.N. McCoy, and M.L. Platt Risk-sensitive neurons in macaque posterior cingulate cortex Nat. Neurosci. 8 2005 1220 1227
35. M. O'Neill, and W. Schultz Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value Neuron 68 2010 789 800
36. S. Kim, I. Bobeica, N.J. Gamo, A.F.T. Arnsten, and D. Lee Effects of α-2A adrenergic receptor agonist on time and risk preference in primates Psychopharmacology (Berl.) 219 2012 363 375
37. C.A. Holt, and S.K. Laury Risk aversion and incentive effects Am. Econ. Rev. 92 2002 1644 1655
38. M. Allais Le comportement de l'homme rationnel devant le risque: critique des postulats et axiomes de l'ecole americaine Econometrica 21 1953 503 546
39. D. Ellsberg Risk, ambiguity, and the savage axioms Q. J. Econ. 75 1961 643 669
40. D. Kahneman, and A. Tversky Prospect theory: an analysis of decision under risk Econometrica 47 1979 263 291
41. R. Gonzalez, and G. Wu On the shape of the probability weighting function Cognit. Psychol. 38 1999 129 166
42. E.E. Steinberg, R. Keiflin, J.R. Boivin, I.B. Witten, K. Deisseroth, and P.H. Janak A causal link between prediction errors, dopamine neurons and learning Nat. Neurosci. 16 2013 966 973
43. L.-H. Tai, A.M. Lee, N. Benavidez, A. Bonci, and L. Wilbrecht Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value Nat. Neurosci. 15 2012 1281 1289
44. B. Lau, and P.W. Glimcher Value representations in the primate striatum during matching behavior Neuron 58 2008 451 463
45. A. Dickinson, and B. Balleine Motivational control of goal-directed action Anim. Learn. Behav. 22 1994 1 18
46. P.N. Tobler, C.D. Fiorillo, and W. Schultz Adaptive coding of reward value by dopamine neurons Science 307 2005 1642 1645
47. C.D. Fiorillo, P.N. Tobler, and W. Schultz Discrete coding of reward probability and uncertainty by dopamine neurons Science 299 2003 1898 1902
48. M. O'Neill, and W. Schultz Risk prediction error coding in orbitofrontal neurons J. Neurosci. 33 2013 15810 15814
49. I.E. Monosov, and O. Hikosaka Selective and graded coding of reward uncertainty by neurons in the primate anterodorsal septal region Nat. Neurosci. 16 2013 756 762
50. P.N. Tobler, G.I. Christopoulos, J.P. O'Doherty, R.J. Dolan, and W. Schultz Risk-dependent reward value signal in human prefrontal cortex Proc. Natl. Acad. Sci. USA 106 2009 7185 7190