The Neurobiology of Decision: Consensus and Controversy

Neuron

Volumn 63, Issue 6, 2009, Pages 733-745

  Kable, Joseph W ^a   Glimcher, Paul W ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE;

CAUDATE NUCLEUS; CINGULATE GYRUS; CORPUS STRIATUM; DECISION MAKING; DOPAMINERGIC ACTIVITY; HUMAN; MENTAL PERFORMANCE; MESENCEPHALON; NEUROBIOLOGY; NONHUMAN; ORBITAL CORTEX; PARIETAL LOBE; PREFRONTAL CORTEX; PRIMATE; PRIORITY JOURNAL; REINFORCEMENT; REVIEW; REWARD; SOCIAL BEHAVIOR;

ANIMALS; BRAIN; BRAIN MAPPING; COMPUTER SIMULATION; CONSENSUS; DECISION MAKING; HUMANS; LEARNING; MODELS, NEUROLOGICAL; NERVE NET; NEURAL PATHWAYS; NEUROBIOLOGY; NEURONS; NEUROPSYCHOLOGICAL TESTS;

EID: 70349138795     PISSN: 08966273     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuron.2009.09.003     Document Type: Review

References (122)

1. Adolphs R. Cognitive neuroscience of human social behaviour. Nat. Rev. Neurosci. 4 (2003) 165-178
2. Andersen R.A., and Buneo C.A. Intentional maps in posterior parietal cortex. Annu. Rev. Neurosci. 25 (2002) 189-220
3. Balleine B.W., and Dickinson A. Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology 37 (1998) 407-419
4. Balleine B.W., Daw N.D., and O'Doherty J.P. Multiple forms of value learning and the function of dopamine. In: Glimcher P.W., Camerer C.F., Fehr E., and Poldrack R.A. (Eds). Neuroeconomics: Decision Making and the Brain (2009), Academic Press, New York, NY 367-387
5. Barraclough D.J., Conroy M.L., and Lee D. Prefrontal cortex and decision making in a mixed-strategy game. Nat. Neurosci. 7 (2004) 404-410
6. Basso M.A., and Wurtz R.H. Modulation of neuronal activity in superior colliculus by changes in target probability. J. Neurosci. 18 (1998) 7519-7534
7. Bayer H.M., and Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47 (2005) 129-141
8. Bayer H.M., Lau B., and Glimcher P.W. Statistics of midbrain dopamine neuron spike trains in the awake primate. J. Neurophysiol. 98 (2007) 1428-1439
9. Behrens T.E.J., Woolrich M.W., Walton M.E., and Rushworth M.F.S. Learning the value of information in an uncertain world. Nat. Neurosci. 10 (2007) 1214-1221
10. Bernheim B.D., and Rangel A. Addiction and cue-triggered decision processes. Am. Econ. Rev. 94 (2004) 1558-1590
11. Bossaerts P., Preuschoff K., and Hsu M. The neurobiological foundations of valuation in human decision-making under uncertainty. In: Glimcher P.W., Camerer C.F., Fehr E., and Poldrack R.A. (Eds). Neuroeconomics: Decision Making and the Brain (2009), Academic Press, New York, NY 353-365
12. Chiu P.H., Kayali M.A., Kishida K.T., Tomlin D., Klinger L.G., Klinger M.R., and Montague P.R. Self responses along cingulate cortex reveal quantitative neural phenotype for high-functioning autism. Neuron 57 (2008) 463-473
13. Chiu P.H., Lohrenz T.M., and Montague P.R. Smokers' brains compute, but ignore, a fictive error signal in a sequential investment task. Nat. Neurosci. 11 (2008) 514-520
14. Churchland A.K., Kiani R., and Shadlen M.N. Decision-making with multiple alternatives. Nat. Neurosci. 11 (2008) 693-702
15. Cohen J.D., and Blum K.I. Reward and decision. Neuron 36 (2002) 193-198
16. Colby C.L., and Goldberg M.E. Space and attention in parietal cortex. Annu. Rev. Neurosci. 22 (1999) 319-349
17. D'Ardenne K., McClure S.M., Nystrom L.E., and Cohen J.D. BOLD responses reflecting dopaminergic signals in the human Ventral Tegmental Area. Science 319 (2008) 1264-1267
18. Daw N.D., Kakade S., and Dayan P. Opponent interactions between serotonin and dopamine. Neural Netw. 15 (2002) 617-634
19. Daw N.D., Niv Y., and Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8 (2005) 1704-1711
20. Dayan P., and Balleine B.W. Reward, motivation, and reinforcement learning. Neuron 36 (2002) 285-298
21. de Quervain D.J., Fischbacher U., Treyer V., Schellhammer M., Schnyder U., Buck A., and Fehr E. The neural basis of altruistic punishment. Science 305 (2004) 1254-1258
22. Delgado M.R. Reward-related responses in the human striatum. Ann. N Y Acad. Sci. 1104 (2007) 70-88
23. Dommett E., Coizet V., Blaha C.D., Martindale J., Lefebvre V., Walton N., Mayhew J.E., Overton P.G., and Redgrave P. How visual stimuli activate dopaminergic neurons at short latency. Science 307 (2005) 1476-1479
24. Dorris M.C., and Munoz D.P. Saccadic probability influences motor preparation signals and time to saccadic initiation. J. Neurosci. 18 (1998) 7015-7026
25. Dorris M.C., and Glimcher P.W. Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron 44 (2004) 365-378
26. Fehr E., and Camerer C.F. Social neuroeconomics: The neural circuitry of social preferences. Trends Cogn. Sci. 11 (2007) 419-427
27. Fiorillo C.D., Tobler P.N., and Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299 (2003) 1898-1902
28. Fiorillo C.D., Newsome W.T., and Schultz W. The temporal precision of reward prediction in dopamine neurons. Nat. Neurosci. 11 (2008) 966-973
29. Fox C.R., and Poldrack R.A. Prospect theory and the brain. In: Glimcher P.W., Camerer C.F., Fehr E., and Poldrack R.A. (Eds). Neuroeconomics: Decision Making and the Brain (2009), Academic Press, New York, NY 145-173
30. Frank M.J., Seeberger L.C., and O'Reilly R.C. By carrot or by stick: Cognitive reinforcement learning in parkinsonism. Science 306 (2004) 1940-1943
31. Friedman M. Essays in Positive Economics (1953), University of Chicago Press, Chicago, IL
32. Glimcher P.W. The neurobiology of visual-saccadic decision making. Annu. Rev. Neurosci. 26 (2003) 133-179
33. Glimcher P.W., and Sparks D.L. Movement selection in advance of action in the superior colliculus. Nature 355 (1992) 542-545
34. In: Glimcher P.W., Camerer C.F., Fehr E., and Poldrack R.A. (Eds). Neuroeconomics: Decision Making and the Brain (2009), Academic Press, New York, NY
35. Gold J.I., and Shadlen M.N. Representation of a perceptual decision in developing oculomotor commands. Nature 404 (2000) 390-394
36. Gold J.I., and Shadlen M.N. The neural basis of decision making. Annu. Rev. Neurosci. 30 (2007) 535-574
37. Gul F., and Pesendorfer W. The case for mindless economics. In: Handbook A., Caplin A., and Schotter A. (Eds). The Foundations of Positive and Normative Economics (2008), Oxford University Press, New York, NY 3-41
38. Haber S.N. The primate basal ganglia: Parallel and integrative networks. J. Chem. Neuroanat. 26 (2003) 317-330
39. Hampton A.N., Bossaerts P., and O'Doherty J.P. Neural correlates of mentalizing-related computations during strategic interactions in humans. Proc. Natl. Acad. Sci. USA 105 (2008) 6741-6746
40. Harbaugh W.T., Mayr U., and Burghart D.R. Neural responses to taxation and voluntary giving reveal motives for charitable donations. Science 316 (2007) 1622-1625
41. Hare T.A., O'Doherty J., Camerer C.F., Schultz W., and Rangel A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 28 (2008) 5623-5630
42. Hare T.A., Camerer C.F., and Rangel A. Self-control in decision-making involves modulation of the vmPFC valuation system. Science 324 (2009) 646-648
43. Hayden B.Y., Nair A.C., McCoy A.N., and Platt M.L. Posterior cingulate cortex mediates outcome-contingent allocation of behavior. Neuron 60 (2008) 19-25
44. Hayden B.Y., Pearson J.M., and Platt M.L. Fictive reward signals in the anterior cingulate cortex. Science 324 (2009) 948-950
45. Heeger D.J. Normalization of cell responses in cat striate cortex. Vis. Neurosci. 9 (1992) 181-197
46. Herrnstein R.J. Relative and absolute strength of responses as a function of frequency of reinforcement. J. Exp. Anal. Behav. 4 (1961) 267-272
47. Horwitz G.D., Batista A.P., and Newsome W.T. Representation of an abstract perceptual decision in macaque superior colliculus. J. Neurophysiol. 91 (2004) 2281-2296
48. Houthakker H.S. Revealed preference and the utility function. Economica 17 (1950) 159-174
49. Isa T., Kobayashi Y., and Saito Y. Dynamic modulation of signal transmission through local circuits. In: Hall W.C., and Moschovakis A. (Eds). The Superior Colliculus: New Approaches for Studying Sensorimotor Integration (2004), CRC Press, New York 159-171
50. Janssen P., and Shadlen M.N. A representation of the hazard rate of elapsed time in macaque area LIP. Nat. Neurosci. 8 (2005) 234-241
51. Kable J.W., and Glimcher P.W. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10 (2007) 1625-1633
52. Kahneman D., and Tversky A. Prospect theory: An analysis of decision under risk. Econometrica 47 (1979) 263-291
53. Kiani R., Hanks T.D., and Shadlen M.N. Bounded integration in parietal cortex underlies decisions even when viewing duration is dictated by the environment. J. Neurosci. 28 (2008) 3017-3029
54. Kim J.N., and Shadlen M.N. Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nat. Neurosci. 2 (1999) 176-185
55. Kim S., Hwang J., and Lee D. Prefrontal coding of temporally discounted values during intertemporal choice. Neuron 59 (2008) 161-172
56. King-Casas B., Tomlin D., Anen C., Camerer C.F., Quartz S.R., and Montague P.R. Getting to know you: Reputation and trust in a two-person economic exchange. Science 308 (2005) 78-83
57. King-Casas B., Sharp C., Lomax-Bream L., Lohrenz T., Fonagy P., and Montague P.R. The rupture and repair of cooperation in borderline personality disorder. Science 321 (2008) 806-810
58. Knutson B., and Cooper J.C. Functional magnetic resonance imaging of reward prediction. Curr. Opin. Neurol. 18 (2005) 411-417
59. Kobayashi S., and Schultz W. Influence of reward delays on responses of dopamine neurons. J. Neurosci. 28 (2008) 7837-7846
60. Koszegi B., and Rabin M. A model of reference-dependent preferences. Q. J. Econ. 121 (2006) 1133-1166
61. Lau B., and Glimcher P.W. Value representations in the primate striatum during matching behavior. Neuron 58 (2008) 451-463
62. Lee D. Game theory and neural basis of social decision making. Nat. Neurosci. 11 (2008) 404-409
63. Lee P., and Hall W.C. An in vitro study of horizontal connections in the intermediate layer of the superior colliculus. J. Neurosci. 26 (2006) 4763-4768
64. Leon M.I., and Shadlen M.N. Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 24 (1999) 415-425
65. Leon M.I., and Shadlen M.N. Representation of time by neurons in the posterior parietal cortex of the macaque. Neuron 38 (2003) 317-327
66. Levy, I., Rustichini, A., and Glimcher, P.W. (2007). A single system represents subjective value under both risky and ambiguous decision-making in humans. In 37th Annual Society for Neuroscience Meeting (San Diego, CA).
67. Lo C.C., and Wang X.J. Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nat. Neurosci. 9 (2006) 956-963
68. Marr D. Vision: A Computational Investigation into the Human Representation and Processing of Visual Information (1982), Henry Holt and Co., Inc., New York, NY
69. Matsumoto M., Matsumoto K., Abe H., and Tanaka K. Medial prefrontal cell activity signaling prediction errors of action values. Nat. Neurosci. 10 (2007) 647-656
70. McClure S.M., Berns G.S., and Montague P.R. Temporal prediction errors in a passive learning task activate human striatum. Neuron 38 (2003) 339-346
71. McCoy A.N., and Platt M.L. Risk-sensitive neurons in macaque posterior cingulate cortex. Nat. Neurosci. 8 (2005) 1220-1227
72. McFadden D. Conditional logit analysis of quantitative choice behavior. In: Zarembka P. (Ed). Frontiers in Econometrics (1974), Academic Press, New York, NY 105-142
73. Moll J., Krueger F., Zahn R., Pardini M., de Oliveira-Souza R., and Grafman J. Human fronto-mesolimbic networks guide decisions about charitable donation. Proc. Natl. Acad. Sci. USA 103 (2006) 15623-15628
74. Montague P.R., and Lohrenz T. To detect and correct: Norm violations and their enforcement. Neuron 56 (2007) 14-18
75. Montague P.R., Dayan P., and Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16 (1996) 1936-1947
76. Morris G., Nevet A., Arkadir D., Vaadia E., and Bergman H. Midbrain dopamine neurons encode decisions for future action. Nat. Neurosci. 9 (2006) 1057-1063
77. Niv Y., and Montague P.R. Theoretical and empirical studies of learning. In: Glimcher P.W., Camerer C.F., Fehr E., and Poldrack R.A. (Eds). Neuroeconomics: Decision Making and the Brain (2009), Academic Press, New York, NY 331-351
78. O'Doherty J.P. Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr. Opin. Neurobiol. 14 (2004) 769-776
79. O'Doherty J.P., Dayan P., Friston K., Critchley H., and Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 38 (2003) 329-337
80. Padoa-Schioppa C., and Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 441 (2006) 223-226
81. Padoa-Schioppa C., and Assad J.A. The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat. Neurosci. 11 (2008) 95-102
82. Pessiglione M., Seymour B., Flandin G., Dolan R.J., and Frith C.D. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442 (2006) 1042-1045
83. Plassmann H., O'Doherty J., and Rangel A. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J. Neurosci. 27 (2007) 9984-9988
84. Platt M.L., and Glimcher P.W. Neural correlates of decision variables in parietal cortex. Nature 400 (1999) 233-238
85. Platt M.L., and Huettel S.A. Risky business: The neuroeconomics of decision making under uncertainty. Nat. Neurosci. 11 (2008) 398-403
86. Quilodran R., Rothe M., and Procyk E. Behavioral shifts and action valuation in the anterior cingulate cortex. Neuron 57 (2008) 314-325
87. Rangel A., Camerer C., and Montague P.R. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9 (2008) 545-556
88. Ratcliff R., Van Zandt T., and McKoon G. Connectionist and diffusion models of reaction time. Psychol. Rev. 106 (1999) 261-300
89. Redgrave P., and Gurney K. The short-latency dopamine signal: a role in discovering novel actions?. Nat. Rev. Neurosci. 7 (2006) 967-975
90. Redish A.D. Addiction as a computational process gone awry. Science 306 (2004) 1944-1947
91. Roesch M.R., Calu D.J., and Schoenbaum G. Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat. Neurosci. 10 (2007) 1615-1624
92. Roitman J.D., and Shadlen M.N. Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J. Neurosci. 22 (2002) 9475-9489
93. Rudebeck P.H., Behrens T.E., Kennerley S.W., Baxter M.G., Buckley M.J., Walton M.E., and Rushworth M.F. Frontal cortex subregions play distinct roles in choices between actions and stimuli. J. Neurosci. 28 (2008) 13775-13785
94. Rushworth M.F., and Behrens T.E. Choice, uncertainty and value in prefrontal and cingulate cortex. Nat. Neurosci. 11 (2008) 389-397
95. Samejima K., Ueda Y., Doya K., and Kimura M. Representation of action-specific reward values in the striatum. Science 310 (2005) 1337-1340
96. Samuelson P. A note on the measurement of utility. Rev. Econ. Stud. 4 (1937) 155-161
97. Saxe R., Carey S., and Kanwisher N. Understanding other minds: Linking developmental psychology and functional neuroimaging. Annu. Rev. Psychol. 55 (2004) 87-124
98. Schultz W., Dayan P., and Montague P.R. A neural substrate of prediction and reward. Science 275 (1997) 1593-1599
99. Selten R. A reexamination of the perfectness concept for equilibrium points in extensive games. Int. J. Game Theory 4 (1975) 819-825
100. Seo H., and Lee D. Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J. Neurosci. 27 (2007) 8366-8377
101. Seo H., and Lee D. Behavioral and neural changes after gains and losses of conditioned reinforcers. J. Neurosci. 29 (2009) 3627-3641
102. Shadlen M.N., and Newsome W.T. Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J. Neurophysiol. 86 (2001) 1916-1936
103. Shadlen M.N., Britten K.H., Newsome W.T., and Movshon J.A. A computational analysis of the relationship between neuronal and behavioral responses to visual motion. J. Neurosci. 16 (1996) 1486-1510
104. Singer T., and Fehr E. The neuroeconomics of mind reading and empathy. Am. Econ. Rev. 95 (2005) 340-345
105. Sugrue L.P., Corrado G.S., and Newsome W.T. Matching behavior and the representation of value in the parietal cortex. Science 304 (2004) 1782-1787
106. Sutton R.S., and Barto A.G. Reinforcement Learning: An Introduction (1998), The MIT Press, Cambridge, MA
107. Takahashi Y.K., Roesch M.R., Stalnaker T.A., Haney R.Z., Calu D.J., Taylor A.R., Burke K.A., and Schoenbaum G. The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62 (2009) 269-280
108. Tanji J., and Evarts E.V. Anticipatory activity of motor cortex neurons in relation to direction of an intended movement. J. Neurophysiol. 39 (1976) 1062-1068
109. Tankersley D., Stowe C.J., and Huettel S.A. Altruism is associated with an increased neural response to agency. Nat. Neurosci. 10 (2007) 150-151
110. Tobler P.N., Dickinson A., and Schultz W. Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. J. Neurosci. 23 (2003) 10402-10410
111. Tobler P.N., Fiorillo C.D., and Schultz W. Adaptive coding of reward value by dopamine neurons. Science 307 (2005) 1642-1645
112. Tom S.M., Fox C.R., Trepel C., and Poldrack R.A. The neural basis of loss aversion in decision-making under risk. Science 315 (2007) 515-518
113. Tomlin D., Kayali M.A., King-Casas B., Anen C., Camerer C.F., Quartz S.R., and Montague P.R. Agent-specific responses in the cingulate cortex during economic exchanges. Science 312 (2006) 1047-1050
114. Tremblay L., and Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 398 (1999) 704-708
115. Van Gisbergen J.A., Robinson D.A., and Gielen S. A quantitative analysis of generation of saccadic eye movements by burst neurons. J. Neurophysiol. 45 (1981) 417-442
116. von Neumann J., and Morgenstern O. The Theory of Games and Economic Behavior (1944), Princeton University Press, Princeton, NJ
117. Waelti P., Dickinson A., and Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 412 (2001) 43-48
118. Wallis J.D., and Miller E.K. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur. J. Neurosci. 18 (2003) 2069-2081
119. Wang X.J. Decision making in recurrent neuronal circuits. Neuron 60 (2008) 215-234
120. Wong K.F., and Wang X.J. A recurrent network mechanism of time integration in perceptual decisions. J. Neurosci. 26 (2006) 1314-1328
121. Yang T., and Shadlen M.N. Probabilistic reasoning by neurons. Nature 447 (2007) 1075-1080
122. Zaghloul K.A., Blanco J.A., Weidemann C.T., McGill K., Jaggi J.L., Baltuch G.H., and Kahana M.J. Human substantia nigra neurons encode unexpected financial rewards. Science 323 (2009) 1496-1499