Reward processing in the human brain. Insights from fMRI

Handbook of Reward and Decision Making

Volumn , Issue , 2009, Pages 165-184

  Porcelli, Anthony J ^a   Delgado, Mauricio R ^a  

^a RUTGERS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84882558960     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-374620-7.00007-8     Document Type: Chapter

References (118)

1. Haber S.N., Kunishio K., Mizobuchi M., Lynd-Balta E. The orbital and medial prefrontal circuit through the primate basal ganglia. J. Neurosci. 1995, 15:4851-4867.
2. Robbins T.W., Everitt B.J. Neurobehavioural mechanisms of reward and motivation. Curr. Opin. Neurobiol. 1996, 6:228-236.
3. Schultz W. Multiple reward signals in the brain. Nat. Rev. Neurosci. 2000, 1:199-207.
4. Wise R.A., Hoffman D.C. Localization of drug reward mechanisms by intracranial injections. Synapse 1992, 10:247-263.
5. Rolls E.T. The Brain and Emotion 1999, Oxford University Press, Oxford.
6. Dickinson A., Balleine B. Motivational control of goal-directed action. Anim. Learn. Behav. 1994, 22:1-18.
7. Berridge K.C., Robinson T.E. Parsing reward. Trends Neurosci. 2003, 26:507-513.
8. Breiter H.C., Gollub R.L., Weisskoff R.M., Kennedy D.N., Makris N., Berke J.D., Goodman J.M., Kantor H.L., Gastfriend D.R., Riorden J.P., Mathew R.T., Rosen B.R., Hyman S.E. Acute effects of cocaine on human brain activity and emotion. Neuron 1997, 19:591-611.
9. Ongur D., Price J.L. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb. Cortex 2000, 10:206-219.
10. Kringelbach M.L. The human orbitofrontal cortex: linking reward to hedonic experience. Nat. Rev. Neurosci. 2005, 6:691-702.
11. Bechara A., Damasio A.R., Damasio H., Anderson S.W. Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 1994, 50:7-15.
12. Clark L., Bechara A., Damasio H., Aitken M.R., Sahakian B.J., Robbins T.W. Differential effects of insular and ventromedial prefrontal cortex lesions on risky decision-making. Brain 2008, 131:1311-1322.
13. Carmichael S.T., Price J.L. Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol. 1995, 363:642-664.
14. Miller E.K., Cohen J.D. An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 2001, 24:167-202.
15. Amaral D.G., Price J.L. Amygdalo-cortical projections in the monkey (Macaca fascicularis). J. Comp. Neurol. 1984, 230:465-496.
16. Eblen F., Graybiel A.M. Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey. J. Neurosci. 1995, 15:5999-6013.
17. Kringelbach M.L., Rolls E.T. The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Prog. Neurobiol. 2004, 72:341-372.
18. Amodio D.M., Frith C.D. Meeting of minds: the medial frontal cortex and social cognition. Nat. Rev. Neurosci. 2006, 7:268-277.
19. Alexander G.E., Crutcher M.D. Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends Neurosci. 1990, 13:266-271.
20. Balleine B.W., Delgado M.R., Hikosaka O. The role of the dorsal striatum in reward and decision-making. J. Neurosci. 2007, 27:8161-8165.
21. Middleton F.A., Strick P.L. Basal ganglia output and cognition: evidence from anatomical, behavioral, and clinical studies. Brain Cogn. 2000, 42:183-200.
22. O'Doherty J., Dayan P., Schultz J., Deichmann R., Friston K., Dolan R.J. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 2004, 304:452-454.
23. Fudge J.L., Haber S.N. Defining the caudal ventral striatum in primates: cellular and histochemical features. J. Neurosci. 2002, 22:10078-10082.
24. Haber S.N., Kim K.S., Mailly P., Calzavara R. Reward-related cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning. J. Neurosci. 2006, 26:8368-8376.
25. Groenewegen H.J., Uylings H.B. The prefrontal cortex and the integration of sensory, limbic and autonomic information. Prog. Brain Res. 2000, 126:3-28.
26. Haber S.N., Fudge J.L., McFarland N.R. Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J. Neurosci. 2000, 20:2369-2382.
27. Voorn P., Vanderschuren L.J., Groenewegen H.J., Robbins T.W., Pennartz C.M. Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci. 2004, 27:468-474.
28. Schultz W. Behavioral dopamine signals. Trends Neurosci. 2007, 30:203-210.
29. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
30. Davis M. The role of the amygdala in fear and anxiety. Annu. Rev. Neurosci. 1992, 15:353-375.
31. Delgado M.R., Olsson A., Phelps E.A. Extending animal models of fear conditioning to humans. Biol. Psychol. 2006, 73:39-48.
32. LeDoux J.E. Emotion circuits in the brain. Annu. Rev. Neurosci. 2000, 23:155-184.
33. Morris J.S., Friston K.J., Buchel C., Frith C.D., Young A.W., Calder A.J., Dolan R.J. A neuromodulatory role for the human amygdala in processing emotional facial expressions. Brain 1998, 121(Pt 1):47-57.
34. Derryberry D., Tucker D.M. Neural mechanisms of emotion. J. Consult. Clin. Psychol. 1992, 60:329-338.
35. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 2008, 9:545-556.
36. O'Doherty J., Rolls E.T., Francis S., Bowtell R., McGlone F. Representation of pleasant and aversive taste in the human brain. J. Neurophysiol. 2001, 85:1315-1321.
37. Rolls E.T., Kringelbach M.L., de Araujo I.E.T. Different representations of pleasant and unpleasant odours in the human brain. Eur. J. Neurosci. 2003, 18:695-703.
38. Rolls E.T., O'Doherty J., Kringelbach M.L., Francis S., Bowtell R., McGlone F. Representations of pleasant and painful touch in the human orbitofrontal and cingulate cortices. Cereb. Cortex 2003, 13:308-317.
39. Blood A.J., Zatorre R.J., Bermudez P., Evans A.C. Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nat. Neurosci. 1999, 2:382-387.
40. O'Doherty J., Winston J., Critchley H., Perrett D., Burt D.M., Dolan R.J. Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness. Neuropsychologia 2003, 41:147-155.
41. Kringelbach M.L., O'Doherty J., Rolls E.T., Andrews C. Activation of the Human Orbitofrontal Cortex to a Liquid Food Stimulus is Correlated with its Subjective Pleasantness. Cereb. Cortex 2003, 13:1064-1071.
42. O'Doherty J., Rolls E.T., Francis S., Bowtell R., McGlone F., Kobal G., Renner B., Ahne G. Sensory-specific satiety-related olfactory activation of the human orbitofrontal cortex. Neuroreport 2000, 11:399-403.
43. Anderson A.K., Christoff K., Stappen I., Panitz D., Ghahremani D.G., Glover G., Gabrieli J.D., Sobel N. Dissociated neural representations of intensity and valence in human olfaction. Nat. Neurosci. 2003, 6:196-202.
44. Plassmann H., O'Doherty J., Rangel A. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J. Neurosci. 2007, 27:9984-9988.
45. Knutson B., Fong G.W., Bennett S.M., Adams C.M., Hommer D. A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI. Neuroimage 2003, 18:263-272.
46. Hare T.A., O'Doherty J., Camerer C.F., Schultz W., Rangel A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 2008, 28:5623-5630.
47. Ferry A.T., Öngür D., Xinhai A., Price J.L. Prefrontal cortical projections to the striatum in macaque monkeys: evidence for an organization related to prefrontal networks. J. Comp. Neurol. 2000, 425:447-470.
48. Knutson B., Delgado M.R., Phillips P.E.M. Representation of subjective value in the striatum. Neuroeconomics: Decision Making and the Brain 2008, 389-403. Academic Press, New York. P.W. Glimcher, C. Camerer, E. Fehr, R.A. Poldrack (Eds.).
49. Delgado M.R., Nystrom L.E., Fissell C., Noll D.C., Fiez J.A. Tracking the hemodynamic responses to reward and punishment in the striatum. J. Neurophysiol. 2000, 84:3072-3077.
50. Aharon I., Etcoff N., Ariely D., Chabris C.F., O'Connor E., Breiter H.C. Beautiful faces have variable reward value: fMRI and behavioral evidence. Neuron 2001, 32:537-551.
51. Small D.M., Gregory M.D., Mak Y.E., Gitelman D., Mesulam M.M., Parrish T. Dissociation of neural representation of intensity and affective valuation in human gustation. Neuron 2003, 39:701-711.
52. O'Doherty J.P. Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr. Opin. Neurobiol. 2004, 14:769-776.
53. Delgado M.R., Stenger V.A., Fiez J.A. Motivation-dependent responses in the human caudate nucleus. Cereb. Cortex 2004, 14:1022-1030.
54. Kirsch P., Schienle A., Stark R., Sammer G., Blecker C., Walter B., Ott U., Burkart J., Vaitl D. Anticipation of reward in a nonaversive differential conditioning paradigm and the brain reward system: an event-related fMRI study. Neuroimage 2003, 20:1086-1095.
55. Knutson B., Adams C.M., Fong G.W., Hommer D. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J. Neurosci. 2001, 21:RC159.
56. O'Doherty J.P., Deichmann R., Critchley H.D., Dolan R.J. Neural responses during anticipation of a primary taste reward. Neuron 2002, 33:815-826.
57. Balleine B.W., Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 1998, 37:407-419.
58. Packard M.G., Knowlton B.J. Learning and memory functions of the Basal Ganglia. Annu. Rev. Neurosci. 2002, 25:563-593.
59. Tricomi E.M., Delgado M.R., Fiez J.A. Modulation of caudate activity by action contingency. Neuron 2004, 41:281-292.
60. Elliott R., Newman J.L., Longe O.A., William Deakin J.F. Instrumental responding for rewards is associated with enhanced neuronal response in subcortical reward systems. Neuroimage 2004, 21:984-990.
61. Zink C.F., Pagnoni G., Martin-Skurski M.E., Chappelow J.C., Berns G.S. Human striatal responses to monetary reward depend on saliency. Neuron 2004, 42:509-517.
62. Barto A.G. Adaptive critics and the basal ganglia. Models of Information Processing in the Basal Ganglia 1996, 215-232. MIT Press, Cambridge, MA. J. Houk, L. Davis, B.G. Beiser (Eds.).
63. Sutton R.S., Barto A.G. Reinforcement Learning 1998, MIT Press, Cambridge, MA.
64. McClure S.M., Berns G.S., Montague P.R. Temporal prediction errors in a passive learning task activate human striatum. Neuron 2003, 38:339-346.
65. O'Doherty J.P., Dayan P., Friston K., Critchley H., Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 2003, 38:329-337.
66. Pagnoni G., Zink C.F., Montague P.R., Berns G.S. Activity in human ventral striatum locked to errors of reward prediction. Nat. Neurosci. 2002, 5:97-98.
67. Delgado M.R., Miller M.M., Inati S., Phelps E.A. An fMRI study of reward-related probability learning. Neuroimage 2005, 24:862-873.
68. Haruno M., Kuroda T., Doya K., Toyama K., Kimura M., Samejima K., Imamizu H., Kawato M. A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task. J. Neurosci. 2004, 24:1660-1665.
69. Koch K., Schachtzabel C., Wagner G., Reichenbach J.R., Sauer H., Schlosser R. The neural correlates of reward-related trial-and-error learning: an fMRI study with a probabilistic learning task. Learn. Mem. 2008, 15:728-732.
70. Haruno M., Kawato M. Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. J. Neurophysiol. 2006, 95:948-959.
71. LaBar K.S., Gatenby J.C., Gore J.C., LeDoux J.E., Phelps E.A. Human amygdala activation during conditioned fear acquisition and extinction: a mixed-trial fMRI study. Neuron 1998, 20:937-945.
72. Morris J.S., Ohman A., Dolan R.J. A subcortical pathway to the right amygdala mediating "unseen" fear. Proc. Natl. Acad. Sci. USA 1999, 96:1680-1685.
73. Phelps E.A., O'Connor K.J., Gatenby J.C., Gore J.C., Grillon C., Davis M. Activation of the left amygdala to a cognitive representation of fear. Nat. Neurosci. 2001, 4:437-441.
74. LaBar K.S., LeDoux J.E., Spencer D.D., Phelps E.A. Impaired fear conditioning following unilateral temporal lobectomy in humans. J. Neurosci. 1995, 15:6846-6855.
75. Petrovic P., Kalisch R., Pessiglione M., Singer T., Dolan R.J. Learning affective values for faces is expressed in amygdala and fusiform gyrus. Soc. Cogn. Affect. Neurosci. 2008, 3:109-118.
76. Hamann S.B., Ely T.D., Grafton S.T., Kilts C.D. Amygdala activity related to enhanced memory for pleasant and aversive stimuli. Nat. Neurosci. 1999, 2:289-293.
77. Royet J.P., Zald D., Versace R., Costes N., Lavenne F., Koenig O., Gervais R. Emotional responses to pleasant and unpleasant olfactory, visual, and auditory stimuli: a positron emission tomography study. J. Neurosci. 2000, 20:7752-7759.
78. Dolcos F., LaBar K.S., Cabeza R. Interaction between the amygdala and the medial temporal lobe memory system predicts better memory for emotional events. Neuron 2004, 42:855-863.
79. Delgado M.R., Li J., Schiller D., Phelps E.A. The role of the striatum in aversive learning and aversive prediction errors. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2008, 363:3787-3800.
80. Fellows L.K. The cognitive neuroscience of human decision making: a review and conceptual framework. Behav. Cogn. Neurosci. Rev. 2004, 3:159-172.
81. Johnson J.G., Raab M. Take the first: option-generation and resulting choices. Organ. Behav. Hum. Decis. Process. 2003, 91:215-229.
82. Butler A.B., Scherer L.L. The effects of elicitation aids, knowledge, and problem content on option quantity and quality. Organ. Behav. Hum. Decis. Process. 1997, 72:184-202.
83. Saad G., Russo J. Stopping criteria in sequential choice. Organ. Behav. Hum. Decis. Process. 1996, 67:258-270.
84. Ridderinkhof K.R., Ullsperger M., Crone E.A., Nieuwenhuis S. The role of the medial frontal cortex in cognitive control. Science 2004, 306:443-447.
85. Levy R., Dubois B. Apathy and the functional anatomy of the prefrontal cortex-basal ganglia circuits. Cereb. Cortex 2006, 16:916-928.
86. Jog M.S., Kubota Y., Connolly C.I., Hillegaart V., Graybiel A.M. Building neural representations of habits. Science 1999, 286:1745-1749.
87. Poldrack R.A., Clark J., Pare-Blagoev E.J., Shohamy D., Moyano J.C., Myers C., Gluck M.A. Interactive memory systems in the human brain. Nature 2001, 414:546-550.
88. Bogacz R., Gurney K. The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput. 2007, 19:442-477.
89. Delgado M.R., Locke H.M., Stenger V.A., Fiez J.A. Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations. Cogn. Affect. Behav. Neurosci. 2003, 3:27-38.
90. Nieuwenhuis S., Slagter H.A., von Geusau N.J., Heslenfeld D.J., Holroyd C.B. Knowing good from bad: differential activation of human cortical areas by positive and negative outcomes. Eur. J. Neurosci. 2005, 21:3161-3168.
91. Bossaerts P., Preuschoff K., Hsu M. The neurobiological foundations of valuation in human decision making under uncertainty. Neuroeconomics: Decision Making and the Brain 2008, 353-366. Academic Press, New York. P.W. Glimcher, C. Camerer, E. Fehr, R.A. Poldrack (Eds.).
92. Kreps D.M. A Course in Microeconomic Theory 1990, Princeton University Press, New York.
93. Weber E.U., Blais A., Betz N.E. Measuring risk perceptions and risk behaviors. J. Behav. Decis. Making 2002, 15:263-290.
94. Kuhnen C.M., Knutson B. The neural basis of financial risk taking. Neuron 2005, 47:763-770.
95. Huettel S.A., Song A.W., McCarthy G. Decisions under uncertainty: probabilistic context influences activation of prefrontal and parietal cortices. J. Neurosci. 2005, 25:3304-3311.
96. Paulus M.P., Rogalsky C., Simmons A., Feinstein J.S., Stein M.B. Increased activation in the right insula during risk-taking decision making is related to harm avoidance and neuroticism. Neuroimage 2003, 19:1439-1448.
97. Preuschoff K., Quartz S.R., Bossaerts P. Human insula activation reflects risk prediction errors as well as risk. J. Neurosci. 2008, 28:2745-2752.
98. Tobler P.N., O'Doherty J.P., Dolan R.J., Schultz W. Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J. Neurophysiol. 2007, 97:1621-1632.
99. Hsu M., Bhatt M., Adolphs R., Tranel D., Camerer C.F. Neural systems responding to degrees of uncertainty in human decision-making. Science 2005, 310:1680-1683.
100. Ghirardato P., Maccheroni F., Marinacci M. Differentiating ambiguity and ambiguity attitude. J. Econ. Theor. 2004, 118:133-173.
101. Frederick S., Loewenstein G., O'Donoghue T. Time discounting and time preference: a critical review. J. Econ. Lit. 2002, 40:351-401.
102. Green L., Myerson J. A discounting framework for choice with delayed and probabilistic rewards. Psychol. Bull. 2004, 130:769-792.
103. Laibson D. Golden eggs and hyperbolic discounting. Q. J. Econ. 1997, 112:443-477.
104. Berns G.S., Laibson D., Loewenstein G. Intertemporal choice - toward an integrative framework. Trends Cogn. Sci. 2007, 11:482-488.
105. Li J., McClure S.M., King-Casas B., Montague P.R. Policy adjustment in a dynamic economic game. PLoS ONE 2006, 1:e103.
106. McClure S.M., Ericson K.M., Laibson D.I., Loewenstein G., Cohen J.D. Time discounting for primary rewards. J. Neurosci. 2007, 27:5796-5804.
107. McClure S.M., York M.K., Montague P.R. The neural substrates of reward processing in humans: the modern role of FMRI. Neuroscientist 2004, 10:260-268.
108. Kable J.W., Glimcher P.W. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 2007, 10:1625-1633.
109. Berg J., Dickhaut J., McCabe K. Trust, reciprocity, and social History. Game. Econ. Behav. 1995, 10:122-142.
110. King-Casas B., Tomlin D., Anen C., Camerer C.F., Quartz S.R., Montague P.R. Getting to know you: reputation and trust in a two-person economic exchange. Science 2005, 308:78-83.
111. Kahneman D., Tversky A. Prospect theory: an analysis of decision under risk. Econometrica 1979, 47:263-291.
112. Tom S.M., Fox C.R., Trepel C., Poldrack R.A. The neural basis of loss aversion in decision-making under risk. Science 2007, 315:515-518.
113. De Martino B., Kumaran D., Seymour B., Dolan R.J. Frames, biases, and rational decision-making in the human brain. Science 2006, 313:684-687.
114. Camerer C., Loewenstein G., Prelec D. Neuroeconomics: how neuroscience can inform economics. J. Econ. Lit. 2005, 43:9-64.
115. Delgado M.R., Schotter A., Ozbay E.Y., Phelps E.A. Understanding overbidding: using the neural circuitry of reward to design economic auctions. Science 2008, 321:1849-1852.
116. Izuma K., Saito D.N., Sadato N. Processing of social and monetary rewards in the human striatum. Neuron 2008, 58:284-294.
117. Milad M.R., Rauch S.L. The role of the orbitofrontal cortex in anxiety disorders. Ann. NY Acad. Sci. 2007, 1121:546-561.
118. Illes J., Kirschen M.P., Gabrieli J.D. From neuroimaging to neuroethics. Nat. Neurosci. 2003, 6:205.