The neural substrates of reward processing in humans: The modern role of fMRI

Neuroscientist

Volumn 10, Issue 3, 2004, Pages 260-268

  McClure, Samuel M ^a,b   York, Michele K ^a   Montague, P Read ^a  

^a BAYLOR COLLEGE OF MEDICINE   (United States)

^b PRINCETON UNIVERSITY   (United States)

Author keywords

Atriatum Amygdala; fMRI; Orbitofrontal cortex; Parkinson's disease; Reward

Indexed keywords

AMYGDALOID NUCLEUS; CORPUS STRIATUM; HUMAN; LEARNING; NEUROIMAGING; NONHUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; ORBITAL CORTEX; PARKINSON DISEASE; POSITRON EMISSION TOMOGRAPHY; PREFRONTAL CORTEX; PRIORITY JOURNAL; REVIEW; REWARD; SYSTEMATIC REVIEW;

ALGORITHMS; ANIMALS; BRAIN; HUMANS; MAGNETIC RESONANCE IMAGING; NEURONS; PARKINSON DISEASE; REWARD;

EID: 2442681557     PISSN: 10738584     EISSN: None     Source Type: Journal    
DOI: 10.1177/1073858404263526     Document Type: Review

References (60)

1. Aharon I, Etcoff N, Ariely D, Chabris CF, O'Donner E, Breiter HC. 2001. Beautiful faces have variable reward value: fMRI and behavioral evidence. Neuron 32:527-51.
2. Alexander GE, DeLong MR, Strick PL. 1986. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9:357-81.
3. Anderson AK, Christoff K, Stappen I, Panitz D, Ghahremani DG, Glover G, and others. 2003. Dissociated neural representations of intensity and valence in human olfaction. Nature Neurosci 6:196-202.
4. Arnow BA, Desmond JE, Banner LL, Glover GH, Solomon A, Polan ML, and others. 2002. Brain activation and sexual arousal in healthy, heterosexual males. Brain 125:1014-23.
5. Baxter MG, Murray EA. 2002. The amygdala and reward. Nat Rev Neurosci 3:563-73.
6. Becerra L, Breiter HC, Wise R, Gonzalez RG, Borsook D. 2001. Reward circuitry activation by noxious thermal stimuli. Neuron 32:927-46.
7. Bechara A, Damasio AR, Damasio H, Anderson SW. 1994. Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50:7-15.
8. Belliveau JW, Kennedy DN, McKinstry RC, Buchbinder BR, Weisskoff RM, Cohen MS, and others. 1991. Functional mapping of the human visual cortex by magnetic resonance imaging. Science 254:716-9.
9. Bellman RE. 1957. Dynamic programming. Princeton (NJ): Princeton University Press.
10. Berns GS, McClure SM, Pagnoni G, Montague PR. 2001. Predictability modulates human brain response to reward. J Neurosci 21:2793-8.
11. Berridge KC, Robinson TE. 1998. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Rev 28:309-69.
12. Brown RG, Marsden CD. 1990. Cognitive function in Parkinson's disease: from description to theory. Trends Neurosci 13:21-9.
13. Calder AJ, Lawrence AD, Young AW. 2001. Neuropsychology of fear and loathing. Nat Rev Neurosci 2:352-63.
14. Cooper JA, Sagar HJ, Jordan N, Harvey NS, Sullivan EV. 1991. Cognitive impairment in early, untreated Parkinson's disease and its relationship to motor disability. Brain 114:2095-122.
15. Damasio AR. 1994. Descartes' error: emotion, rationality and the human brain. New York: Putnam.
16. Delgado MR, Nystron LE, Fissell C, Noll DC, Fiez JA. 2000. Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol 84:3072-7.
17. Dubois B, Pillon B. 1997. Cognitive deficits in Parkinson's disease. J Neurol 244:2-8.
18. Elliott R, Dolan RJ, Frith CD. 2000. Dissociable functions of the medial and lateral orbitofrontal cortex: evidence from neuroimaging studies. Cereb Cortex 10:308-17.
19. Elliott R, Friston KJ, Dolan RJ. 2000. Dissociable neural responses in human reward systems. J Neurosci 20:6159-65.
20. Gottfried JA, O'Doherty J, Dolan RJ. 2002. Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. J Neurosci 22:10829-37.
21. Gottfried JA, O'Doherty J, Dolan RJ. 2003. Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science 301:1104-7.
22. Hamann S, Mao H. 2002. Positive and negative emotional verbal stimuli elicit activity in the left amygdala. Neuroreport 13:15-9.
23. Hommer DW, Knutson B, Fong GW, Bennett S, Adams CM, Vamer JL. 2003. Amygdalar recruitment during anticipation of monetary rewards. Ann N Y Acad Sci 985:476-8.
24. Ikemoto S, Panksepp J. 1999. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res Rev 31:6-41.
25. Knutson B, Adams CM, Fong GW, Hommer D. 2001. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21:RC159.
26. Knutson B, Fong GW, Bennett SM, Adams CM, Hommer D. 2003. A region of the mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI. Neuroimage 18:263-72.
27. Knutson B, Westdorp A, Kaiser E, Hommer D. 2000. FMRI visualization of brain activity during a monetary incentive delay task. Neuroimage 12:20-7.
28. Komisaruk BR, Whipple B, Crawford A, Grimes S, Kalnin AJ, Mosier K, and others. 2002. Brain activity (fMRI and PET) during orgasm in women, in response to vaginocervical self-stimulation. Society for Neuroscience Abstracts.
29. Koob GF, Bloom FE. 1988. Cellular and molecular mechanisms of drug dependence. Science 242:715-23.
30. LeDoux JE. 2000. Emotion circuits in the brain. Annu Rev Neurosci 23:155-84.
31. McClure SM, Berns GS, Montague PR. 2003. Temporal prediction errors in a passive learning task activation human striatum. Neuron 38:339-46.
32. McClure SM, Daw ND, Montague PR. 2003. A computational substrate for incentive salience. Trends Neurosci 26:423-8.
33. Montague PR, Berns GS. 2002. Neural economics and the biological substrates of valuation. Neuron 36:265-84.
34. Montague PR, Dayan P, Sejnowski TJ. 1996. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-47.
35. O'Doherty J, Critchley H, Deichmann R, Dolan RJ. 2003. Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J Neurosci 23:7931-9.
36. O'Doherty J, Dayan P, Friston KJ, Critchley H, Dolan RJ. 2003. Temporal difference models and reward-related learning in the human brain. Neuron 38:329-37.
37. O'Doherty JP, Deichmann R, Critchley HD, Dolan RJ. 2002. Neural responses during anticipation of a primary taste reward. Neuron 33:815-26.
38. O'Doherty JP, Kringelbach ML, Rolls ET, Homak J, Andrews C. 2001. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci 4:95-102
39. O'Doherty JP, Rolls ET, Francis S, Bowtell R, McGlone F. 2001. Representations of pleasant and aversive taste in the human brain. J Neurophysiol 85:1315-21.
40. Ogawa S, Lee TM, Kay AR, Tank DW. 1990. Brain magnetic resonance imaging with contrast dependent on blood oxygenation. Proc Natl Acad Sci U S A 87:9868-72.
41. Pagnoni G, Zink CF, Montague PR, Berns GS. 2002. Activity in human ventral striatum locked to errors of reward prediction. Nat Neurosci 5:97-8.
42. Phillips PE, Stuber GD, Heien ML, Wightman RM, Carelli RM. 2003. Subsecond dopamine release promotes cocaine seeking. Nature 422:614-8.
43. Piccirilli M, D'Alessandro P, Finali G, Piccinin G. 1997. Early frontal impairment as a predictor of dementia in Parkinson's disease. Neurology 48:546-7.
44. Rilling J, Gutman D, Zeh T, Pagnoni G, Berns G, Kilts C. 2002. A neural basis for social cooperation. Neuron 35:395-405.
45. Rolls ET. 2000. The orbitofrontal cortex and reward, Cereb Cortex 10:284-94.
46. Rolls ET, Hornak J, Wade D, McGrath J. 1994. Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. J Neurol Neurosurg Psychiatry 57:1518-24.
47. Rolls ET, O'Doherty J, Kringelbach ML, Francis S, Bowtell R, McGlone F. 2003. Representations of pleasant and painful touch in the human orbitofrontal and cingulate cortices. Cereb Cortex 13:308-17.
48. Rosen BR, Buckner RL, Dale AM. 1998. Event-related fMRI: past, present, and future. Proc Natl Acad Sci U S A 95:773-80.
49. Sanfey AG, Rilling JK, Aronson JA, Nystrom LE, Cohen JD. 2003. Decision-making in the ultimatum game. Science 300:1755-8.
50. Schultz W, Dayan P, Montague PR. 1997. A neural substrate of prediction and reward. Science 275:1593-9.
51. Shizgal P. 1997. Neural basis of utility estimation. Curr Opin Neurobiol 7:198-208.
52. Small DM, Gregory MD, Mak YE, Gitelman D, Mesulam MM, Parish T. 2003. Dissociation of neural representation of intensity and affective valuation in human gustation. Neuron 39:701-11.
53. Starkstein SE, Bolduc PL, Preziosi TJ, Robinson RG. 1989. Cognitive impairments in different stages of Parkinson's disease. J Neuropsychiatry Clin Neurosci 1:243-48.
54. Starr PA, Vitek JL, Bakay RA. 1998. Ablative surgery and deep brain stimulation for Parkinson's disease. Neurosurgery 43:989-1013.
55. Sutton RS, Barto AG. 1998. Reinforcement learning. Cambridge (MA): MIT Press.
56. Taylor AE, Saint-Cyr JA, Lang AE. 1990. Memory and learning in early Parkinson's disease: evidence for a n"frontal lobe syndrome." Brain Cogn 13:211-32.
57. Tremblay L, Schultz W. 1999. Relative reward preference in primate orbitofrontal cortex. Nature 398:704-8.
58. Ullsperger M, Von Cramon DY. 2003. Error monitoring using external feedback: specific roles of the habenular comples, the reward system, and the cingulate motor area revealed by functional magnetic resonance imaging. J Neurosci 23:4308-14.
59. Weiskrantz L. 1956. Behavioral changes associated with ablation of the amygdaloid complex in monkeys. J Comp Physiol Psychol 49:381-91.
60. Woods SP, Troster Al. 2003. Prodromal frontal/executive dysfunction predicts incident dementia in Parkinson's disease. J Int Neuropsychol Soc 9:17-24.