Separate brain regions code for salience vs. valence during reward prediction in humans

Human Brain Mapping

Volumn 28, Issue 4, 2007, Pages 294-302

  Jensen, Jimmy ^a   Smith, Andrew J ^b   Willeit, Matthäus ^a   Crawley, Adrian P ^c   Mikulis, David J ^c   Vitcu, Irina ^a   Kapur, Shitij ^a,d  

^a CENTRE FOR ADDICTION AND MENTAL HEALTH   (Canada)

^b MCMASTER UNIVERSITY   (Canada)

^c UNIVERSITY OF TORONTO   (Canada)

^d UNIVERSITY OF TORONTO   (Canada)

Author keywords

Computational models; fMRI; Reward; Ventral striatum

Indexed keywords

ADULT; ALGORITHM; ANALYTICAL ERROR; APPARATUS; APPETITE; ARTICLE; AVOIDANCE BEHAVIOR; BRAIN BLOOD FLOW; BRAIN MAPPING; CALCULATION; CONDITIONING; CORPUS STRIATUM; CORRELATION ANALYSIS; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INSULA; LEARNING; LIMBIC CORTEX; MALE; MOTIVATION; MOTOR CORTEX; NORMAL HUMAN; OXYGEN BLOOD LEVEL; PREDICTION; PRIORITY JOURNAL; REWARD; STIMULUS; STIMULUS RESPONSE; VOLUNTEER;

ADULT; AVOIDANCE LEARNING; BASAL GANGLIA; BRAIN MAPPING; CHOICE BEHAVIOR; CONDITIONING, CLASSICAL; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; REWARD;

EID: 34047222753     PISSN: 10659471     EISSN: None     Source Type: Journal    
DOI: 10.1002/hbm.20274     Document Type: Article

References (47)

1. Anderson AK, Christoff K, Stappen I, Panitz D, Ghahremani DG, Glover G, Gabrieli JD, Sobel N (2003): Dissociated neural representations of intensity and valence in human olfaction. Nat Neurosci 6:196-202.
2. Berns CS, McClure SM, Pagnoni G, Montague PR (2001): Predictability modulates human brain response to reward. J Neurosci 21:2793-2798.
3. Berridge KC, Robinson TE (1998): What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev 28:309-369.
4. Breiter HC, Aharon I, Kahneman D, Dale A, Shizgal P (2001): Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30:619-639.
5. Buchel C, Morris J, Dolan RJ, Fristen KJ (1998): Brain systems mediating aversive conditioning: an event-related fMRI study. Neuron 20:947-957.
6. Buchel C, Dolan RJ, Armony JL, Fristen KJ (1999): Amygdalahippocampal involvement in human aversive trace conditioning revealed through event-related functional magnetic resonance imaging. J Neurosci 19:10869-10876.
7. Damasio AR (1994): Descarte's Error. New York: Grosset/Putnam.
8. Delgado MR, Nystrom LE, Fissel C, Noll DC, Fiez JA (2000): Tracking the hemodynamic responses to reward and punishment in the stria turn. J Neurophysiol 84:3072-3077.
9. Elliott R, Fristen KJ, Dolan RJ (2000): Dissociable neural responses in human reward systems. J Neurosci 20:6159-6165.
10. Evans AC, Collins DL, Mills SR, Brown ED, Kelly RL, Peters TM (1993): 3D statistical neuroanatomical models from 305 MRI volumes. Proc Inst Electric Electron Engineer Nucl Sci Symp Med Imaging 3:1813-1817.
11. Fristen KJ, Ashburner J, Frith CD, Poline JB, Heather J, Frackowiak RS (1995a): Spatial registration and normalization of images. Hum Brain Mapp 2:1-25.
12. Fristen KJ, Holmes AP, Worsley KJ, Poline JB, Frith CD, Frackowiak RS (1995b): Statistical parametric maps in functional imaging: a general linear approach. Hum Brain Mapp 2:189-210.
13. Garris PA, Kilpatrick M, Bunin MA, Michael D, Walker QD, Wightman RM (1999): Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation. Nature 398:67-69.
14. Gottfried JA, O'Doherty J, Dolan RJ (2002): Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. J Neurosci 22:10829-10837.
15. Haber SN, Kunishio K, Mizobuchi M, Lynd-Balta E (1995): The orbital and medial prefrontal circuit through the primate basal ganglia. J Neurosci 15(7 Pt 1):4851-4867.
16. Haber SN, Fudge JL, McFarland NR (2000): Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J Neurosci 20:2369-2382.
17. Jensen J, McIntosh AR, Crawley AP, Mikulis DJ, Remington G, Kapur S (2003): Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron 40:1251-1257.
18. Joseph MH, Datla K, Young AM (2003): The interpretation of the measurement of nucleus accumbens dopamine by in vivo dialysis: the kick, the craving or the cognition? Neurosci Biobehav Rev 27:527-541.
19. Knutson B, Fong GW, Adams CM, Varner JL, Hommer D (2001): Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport 12:3683-3687.
20. LaBar KS, Gatenby JC, Gore JC, LeDoux JE, Phelps EA (1998): Human amygdala activation during conditioned fear acquisition and extinction: a mixed-trial fMRI study. Neuron 20:937-945.
21. Logothetis NK (2003): The underpinnings of the BOLD functional magnetic resonance imaging signal. J Neurosci 23:3963-3971.
22. McClure SM, Berns GS, Montague PR (2003a): Temporal prediction errors in a passive learning task activate human striatum. Neuron 38:339-346.
23. McClure SM, Daw ND, Montague PR (2003b): A computational substrate for incentive salience. Trends Neurosci 26:423-428.
24. Mesulam MM (2000): Behavioral neuroanatomy: large-scale networks, association cortex, frontal syndromes, the limbic system, and hemispheric specializations. In: Mesulam M-M, editor. Principles of Behavioral and Cognitive Neurology, 2nd ed. New York: Oxford University Press, p 1-120.
25. Mirenowicz J, Schultz W (1996): Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379:449-451.
26. Mogenson GJ, Brudzynski SM, Wu M, Yang CR, Yim CCY (1993): From motivation to action: a review of dopaminergic regulation of limbic, nucleus accumbens, ventral pallidum, pedunculopontine nucleus circuittries involved in limbic-motor integration. In: Kalivas PW, Barnes CD, editors. Limbic Motor Circuits and Neuropsychiatry. Boca Raton: CRS Press, p 193-236.
27. Montague PR, Dayan P, Sejnowski TJ (1996): A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-1947.
28. Montague PR, Hyman SE, Cohen JD (2004): Computational roles for dopamine in behavioural control. Nature 431:760-767.
29. O'Doherty JP, Deichmann R, Critchley HD, Dolan RJ (2002): Neural responses during anticipation of a primary taste reward. Neuron 33:815-826.
30. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003): Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337.
31. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004): Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454.
32. Ravel S, Legallet E, Apicella P (2003): Responses of tonically active neurons in the monkey striatum discriminate between motivationally opposing stimuli. J Neurosci 23:8489-8497.
33. Rolls ET (2000): The orbitofrontal cortex and reward. Cereb Cortex 10:284-294.
34. Rolls ET, Kringelbach ML, de Araujo IE (2003): Different representations of pleasant and unpleasant odours in the human brain. Eur J Neurosci 18:695-703.
35. Salamone JD, Cousins MS, Snyder BJ (1997): Behavioral functions of nucleus accumbens dopamine: empirical and conceptual problems with the anhedonia hypothesis. Neurosci Biobehav Rev 21:341-359.
36. Schoenbaum G, Setlow B, Nugent SL, Saddoris MP, Gallagher M (2003): Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learn Mem 10:129-140.
37. Schultz W, Dayan P, Montague PR (1997): A neural substrate of prediction and reward. Science 275:1593-1599.
38. Schultz W (1999): The reward signal of midbrain dopamine neurons. News Physiol Sci 14:249-255.
39. Schultz W (2001): Reward signaling by dopamine neurons. Neuroscientist 7:293-302.
40. Schultz W (2002): Getting formal with dopamine and reward. Neuron 36:241-263.
41. Setlow B, Schoenbaum G, Gallagher M (2003): Neural encoding in ventral striatum during olfactory discrimination learning. Neuron 38:625-636.
42. Seymour B, O'Doherty JP, Dayan P, Koltzenburg M, Jones AK, Dolan RJ, Friston KJ, Frackowiak RS (2004): Temporal difference models describe higher-order learning in humans. Nature 429: 664-667.
43. Small DM, Gregory MD, Mak YE, Gitelman DR, Mesulam M-M, Parrish TB (2003): Dissociation of neural representation of intensity and affective valuation in human gustation. Neuron 39:701-711.
44. Sutton RS, Barto AG (1990): Time-derivative models of pavlovian reinforcement. In: Gabriel M, Moore J, editors. Learning and Computational Neuroscience: Foundations of Adaptive Networks. Cambridge, MA: MIT Press, p 497-537.
45. Ungless MA, Magill PJ, Bolam JP (2004): Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303:2040-2042.
46. Williams GV, Rolls ET, Leonard CM, Stern C (1993): Neuronal responses in the ventral striatum of the behaving macaque. Behav Brain Res 55:243-252.
47. Zink CF, Pagnoni G, Martin-Skurski ME, Chappelow JC, Berns CS (2004): Human striatal responses to monetary reward depend on saliency. Neuron 42:509-517.