Reward prediction error signal enhanced by striatum-amygdala interaction explains the acceleration of probabilistic reward learning by emotion

Journal of Neuroscience

Volumn 33, Issue 10, 2013, Pages 4487-4493

  Watanabe, Noriya ^a,b,c   Sakagami, Masamichi ^b   Haruno, Masahiko ^a,c,d  

^a NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

^b TAMAGAWA UNIVERSITY   (Japan)

^c OSAKA UNIVERSITY   (Japan)

^d JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AMYGDALOID NUCLEUS; ARTICLE; ASSOCIATION; BEHAVIOR; CORPUS STRIATUM; EMOTION; ERROR; FACE; FACIAL EXPRESSION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INFORMATION PROCESSING; LEARNING; MALE; NORMAL HUMAN; PRIORITY JOURNAL; PSYCHOPHYSIOLOGY; REINFORCEMENT; REWARD PREDICTION ERROR; SHORT TERM MEMORY;

AMYGDALA; ASSOCIATION LEARNING; CORPUS STRIATUM; CUES; EMOTIONS; FACIAL EXPRESSION; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MEMORY, SHORT-TERM; NEURAL PATHWAYS; OXYGEN; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PREDICTIVE VALUE OF TESTS; PROBABILITY LEARNING; REACTION TIME; REWARD; STATISTICS AS TOPIC; YOUNG ADULT;

EID: 84874610527     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.3400-12.2013     Document Type: Article

References (30)

1. Ahn S, Phillips AG (2002) Modulation by central and basolateral amygdalar nuclei of dopaminergic correlates of feeding to satiety in the rat nucleus accumbens and medial prefrontal cortex. J Neurosci 22:10958-10965. Medline
2. Behrens TE, Hunt LT, Woolrich MW, Rushworth MF (2008) Associative learning of social value. Nature 456:245-249. CrossRef Medline
3. Bradley MM, Lang PJ (1994) Measuring emotion: the self-assessment manikin and the semantic differential. J Behav Ther Exp Psychiatry 25:49-59. CrossRef Medline
4. Bray S, Rangel A, Shimojo S, Balleine B, O'Doherty JP (2008) The neural mechanisms underlying the influence of pavlovian cues on human decision making. J Neurosci 28:5861-5866. CrossRef Medline
5. Daw DN (2011) Trial-by-trial data analysis using computational models. In: Decision making, affect, and learning: attention and performance XXIII (Delgado MR, Phelps EA, Robbins TW, eds), pp 3-38. Oxford, UK: Oxford UP.
6. Dayan P (2008) The role of value systems in decision making. In: Better than conscious? Decision making, the human mind, and implications for institutions (Engel C, Singer W, eds), pp 51-70. Cambridge, MA: MIT Press.
7. Delgado MR, Gillis MM, Phelps EA (2008) Regulating the expectation of reward via cognitive strategies. Nat Neurosci 11:880-881. CrossRef Medline
8. Delgado MR, Jou RL, Ledoux JE, Phelps EA (2009) Avoiding negative outcomes: tracking the mechanisms of avoidance learning in humans during fear conditioning. Front Behav Neurosci 3:33. CrossRef Medline
9. Evans S, Fleming SM, Dolan RJ, Averbeck BB (2011) Effects of emotional preferences on value-based decision-making are mediated by mentalizing and not reward networks. J Cogn Neurosci 23:2197-2210. CrossRef Medline
10. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902. CrossRef Medline
11. Friston KJ, Holmes AP, Worsley KJ, Poline JB, Frith CD, Frackowiak RSJ (1995) Statistical parametric maps in functional brain imaging: a general linear approach. Hum Brain Mapp 2:189-210.
12. Guitart-Masip M, Bunzeck N, Stephan KE, Dolan RJ, Düzel E (2010) Contextual novelty changes reward representations in the striatum. J Neurosci 30:1721-1726. CrossRef Medline
13. Haruno M, Kawato M (2006) Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. J Neurophysiol 95: 948-959. CrossRef Medline
14. Kahneman D, Tversky A (1979) Prospect theory: an analysis of decision under risk. Econometrica 47:263-291. CrossRef
15. Knutson B, Wimmer GE, Kuhnen CM, Winkielman P (2008) Nucleus accumbens activation mediates the influence of reward cues on financial risk taking. Neuroreport 19:509-513. CrossRef Medline
16. Li J, Daw ND (2011) Signals in human striatum are appropriate for policy update rather than value prediction. J Neurosci 31:5504-5511. CrossRef Medline
17. Li J, Schiller D, Schoenbaum G, Phelps EA, Daw ND (2011) Differential roles of human striatum and amygdala in associative learning. Nat Neurosci 14:1250-1252. CrossRef Medline
18. Maunsell JH (2004) Neuronal representations of cognitive state: reward or attention? Trends Cogn Sci 8:261-265. CrossRef Medline
19. McClure SM, Berns GS, Montague PR (2003) Temporal prediction errors in a passive learning task activate human striatum. Neuron 38:339-346. CrossRef Medline
20. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337. CrossRef Medline
21. Phelps EA, Ling S, Carrasco M (2006) Emotion facilitates perception and potentiates the perceptual benefits of attention. Psychol Sci 17:292-299. CrossRef Medline
22. Schaefer A, Braver TS, Reynolds JR, Burgess GC, Yarkoni T, Gray JR (2006) Individual differences in amygdala activity predict response speed during working memory. J Neurosci 26:10120-10128. CrossRef Medline
23. Schlund MW, Cataldo MF (2010) Amygdala involvement in human avoidance, escape and approach behavior. Neuroimage 53:769-776. CrossRef Medline
24. Schoenbaum G, Setlow B, Saddoris MP, Gallagher M (2003) Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron 39: 855-867. CrossRef Medline
25. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599. CrossRef Medline
26. Stuber GD, Sparta DR, Stamatakis AM, van Leeuwen WA, Hardjoprajitno JE, Cho S, Tye KM, Kempadoo KA, Zhang F, Deisseroth K, Bonci A (2011) Excitatory transmission from the amygdala to nucleus accumbens facilitates reward seeking. Nature 475:377-380. CrossRef Medline
27. Sutton RS, Barto AG (1998) Reinforcement learning. Cambridge, MA: MIT Press.
28. Talmi D, Seymour B, Dayan P, Dolan RJ (2008) Human pavlovianinstrumental transfer. J Neurosci 28:360-368. CrossRef Medline
29. Tom SM, Fox CR, Trepel C, Poldrack RA (2007) The neural basis of loss aversion in decision-making under risk. Science 315:515-518. CrossRef Medline
30. Whalen PJ, Davis FC, Oler JA, Kim H, Kim MJ, Neta M (2009) Human amygdala responses to facial expressions of emotion. In: The human amygdala (Whalen PJ, Phelps EA, eds), pp 265-288. New York: Guilford Press.