Neural basis of decision making guided by emotional outcomes

Journal of Neurophysiology

Volumn 113, Issue 9, 2015, Pages 3056-3068

  Katahira, Kentaro ^a,b   Matsuda, Yoshi Taka ^a,b   Fujimura, Tomomi ^a,b   Ueno, Kenichi ^b   Asamizuya, Takeshi ^b   Suzuki, Chisato ^b   Cheng, Kang ^b   Okanoya, Kazuo ^a,b,c   Okada, Masato ^a,c  

^a JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^b RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^c UNIVERSITY OF TOKYO   (Japan)

Author keywords

Emotional pictures; Insula; Reinforcement learning; Striatum; Valence

Indexed keywords

ADULT; ARTICLE; CONTROLLED STUDY; DECISION MAKING; ELECTROENCEPHALOGRAM; EMOTION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; FUSIFORM GYRUS; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; MESENCEPHALON; NORMAL HUMAN; PARAHIPPOCAMPAL GYRUS; PRIORITY JOURNAL; REINFORCEMENT; VENTRAL STRIATUM; BLOOD; BRAIN; BRAIN MAPPING; IMAGE PROCESSING; NEUROPSYCHOLOGICAL TEST; NUCLEAR MAGNETIC RESONANCE IMAGING; PHOTOSTIMULATION; PHYSIOLOGY; VASCULARIZATION; YOUNG ADULT;

OXYGEN;

ADULT; BRAIN; BRAIN MAPPING; DECISION MAKING; EMOTIONS; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; NEUROPSYCHOLOGICAL TESTS; OXYGEN; PHOTIC STIMULATION; REINFORCEMENT (PSYCHOLOGY); YOUNG ADULT;

EID: 84930842819     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00564.2014     Document Type: Article

References (48)

1. Bechara A, Damasio H, Tranel D, Damasio AR. The Iowa Gambling Task and the somatic marker hypothesis: some questions and answers. Trends Cogn Sci 9: 159–164, 2005.
2. Bradley MM, Codispoti M, Cuthbert BN, Lang PJ. Emotion and motivation I: defensive and appetitive reactions in picture processing. Emotion 1: 276–298, 2001.
3. Bray S, O’Doherty J. Neural coding of reward-prediction error signals during classical conditioning with attractive faces. J Neurophysiol 97: 3036–3045, 2007.
4. Brett M, Anton JL, Valabregue R, Poline JB. Region of interest analysis using the MarsBar toolbox for SPM 99. Neuroimage 16: S497, 2002.
5. Britton JC, Taylor SF, Sudheimer KD, Liberzon I. Facial expressions and complex IAPS pictures: common and differential networks. Neuroimage 31: 906–919, 2006.
6. Cavanna AE, Trimble MR. The precuneus: a review of its functional anatomy and behavioural correlates. Brain 129: 564–583, 2006.
7. Codispoti M, Bradley MM, Lang PJ. Affective reactions to briefly presented pictures. Psychophysiology 38: 474–478, 2001.
8. Cohen JD. The vulcanization of the human brain: a neural perspective on interactions between cognition and emotion. J Econ Perspect 19: 3–24, 2005.
9. Daw ND. Trial-by-trial data analysis using computational models. Tutorial review. In: Decision Making, Affect, and Learning: Attention and Performance XXIII, edited by Delgado MR, Phelps EA, Robbins TW. Oxford, UK: Oxford Univ. Press, 2011, p. 3–38.
10. Daw ND, O’Doherty JP, Dayan P, Seymour B, Dolan RJ. Cortical substrates for exploratory decisions in humans. Nature 441: 876–879, 2006.
11. Evans S, Fleming SM, Dolan RJ, Averbeck BB. Effects of emotional preferences on value-based decision-making are mediated by mentalizing and not reward networks. J Cogn Neurosci 23: 2197–2210, 2011.
12. Grupe DW, Oathes DJ, Nitschke JB. Dissecting the anticipation of aversion reveals dissociable neural networks. Cereb Cortex 23: 1874–1883, 2013.
13. Guitart-Masip M, Duzel E, Dolan R, Dayan P. Action versus valence in decision making. Trends Cogn Sci 18: 194–202, 2014.
14. Guitart-Masip M, Fuentemilla L, Bach DR, Huys QJM, Dayan P, Dolan RJ, Duzel E. Action dominates valence in anticipatory representations in the human striatum and dopaminergic midbrain. J Neurosci 31: 7867–7875, 2011.
15. Hu X, Le TH, Parrish T, Erhard P. Retrospective estimation and correction of physiological fluctuation in functional MRI. Magn Reson Med 34: 201–212, 1995.
16. Katahira K, Fujimura T, Matsuda YT, Okanoya K, Okada M. Individual differences in heart rate variability are associated with the avoidance of negative emotional events. Biol Psychol 103: 322–331, 2014.
17. Katahira K, Fujimura T, Okanoya K, Okada M. Decision-making based on emotional images. Front Psychol 2: 311, 2011.
18. Kellman P. Adaptive sensitivity encoding incorporating temporal filtering (TSENSE). Magn Reson Med 852: 846–852, 2001.
19. Lane RD, Reiman EM, Bradley MM, Lang PJ, Ahern GL, Davidson RJ, Schwartz GE. Neuroanatomical correlates of pleasant and unpleasant emotion. Neuropsychologia 35: 1437–1444, 1997.
20. Lang PJ, Bradley MM. Emotion and the motivational brain. Biol Psychol 84: 437–450, 2010.
21. Lang PJ, Bradley MM, Cuthbert BN. Emotion, motivation, and anxiety: brain mechanisms and psychophysiology. Biol Psychiatry 44: 1248–1263, 1998a.
22. Lang PJ, Bradley MM, Cuthbert BN. International Affective Picture System (IAPS): affective ratings of pictures and instruction manual. Technical Report A-8. Gainesville, FL: University of Florida, 2008.
23. Lang PJ, Bradley MM, Fitzsimmons JR, Cuthbert BN, Scott JD, Moulder B, Nangia V. Emotional arousal and activation of the visual cortex: an fMRI analysis. Psychophysiology 35: 199–210, 1998b.
24. Levita L, Hoskin R, Champi S. Avoidance of harm and anxiety: a role for the nucleus accumbens. Neuroimage 62: 189–198, 2012.
25. Li J, Schiller D, Schoenbaum G, Phelps a E, Daw ND. Differential roles of human striatum and amygdala in associative learning. Nat Neurosci 14: 1250–1252, 2011.
26. Lin A, Adolphs R, Rangel A. Social and monetary reward learning engage overlapping neural substrates. Soc Cogn Affect Neurosci 7: 274–281, 2012.
27. Loewenstein GF, Weber EU, Hsee CK, Welch N. Risk as feelings. Psychol Bull 127: 267–286, 2001.
28. Niv Y. Reinforcement learning in the brain. J Math Psychol 53: 139–154, 2009.
29. Niv Y, Duff MO, Dayan P. Dopamine, uncertainty and TD learning. Behav Brain Funct 1: 6, 2005.
30. Niv Y, Schoenbaum G. Dialogues on prediction errors. Trends Cogn Sci 12: 265–272, 2008.
31. Ochsner KN, Knierim K, Ludlow DH, Hanelin J, Ramachandran T, Glover G, Mackey SC. Reflecting upon feelings: an fMRI study of neural systems supporting the attribution of emotion to self and other. J Cogn Neurosci 16: 1746–1772, 2004.
32. O’Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304: 452–454, 2004.
33. O’Doherty J, Winston J, Critchley H, Perrett D. Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness. Neuropsychologia 41: 147–155, 2003a.
34. O’Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ. Temporal difference models and reward-related learning in the human brain. Neuron 38: 329–337, 2003b.
35. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. Dopaminedependent prediction errors underpin reward-seeking behaviour in humans. Nature 442: 1042–1045, 2006.
36. Pruessmann KP, Weiger M, Scheidegger MB, Boesiger P. SENSE: sensitivity encoding for fast MRI. Magn Reson Med 42: 952–962, 1999.
37. Sabatinelli D, Bradley MM, Fitzsimmons JR, Lang PJ. Parallel amygdala and inferotemporal activation reflect emotional intensity and fear relevance. Neuroimage 24: 1265–1270, 2005.
38. Sabatinelli D, Bradley MM, Lang PJ, Costa VD, Versace F. Pleasure rather than salience activates human nucleus accumbens and medial prefrontal cortex. J Neurophysiol 98: 1374–1379, 2007.
39. Seymour B, Daw N, Dayan P, Singer T, Dolan R. Differential encoding of losses and gains in the human striatum. J Neurosci 27: 4826–4831, 2007.
40. Seymour B, Doherty JPO, Dayan P, Koltzenburg M, Jones AK, Dolan RJ, Friston KJ, Frackowiak RS. Temporal difference models describe higherorder learning in humans. Nature 429: 664–667, 2004.
41. Seymour B, Dolan R. Emotion, decision making, and the amygdala. Neuron 58: 662–671, 2008.
42. Seymour B, O’Doherty JP, Koltzenburg M, Wiech K, Frackowiak R, Friston K, Dolan R. Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat Neurosci 8: 1234–1240, 2005.
43. Shiv B, Loewenstein G, Bechara A, Damasio H, Damasio AR. Investment behavior and the negative side of emotion. Psychol Sci 16: 435–439, 2005.
44. Sutton RS, Barto AG. Reinforcement Learning: An Introduction. Cambridge, UK: Cambridge Univ. Press, 1998.
45. Tanaka SC, Doya K, Okada G, Ueda K, Okamoto Y, Yamawaki S. Prediction of immediate and future rewards differentially recruits corticobasal ganglia loops. Nat Neurosci 7: 887–893, 2004.
46. Watkins CJ, Dayan P. Q-Learning. Mach Learn 8: 279–292, 1992.
47. Zink CF, Pagnoni G, Martin ME, Dhamala M, Berns GS. Human striatal response to salient nonrewarding stimuli. J Neurosci 23: 8092–8097, 2003.
48. Zink CF, Pagnoni G, Martin-Skurski ME, Chappelow JC, Berns GS. Human striatal responses to monetary reward depend on saliency. Neuron 42: 509–517, 2004.