Cognitive strategies regulate fictive, but not reward prediction error signals in a sequential investment task

Human Brain Mapping

Volumn 35, Issue 8, 2014, Pages 3738-3749

  Gu, Xiaosi ^a,b   Kirk, Ulrich ^c   Lohrenz, Terry M ^b   Montague, P Read ^a,b,d  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b VIRGINIA TECH CARILION SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

^d VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

Author keywords

Decision making; Emotion regulation; Fictive learning; FMRI; Insula; Reappraisal; Reward prediction errors

Indexed keywords

ADULT; ANTERIOR INSULA; ARTICLE; BOLD SIGNAL; BRAIN REGION; COGNITIVE REAPPRAISAL TASK; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; EMOTIONALITY; ENDOWMENT EFFECT; FEMALE; FICTIVE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INFERIOR FRONTAL GYRUS; INSULA; MALE; MENTAL TASK; MESENCEPHALON; NERVE POTENTIAL; NEUROIMAGING; NORMAL HUMAN; ORBITAL CORTEX; PREDICTION; PRIORITY JOURNAL; REINFORCEMENT; REWARD; REWARD PREDICTION ERROR; SEQUENTIAL INVESTMENT TASK; TASK PERFORMANCE; ANTICIPATION; BRAIN; BRAIN MAPPING; COGNITION; INVESTMENT; LEARNING; NERVE TRACT; NEUROPSYCHOLOGICAL TEST; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PSYCHOPHYSICS; REGRESSION ANALYSIS; STATISTICAL MODEL;

ADULT; ANTICIPATION, PSYCHOLOGICAL; BRAIN; BRAIN MAPPING; COGNITION; DECISION MAKING; FEMALE; HUMANS; INVESTMENTS; LEARNING; LINEAR MODELS; MAGNETIC RESONANCE IMAGING; MALE; NEURAL PATHWAYS; NEUROPSYCHOLOGICAL TESTS; PSYCHOPHYSICS; REGRESSION ANALYSIS; REWARD;

EID: 84903964632     PISSN: 10659471     EISSN: 10970193     Source Type: Journal    
DOI: 10.1002/hbm.22433     Document Type: Article

References (65)

1. Bossaerts P (2010): Risk and risk prediction error signals in anterior insula. Brain Struct Funct 214:645-653.
2. Chiu PH, Lohrenz TM, Montague PR (2008): Smokers' brains compute, but ignore, a fictive error signal in a sequential investment task. Nat Neurosci 11:514-520.
3. Coricelli G, Critchley HD, Joffily M, O'Doherty JP, Sirigu A, Dolan RJ (2005): Regret and its avoidance: A neuroimaging study of choice behavior. Nat Neurosci 8:1255-1262.
4. Craig AD (2009): How do you feel--now? The anterior insula and human awareness. Nat Rev Neurosci 10:59-70.
5. Critchley HD, Wiens S, Rotshtein P, Ohman A, Dolan RJ (2004): Neural systems supporting interoceptive awareness. Nat Neurosci 7:189-195.
6. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ (2011): Model-based influences on humans' choices and striatal prediction errors. Neuron 69:1204-1215.
7. Dayan P, Kakade S, Montague PR (2000): Learning and selective attention. Nat Neurosci 3(Suppl):1218-1223.
8. De Martino B, Kumaran D, Seymour B, Dolan RJ (2006): Frames, biases, and rational decision-making in the human brain. Science 313:684-687.
9. Delgado MR, Gillis MM, Phelps EA (2008): Regulating the expectation of reward via cognitive strategies. Nat Neurosci 11:880-881.
10. Eckert MA, Menon V, Walczak A, Ahlstrom J, Denslow S, Horwitz A, Dubno JR (2009): At the heart of the ventral attention system: the right anterior insula. Hum Brain Mapp 30:2530-2541.
11. Fan J, Gu X, Liu X, Guise KG, Park Y, Martin L, de Marchena A, Tang CY, Minzenberg MJ, Hof PR (2011): Involvement of the anterior cingulate and frontoinsular cortices in rapid processing of salient facial emotional information. Neuroimage 54:2539-2546.
12. Fenton-O'Creevy, M, Soane E, Nicholson N, Willman P (2011): Thinking, feeling and deciding: The influence of emotions on the decision making and performance of traders. J Org Behav 32:1044-1061.
13. Friston KJ, Buechel C, Fink GR, Morris J, Rolls E, Dolan RJ (1997): Psychophysiological and modulatory interactions in neuroimaging. Neuroimage 6:218-229.
14. Friston KJ, Fletcher P, Josephs O, Holmes A, Rugg MD, Turner R (1998): Event-related fMRI: characterizing differential responses. Neuroimage 7:30-40.
15. Friston KJ, Frith CD, Turner R, Frackowiak RSJ (1995): Characterizing evoked hemodynamics with FMRI. Neuroimage 2:157-165.
16. Gitelman DR, Penny WD, Ashburner J, Friston KJ (2003): Modeling regional and psychophysiologic interactions in fMRI: The importance of hemodynamic deconvolution. Neuroimage 19:200-207.
17. Glascher J, Daw N, Dayan P, O'Doherty JP (2010): States versus rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66:585-595.
18. Gross JJ (1998): Antecedent- and response-focused emotion regulation: Divergent consequences for experience, expression, and physiology. J Pers Soc Psychol 74:224-237.
19. Gu X, Gao Z, Wang X, Liu X, Knight RT, Hof PR, Fan J (2012): Anterior insular cortex is necessary for empathetic pain perception. Brain 135:2726-2735.
20. Gu X, Hof PR, Friston KJ, Fan J (2013a): Anterior insular cortex and emotional awareness. J Comp Neurol 521:3371-3388.
21. Gu X, Liu X, Guise KG, Naidich TP, Hof PR, Fan J (2010): Functional dissociation of the frontoinsular and anterior cingulate cortices in empathy for pain. J Neurosci 30:3739-3744.
22. Gu X, Liu X, Van Dam NT, Hof PR, Fan J (2013b): Cognition-emotion integration in the anterior insular cortex. Cereb Cortex 23:20-27.
23. Hayden BY, Pearson JM, Platt ML (2009): Fictive reward signals in the anterior cingulate cortex. Science 324:948-950.
24. Hsu M, Bhatt M, Adolphs R, Tranel D, Camerer CF (2005): Neural systems responding to degrees of uncertainty in human decision-making. Science 310:1680-1683.
25. King-Casas B, Sharp C, Lomax-Bream L, Lohrenz T, Fonagy P, Montague PR (2008): The rupture and repair of cooperation in borderline personality disorder. Science 321:806-810.
26. Kirk U, Harvey A, Montague PR (2011): Domain expertise insulates against judgment bias by monetary favors through a modulation of ventromedial prefrontal cortex. Proc Natl Acad Sci USA 108:10332-10336.
27. Kober H, Mende-Siedlecki P, Kross EF, Weber J, Mischel W, Hart CL, Ochsner KN (2010): Prefrontal-striatal pathway underlies cognitive regulation of craving. Proc Natl Acad Sci USA 107:14811-14816.
28. Kuo WJ, Sjostrom T, Chen YP, Wang YH, Huang CY (2009): Intuition and deliberation: Two systems for strategizing in the brain. Science 324:519-522.
29. LaBar KS, Gatenby JC, Gore JC, LeDoux JE, Phelps EA (1998): Human amygdala activation during conditioned fear acquisition and extinction: A mixed-trial fMRI study. Neuron 20:937-945.
30. Lamm C, Singer T (2010): The role of anterior insular cortex in social emotions. Brain Struct Funct 214:579-591.
31. LeDoux JE (2000): Emotion circuits in the brain. Annu Rev Neurosci 23:155-184.
32. Li J, Schiller D, Schoenbaum G, Phelps EA, Daw ND (2011): Differential roles of human striatum and amygdala in associative learning. Nat Neurosci 14:1250-1252.
33. Lieberman MD, Cunningham WA (2009): Type I and Type II error concerns in fMRI research: Re-balancing the scale. Soc Cogn Affect Neurosci 4:423-428.
34. Lohrenz T, McCabe K, Camerer CF, Montague PR (2007): Neural signature of fictive learning signals in a sequential investment task. Proc Natl Acad Sci USA 104:9493-9498.
35. Martin LN, Delgado MR (2011): The influence of emotion regulation on decision-making under risk. J Cogn Neurosci 23:2569-2581.
36. Menon V, Uddin LQ (2010): Saliency, switching, attention and control: A network model of insula function. Brain Struct Funct 214:655-667.
37. Montague PR, Berns GS, Cohen JD, McClure SM, Pagnoni G, Dhamala M, Wiest MC, Karpov I, King RD, Apple N, Fisher RE (2002): Hyperscanning: Simultaneous fMRI during linked social interactions. Neuroimage 16:1159-1164.
38. Montague PR, Hyman SE, Cohen JD (2004): Computational roles for dopamine in behavioural control. Nature 431:760-767.
39. Montague PR, King-Casas B, Cohen JD (2006): Imaging valuation models in human choice. Annu Rev Neurosci 29:417-448.
40. Montague PR, Lohrenz T (2007): To detect and correct: norm violations and their enforcement. Neuron 56:14-18.
41. Mufson EJ, Mesulam MM, Pandya DN (1981): Insular interconnections with the amygdala in the rhesus monkey. Neuroscience 6:1231-1248.
42. Niv Y, Duff MO, Dayan P (2005): Dopamine, uncertainty and TD learning. Behav Brain Funct 1:6.
43. Ochsner KN, Silvers JA, Buhle JT (2012): Functional imaging studies of emotion regulation: A synthetic review and evolving model of the cognitive control of emotion. Ann NY Acad Sci 1251:E1-E24.
44. Pagnoni G, Zink CF, Montague PR, Berns GS (2002): Activity in human ventral striatum locked to errors of reward prediction. Nat Neurosci 5:97-98.
45. Pessoa L, Adolphs R (2010): Emotion processing and the amygdala: From a 'low road' to 'many roads' of evaluating biological significance. Nat Rev Neurosci 11:773-783.
46. Phelps EA (2006): Emotion and cognition: Insights from studies of the human amygdala. Annu Rev Psychol 57:27-53.
47. Preuschoff K, Quartz SR, Bossaerts P (2008): Human insula activation reflects risk prediction errors as well as risk. J Neurosci 28:2745-2752.
48. Rangel A, Camerer C, Montague PR (2008): A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9:545-556.
49. Rosenstein MT, Barto AG, Si J, Barto A, Powell W, Wunsch D (2004): Supervised Actor-Critic Reinforcement Learning. Handbook of Learning and Approximate Dynamic Programming. John Wiley & Sons, Inc. Hoboken, NJ, United States, pp 359-380.
50. Sanfey AG, Rilling JK, Aronson JA, Nystrom LE, Cohen JD (2003): The neural basis of economic decision-making in the Ultimatum Game. Science 300:1755-1758.
51. Schultz W, Dayan P, Montague PR (1997): A neural substrate of prediction and reward. Science 275:1593-1599.
52. Seth AK (2013): Interoceptive inference, emotion, and the embodied self. Trends Cogn Sci 17:565-573.
53. Seymour B, O'Doherty JP, Dayan P, Koltzenburg M, Jones AK, Dolan RJ, Friston KJ, Frackowiak RS (2004): Temporal difference models describe higher-order learning in humans. Nature 429:664-667.
54. Simon DA, Daw ND (2011): Neural correlates of forward planning in a spatial decision task in humans. J Neurosci 31:5526-5539.
55. Singer T, Critchley HD, Preuschoff K (2009): A common role of insula in feelings, empathy and uncertainty. Trends Cogn Sci 13:334-340.
56. Singer T, Seymour B, O'Doherty J, Kaube H, Dolan RJ, Frith CD (2004): Empathy for pain involves the affective but not sensory components of pain. Science 303:1157-1162.
57. Sokol-Hessner P, Camerer CF, Phelps EA (2013): Emotion regulation reduces loss aversion and decreases amygdala responses to losses. Soc Cogn Affect Neurosci 8:341-350.
58. Sokol-Hessner P, Hsu M, Curley NG, Delgado MR, Camerer CF, Phelps EA (2009): Thinking like a trader selectively reduces individuals' loss aversion. Proc Natl Acad Sci USA 106:5035-5040.
59. Staudinger, M.R., Erk, S., Abler, B., Walter, H. (2009): Cognitive reappraisal modulates expected value and prediction error encoding in the ventral striatum. Neuroimage, 47:713-721.
60. Staudinger MR, Erk S, Walter H (2011): Dorsolateral prefrontal cortex modulates striatal reward encoding during reappraisal of reward anticipation. Cereb Cortex 21:2578-2588.
61. Stephan KE, Harrison LM, Penny WD, Friston KJ (2004): Biophysical models of fMRI responses. Curr Opin Neurobiol 14:629-635.
62. Ullsperger M, Harsay HA, Wessel JR, Ridderinkhof KR (2010): Conscious perception of errors and its relation to the anterior insula. Brain Struct Funct 214:629-643.
63. Volkow ND, Fowler JS, Wang GJ, Telang F, Logan J, Jayne M, Ma Y, Pradhan K, Wong C, Swanson JM (2010): Cognitive control of drug craving inhibits brain reward regions in cocaine abusers. Neuroimage 49:2536-2543.
64. Wager TD, Davidson ML, Hughes BL, Lindquist MA, Ochsner KN (2008): Prefrontal-subcortical pathways mediating successful emotion regulation. Neuron 59:1037-1050.
65. Xiang T, Lohrenz T, Montague PR (2013): Computational substrates of norms and their violations during social exchange. J Neurosci 33:1099-1089.