Attentional modulation of reward processing in the human brain

Human Brain Mapping

Volumn 35, Issue 7, 2014, Pages 3036-3051

  Rothkirch, Marcus ^a   Schmack, Katharina ^a   Deserno, Lorenz ^a,b   Darmohray, Dana ^c   Sterzer, Philipp ^a,d  

^a CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

^b MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

^c UNIVERSITY OF MUNICH   (Germany)

^d BERNSTEIN CENTER FOR COMPUTATIONAL NEUROSCIENCE   (Germany)

Author keywords

Anterior insula; Attention; FMRI; Reinforcement; Ventral striatum; Visual cortex

Indexed keywords

ADULT; ANTERIOR INSULA; ANTICIPATION; ARTICLE; ATTENTION; BRAIN REGION; CAUSAL MODELING; CORPUS STRIATUM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INFORMATION; INSULA; MEDICAL INFORMATION; NERVE POTENTIAL; NEUROMODULATION; NORMAL HUMAN; PRIORITY JOURNAL; PROCESSING; REINFORCEMENT; REWARD; STIMULUS; TASK PERFORMANCE; VENTRAL TEGMENTUM; VISUAL CORTEX; ANALYSIS OF VARIANCE; ASSOCIATION; BIOLOGICAL MODEL; BLOOD; BRAIN; BRAIN MAPPING; EYE FIXATION; IMAGE PROCESSING; MALE; NONLINEAR SYSTEM; NUCLEAR MAGNETIC RESONANCE IMAGING; PHOTOSTIMULATION; PHYSIOLOGY; STATISTICAL MODEL; TIME; VASCULARIZATION; YOUNG ADULT;

OXYGEN;

ANALYSIS OF VARIANCE; ATTENTION; BRAIN; BRAIN MAPPING; CUES; FEMALE; FIXATION, OCULAR; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LINEAR MODELS; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; NONLINEAR DYNAMICS; OXYGEN; PHOTIC STIMULATION; REWARD; TIME FACTORS; YOUNG ADULT;

EID: 84902215889     PISSN: 10659471     EISSN: 10970193     Source Type: Journal    
DOI: 10.1002/hbm.22383     Document Type: Article

References (114)

1. Allman JM, Tetreault NA, Hakeem AY, Manaye KF, Semendeferi K, Erwin JM, Park S, Goubert V, Hof PR (2010): The von Economo neurons in frontoinsular and anterior cingulate cortex in great apes and humans. Brain Struct Funct 214:495-517.
2. Apitz T, Bunzeck N (2012): Reward modulates the neural dynamics of early visual category processing. Neuroimage 63:1614-1622.
3. Ballard K, Knutson B (2009): Dissociable neural representations of future reward magnitude and delay during temporal discounting. Neuroimage 45:143-150.
4. Basten U, Biele G, Heekeren HR, Fiebach CJ (2010): How the brain integrates costs and benefits during decision making. Proc Natl Acad Sci USA 107:21767-21772.
5. Bijleveld E, Custers R, Aarts H (2010): Unconscious reward cues increase invested effort, but do not change speed-accuracy tradeoffs. Cognition 115:330-335.
6. Bijleveld E, Custers R, Aarts H (2012): Adaptive reward pursuit: How effort requirements affect unconscious reward responses and conscious reward decisions. J Exp Psychol Gen 141:728-742.
7. Bjork JM, Hommer DW (2007): Anticipating instrumentally obtained and passively-received rewards: A factorial fMRI investigation. Behav Brain Res 177:165-170.
8. Bromberg-Martin ES, Matsumoto M, Hikosaka O (2010): Dopamine in motivational control: Rewarding, aversive, and alerting. Neuron 68:815-834.
9. Büchel C, Holmes AP, Rees G, Friston KJ (1998): Characterizing stimulus-response functions using nonlinear regressors in parametric fMRI experiments. Neuroimage 8:140-148.
10. Carlson JM, Foti D, Mujica-Parodi LR, Harmon-Jones E, Hajcak G (2011): Ventral striatal and medial prefrontal BOLD activation is correlated with reward-related electrocortical activity: A combined ERP and fMRI study. Neuroimage 57:1608-1616.
11. Chikama M, McFarland NR, Amaral DG, Haber SN (1997): Insular cortical projections to functional regions of the striatum correlate with cortical cytoarchitectonic organization in the primate. J Neurosci 17:9686-9705.
12. Cohen JY, Haesler S, Vong L, Lowell BB, Uchida N (2012): Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482:85-88.
13. Corbetta M, Shulman GL (2002): Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci 3:201-215.
14. Craig AD (2002): How do you feel? Interoception: The sense of the physiological condition of the body. Nat Rev Neurosci 3:655-666.
15. Craig ADB (2009): How do you feel-now? The anterior insula and human awareness. Nat Rev Neurosci 10:59-70.
16. Critchley HD, Wiens S, Rotshtein P, Ohman A, Dolan RJ (2004): Neural systems supporting interoceptive awareness. Nat Neurosci 7:189-195.
17. Croxson PL, Walton ME, O'Reilly JX, Behrens TEJ, Rushworth MFS (2009): Effort-based cost-benefit valuation and the human brain. J Neurosci 29:4531-4541.
18. Daunizeau J, David O, Stephan KE (2011): Dynamic causal modelling: A critical review of the biophysical and statistical foundations. Neuroimage 58:312-322.
19. Davey CG, Allen NB, Harrison BJ, Dwyer DB, Yücel M (2010): Being liked activates primary reward and midline self-related brain regions. Hum Brain Mapp 31:660-668.
20. David O, Guillemain I, Saillet S, Reyt S, Deransart C, Segebarth C, Depaulis A (2008): Identifying neural drivers with functional MRI: An electrophysiological validation. PLoS Biol 6:2683-2697.
21. Della Libera C, Chelazzi L (2006): Visual selective attention and the effects of monetary rewards. Psychol Sci 17:222-227.
22. Deserno L, Sterzer P, Wüstenberg T, Heinz A, Schlagenhauf F (2012): Reduced prefrontal-parietal effective connectivity and working memory deficits in schizophrenia. J Neurosci 32:12-20.
23. Desimone R, Duncan J (1995): Neural mechanisms of selective visual attention. Annu Rev Neurosci 18:193-222.
24. Doñamayor N, Schoenfeld MA, Münte TF (2012): Magneto- and electroencephalographic manifestations of reward anticipation and delivery. Neuroimage 62:17-29.
25. Dosenbach NUF, Fair DA, Miezin FM, Cohen AL, Wenger KK, Dosenbach RAT, Fox MD, Snyder AZ, Vincent JL, Raichle ME, Schlaggar BL, Petersen SE (2007): Distinct brain networks for adaptive and stable task control in humans. Proc Natl Acad Sci USA 104:11073-11078.
26. Downar J, Mikulis DJ, Davis KD (2003): Neural correlates of the prolonged salience of painful stimulation. Neuroimage 20:1540-1551.
27. Dupont S, Bouilleret V, Hasboun D, Semah F, Baulac M (2003): Functional anatomy of the insula: New insights from imaging. Surg Radiol Anat. 25:113-119.
28. Eblen F, Graybiel AM (1995): Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey. J Neurosci 15:5999-6013.
29. Eckert MA, Menon V, Walczak A, Ahlstrom J, Denslow S, Horwitz A, Dubno JR (2009): At the heart of the ventral attention system: The right anterior insula. Hum Brain Mapp 30:2530-2541.
30. Elliott R, Newman JL, Longe OA, William Deakin JF (2004): Instrumental responding for rewards is associated with enhanced neuronal response in subcortical reward systems. Neuroimage 21:984-990.
31. Engelmann JB, Pessoa L (2007): Motivation sharpens exogenous spatial attention. Emotion 7:668-674.
32. Engelmann JB, Damaraju E, Padmala S, Pessoa L (2009): Combined effects of attention and motivation on visual task performance: Transient and sustained motivational effects. Front Hum Neurosci 3:4.
33. Ernst M, Nelson EE, McClure EB, Monk CS, Munson S, Eshel N, Zarahn E, Leibenluft E, Zametkin A, Towbin K, Blair J, Charney D, Pine DS (2004): Choice selection and reward anticipation: An fMRI study. Neuropsychologia 42:1585-1597.
34. Fields HL, Hjelmstad GO, Margolis EB, Nicola SM (2007): Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. Annu Rev Neurosci 30:289-316.
35. Friston KJ, Harrison L, Penny W (2003): Dynamic causal modelling. Neuroimage 19:1273-1302.
36. Fudge JL, Breitbart MA, Danish M, Pannoni V (2005): Insular and gustatory inputs to the caudal ventral striatum in primates. J Comp Neurol 490:101-118.
37. Gläscher J, Daw N, Dayan P, O'Doherty JP (2010) States versus rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66:585-595.
38. Gomez A, Rothkirch M, Kaul C, Weygandt M, Haynes J-D, Rees G, Sterzer P (2011): Emotion modulates the effects of endogenous attention on retinotopic visual processing. Neuroimage 57:1542-1551.
39. Guitart-Masip M, Huys QJM, Fuentemilla L, Dayan P, Duzel E, Dolan RJ (2012): Go and no-go learning in reward and punishment: Interactions between affect and effect. Neuroimage 62:154-166.
40. Hampshire A, Thompson R, Duncan J, Owen AM (2009): Selective tuning of the right inferior frontal gyrus during target detection. Cogn Affect Behav Neurosci 9:103-112.
41. Harrison NA, Gray MA, Critchley HD (2009): Dynamic pupillary exchange engages brain regions encoding social salience. Soc Neurosci 4:233-243.
42. Jensen J, Smith AJ, Willeit M, Crawley AP, Mikulis DJ, Vitcu I, Kapur S (2007): Separate brain regions code for salience vs. valence during reward prediction in humans. Hum Brain Mapp 28:294-302.
43. Jiang Y, Costello P, Fang F, Huang M, He S (2006): A gender- and sexual orientation-dependent spatial attentional effect of invisible images. Proc Natl Acad Sci USA 103:17048-17052.
44. Kable JW, Glimcher PW (2007): The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10:1625-1633.
45. Kanwisher N, McDermott J, Chun MM (1997): The fusiform face area: A module in human extrastriate cortex specialized for face perception. J Neurosci 17:4302-4311.
46. Kemp JM, Powell TP (1970): The cortico-striate projection in the monkey. Brain 93:525-546.
47. Kim H, Shimojo S, O'Doherty JP (2011): Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex. Cereb Cortex 21:769-776.
48. Knutson B, Westdorp A, Kaiser E, Hommer D (2000): FMRI visualization of brain activity during a monetary incentive delay task. Neuroimage 12:20-27.
49. Knutson B, Adams CM, Fong GW, Hommer D (2001a): Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21:RC159.
50. Knutson B, Fong GW, Adams CM, Varner JL, Hommer D (2001b): Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport 12:3683-3687.
51. Knutson B, Fong GW, Bennett SM, Adams CM, Hommer D (2003): A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: Characterization with rapid event-related fMRI. Neuroimage 18:263-272.
52. Knutson B, Taylor J, Kaufman M, Peterson R, Glover G (2005): Distributed neural representation of expected value. J Neurosci 25:4806-4812.
53. Knutson B, Wimmer GE (2007): Splitting the difference: how does the brain code reward episodes? Ann NY Acad Sci 1104:54-69.
54. Lamme VAF (2003): Why visual attention and awareness are different. Trends Cogn Sci 7:12-18.
55. Lavie N (1995): Perceptual load as a necessary condition for selective attention. J Exp Psychol Hum Percept Perform 21:451-468.
56. Lavie N (2006): The role of perceptual load in visual awareness. Brain Res 1080:91-100.
57. Marsh AA, Blair KS, Vythilingam M, Busis S, Blair RJR (2007): Response options and expectations of reward in decision-making: The differential roles of dorsal and rostral anterior cingulate cortex. Neuroimage 35:979-988.
58. Maunsell JHR (2004): Neuronal representations of cognitive state: Reward or attention? Trends Cogn Sci 8:261-265.
59. Medford N, Critchley HD (2010): Conjoint activity of anterior insular and anterior cingulate cortex: Awareness and response. Brain Struct Funct 214:535-549.
60. Menon V, Uddin LQ (2010): Saliency, switching, attention and control: A network model of insula function. Brain Struct Funct 214:655-667.
61. Mesulam MM, Mufson EJ (1982): Insula of the old world monkey. III. Efferent cortical output and comments on function. J Comp Neurol 212:38-52.
62. Middleton FA, Strick PL (1996): The temporal lobe is a target of output from the basal ganglia. Proc Natl Acad Sci USA 93:8683-8687.
63. Mirenowicz J, Schultz W (1996): Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379:449-451.
64. Mizuhiki T, Richmond BJ, Shidara M (2012): Encoding of reward expectation by monkey anterior insular neurons. J Neurophysiol 107:2996-3007.
65. Mohanty A, Gitelman DR, Small DM, Mesulam MM (2008): The spatial attention network interacts with limbic and monoaminergic systems to modulate motivation-induced attention shifts. Cereb Cortex 18:2604-2613.
66. Mowrer SM, Jahn AA, Abduljalil A, Cunningham WA (2011): The value of success: Acquiring gains, avoiding losses, and simply being successful. PLoS ONE 6:e25307.
67. Nelson SM, Dosenbach NUF, Cohen AL, Wheeler ME, Schlaggar BL, Petersen SE (2010): Role of the anterior insula in task-level control and focal attention. Brain Struct Funct 214:669-680.
68. Nimchinsky EA, Gilissen E, Allman JM, Perl DP, Erwin JM, Hof PR (1999): A neuronal morphologic type unique to humans and great apes. Proc Natl Acad Sci USA 96:5268-5273.
69. O'Doherty J, Critchley H, Deichmann R, Dolan RJ (2003): Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J Neurosci 23:7931-7939.
70. Parent A, Hazrati LN (1995): Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop. Brain Res Brain Res Rev 20:91-127.
71. Paus T (2001): Primate anterior cingulate cortex: where motor control, drive and cognition interface. Nat Rev Neurosci 2:417-424.
72. Pedroni A, Koeneke S, Velickaite A, Jäncke L (2011): Differential magnitude coding of gains and omitted rewards in the ventral striatum. Brain Res 1411:76-86.
73. Pessiglione M, Schmidt L, Draganski B, Kalisch R, Lau H, Dolan RJ, Frith CD (2007): How the brain translates money into force: A neuroimaging study of subliminal motivation. Science 316:904-906.
74. Pessiglione M, Petrovic P, Daunizeau J, Palminteri S, Dolan RJ, Frith CD (2008): Subliminal instrumental conditioning demonstrated in the human brain. Neuron 59:561-567.
75. Pessoa L, Engelmann JB (2010): Embedding reward signals into perception and cognition. Front Neurosci 4.
76. Pessoa L, Kastner S, Ungerleider LG (2002): Attentional control of the processing of neural and emotional stimuli. Brain Res Cogn Brain Res 15:31-45.
77. Pessoa L, Padmala S, Morland T (2005): Fate of unattended fearful faces in the amygdala is determined by both attentional resources and cognitive modulation. Neuroimage 28:249-255.
78. Ploran EJ, Nelson SM, Velanova K, Donaldson DI, Petersen SE, Wheeler ME (2007): Evidence accumulation and the moment of recognition: Dissociating perceptual recognition processes using fMRI. J Neurosci 27:11912-11924.
79. Pochon JB, Levy R, Fossati P, Lehericy S, Poline JB, Pillon B, Le Bihan D, Dubois B (2002): The neural system that bridges reward and cognition in humans: An fMRI study. Proc Natl Acad Sci USA 99:5669-5674.
80. Prévost C, Pessiglione M, Météreau E, Cléry-Melin M-L, Dreher J-C (2010): Separate valuation subsystems for delay and effort decision costs. J Neurosci 30:14080-14090.
81. Rademacher L, Krach S, Kohls G, Irmak A, Gründer G, Spreckelmeyer KN (2010): Dissociation of neural networks for anticipation and consumption of monetary and social rewards. Neuroimage 49:3276-3285.
82. Reddy L, Moradi F, Koch C (2007): Top-down biases win against focal attention in the fusiform face area. Neuroimage 38:730-739.
83. Rogers RD, Ramnani N, Mackay C, Wilson JL, Jezzard P, Carter CS, Smith SM (2004): Distinct portions of anterior cingulate cortex and medial prefrontal cortex are activated by reward processing in separable phases of decision-making cognition. Biol Psychiatry 55:594-602.
84. Rolls ET, McCabe C, Redoute J (2008): Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cereb Cortex 18:652-663.
85. Saint-Cyr JA, Ungerleider LG, Desimone R (1990): Organization of visual cortical inputs to the striatum and subsequent outputs to the pallido-nigral complex in the monkey. J Comp Neurol 298:129-156.
86. Schubert R, Ritter P, Wüstenberg T, Preuschhof C, Curio G, Sommer W, Villringer A (2008): Spatial attention related SEP amplitude modulations covary with BOLD signal in S1-A simultaneous EEG-fMRI study. Cereb Cortex 18:2686-2700.
87. Schultz W (2000): Multiple reward signals in the brain. Nat Rev Neurosci 1:199-207.
88. Schultz W, Apicella P, Scarnati E, Ljungberg T (1992): Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci 12:4595-4610.
89. Schultz W, Dayan P, Montague PR (1997): A neural substrate of prediction and reward. Science 275:1593-1599.
90. Schultz W, Tremblay L, Hollerman JR (1998): Reward prediction in primate basal ganglia and frontal cortex. Neuropharmacology 37:421-429.
91. Seeley WW, Menon V, Schatzberg AF, Keller J, Glover GH, Kenna H, Reiss AL, Greicius MD (2007): Dissociable intrinsic connectivity networks for salience processing and executive control. J Neurosci 27:2349-2356.
92. Sescousse G, Redouté J, Dreher J-C (2010): The architecture of reward value coding in the human orbitofrontal cortex. J Neurosci 30:13095-13104.
93. Sheth SA, Mian MK, Patel SR, Asaad WF, Williams ZM, Dougherty DD, Bush G, Eskandar EN (2012): Human dorsal anterior cingulate cortex neurons mediate ongoing behavioural adaptation. Nature 488:218-221.
94. Shin LM, Dougherty DD, Orr SP, Pitman RK, Lasko M, Macklin ML, Alpert NM, Fischman AJ, Rauch SL (2000): Activation of anterior paralimbic structures during guilt-related script-driven imagery. Biol Psychiatry 48:43-50.
95. Shuler MG, Bear MF (2006): Reward timing in the primary visual cortex. Science 311:1606-1609.
96. Simmons WK, Avery JA, Barcalow JC, Bodurka J, Drevets WC, Bellgowan P (2012): Keeping the body in mind: Insula functional organization and functional connectivity integrate interoceptive exteroceptive, and emotional awareness. Hum Brain Mapp. doi: 10.1002/hbm.22113. [Epub ahead of print]
97. Small DM, Gitelman D, Simmons K, Bloise SM, Parrish T, Mesulam M-M (2005): Monetary incentives enhance processing in brain regions mediating top-down control of attention. Cereb Cortex 15:1855-1865.
98. Smith BW, Mitchell DGV, Hardin MG, Jazbec S, Fridberg D, Blair RJR, Ernst M (2009): Neural substrates of reward magnitude, probability, and risk during a wheel of fortune decision-making task. Neuroimage 44:600-609.
99. Stephan KE, Penny WD, Daunizeau J, Moran RJ, Friston KJ (2009): Bayesian model selection for group studies. Neuroimage 46:1004-1017.
100. Sterzer P, Kleinschmidt A (2010): Anterior insula activations in perceptual paradigms: Often observed but barely understood. Brain Struct Funct 214:611-622.
101. Tallon-Baudry C, Meyniel F, Bourgeois-Gironde S (2011): Fast and automatic activation of an abstract representation of money in the human ventral visual pathway. PLoS ONE 6:e28229.
102. Tobler PN, O'Doherty JP, Dolan RJ, Schultz W (2007): Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol 97:1621-1632.
103. Tops M, Boksem MAS (2011): A potential role of the inferior frontal gyrus and anterior insula in cognitive control, brain rhythms, and event-related potentials. Front Psychol 2:330.
104. Ursu S, Carter CS (2005): Outcome representations, counterfactual comparisons and the human orbitofrontal cortex: Implications for neuroimaging studies of decision-making. Brain Res Cogn Brain Res 23:51-60.
105. Venkatraman V, Payne JW, Bettman JR, Luce MF, Huettel SA (2009): Separate neural mechanisms underlie choices and strategic preferences in risky decision making. Neuron 62:593-602.
106. Vuilleumier P, Armony JL, Driver J, Dolan RJ (2001): Effects of attention and emotion on face processing in the human brain: An event-related fMRI study. Neuron 30:829-841.
107. Weil RS, Furl N, Ruff CC, Symmonds M, Flandin G, Dolan RJ, Driver J, Rees G (2010): Rewarding feedback after correct visual discriminations has both general and specific influences on visual cortex. J Neurophysiol 104:1746-1757.
108. Wiech K, Lin C, Brodersen KH, Bingel U, Ploner M, Tracey I (2010): Anterior insula integrates information about salience into perceptual decisions about pain. J Neurosci 30:16324-16331.
109. Wimmer GE, Daw ND, Shohamy D (2012): Generalization of value in reinforcement learning by humans. Eur J Neurosci 35:1092-1104.
110. Wood G, Nuerk H-C, Sturm D, Willmes K (2008): Using parametric regressors to disentangle properties of multi-feature processes. Behav Brain Funct 4:38.
111. Wrase J, Kahnt T, Schlagenhauf F, Beck A, Cohen MX, Knutson B, Heinz A (2007): Different neural systems adjust motor behavior in response to reward and punishment. Neuroimage 36:1253-1262.
112. Wu S-W, Delgado MR, Maloney LT (2011): The neural correlates of subjective utility of monetary outcome and probability weight in economic and in motor decision under risk. J Neurosci 31:8822-8831.
113. Wyart V, Tallon-Baudry C (2008): Neural dissociation between visual awareness and spatial attention. J Neurosci 28:2667-2679.
114. Yacubian J, Gläscher J, Schroeder K, Sommer T, Braus DF, Büchel C (2006): Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. J Neurosci 26:9530-9537.