Overlapping neural systems represent cognitive effort and reward anticipation

PLoS ONE

Volumn 9, Issue 3, 2014, Pages

  Vassena, Eliana ^a,b   Silvetti, Massimo ^a,b   Boehler, Carsten N ^a,b   Achten, Eric ^b   Fias, Wim ^a,b   Verguts, Tom ^a,b  

^a GHENT UNIVERSITY   (Belgium)

^b GHENT UNIVERSITY HOSPITAL   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANALYSIS OF VARIANCE; ANTERIOR CINGULATE; ANTICIPATION; ARTICLE; CAUDATE NUCLEUS; COGNITION; DOPAMINERGIC NERVE CELL; EVOKED BRAIN STEM RESPONSE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; IMAGE PROCESSING; MALE; MOTIVATION; NERVE CELL NETWORK; NEUROMODULATION; NEUROTRANSMISSION; NORMAL HUMAN; ORBITAL CORTEX; POSITRON EMISSION TOMOGRAPHY; REACTION TIME; REWARD; SUBSTANTIA NIGRA; YOUNG ADULT; ADOLESCENT; ANATOMY AND HISTOLOGY; BRAIN MAPPING; CINGULATE GYRUS; CORPUS STRIATUM; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; TASK PERFORMANCE;

ADOLESCENT; ANTICIPATION, PSYCHOLOGICAL; BRAIN MAPPING; COGNITION; CORPUS STRIATUM; FEMALE; GYRUS CINGULI; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MOTIVATION; REACTION TIME; REWARD; TASK PERFORMANCE AND ANALYSIS; YOUNG ADULT;

EID: 84897458123     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0091008     Document Type: Article

References (86)

1. Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9: 545-556. (Pubitemid 351873461)
2. Kahneman D, Tversky A (1979) Prospect theory: an analysis of decision under risk. Econometrica 47: 263-292.
3. Schultz W, Dickinson A (2000) Neuronal coding of prediction errors. Annu Rev Neurosci 23: 473-500. (Pubitemid 30350051)
4. Silvetti M, Seurinck R, Verguts T (2012) Value and prediction error estimation account for volatility effects in ACC: A model-based fMRI study. Cortex 49: 1327-1635.
5. Knutson B, Cooper JC (2005) Functional magnetic resonance imaging of reward prediction. Curr Opin Neurol 18: 411-417. (Pubitemid 41104804)
6. Silvetti M, Seurinck R, Verguts T (2011) Value and prediction error in medial frontal cortex: integrating the single-unit and systems levels of analysis. Front Hum Neurosci 5: 75.
7. Alexander W, Brown JW (2011) Medial prefrontal cortex as an action-outcome predictor. Nat Neurosci 14: 1338-1344.
8. Walton ME, Rudebeck PH, Bannerman DM, Rushworth MFS (2008) Calculating the cost of acting in frontal cortex. Ann N Y Acad Sci 44: 1-16.
9. Basten U, Biele G, Heekeren HR, Fiebach CJ (2010) How the brain integrates costs and benefits during decision making. Proc Natl Acad Sci U S A 107: 21767-21772.
10. Kennerley SW, Dahmubed AF, Lara AH, Wallis JD (2009) Neurons in the frontal lobe encode the value of multiple decision variables. J Cogn Neurosci 21: 1162-1178.
11. Park SQ, Kahnt T, Rieskamp J, Heekeren HR (2011) Neurobiology of value integration: when value impacts valuation. J Neurosci 31: 9307-9314.
12. Boksem MAS, Tops M (2008) Mental fatigue: costs and benefits. Brain Res Rev 59: 125-139.
13. Walton ME, Kennerley SW, Bannerman DM, Phillips PEM, Rushworth MFS (2006) Weighing up the benefits of work: behavioral and neural analyses of effort-related decision making. Neural Networks 19: 1302-1314. (Pubitemid 44466342)
14. Schweimer J, Hauber W (2010) Dopamine D1 receptors in the anterior cingulate cortex regulate effort-based decision making. Learn Mem 13: 777-782. (Pubitemid 44871679)
15. Kurniawan IT, Seymour B, Talmi D, Yoshida W, Chater N, et al. (2010) Choosing to make an effort: the role of striatum in signaling physical effort of a chosen action. J Neurophysiol 104: 313-321.
16. Kurniawan IT, Guitart-Masip M, Dolan RJ (2011) Dopamine and effort-based decision making. Fronti Neurosci 5: 81.
17. Assadi SM, Yücel M, Pantelis C (2009) Dopamine modulates neural networks involved in effort-based decision-making. Neurosci Biobehav Rev 3: 383-393.
18. Croxson PL, Walton ME, O'Reilly JX, Behrens TEJ, Rushworth MFS (2009) Effort-based cost-benefit valuation and the human brain. J Neurosci 29: 4531-4541.
19. Botvinick MM, Huffstetler S, McGuire JT (2009) Effort discounting in human nucleus accumbens. Cogn Affect Behav Neurosci 9: 16-27.
20. Berridge KC (2004) Motivation concepts in behavioral neuroscience. Physiol Behav 81: 179-209.
21. Hübner R, Schlösser J (2010) Monetary reward increases attentional effort in the flanker task. Psychon Bull Rev 17: 821-826.
22. Berridge KC, Robinson TE, Aldridge JW (2010) Dissecting components of reward: "liking", "wanting", and learning. Curr Opin Pharmacol 9: 65-73.
23. Krebs RM, Boehler CN, Roberts KC, Song AW, Woldorff MG (2012) The involvement of the dopaminergic midbrain and cortico-striatal-thalamic circuits in the integration of reward prospect and attentional task demands. Cereb Cortex. 22: 607-615.
24. Boehler CN, Hopf JM, Krebs RM, Stoppel CM, Schoenfeld MA, et al. (2011) Task-load-dependent activation of dopaminergic midbrain areas in the absence of reward. J Neurosci 31: 4955-4961.
25. Stoppel CM, Boehler CN, Strumpf H, Heinze H-J, Hopf J-M, et al. (2011) Neural processing of reward magnitude under varying attentional demands. Brain Res 1383: 218-229.
26. Salamone JD, Correa M, Mingote SM, Weber SM (2005) Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine. Curr Opin Pharmacol 5: 34-41. (Pubitemid 40124532)
27. Bardgett ME, Depenbrock M, Downs N, Points M, Green L (2009) Dopamine modulates effort-based decision making in rats. Behav Neurosci 123: 242-251.
28. Kurniawan IT, Guitart-Masip M, Dayan P, Dolan RJ (2013) Effort and valuation in the brain: the effects of anticipation and execution. J Neurosci 33: 6160-6169.
29. Schmidt L, Lebreton M, Clery-Melin ML, Daunizeau J, Pessiglione M (2012) Neural mechanisms underlying motivation of physical versus mental effort. Plos Biol 10, e1001266.
30. McGuire JT, Botvinick MM (2010) Prefrontal cortex, cognitive control and the registration of decision costs. Proc Natl Acad Sci USA 107, 7922-7926.
31. Lallement JH, Kuss K, Trautner P, Weber B, Falk A, et al. (2012) Effort increases sensitivity to reward and loss magnitude in the human brain. Soc Cogn Affect Neurosci doi: 10.1093/scan/nss147.
32. Haber SN, Knutson B (2010) The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 35: 4-26.
33. Kong J, Wang C, Kwong K, Vangel M, Chua E, et al. (2005) The neural substrate of arithmetic operations and procedure complexity. Brain Res Cogn Brain Res 22: 397-405. (Pubitemid 40276806)
34. Sohn M-H, Albert M V, Jung K, Carter CS, Anderson JR (2007) Anticipation of conflict monitoring in the anterior cingulate cortex and the prefrontal cortex. Proc Natl Acad Sci U S A 104: 10330-10334. (Pubitemid 47185665)
35. Sterling P (2012) Allostasis: a model of predictive regulation. Physiol Behav 106: 5-15.
36. Aarts E, Roelofs A, van Turennout M (2008) Anticipatory activity in anterior cingulate cortex can be independent of conflict and error likelihood. J Neurosci 28: 4671-4678.
37. Green L, Myerson J (2004) A discounting framework for choice with delayed and probabilistic rewards. Psychol Bull 130: 769-792. (Pubitemid 39216582)
38. Peters J, Büchel C (2011) The neural mechanisms of inter-temporal decision-making: understanding variability. Trends Cogn Sci 15: 227-239.
39. Roesch MR, Taylor AR, Schoenbaum G (2006) Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51: 509-520. (Pubitemid 44189799)
40. Kobayashi S, Schultz W (2008) Influence of reward delays on responses of dopamine neurons. J Neurosci 28: 7837-7846.
41. Imbo I, De Rammelaere S, Vandierendonck A (2005) New insights in the role of working memory in carry and borrow operations. Psicologica Belgica 32: 101-121. (Pubitemid 41666419)
42. Carver CS, White TL (1994) Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS/BAS Scales. J Pers Soc Psychol 67: 319-333.
43. Nichols T, Brett M, Andersson J, Wager T, Poline J-B (2005) Valid conjunction inference with the minimum statistic. NeuroImage 25: 653-660. (Pubitemid 40461704)
44. Raizada RD, Poldrack RA (2008) Challenge-driven attention: interacting frontal and brainstem systems. Front Hum Neurosci. 28,1: 3.
45. Malecek NJ, Poldrack RA (2013) Beyond dopamine: the noradrenergic system and mental effort. Behav Brain Sci. 36: 698-9.
46. Nakagawa S, Sugiura M, Akitsuki Y, Hosseini SM, Kotozaki Y, et al. (2013) Compensatory effort parallels midbrain deactivation during mental fatigue: an fMRI study, Plos One 8(2): e56606.
47. Aston-Jones G, Cohen JD (2005). Adaptive gain and the role of the locus coeruleus-norepinephrine system in optimal performance. J Comp Neurol. 493, 99-110. (Pubitemid 41637975)
48. Woo CW, Krishnan A, Wager TD (2013) Cluster-extent based thresholding in fMRI analyses: pitfalls and recommendations. Neuroimage http://dx.doi.org/10. 1016/j.neuroimage.2013.12.058.
49. Oikawa H, Sasaki M, Tamakawa Y, Ehara S, Tohyama K (2002) The Substantia Nigra in Parkinson Disease: Proton density - weighted spin-echo and fast short inversion time inversion-recovery MR findings. AJNR Am J Neuroradiol 23: 1747-1756. (Pubitemid 35304115)
50. Naidic T, Duvernoy H, Delman B, Sorensen A, Kollias S, et al. (2009) Duvernoy's atlas of the human brain stem and cerebellum. Wien: SpringerWienNewYork.
51. Amiez C, Joseph JP, Procyk E (2006) Reward encoding in the monkey anterior cingulate cortex. Cereb Cortex 16: 1040-1055. (Pubitemid 43992453)
52. Liu X, Hairston J, Schrier M, Fan J (2011) Common and distinct networks underlying reward valence and processing stages: a meta-analysis of functional neuroimaging studies. Neurosci Biobehav Rev 35: 1219-1236.
53. Levy DJ, Glimcher PW (2011) Comparing apples and aranges: using reward-specific and reward-general subjective value representation in the brain. J Neurosci 31: 14693-14707.
54. Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD (2001) Conflict monitoring and cognitive control. Psychol Rev 108: 624-652. (Pubitemid 33604139)
55. Engström M, Landtblom A-M, Karlsson T (2013) Brain and effort: brain activation and effort-related working memory in healthy participants and patients with working memory deficits. Front Hum Neurosci 7: 140.
56. Naccache L, Dehaene S, Cohen L, Habert MO, Guichart-Gomez E, et al. (2005) Effortless control: executive attention and conscious feeling of mental effort are dissociable. Neuropsychologia 43: 1318-1328. (Pubitemid 40798362)
57. Luks TL, Simpson GV, Feiwell RJ, Miller WL (2002) Evidence for Anterior Cingulate Cortex involvement in monitoring preparatory attentional set. NeuroImage 17: 792-802. (Pubitemid 35317013)
58. Niv Y, Daw ND, Joel D, Dayan P (2007) Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology 191: 507-520. (Pubitemid 46355878)
59. Pessiglione M, Schmidt L, Draganski B, Kalisch R, Lau H, et al. (2007) How the brain translates money into force: a neuroimaging study of subliminal motivation. Science 316: 904-906. (Pubitemid 46764283)
60. Salamone JD, Correa M, Farrar A, Mingote SM (2007) Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 191: 461-482. (Pubitemid 46355902)
61. Salamone JD, Correa M (2012) The mysterious motivational functions of mesolimbic dopamine. Neuron 76: 470-485.
62. Beierholm U, Guitart-Masip M, Economides M, Chowdhury R, Düzel E, et al. (2013) Dopamine modulates reward-related vigor. Neuropsychopharmacology 38: 1495-1503.
63. Lorist MM, Boksem MAS, Ridderinkhof KR (2005) Impaired cognitive control and reduced cingulate activity during mental fatigue. Brain Res Cogn Brain Res 24: 199-205. (Pubitemid 40922628)
64. Moeller SJ, Tomasi D, Honorio J, Volkow ND, Goldstein RZ (2012) Dopaminergic involvement during mental fatigue in health and cocaine addiction. Transl Psychiatry 2: e176.
65. Treadway MT, Buckholtz JW, Cowan RL, Woodward ND, Li R, et al. (2012) Dopaminergic mechanisms of individual differences in human effort-based decision-making. J Neurosci 32: 6170-6176.
66. Cools R (2011) Dopaminergic control of the striatum for high-level cognition. Current opinion in neurobiology: 402-407. doi:10.1016/j.conb.2011.04. 002.
67. Shenhav A, Botvinick MM, Cohen JD (2013) The expected value of control: an integrative theory of Anterior Cingulate Cortex function. Neuron 79: 217-240.
68. D'Ardenne K, McClure SM, Nystrom LE, Cohen JD (2008) BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319: 1264-1267. (Pubitemid 351323026)
69. Cools R, Robinson OJ, Sahakian B (2008) Acute tryptophan depletion in healthy volunteers enhances punishment prediction but does not affect reward prediction. Neuropsychopharmacology 33: 2291-2299. (Pubitemid 351992074)
70. Cools R, Calder AJ, Lawrence AD, Clark L, Bullmore E, et al. (2005) Individual differences in threat sensitivity predict serotonergic modulation of amygdala response to fearful faces. Psychopharmacology 180: 670-679. doi:10.1007/s00213-005-2215-5. (Pubitemid 41317863)
71. Van der Veen FM, Evers EAT, Deutz NEP, Schmitt JAJ (2007) Effects of acute tryptophan depletion on mood and facial emotion perception related brain activation and performance in healthy women with and without a family history of depression. Neuropsychopharmacology 32: 216-224. (Pubitemid 44967800)
72. Cools R, Roberts AC, Robbins TW (2008) Serotoninergic regulation of emotional and behavioural control processes. Trends Cogn Sci 12: 31-40. (Pubitemid 50012215)
73. Robinson OJ, Cools R, Sahakian BJ (2012) Tryptophan depletion disinhibits punishment but not reward prediction: implications for resilience. Psychopharmacology 219: 599-605.
74. Harmer CJ, Mackay CE, Reid CB, Cowen PJ, Goodwin GM (2006) Antidepressant drug treatment modifies the neural processing of nonconscious threat cues. Biol Psychiatry 59: 816-820.
75. Bromberg-Martin ES, Hikosaka O, Nakamura K (2010) Coding of task reward value in the dorsal raphe nucleus. J Neurosci 30: 6262-6272.
76. Amat J, Baratta M V, Paul E, Bland ST, Watkins LR, et al. (2005) Medial prefrontal cortex determines how stressor controllability affects behavior and dorsal raphe nucleus. Nat Neurosci 8: 365-371. (Pubitemid 40300194)
77. Boureau Y-L, Dayan P (2011) Opponency revisited: competition and cooperation between dopamine and serotonin. Neuropsychopharmacology 36: 74-97.
78. Cools R, Nakamura K, Daw ND (2011) Serotonin and dopamine: unifying affective, activational, and decision functions. Neuropsychopharmacology 36: 98-113.
79. Verguts T, Notebaert W (2009) Adaptation by binding: a learning account of cognitive control. Trends Cogn Sci 13,252-7.
80. McClure SM, Laibson DI, Loewenstein G, Cohen JD (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306: 503-507. (Pubitemid 39372453)
81. Tanaka SC, Doya K, Okada G, Ueda K, Okamoto Y, et al. (2004) Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat Neurosci 7: 887-893. (Pubitemid 38989513)
82. Miyazaki K, Miyazaki KW, Doya K (2011) Activation of dorsal raphe serotonin neurons underlies waiting for delayed rewards. J Neurosci 31: 469-479.
83. Miyazaki K, Miyazaki KW, Doya K (2012) Activation of Dorsal Raphe Serotonin Neurons Is Necessary for Waiting for Delayed Rewards. J Neurosci 32: 10451-10457.
84. Luo S, Ainslie G, Giragosian L, Monterosso JR (2009) Behavioral and neural evidence of incentive bias for immediate rewards relative to preference-matched delayed rewards. J Neurosci 29: 14820-14827.
85. Schweighofer N, Tanaka SC, Doya K (2007) Serotonin and the evaluation of future rewards: theory, experiments, and possible neural mechanisms. Ann N Y Acad Sci 1104: 289-300. (Pubitemid 47092737)
86. Schweighofer N, Bertin M, Shishida K, Okamoto Y, Tanaka SC, et al. (2008) Low-serotonin levels increase delayed reward discounting in humans. J Neurosci 28: 4528-4532.