Dopamine Does Double Duty in Motivating Cognitive Effort

Neuron

Volumn 89, Issue 4, 2016, Pages 695-710

  Westbrook, Andrew ^a   Braver, Todd S ^a,b  

^a WASHINGTON UNIVERSITY   (United States)

^b WASHINGTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE;

ANALYTICAL ERROR; COGNITION; DECISION MAKING; HUMAN; LEARNING; MOTIVATION; NONHUMAN; PRIORITY JOURNAL; REVIEW; REWARD; TASK PERFORMANCE; WORKING MEMORY; ANATOMY AND HISTOLOGY; ANIMAL; BRAIN; DRUG EFFECTS; METABOLISM; NERVE TRACT; PHYSIOLOGY; SHORT TERM MEMORY;

ANIMALS; BRAIN; COGNITION; DECISION MAKING; DOPAMINE; HUMANS; LEARNING; MEMORY, SHORT-TERM; MOTIVATION; NEURAL PATHWAYS;

EID: 84958162409     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2015.12.029     Document Type: Review

References (152)

1. Aalto S., Brück A., Laine M., Någren K., Rinne J.O. Frontal and temporal dopamine release during working memory and attention tasks in healthy humans: a positron emission tomography study using the high-affinity dopamine D2 receptor ligand [11C]FLB 457. J. Neurosci. 2005, 25:2471-2477.
2. Aarts E., Roelofs A., Franke B., Rijpkema M., Fernández G., Helmich R.C., Cools R. Striatal dopamine mediates the interface between motivational and cognitive control in humans: evidence from genetic imaging. Neuropsychopharmacology 2010, 35:1943-1951.
3. Aarts E., Wallace D.L., Dang L.C., Jagust W.J., Cools R., D'Esposito M. Dopamine and the cognitive downside of a promised bonus. Psychol. Sci. 2014, 25:1003-1009.
4. Alexander W.H., Brown J.W. Medial prefrontal cortex as an action-outcome predictor. Nat. Neurosci. 2011, 14:1338-1344.
5. Badre D., Frank M.J. Mechanisms of hierarchical reinforcement learning in cortico-striatal circuits 2: evidence from fMRI. Cereb. Cortex 2012, 22:527-536.
6. Bahlmann J., Aarts E., D'Esposito M. Influence of motivation on control hierarchy in the human frontal cortex. J. Neurosci. 2015, 35:3207-3217.
7. Berridge C.W., Arnsten A.F.T. Psychostimulants and motivated behavior: arousal and cognition. Neurosci. Biobehav. Rev. 2013, 37(Pt A):1976-1984.
8. Boehler C.N., Hopf J.M., Krebs R.M., Stoppel C.M., Schoenfeld M.A., Heinze H.J., Noesselt T. Task-load-dependent activation of dopaminergic midbrain areas in the absence of reward. J. Neurosci. 2011, 31:4955-4961.
9. Botvinick M.M. Conflict monitoring and decision making: reconciling two perspectives on anterior cingulate function. Cogn. Affect. Behav. Neurosci. 2007, 7:356-366.
10. Botvinick M., Braver T. Motivation and cognitive control: from behavior to neural mechanism. Annu. Rev. Psychol. 2015, 66:83-113.
11. Botvinick M.M., Braver T.S., Barch D.M., Carter C.S., Cohen J.D. Conflict monitoring and cognitive control. Psychol. Rev. 2001, 108:624-652.
12. Botvinick M.M., Huffstetler S., McGuire J.T. Effort discounting in human nucleus accumbens. Cogn. Affect. Behav. Neurosci. 2009, 36:74-97.
13. Boureau Y.-L., Dayan P. Opponency revisited: competition and cooperation between dopamine and serotonin. Neuropsychopharmacology 2010, 9:16-27.
14. Braver T.S. The variable nature of cognitive control: a dual mechanisms framework. Trends Cogn. Sci. 2012, 16:106-113.
15. Braver T.S., Barch D.M., Cohen J.D. Cognition and control in schizophrenia: a computational model of dopamine and prefrontal function. Biol. Psychiatry 1999, 46:312-328.
16. Bromberg-Martin E.S., Matsumoto M., Hikosaka O. Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 2010, 68:815-834.
17. Brown J.W., Braver T.S. Learned predictions of error likelihood in the anterior cingulate cortex. Science 2005, 307:1118-1121.
18. Brunel N., Wang X.-J. Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. J. Comput. Neurosci. 2001, 11:63-85.
19. Butts K.A., Weinberg J., Young A.H., Phillips A.G. Glucocorticoid receptors in the prefrontal cortex regulate stress-evoked dopamine efflux and aspects of executive function. Proc. Natl. Acad. Sci. USA 2011, 108:18459-18464.
20. Cacioppo J., Petty R., Feinstein J., Jarvis W. Dispositional differences in cognitive motivation: The life and times of individuals varying in need for cognition. Psychol. Bull. 1996, 119:197-253.
21. Cavanagh J.F., Masters S.E., Bath K., Frank M.J. Conflict acts as an implicit cost in reinforcement learning. Nat. Commun. 2014, 5:5394.
22. Chatham C.H., Badre D. Working memory management and predicted utility. Front. Behav. Neurosci. 2013, 7:83.
23. Chatham C.H., Badre D. Multiple gates on working memory. Current Opinion in Behavioral Sciences 2015, 1:23-31.
24. Chatham C.H., Frank M.J., Badre D. Corticostriatal output gating during selection from working memory. Neuron 2014, 81:930-942.
25. Chiew K.S., Braver T.S. Dissociable influences of reward motivation and positive emotion on cognitive control. Cogn. Affect. Behav. Neurosci. 2014, 14:509-529.
26. Chong T.T.J., Bonnelle V., Manohar S., Veromann K.-R., Muhammed K., Tofaris G.K., Hu M., Husain M. Dopamine enhances willingness to exert effort for reward in Parkinson's disease. Cortex 2015, 69:40-46.
27. Collins A.G.E., Frank M.J. Opponent actor learning (OpAL): modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive. Psychol. Rev. 2014, 121:337-366.
28. Cools R., D'Esposito M. Inverted-U-shaped dopamine actions on human working memory and cognitive control. Biol. Psychiatry 2011, 69:e113-e125.
29. Cowen S.L., Davis G.A., Nitz D.A. Anterior cingulate neurons in the rat map anticipated effort and reward to their associated action sequences. J. Neurophysiol. 2012, 107:2393-2407.
30. Croxson P.L., Walton M.E., O'Reilly J.X., Behrens T.E.J., Rushworth M.F.S. Effort-based cost-benefit valuation and the human brain. J. Neurosci. 2009, 29:4531-4541.
31. D'Ardenne K., Eshel N., Luka J., Lenartowicz A., Nystrom L.E., Cohen J.D. Role of prefrontal cortex and the midbrain dopamine system in working memory updating. Proc. Natl. Acad. Sci. USA 2012, 109:19900-19909.
32. D'Ardenne K., Lohrenz T., Bartley K.A., Montague P.R. Computational heterogeneity in the human mesencephalic dopamine system. Cogn. Affect. Behav. Neurosci. 2013, 13:747-756.
33. Daw N.D., Gershman S.J., Seymour B., Dayan P., Dolan R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 2011, 69:1204-1215.
34. Day J.J., Jones J.L., Wightman R.M., Carelli R.M. Phasic nucleus accumbens dopamine release encodes effort- and delay-related costs. Biol. Psychiatry 2010, 68:306-309.
35. Dayan P. How to set the switches on this thing. Curr. Opin. Neurobiol. 2012, 22:1068-1074.
36. Deserno L., Huys Q.J.M., Boehme R., Buchert R., Heinze H.-J., Grace A.A., Dolan R.J., Heinz A., Schlagenhauf F. Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making. Proc. Natl. Acad. Sci. USA 2015, 112:1595-1600.
37. Dixon M.L., Christoff K. The decision to engage cognitive control is driven by expected reward-value: neural and behavioral evidence. PLoS ONE 2012, 7:e51637.
38. Dolan R.J., Dayan P. Goals and habits in the brain. Neuron 2013, 80:312-325.
39. Donoso M., Collins A.G., Koechlin E. Human cognition. Foundations of human reasoning in the prefrontal cortex. Science 2014, 344:1481-1486.
40. Dosenbach N.U.F., Visscher K.M., Palmer E.D., Miezin F.M., Wenger K.K., Kang H.C., Burgund E.D., Grimes A.L., Schlaggar B.L., Petersen S.E. A core system for the implementation of task sets. Neuron 2006, 50:799-812.
41. Dreisbach G., Goschke T. How positive affect modulates cognitive control: reduced perseveration at the cost of increased distractibility. J. Exp. Psychol. Learn. Mem. Cogn. 2004, 30:343-353.
42. Dreisbach G., Fischer R. Conflicts as aversive signals. Brain Cogn. 2012, 78:94-98.
43. Dreyer J.K., Herrik K.F., Berg R.W., Hounsgaard J.D. Influence of phasic and tonic dopamine release on receptor activation. J. Neurosci. 2010, 30:14273-14283.
44. Duncan J. The structure of cognition: attentional episodes in mind and brain. Neuron 2013, 80:35-50.
45. Durstewitz D., Seamans J.K. The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-o-methyltransferase genotypes and schizophrenia. Biol. Psychiatry 2008, 64:739-749.
46. Etzel J., Cole M.W., Zacks J.M., Kay K.N., Braver T.S. Reward motivation enhances task coding in frontoparietal cortex. Cereb. Cortex. 2015, Published online January 19, 2015. 10.1093/cercor/bhu327.
47. Frank M.J., Badre D. Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis. Cereb. Cortex 2012, 22:509-526.
48. Frank M.J., Loughry B., O'Reilly R.C. Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cogn. Affect. Behav. Neurosci. 2001, 1:137-160.
49. Gan J.O., Walton M.E., Phillips P.E.M. Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat. Neurosci. 2009, 13:25-27.
50. Gershman S.J. Dopamine ramps are a consequence of reward prediction errors. Neural Comput. 2014, 26:467-471.
51. Ghods-Sharifi S., Floresco S.B. Differential effects on effort discounting induced by inactivations of the nucleus accumbens core or shell. Behav. Neurosci. 2010, 124:179-191.
52. Gläscher J., Hampton A.N., O'Doherty J.P. Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb. Cortex 2009, 19:483-495.
53. Haber S.N., Knutson B. The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 2010, 35:4-26.
54. Hammar A., Strand M., Årdal G., Schmid M., Lund A., Elliott R. Testing the cognitive effort hypothesis of cognitive impairment in major depression. Nord. J. Psychiatry 2011, 65:74-80.
55. Herd S.A., O'Reilly R.C., Hazy T.E., Chatham C.H., Brant A.M., Friedman N.P. A neural network model of individual differences in task switching abilities. Neuropsychologia 2014, 62:375-389.
56. Hess T.M., Ennis G.E. Age differences in the effort and costs associated with cognitive activity. J. Gerontol. B Psychol. Sci. Soc. Sci. 2012, 67:447-455.
57. Hillman K.L., Bilkey D.K. Neural encoding of competitive effort in the anterior cingulate cortex. Nat. Neurosci. 2012, 15:1290-1297.
58. Hiroyuki N. Multiplexing signals in reinforcement learning with internal models and dopamine. Curr. Opin. Neurobiol. 2014, 25:123-129.
59. Hollon N.G., Arnold M.M., Gan J.O., Walton M.E., Phillips P.E.M. Dopamine-associated cached values are not sufficient as the basis for action selection. Proc. Natl. Acad. Sci. USA 2014, 111:18357-18362.
60. Holroyd C.B., Coles M.G.H. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 2002, 109:679-709.
61. Holroyd C.B., Yeung N. Motivation of extended behaviors by anterior cingulate cortex. Trends Cogn. Sci. 2012, 16:122-128.
62. Holroyd C.B., McClure S.M. Hierarchical control over effortful behavior by rodent medial frontal cortex: A computational model. Psychol. Rev. 2015, 122:54-83.
63. Hosking J.G., Floresco S.B., Winstanley C.A. Dopamine antagonism decreases willingness to expend physical, but not cognitive, effort: a comparison of two rodent cost/benefit decision-making tasks. Neuropsychopharmacology 2015, 40:1005-1015.
64. Howe M.W., Tierney P.L., Sandberg S.G., Phillips P.E.M., Graybiel A.M. Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 2013, 500:575-579.
65. Inzlicht M., Schmeichel B.J., Macrae C.N. Why self-control seems (but may not be) limited. Trends Cogn. Sci. 2014, 18:127-133.
66. Jimura K., Locke H.S., Braver T.S. Prefrontal cortex mediation of cognitive enhancement in rewarding motivational contexts. Proc. Natl. Acad. Sci. USA 2010, 107:8871-8876.
67. Joel D., Niv Y., Ruppin E. Actor-critic models of the basal ganglia: new anatomical and computational perspectives. Neural Netw. 2002, 15:535-547.
68. Kahnt T., Weber S.C., Haker H., Robbins T.W., Tobler P.N. Dopamine D2-receptor blockade enhances decoding of prefrontal signals in humans. J. Neurosci. 2015, 35:4104-4111.
69. Kayser A.S., Mitchell J.M., Weinstein D., Frank M.J. Dopamine, locus of control, and the exploration-exploitation tradeoff. Neuropsychopharmacology 2014, 40:454-462.
70. Kennerley S.W., Dahmubed A.F., Lara A.H., Wallis J.D. Neurons in the frontal lobe encode the value of multiple decision variables. J. Cogn. Neurosci. 2009, 21:1162-1178.
71. Kennerley S.W., Behrens T.E.J., Wallis J.D. Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat. Neurosci. 2011, 14:1581-1589.
72. Kodama T., Hikosaka K., Honda Y., Kojima T., Watanabe M. Higher dopamine release induced by less rather than more preferred reward during a working memory task in the primate prefrontal cortex. Behav. Brain Res. 2014, 266:104-107.
73. Kool W., McGuire J.T., Rosen Z.B., Botvinick M.M. Decision making and the avoidance of cognitive demand. J. Exp. Psychol. Gen. 2010, 139:665-682.
74. Kouneiher F., Charron S., Koechlin E. Motivation and cognitive control in the human prefrontal cortex. Nat. Neurosci. 2009, 12:939-945.
75. Krabbe S., Duda J., Schiemann J., Poetschke C., Schneider G., Kandel E.R., Liss B., Roeper J., Simpson E.H. Increased dopamine D2 receptor activity in the striatum alters the firing pattern of dopamine neurons in the ventral tegmental area. Proc. Natl. Acad. Sci. USA 2015, 112:E1498-E1506.
76. Krebs R.M., Boehler C.N., Roberts K.C., Song A.W., Woldorff M.G. The involvement of the dopaminergic midbrain and cortico-striatal-thalamic circuits in the integration of reward prospect and attentional task demands. Cereb. Cortex 2012, 22:607-615.
77. Kroemer N.B., Guevara A., Ciocanea Teodorescu I., Wuttig F., Kobiella A., Smolka M.N. Balancing reward and work: anticipatory brain activation in NAcc and VTA predict effort differentially. Neuroimage 2014, 102:510-519.
78. Kurniawan I.T., Seymour B., Talmi D., Yoshida W., Chater N., Dolan R.J. Choosing to make an effort: the role of striatum in signaling physical effort of a chosen action. J. Neurophysiol. 2010, 104:313-321.
79. Kurniawan I.T., Guitart-Masip M., Dolan R.J. Dopamine and effort-based decision making. Front. Neurosci. 2011, 5:81.
80. Kurniawan I.T., Guitart-Masip M., Dayan P., Dolan R.J. Effort and valuation in the brain: the effects of anticipation and execution. J. Neurosci. 2013, 33:6160-6169.
81. Kurzban R., Duckworth A., Kable J.W., Myers J. An opportunity cost model of subjective effort and task performance. Behav. Brain Sci. 2013, 36:661-679.
82. Lee A.M., Tai L.H., Zador A., Wilbrecht L. Between the primate and 'reptilian' brain: Rodent models demonstrate the role of corticostriatal circuits in decision making. Neuroscience 2015, 296:66-74.
83. Li J., Daw N.D. Signals in human striatum are appropriate for policy update rather than value prediction. J. Neurosci. 2011, 31:5504-5511.
84. Locke H.S., Braver T.S. Motivational influences on cognitive control: behavior, brain activation, and individual differences. Cogn. Affect. Behav. Neurosci. 2008, 8:99-112.
85. Ma L., Hyman J.M., Phillips A.G., Seamans J.K. Tracking progress toward a goal in corticostriatal ensembles. J. Neurosci. 2014, 34:2244-2253.
86. Massar S.A.A., Libedinsky C., Weiyan C., Huettel S.A., Chee M.W.L. Separate and overlapping brain areas encode subjective value during delay and effort discounting. Neuroimage 2015, 120:104-113.
87. Matsumoto M., Takada M. Distinct representations of cognitive and motivational signals in midbrain dopamine neurons. Neuron 2013, 79:1011-1024.
88. McClure S.M., Daw N.D., Montague P.R. A computational substrate for incentive salience. Trends Neurosci. 2003, 26:423-428.
89. McGinty V.B., Lardeux S., Taha S.A., Kim J.J., Nicola S.M. Invigoration of reward seeking by cue and proximity encoding in the nucleus accumbens. Neuron 2013, 78:910-922.
90. McGuire J.T., Botvinick M.M. Prefrontal cortex, cognitive control, and the registration of decision costs. Proc. Natl. Acad. Sci. USA 2010, 107:7922-7926.
91. Meyniel F., Sergent C., Rigoux L., Daunizeau J., Pessiglione M. Neurocomputational account of how the human brain decides when to have a break. Proc. Natl. Acad. Sci. USA 2013, 110:2641-2646.
92. Miller E.K., Cohen J.D. An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 2001, 24:167-202.
93. Mogenson G.J., Jones D.L., Yim C.Y. From motivation to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 1980, 14:69-97.
94. Montague P.R., Dayan P., Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 1996, 16:1936-1947.
95. Nicola S.M. The nucleus accumbens as part of a basal ganglia action selection circuit. Psychopharmacology (Berl.) 2007, 191:521-550.
96. Nicola S.M. The flexible approach hypothesis: unification of effort and cue-responding hypotheses for the role of nucleus accumbens dopamine in the activation of reward-seeking behavior. J. Neurosci. 2010, 30:16585-16600.
97. Nicola S.M., Hopf F.W., Hjelmstad G.O. Contrast enhancement: a physiological effect of striatal dopamine?. Cell Tissue Res. 2004, 318:93-106.
98. Niv Y. Reinforcement learning in the brain. J. Math. Psychol. 2009, 53:139-154.
99. Niv Y., Daw N.D., Joel D., Dayan P. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl.) 2007, 191:507-520.
100. Nymberg C., Banaschewski T., Bokde A.L., Büchel C., Conrod P., Flor H., Frouin V., Garavan H., Gowland P., Heinz A., et al. DRD2/ANKK1 polymorphism modulates the effect of ventral striatal activation on working memory performance. Neuropsychopharmacology 2014, 39:2357-2365. IMAGEN consortium.
101. O'Reilly R.C., Frank M.J. Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput. 2006, 18:283-328.
102. O'Reilly, R.C., Hazy, T.E., Mollick, J., Mackie, P., and Herd, S. (2014). Goal-driven cognition in the brain: a computational framework. arXiv, arXiv:1404.7591, . http://www.arxiv.org/abs/1404.7591.
103. Padoa-Schioppa C. Neurobiology of economic choice: a good-based model. Annu. Rev. Neurosci. 2011, 34:333-359.
104. Parvizi J., Rangarajan V., Shirer W.R., Desai N., Greicius M.D. The will to persevere induced by electrical stimulation of the human cingulate gyrus. Neuron 2013, 80:1359-1367.
105. Pasquereau B., Turner R.S. Limited encoding of effort by dopamine neurons in a cost-benefit trade-off task. J. Neurosci. 2013, 33:8288-8300.
106. Pessoa L., Engelmann J.B. Embedding reward signals into perception and cognition. Front. Neurosci. 2010, 4:4.
107. Phillips A.G., Vacca G., Ahn S. A top-down perspective on dopamine, motivation and memory. Pharmacol. Biochem. Behav. 2008, 90:236-249.
108. Prévost C., Pessiglione M., Météreau E., Cléry-Melin M.-L., Dreher J.-C. Separate valuation subsystems for delay and effort decision costs. J. Neurosci. 2010, 30:14080-14090.
109. Raichle M.E., Mintun M.A. Brain work and brain imaging. Annu. Rev. Neurosci. 2006, 29:449-476.
110. Ribas-Fernandes J.J.F., Solway A., Diuk C., McGuire J.T., Barto A.G., Niv Y., Botvinick M.M. A neural signature of hierarchical reinforcement learning. Neuron 2011, 71:370-379.
111. Riggall A.C., Postle B.R. The relationship between working memory storage and elevated activity as measured with functional magnetic resonance imaging. J. Neurosci. 2012, 32:12990-12998.
112. Robbins T.W., Arnsten A.F. The neuropsychopharmacology of fronto-executive function: monoaminergic modulation. Annu. Rev. Neurosci. 2009, 32:267-287.
113. Roesch M.R., Singh T., Brown P.L., Mullins S.E., Schoenbaum G. Ventral striatal neurons encode the value of the chosen action in rats deciding between differently delayed or sized rewards. J. Neurosci. 2009, 29:13365-13376.
114. Salamone J.D., Correa M. The mysterious motivational functions of mesolimbic dopamine. Neuron 2012, 76:470-485.
115. Salamone J.D., Correa M., Nunes E.J., Randall P.A., Pardo M. The behavioral pharmacology of effort-related choice behavior: dopamine, adenosine and beyond. J. Exp. Anal. Behav. 2012, 97:125-146.
116. Samanez-Larkin G.R., Buckholtz J.W., Cowan R.L., Woodward N.D., Li R., Ansari M.S., Arrington C.M., Baldwin R.M., Smith C.E., Treadway M.T., et al. A thalamocorticostriatal dopamine network for psychostimulant-enhanced human cognitive flexibility. Biol. Psychiatry 2013, 74:99-105.
117. Sara S.J. The locus coeruleus and noradrenergic modulation of cognition. Nat. Rev. Neurosci. 2009, 10:211-223.
118. Satterthwaite T.D., Ruparel K., Loughead J., Elliott M.A., Gerraty R.T., Calkins M.E., Hakonarson H., Gur R.C., Gur R.E., Wolf D.H. Being right is its own reward: load and performance related ventral striatum activation to correct responses during a working memory task in youth. Neuroimage 2012, 61:723-729.
119. Saunders B., Inzlicht M. Vigour and fatigue: How variation in affect underlies effective self-control. Motivation and Cognitive Control 2015, 211-234. Taylor & Francis/Routledge. T.S. Braver (Ed.).
120. Schmidt L., Lebreton M., Cléry-Melin M.-L., Daunizeau J., Pessiglione M. Neural mechanisms underlying motivation of mental versus physical effort. PLoS Biol. 2012, 10:e1001266.
121. Schouppe N., De Houwer J., Ridderinkhof K.R., Notebaert W. Conflict: run! Reduced Stroop interference with avoidance responses. Q. J. Exp. Psychol. (Hove) 2012, 65:1052-1058.
122. Schouppe N., Demanet J., Boehler C.N., Ridderinkhof K.R., Notebaert W. The role of the striatum in effort-based decision-making in the absence of reward. J. Neurosci. 2014, 34:2148-2154.
123. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
124. Schweimer J., Hauber W. Dopamine D1 receptors in the anterior cingulate cortex regulate effort-based decision making. Learn. Mem. 2006, 13:777-782.
125. Schweimer J., Saft S., Hauber W. Involvement of catecholamine neurotransmission in the rat anterior cingulate in effort-related decision making. Behav. Neurosci. 2005, 119:1687-1692.
126. Seamans J.K., Yang C.R. The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog. Neurobiol. 2004, 74:1-58.
127. Shackman A.J., Salomons T.V., Slagter H.A., Fox A.S., Winter J.J., Davidson R.J. The integration of negative affect, pain and cognitive control in the cingulate cortex. Nat. Rev. Neurosci. 2011, 12:154-167.
128. Shenhav A., Botvinick M.M., Cohen J.D. The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron 2013, 79:217-240.
129. Shiner T., Symmonds M., Guitart-Masip M., Fleming S.M., Friston K.J., Dolan R.J. Dopamine, salience, and response set shifting in prefrontal cortex. Cereb. Cortex 2015, 25:3629-3639.
130. Skvortsova V., Palminteri S., Pessiglione M. Learning to minimize efforts versus maximizing rewards: computational principles and neural correlates. J. Neurosci. 2014, 34:15621-15630.
131. Small D.M., Gitelman D., Simmons K., Bloise S.M., Parrish T., Mesulam M.M. Monetary incentives enhance processing in brain regions mediating top-down control of attention. Cereb. Cortex 2005, 15:1855-1865.
132. Spencer R.C., Devilbiss D.M., Berridge C.W. The cognition-enhancing effects of psychostimulants involve direct action in the prefrontal cortex. Biol. Psychiatry 2015, 77:940-950.
133. Spunt R.P., Lieberman M.D., Cohen J.R., Eisenberger N.I. The phenomenology of error processing: the dorsal ACC response to stop-signal errors tracks reports of negative affect. J. Cogn. Neurosci. 2012, 24:1753-1765.
134. Steullet P., Cabungcal J.-H., Cuénod M., Do K.Q. Fast oscillatory activity in the anterior cingulate cortex: dopaminergic modulation and effect of perineuronal net loss. Front. Cell. Neurosci. 2014, 8:244.
135. Strauss G.P., Morra L.F., Sullivan S.K., Gold J.M. The role of low cognitive effort and negative symptoms in neuropsychological impairment in schizophrenia. Neuropsychology 2015, 29:282-291.
136. Tai L.-H., Lee A.M., Benavidez N., Bonci A., Wilbrecht L. Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value. Nat. Neurosci. 2012, 15:1281-1289.
137. Treadway M.T., Buckholtz J.W., Cowan R.L., Woodward N.D., Li R., Ansari M.S., Baldwin R.M., Schwartzman A.N., Kessler R.M., Zald D.H. Dopaminergic mechanisms of individual differences in human effort-based decision-making. J. Neurosci. 2012, 32:6170-6176.
138. Trifilieff P., Feng B., Urizar E., Winiger V., Ward R.D., Taylor K.M., Martinez D., Moore H., Balsam P.D., Simpson E.H., Javitch J.A. Increasing dopamine D2 receptor expression in the adult nucleus accumbens enhances motivation. Mol. Psychiatry 2013, 18:1025-1033.
139. van der Meer M.A., Redish A.D. Ventral striatum: a critical look at models of learning and evaluation. Curr. Opin. Neurobiol. 2011, 21:387-392.
140. van Holstein M., Aarts E., van der Schaaf M.E., Geurts D.E.M., Verkes R.J., Franke B., van Schouwenburg M.R., Cools R. Human cognitive flexibility depends on dopamine D2 receptor signaling. Psychopharmacology (Berl.) 2011, 218:567-578.
141. van Schouwenburg M., Aarts E., Cools R. Dopaminergic modulation of cognitive control: distinct roles for the prefrontal cortex and the basal ganglia. Curr. Pharm. Des. 2010, 16:2026-2032.
142. Varazzani C., San-Galli A., Gilardeau S., Bouret S. Noradrenaline and dopamine neurons in the reward/effort trade-off: a direct electrophysiological comparison in behaving monkeys. J. Neurosci. 2015, 35:7866-7877.
143. Vassena E., Silvetti M., Boehler C.N., Achten E., Fias W., Verguts T. Overlapping neural systems represent cognitive effort and reward anticipation. PLoS ONE 2014, 9:e91008.
144. Vijayraghavan S., Wang M., Birnbaum S.G., Williams G.V., Arnsten A.F.T. Inverted-dopamine D1 receptor actions on prefrontal neurons engaged in working memory. Nat. Neurosci. 2007, 10:376-384.
145. Volkow N.D., Wang G.-J., Newcorn J.H., Kollins S.H., Wigal T.L., Telang F., Fowler J.S., Goldstein R.Z., Klein N., Logan J., et al. Motivation deficit in ADHD is associated with dysfunction of the dopamine reward pathway. Mol. Psychiatry 2011, 16:1147-1154.
146. von Stumm S., Hell B., Chamorro-Premuzic T. The hungry mind: intellectual curiosity is the third pillar of academic performance. Perspect. Psychol. Sci. 2011, 6:574-588.
147. Walton M.E., Groves J., Jennings K.A., Croxson P.L., Sharp T., Rushworth M.F.S., Bannerman D.M. Comparing the role of the anterior cingulate cortex and 6-hydroxydopamine nucleus accumbens lesions on operant effort-based decision making. Eur. J. Neurosci. 2009, 29:1678-1691.
148. Ward R.D., Winiger V., Higa K.K., Kahn J.B., Kandel E.R., Balsam P.D., Simpson E.H. The impact of motivation on cognitive performance in an animal model of the negative and cognitive symptoms of schizophrenia. Behav. Neurosci. 2015, 129:292-299.
149. Westbrook A., Kester D., Braver T.S. What is the subjective cost of cognitive effort? Load, trait, and aging effects revealed by economic preference. PLoS ONE 2013, 8:e68210.
150. Wickens J.R., Horvitz J.C., Costa R.M., Killcross S. Dopaminergic mechanisms in actions and habits. J. Neurosci. 2007, 27:8181-8183.
151. Wunderlich K., Smittenaar P., Dolan R.J. Dopamine enhances model-based over model-free choice behavior. Neuron 2012, 75:418-424.
152. Zhang J., Berridge K.C., Tindell A.J., Smith K.S., Aldridge J.W. A neural computational model of incentive salience. PLoS Comput. Biol. 2009, 5:e1000437.