Balancing reward and work: Anticipatory brain activation in NAcc and VTA predict effort differentially

NeuroImage

Volumn 102, Issue P2, 2014, Pages 510-519

  Kroemer, Nils B ^a   Guevara, Alvaro ^a,b   Ciocanea Teodorescu, Iuliana ^c,d   Wuttig, Franziska ^a   Kobiella, Andrea ^a   Smolka, Michael N ^a  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

^b UNIVERSIDAD DE COSTA RICA   (Costa Rica)

^c UNIVERSITY OF OXFORD   (United Kingdom)

^d LEIDEN UNIVERSITY   (Netherlands)

Author keywords

Effort discounting; FMRI; Instrumental motivation; Midbrain; Ventral striatum

Indexed keywords

ADULT; AMYGDALOID NUCLEUS; ANTICIPATION; APPETITE; ARTICLE; BRAIN DEPTH STIMULATION; BRAIN REGION; CONTROLLED STUDY; CORPUS STRIATUM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; MOTIVATION; MOTOR PERFORMANCE; NORMAL HUMAN; NUCLEUS ACCUMBENS; PREDICTION; PRIORITY JOURNAL; REINFORCEMENT; REWARD; SUBSTANTIA NIGRA; VENTRAL TEGMENTUM; ASSOCIATION; BRAIN; BRAIN MAPPING; DECISION MAKING; EXERCISE; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; ANTICIPATORY BRAIN ACTIVATION; BRAIN FUNCTION; DORSAL STRIATUM; DRIVE; EVOKED MUSCLE RESPONSE; LIMBIC SYSTEM; MESOCORTICOLIMBIC SYSTEM;

ADULT; ANTICIPATION, PSYCHOLOGICAL; BRAIN; BRAIN MAPPING; CUES; DECISION MAKING; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MOTIVATION; NUCLEUS ACCUMBENS; PHYSICAL EXERTION; REWARD; VENTRAL TEGMENTAL AREA;

EID: 84906725119     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2014.07.060     Document Type: Article

References (54)

1. Arias-Carrión O., Pöppel E. Dopamine, learning, and reward-seeking behavior. Acta Neurobiol. Exp. 2007, 67(4):481-488.
2. Baliki M.N., Mansour A., Baria A.T., Huang L., Berger S.E., Fields H.L., Apkarian A.V. Parceling human accumbens into putative core and shell dissociates encoding of values for reward and pain. J. Neurosci. 2013, 33:16383-16393. 10.1523/JNEUROSCI.1731-13.2013.
3. Basten U., Biele G., Heekeren H.R., Fiebach C.J. How the brain integrates costs and benefits during decision making. Proc. Natl. Acad. Sci. U. S. A. 2010, 107(50):21767-21772. 10.1073/pnas.0908104107.
4. Beierholm U., Guitart-Masip M., Economides M., Chowdhury R., Düzel E., Dolan R., Dayan P. Dopamine modulates reward-related vigor. Neuropsychopharmacology 2013, 38(8):1495-1503. 10.1038/npp.2013.48.
5. Benjamini Y., Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc.: Ser. B: Methodol. 1995, 57:289-300. 10.2307/2346101.
6. Berridge K.C. Food reward: brain substrates of wanting and liking. Neurosci. Biobehav. Rev. 1996, 20(1):1-25.
7. Botvinick M.M., Huffstetler S., McGuire J.T. Effort discounting in human nucleus accumbens. Cogn. Affect. Behav. Neurosci. 2009, 9(1):16-27. 10.3758/CABN.9.1.16.
8. Bühler M., Vollstädt-Klein S., Kobiella A., Budde H., Reed L.J., Braus D.F., Smolka M.N. Nicotine dependence is characterized by disordered reward processing in a network driving motivation. Biol. Psychiatry 2010, 67:745-752. 10.1016/j.biopsych.2009.10.029.
9. Cheer J.F., Heien M.L.A.V., Garris P.A., Carelli R.M., Wightman R.M. Simultaneous dopamine and single-unit recordings reveal accumbens GABAergic responses: implications for intracranial self-stimulation. Proc. Natl. Acad. Sci. U. S. A. 2005, 102(52):19150-19155. 10.1073/pnas.0509607102.
10. Cheer J.F., Aragona B.J., Heien M.L.A.V., Seipel A.T., Carelli R.M., Wightman R.M. Coordinated accumbal dopamine release and neural activity drive goal-directed behavior. Neuron 2007, 54(2):237-244. 10.1016/j.neuron.2007.03.021.
11. Day J.J., Jones J.L., Wightman R.M., Carelli R.M. Phasic nucleus accumbens dopamine release encodes effort- and delay-related costs. Biol. Psychiatry 2010, 68(3):306-309. 10.1016/j.biopsych.2010.03.026.
12. Denk F., Walton M.E., Jennings K.A., Sharp T., Rushworth M.F.S., Bannerman D.M. Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort. Psychopharmacology (Berl) 2005, 179(3):587-596. 10.1007/s00213-004-2059-4.
13. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299(5614):1898-1902. 10.1126/science.1077349.
14. Floresco S.B., Tse M.T.L., Ghods-Sharifi S. Dopaminergic and glutamatergic regulation of effort- and delay-based decision making. Neuropsychopharmacology 2008, 33(8):1966-1979. 10.1038/sj.npp.1301565.
15. Friston K.J., Buechel C., Fink G.R., Morris J., Rolls E., Dolan R.J. Psychophysiological and modulatory interactions in neuroimaging. Neuroimage 1997, 6:218-229. 10.1006/nimg.1997.0291.
16. Gan J.O., Walton M.E., Phillips P.E.M. Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat. Neurosci. 2010, 13(1):25-27. 10.1038/nn.2460.
17. Gold J.M., Strauss G.P., Waltz J.A., Robinson B.M., Brown J.K., Frank M.J. Negative symptoms of schizophrenia are associated with abnormal effort-cost computations. Biol. Psychiatry 2013, 74(2):130-136. 10.1016/j.biopsych.2012.12.022.
18. Grabenhorst F., Rolls E.T. Value, pleasure and choice in the ventral prefrontal cortex. Trends Cogn. Sci. 2011, 15(2):56-67. 10.1016/j.tics.2010.12.004.
19. Gunst R.F., Webster J.T. Regression analysis and problems of multicollinearity. Commun. Stat. 1975, 4(3):277-292. 10.1080/03610927308827246.
20. Haber S.N., Knutson B. The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 2010, 35(1):4-26. 10.1038/npp.2009.129.
21. Hall J., Parkinson J.A., Connor T.M., Dickinson A., Everitt B.J. Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour. Eur. J. Neurosci. 2001, 13(10):1984-1992.
22. Jones J.L., Day J.J., Aragona B.J., Wheeler R.A., Wightman R.M., Carelli R.M. Basolateral amygdala modulates terminal dopamine release in the nucleus accumbens and conditioned responding. Biol. Psychiatry 2010, 67(8):737-744. 10.1016/j.biopsych.2009.11.006.
23. Kobayashi S., Schultz W. Influence of reward delays on responses of dopamine neurons. J. Neurosci. 2008, 28(31):7837-7846. 10.1523/JNEUROSCI.1600-08.2008.
24. Koch M., Fendt M., Kretschmer B.D. Role of the substantia nigra pars reticulata in sensorimotor gating, measured by prepulse inhibition of startle in rats. Behav. Brain Res. 2000, 117:153-162.
25. Kolling N., Behrens T.E.J., Mars R.B., Rushworth M.F.S. Neural mechanisms of foraging. Science 2012, 336(6077):95-98. 10.1126/science.1216930.
26. Kuboyama N., Nabetani T., Shibuya K.-I., Machida K., Ogaki T. The effect of maximal finger tapping on cerebral activation. J. Physiol. Anthropol. Appl. Human Sci. 2004, 23:105-110. 10.2114/jpa.23.105.
27. Kurniawan I.T., Guitart-Masip M., Dayan P., Dolan R.J. Effort and valuation in the brain: the effects of anticipation and execution. J. Neurosci. 2013, 33(14):6160-6169. 10.1523/JNEUROSCI.4777-12.2013.
28. Levy D.J., Glimcher P.W. The root of all value: a neural common currency for choice. Curr. Opin. Neurobiol. 2012, 22:1027-1038. 10.1016/j.conb.2012.06.001.
29. Lex A., Hauber W. Dopamine D1 and D2 receptors in the nucleus accumbens core and shell mediate Pavlovian-instrumental transfer. Learn. Mem. 2008, 15(7):483-491. 10.1101/lm.978708.
30. Liu X., Hairston J., Schrier M., Fan J. Common and distinct networks underlying reward valence and processing stages: a meta-analysis of functional neuroimaging studies. Neurosci. Biobehav. Rev. 2011, 35(5):1219-1236. 10.1016/j.neubiorev.2010.12.012.
31. Mannella F., Gurney K., Baldassarre G. The nucleus accumbens as a nexus between values and goals in goal-directed behavior: a review and a new hypothesis. Front. Behav. Neurosci. 2013, 7:135. 10.3389/fnbeh.2013.00135.
32. Mazzoni P., Hristova A., Krakauer J.W. Why don't we move faster? Parkinson's disease, movement vigor, and implicit motivation. J. Neurosci. 2007, 27(27):7105-7116. 10.1523/JNEUROSCI.0264-07.2007.
33. Meyniel F., Sergent C., Rigoux L., Daunizeau J., Pessiglione M. Neurocomputational account of how the human brain decides when to have a break. Proc. Natl. Acad. Sci. U. S. A. 2013, 110(7):2641-2646. 10.1073/pnas.1211925110.
34. Morris G., Nevet A., Arkadir D., Vaadia E., Bergman H. Midbrain dopamine neurons encode decisions for future action. Nat. Neurosci. 2006, 9(8):1057-1063. 10.1038/nn1743.
35. Niv Y., Daw N.D., Joel D., Dayan P. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl) 2007, 191:507-520. 10.1007/s00213-006-0502-4.
36. Ousdal O.T., Reckless G.E., Server A., Andreassen O.A., Jensen J. Effect of relevance on amygdala activation and association with the ventral striatum. Neuroimage 2012, 62(1):95-101. 10.1016/j.neuroimage.2012.04.035.
37. Pasquereau B., Turner R.S. Limited encoding of effort by dopamine neurons in a cost-benefit trade-off task. J. Neurosci. 2013, 33(19):8288-8300. 10.1523/JNEUROSCI.4619-12.2013.
38. Pessiglione M., Schmidt L., Draganski B., Kalisch R., Lau H., Dolan R.J., Frith C.D. How the brain translates money into force: a neuroimaging study of subliminal motivation. Science 2007, 316(5826):904-906. 10.1126/science.1140459.
39. Phillips A.G., Ahn S., Howland J.G. Amygdalar control of the mesocorticolimbic dopamine system: parallel pathways to motivated behavior. Neurosci. Biobehav. Rev. 2003, 27(6):543-554. 10.1016/j.neubiorev.2003.09.002.
40. Phillips P.E.M., Walton M.E., Jhou T.C. Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology (Berl) 2007, 191(3):483-495. 10.1007/s00213-006-0626-6.
41. Puryear C.B., Kim M.J., Mizumori S.J.Y. Conjunctive encoding of movement and reward by ventral tegmental area neurons in the freely navigating rodent. Behav. Neurosci. 2010, 124(2):234-247. 10.1037/a0018865.
42. Raudenbush S.W., Bryk A.S. Hierarchical Linear Models: Applications and Data Analysis Methods. Advanced Quantitative Techniques in the Social Sciences Series 2002, vol. 1:485. SAGE Publications, Thousand Oakes, CA.
43. Raudenbush S.W., Bryk A.S., Cheong Y.F., Congdon R.T. HLM 6: Hierarchical Linear and Nonlinear Modeling 2004.
44. Rigoux L., Guigon E. A model of reward- and effort-based optimal decision making and motor control. PLoS Comput. Biol. 2012, 8(10):e1002716. 10.1371/journal.pcbi.1002716.
45. Roesch M.R., Singh T., Brown P.L., Mullins S.E., Schoenbaum G. Ventral striatal neurons encode the value of the chosen action in rats deciding between differently delayed or sized rewards. J. Neurosci. 2009, 29(42):13365-13376. 10.1523/JNEUROSCI.2572-09.2009.
46. Salamone J.D., Correa M. The mysterious motivational functions of mesolimbic dopamine. Neuron 2012, 76(3):470-485. 10.1016/j.neuron.2012.10.021.
47. Salamone J.D., Correa M., Farrar A.M., Mingote S.M. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology (Berl) 2007, 191(3):461-482. 10.1007/s00213-006-0668-9.
48. Schacht J.P., Anton R.F., Randall P.K., Li X., Henderson S., Myrick H. Stability of fMRI striatal response to alcohol cues: a hierarchical linear modeling approach. Neuroimage 2011, 56:61-68. 10.1016/j.neuroimage.2011.02.004.
49. Schacht J.P., Anton R.F., Voronin K.E., Randall P.K., Li X., Henderson S., Myrick H. Interacting effects of naltrexone and OPRM1 and DAT1 variation on the neural response to alcohol cues. Neuropsychopharmacology 2013, 38:414-422. 10.1038/npp.2012.195.
50. Treadway M.T., Zald D.H. Reconsidering anhedonia in depression: lessons from translational neuroscience. Neurosci. Biobehav. Rev. 2011, 35:537-555. 10.1016/j.neubiorev.2010.06.006.
51. Treadway M.T., Buckholtz J.W., Cowan R.L., Woodward N.D., Li R., Ansari M.S., Zald D.H. Dopaminergic mechanisms of individual differences in human effort-based decision-making. J. Neurosci. 2012, 32(18):6170-6176. 10.1523/JNEUROSCI.6459-11.2012.
52. Wanat M.J., Kuhnen C.M., Phillips P.E.M. Delays conferred by escalating costs modulate dopamine release to rewards but not their predictors. J. Neurosci. 2010, 30(36):12020-12027. 10.1523/JNEUROSCI.2691-10.2010.
53. Wang A.Y., Miura K., Uchida N. The dorsomedial striatum encodes net expected return, critical for energizing performance vigor. Nat. Neurosci. 2013, 16(5):639-647. 10.1038/nn.3377.
54. Yeh P.H., Gazdzinski S., Durazzo T.C., Sjöstrand K., Meyerhoff D.J. Hierarchical linear modeling (HLM) of longitudinal brain structural and cognitive changes in alcohol-dependent individuals during sobriety. Drug Alcohol Depend. 2007, 91:195-204. 10.1016/j.drugalcdep.2007.05.027.