Separate and overlapping brain areas encode subjective value during delay and effort discounting

NeuroImage

Volumn 120, Issue , 2015, Pages 104-113

  Massar, Stijn A A ^a   Libedinsky, Camilo ^a,b   Weiyan, Chee ^a   Huettel, Scott A ^c   Chee, Michael W L ^a  

^a DUKE NUS MEDICAL SCHOOL   (Singapore)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c DUKE UNIVERSITY   (United States)

Author keywords

Decision making; Delay discounting; Effort discounting; FMRI; Reward; Subjective value

Indexed keywords

ADULT; ANTERIOR CINGULATE; ARTICLE; BRAIN REGION; CAUDATE NUCLEUS; CEREBELLUM; COGNITION; COGNITIVE BIAS; CONTROLLED STUDY; DELAY DISCOUNTING; DORSOLATERAL PREFRONTAL CORTEX; EFFORT DISCOUNTING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INFERIOR FRONTAL GYRUS; MALE; NEUROIMAGING; NORMAL HUMAN; ORBITAL CORTEX; PARIETAL CORTEX; PRIORITY JOURNAL; TASK PERFORMANCE; TEMPORAL CORTEX; BRAIN CORTEX; BRAIN MAPPING; DECISION MAKING; EXECUTIVE FUNCTION; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PROCEDURES; PSYCHOMOTOR PERFORMANCE; REWARD; YOUNG ADULT;

ADULT; BRAIN MAPPING; CAUDATE NUCLEUS; CEREBELLUM; CEREBRAL CORTEX; CHOICE BEHAVIOR; DELAY DISCOUNTING; EXECUTIVE FUNCTION; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; PSYCHOMOTOR PERFORMANCE; REWARD; YOUNG ADULT;

EID: 84938226036     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2015.06.080     Document Type: Article

References (53)

1. Ainslie G. Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol. Bull. 1975, 82(4):463-496.
2. Bakker A.B., Killmer C.H., Siegrist J., Schaufeli W.B. Effort-reward imbalance and burnout among nurses. J. Adv. Nurs. 2000, 31(4):884-891. 10.1046/j.1365-2648.2000.01361.x.
3. Bari A., Robbins T.W. Inhibition and impulsivity: behavioral and neural basis of response control. Prog. Neurobiol. 2013, 108:44-79. 10.1016/j.pneurobio.2013.06.005.
4. Bartra O., Mcguire J.T., Kable J.W. The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. NeuroImage 2013, 76:412-427. 10.1016/j.neuroimage.2013.02.063.
5. Bickel W.K., Pitcock J.A., Yi R., Angtuaco E.J.C. Congruence of BOLD response across intertemporal choice conditions: fictive and real money gains and losses. J. Neurosci. 2009, 29(27):8839-8846. 10.1523/JNEUROSCI.5319-08.2009.
6. Bonnelle V., Veromann K.-R., Burnett Heyes S., Lo Sterzo E., Manohar S., Husain M. Characterization of reward and effort mechanisms in apathy. J. Physiol. Paris 2014, 10.1016/j.jphysparis.2014.04.002.
7. Botvinick M.M. Conflict monitoring and decision making: reconciling two perspectives on anterior cingulate function. Cogn. Affect. Behav. Neurosci. 2007, 7(4):356-366.
8. Botvinick M.M., Huffstetler S., Mcguire J.T. Effort discounting in human nucleus accumbens. Cogn. Affect. Behav. Neurosci. 2009, 9(1):16-27.
9. Burke C.J., Brunger C., Kahnt T., Park S.Q., Tobler P.N. Neural integration of risk and effort costs by the frontal pole: only upon request. J. Neurosci. 2013, 33(4):1706-1713. 10.1523/JNEUROSCI.3662-12.2013.
10. Camille N., Tsuchida A., Fellows L.K. Double dissociation of stimulus-value and action-value learning in humans with orbitofrontal or anterior cingulate cortex damage. J. Neurosci. 2011, 31(42):15048-15052.
11. Carter R.M., Meyer J.R., Huettel S.A. Functional neuroimaging of intertemporal choice models: a review. J. Neurosci. Psychol. Econ. 2010, 3(1):27-45.
12. Clithero J.A., Rangel A. Informatic parcellation of the network involved in the computation of subjective value. Soc. Cogn. Affect. Neurosci. 2014, 9(9):1289-1302. 10.1093/scan/nst106.
13. Fervaha G., Graff-Guerrero A., Zakzanis K.K., Foussias G., Agid O., Remington G. Incentive motivation deficits in schizophrenia reflect effort computation impairments during cost-benefit decision-making. J. Psychiatr. Res. 2013, 47(11):1590-1596. 10.1016/j.jpsychires.2013.08.003.
14. Gold J.M., Strauss G.P., Waltz J.A., Robinson B.M., Brown J.K., Frank M.J. Negative symptoms of schizophrenia are associated with abnormal effort-cost computations. Biol. Psychiatry 2013, 74(2):130-136. 10.1016/j.biopsych.2012.12.022.
15. Hsu M., Bhatt M., Adolphs R., Tranel D., Camerer C.F. Neural systems responding to degrees of uncertainty in human decision-making. Science 2005, 310(5754):1680-1683. 10.1126/science.1115327.
16. Hunt E., Madhyastha T.M. Cognitive demands of the workplace. J. Neurosci. Psychol. Econ. 2012, 5(1):18.
17. Jansma J.M., Ramsey N.F., de Zwart J.A., van Gelderen P., Duyn J.H. fMRI study of effort and information processing in a working memory task. Hum. Brain Mapp. 2007, 28(5):431-440. 10.1002/hbm.20297.
18. Jimura K., Chushak M.S., Braver T.S. Impulsivity and self-control during intertemporal decision making linked to the neural dynamics of reward value representation. J. Neurosci. 2013, 33(1):344-357. 10.1523/JNEUROSCI.0919-12.2013.
19. Kable J.W., Glimcher P.W. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 2007, 10(12):1625-1633. 10.1038/nn2007.
20. Kable J.W., Glimcher P.W. The neurobiology of decision: consensus and controversy. Neuron 2009, 63(6):733-745. 10.1016/j.neuron.2009.09.003.
21. Kool W., Botvinick M. A labor/leisure tradeoff in cognitive control. J. Exp. Psychol. Gen. 2014, 143(1):131-141. 10.1037/a0031048.
22. Kool W., Mcguire J.T., Rosen Z.B., Botvinick M.M. Decision making and the avoidance of cognitive demand. J. Exp. Psychol. Gen. 2010, 139(4):665-682. 10.1037/a0020198.
23. Kool W., Mcguire J.T., Wang G.J., Botvinick M.M. Neural and behavioral evidence for an intrinsic cost of self-control. PLoS One 2013, 8(8):e72626. 10.1371/journal.pone.0072626.
24. Kurniawan I.T., Seymour B., Talmi D., Yoshida W., Chater N., Dolan R.J. Choosing to make an effort: the role of striatum in signaling physical effort of a chosen action. J. Neurophysiol. 2010, 104(1):313-321. 10.1152/jn.00027.2010.
25. Levy D.J., Glimcher P.W. The root of all value: a neural common currency for choice. Curr. Opin. Neurobiol. 2012, 22(6):1027-1038. 10.1016/j.conb.2012.06.001.
26. Libedinsky C., Massar S.A.A., Ling A., Chee W.Y., Huettel S.A., Chee M.W.L. Sleep deprivation alters effort discounting but not delay discounting of monetary rewards. Sleep 2013, 36(6):899-904.
27. Luhmann C.C. Temporal decision-making: insights from cognitive neuroscience. Front. Behav. Neurosci. 2009, 3(39). 10.3389/neuro.08.039.2009.
28. Luhmann C.C., Chun M.M., Yi D.-J., Lee D., Wang X.-J. Neural dissociation of delay and uncertainty in intertemporal choice. J. Neurosci. 2008, 28(53):14459-14466. 10.1523/JNEUROSCI.1037-09.2009.
29. McClure S.M., Laibson D.I., Loewenstein G., Cohen J.D. Separate neural systems value immediate and delayed monetary rewards. Science 2004, 306(5695):503-507. 10.1126/science.1100907.
30. Mcguire J.T. Neural Mechanisms Underlying the Evaluation of Intrinsic Cognitive Costs 2011, PhD, Princeton University. Dept. of Psychology, (Retrieved from http://gradworks.umi.com/34/37/3437780.html).
31. Mcguire J.T., Botvinick M.M. Prefrontal cortex, cognitive control, and the registration of decision costs. Proc. Natl. Acad. Sci. U. S. A. 2010, 107(17):7922-7926. 10.1073/pnas.0910662107.
32. Montague P.R., Berns G.S. Neural economics and the biological substrates of valuation. Neuron 2002, 36(2):265-284. 10.1016/S0896-6273(02)00974-1.
33. Myerson J., Green L., Warusawitharana M. Area under the curve as a measure of discounting. J. Exp. Anal. Behav. 2001, 76(2):235-243. 10.1901/jeab.2001.76-235.
34. Norman D.A., Shallice T. Attention to action. Consciousness and Self-regulation 1986, 1-18. Springer, US. R.J. Davidson, G.E. Schwartz, D. Shapiro (Eds.).
35. Peters J., Büchel C. Overlapping and distinct neural systems code for subjective value during intertemporal and risky decision making. J. Neurosci. 2009, 29(50):15727-15734. 10.1523/JNEUROSCI.3489-09.2009.
36. Peters J., Büchel C. The neural mechanisms of inter-temporal decision-making: understanding variability. Trends Cogn. Sci. 2011, 15(5):227-239. 10.1016/j.tics.2011.03.002.
37. Pine A., Seymour B., Roiser J.P., Bossaerts P., Friston K.J., Curran H.V., Dolan R.J. Encoding of marginal utility across time in the human brain. J. Neurosci. 2009, 29(30):9575-9581. 10.1523/jneurosci.1126-09.2009.
38. Pine A., Shiner T., Seymour B., Dolan R.J. Dopamine, time, and impulsivity in humans. J. Neurosci. 2010, 30(26):8888-8896. 10.1523/JNEUROSCI.6028-09.2010.
39. Prevost C., Pessiglione M., Metereau E., Clery-Melin M.-L., Dreher J.-C. Separate valuation subsystems for delay and effort decision costs. J. Neurosci. 2010, 30(42):14080-14090. 10.1523/JNEUROSCI.2752-10.2010.
40. Rangel A., Hare T. Neural computations associated with goal-directed choice. Curr. Opin. Neurobiol. 2010, 20(2):262-270. 10.1016/j.conb.2010.03.001.
41. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 2008, 9(7):545-556. 10.1038/nrn2357.
42. Ridderinkhof K.R., van den Wildenberg W.P.M., Segalowitz S.J., Carter C.S. Neurocognitive mechanisms of cognitive control: the role of prefrontal cortex in action selection, response inhibition, performance monitoring, and reward-based learning. Brain Cogn. 2004, 56(2):129-140. 10.1016/j.bandc.2004.09.016.
43. Rudebeck P.H., Walton M.E., Smyth A.N., Bannerman D.M., Rushworth M.F.S. Separate neural pathways process different decision costs. Nat. Neurosci. 2006, 9(9):1161-1168. 10.1038/nn1756.
44. Rudebeck P.H., Behrens T.E., Kennerley S.W., Baxter M.G., Buckley M.J., Walton M.E., Rushworth M.F.S. Frontal cortex subregions play distinct roles in choices between actions and stimuli. J. Neurosci. 2008, 28(51):13775-13785. 10.1523/JNEUROSCI.3541-08.2008.
45. Schmidt L., Lebreton M., Clery-Melin M.-L., Daunizeau J., Pessiglione M. Neural mechanisms underlying motivation of mental versus physical effort. PLoS Biol. 2012, 10(2):e1001266. 10.1371/journal.pbio.1001266.
46. Shenhav A., Botvinick M.M., Cohen J.D. The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron 2013, 79(2):217-240. 10.1016/j.neuron.2013.07.007.
47. Siegrist J. Effort-reward imbalance at work and cardiovascular diseases. Int. J. Occup. Med. Environ. Health 2010, 23(3). 10.2478/v10001-010-0013-8.
48. Treadway M.T., Zald D.H. Parsing anhedonia: translational models of reward-processing deficits in psychopathology. Curr. Dir. Psychol. Sci. 2013, 22(3):244-249. 10.1177/0963721412474460.
49. Treadway M.T., Buckholtz J.W., Schwartzman A.N., Lambert W.E., Zald D.H. Worth the EEfRT? The effort expenditure for rewards task as an objective measure of motivation and anhedonia. PLoS One 2009, 4(8):e6598. 10.1371/journal.pone.0006598.
50. Weber B.J., Huettel S.A. The neural substrates of probabilistic and intertemporal decision making. Brain Res. 2008, 1234:104-115. 10.1016/j.brainres.2008.07.105.
51. Westbrook A., Kester D., Braver T.S. What is the subjective cost of cognitive effort? Load, trait, and aging effects revealed by economic preference. PLoS One 2013, 8(7):e68210. 10.1371/journal.pone.0068210.
52. Wittmann M., Paulus M.P. Intertemporal choice: neuronal and psychological determinants of economic decisions. J. Neurosci. Psychol. Econ. 2009, 2(2):71-74.
53. Wunderlich K., Rangel A., O'Doherty J.P. Neural computations underlying action-based decision making in the human brain. Proc. Natl. Acad. Sci. U. S. A. 2009, 106(40):17199-17204. 10.1073/pnas.0901077106.