The role of cognitive effort in subjective reward devaluation and risky decision-making

Scientific Reports

Volumn 5, Issue , 2015, Pages

  Apps, Matthew A J ^a,b   Grima, Laura L ^b   Manohar, Sanjay ^b   Husain, Masud ^a,b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANALYSIS OF VARIANCE; ATTENTION; COGNITION; COST BENEFIT ANALYSIS; DECISION MAKING; FEMALE; HUMAN; MALE; MOTIVATION; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; REWARD; RISK FACTOR; YOUNG ADULT;

ADULT; ANALYSIS OF VARIANCE; ATTENTION; CHOICE BEHAVIOR; COGNITION; COST-BENEFIT ANALYSIS; DECISION MAKING; FEMALE; HUMANS; MALE; MOTIVATION; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REWARD; RISK FACTORS; YOUNG ADULT;

EID: 84947789524     PISSN: None     EISSN: 20452322     Source Type: Journal    
DOI: 10.1038/srep16880     Document Type: Article

References (61)

1. Hull, C. Principles of behavior. (Appleton-Century, 1943).
2. Bonnelle, V. et al. Characterization of reward and effort mechanisms in apathy. J. Physiol.-Paris 109, 16-26 (2014).
3. Phillips, P. E. M., Walton, M. E. & Jhou, T. C. Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology (Berl.) 191, 483-495 (2007).
4. Charnov, E. L. Optimal foraging, marginal value theorem. Theor. Popul. Biol. 9, 129-136 (1976).
5. Salamone, J. D., Correa, M., Farrar, A. & Mingote, S. M. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology (Berl.) 191, 461-482 (2007).
6. Niv, Y. Cost, benefit, tonic, phasic: what do response rates tell us about dopamine and motivation? Ann. N. Y. Acad. Sci. 1104, 357-376 (2007).
7. Adam, R. et al. Dopamine reverses reward insensitivity in apathy following globus pallidus lesions. Cortex 49, 1292-1303 (2013).
8. Sinha, N., Manohar, S. & Husain, M. Impulsivity and apathy in Parkinson's disease. J. Neuropsychol. 7, 255-283 (2013).
9. Bari, A. & Robbins, T. W. Inhibition and impulsivity: behavioral and neural basis of response control. Prog. Neurobiol. 108, 44-79 (2013).
10. Chong, T. T.-J. et al. Dopamine enhances willingness to exert effort for reward in Parkinson's disease. Cortex. 69, 40-46 (2015).
11. Hartmann, M. N. et al. Apathy but not diminished expression in schizophrenia is associated with discounting of monetary rewards by physical effort. Schizophr. Bull. 41, 503-512 (2015).
12. Van Reekum, R., Stuss, D. T. & Ostrander, L. Apathy: Why care? J. Neuropsychiatry Clin. Neurosci. 17, 7-19 (2005).
13. Robert, P. H. b, Mulin, E., Malléa, P. & David, R. Apathy diagnosis, assessment, and treatment in Alzheimer's disease. CNS Neurosci. Ther. 16, 263-271 (2010).
14. Clarke, D. E., Ko, J. Y., Lyketsos, C., Rebok, G. W. & Eaton, W. W. Apathy and cognitive and functional decline in community-dwelling older adults: results from the Baltimore ECA longitudinal study. Int. Psychogeriatr. 22, 819-829 (2010).
15. Hosking, J. G., Floresco, S. B. & Winstanley, C. A. Dopamine Antagonism Decreases Willingness to Expend Physical, but not Cognitive, Effort: a Comparison of Two Rodent Cost/Benefit Decision-Making Tasks. Neuropsychopharmacology. (2014).
16. Hosking, J. G., Cocker, P. J. & Winstanley, C. A. Prefrontal Cortical Inactivations Decrease Willingness to Expend Cognitive Effort on a Rodent Cost/Benefit Decision-Making Task. Cereb. Cortex (2015).
17. Kool, W., McGuire, J. T., Rosen, Z. B. & Botvinick, M. M. Decision Making and the Avoidance of Cognitive Demand. J. Exp. Psychol. Gen. 139, 665-682 (2010).
18. Westbrook, A., Kester, D. & Braver, T. S. What is the subjective cost of cognitive effort? Load, trait, and aging effects revealed by economic preference. PloS One 8, (2013).
19. Kool, W. & Botvinick, M. A labor/leisure tradeoff in cognitive control. J. Exp. Psychol. Gen. 143, 131-141 (2014).
20. Birnbaum, M. H. New paradoxes of risky decision making. Psychol. Rev. 115, (2008).
21. Quartz, S. R. Reason, emotion and decision-making: risk and reward computation with feeling. Trends Cogn. Sci. 13, 209-215 (2009).
22. Kahneman, D. & Tversky, A. Choices, values, and frames. Am. Psychol. 39, 341-350 (1984).
23. Tversky, A. & Kahneman, D. Advances in prospect theory: Cumulative representation of uncertainty. J. Risk Uncertain. 5, 297-323 (1992).
24. Stewart, N., Chater, N., Stott, H. P. & Reimers, S. Prospect relativity: how choice options influence decision under risk. J. Exp. Psychol. Gen. 132, (2003).
25. Norbury, A., Manohar, S., Rogers, R. D. & Husain, M. Dopamine modulates risk-taking as a function of baseline sensation-seeking trait. J. Neurosci. 33, 12982-12986 (2013).
26. Rogers, R. D. et al. Dissociable deficits in the decision-making cognition of chronic amphetamine abusers, opiate abusers, patients with focal damage to prefrontal cortex, and tryptophan-depleted normal volunteersEvidence for monoaminergic mechanisms. Neuropsychopharmacology 20, 322-339 (1999).
27. Pyke, G. H. Optimal foraging theory: a critical review. Annual Review of Ecology and Systematics, 15, 523-575 (1984).
28. Nagengast, A. J., Braun, D. A. & Wolpert, D. M. Risk-sensitivity and the mean-variance trade-off: Decision making in sensorimotor control. Proc. R. Soc. B Biol. Sci. 278, 2325-2332 (2011).
29. Whiteside, S. P., Lynam, D. R., Miller, J. D. & Reynolds, S. K. Validation of the UPPS impulsive behaviour scale: a four-factor model of impulsivity. Eur. J. Personal. 19, 559-574 (2005).
30. Miller, M. A., Thome, A. & Cowen, S. L. Intersection of effort and risk: ethological and neurobiological perspectives. Front. Neurosci. 7 (2013).
31. Yantis, S. et al. Transient neural activity in human parietal cortex during spatial attention shifts. Nat. Neurosci. 5, 995-1002 (2002).
32. Hart, S. G. & Staveland, L. E. in Human mental workload (North Holland Press, 1988).
33. Hartmann, M. N. et al. Apathy in Schizophrenia as a Deficit in the Generation of Options for Action. J. Abnorm. Psychol. (2015).
34. Sockeel, P. B. et al. The Lille apathy rating scale (LARS), a new instrument for detecting and quantifying apathy: Validation in Parkinson's disease. J. Neurol. Neurosurg. Psychiatry 77, 579-584 (2006).
35. Kurzban, R., Duckworth, A., Kable, J. W. & Myers, J. An opportunity cost model of subjective effort and task performance. Behav. Brain Sci. 36, 661-679 (2013).
36. Westbrook, A. & Braver, T. S. Cognitive effort: A neuroeconomic approach. Cogn. Affect. Behav. Neurosci. 15, 395-341 (2015).
37. Klein-Flugge, M. C., Kennerley, S. W., Saraiva, A. C., Penny, W. D. & Bestmann, S. Behavioral modeling of human choices reveals dissociable effects of physical effort and temporal delay on reward devaluation. PLoS Comput. Biol. 11, (2015).
38. Mazur, J. E. Choice between single and multiple delayed reinforcers. J. Exp. Anal. Behav. 46, 67-77 (1986).
39. Mazur, J. E. Hyperbolic value addition and general models of animal choice. Psychol. Rev. 108, 96-112 (2001).
40. Prevost, C., Pessiglione, M., Metereau, E., Clery-Melin, M.-L. & Dreher, J.-C. Separate Valuation Subsystems for Delay and Effort Decision Costs. J. Neurosci. 30, 14080-14090 (2010).
41. Hajcak, G. & Foti, D. Errors are aversive: defensive motivation and the error-related negativity. Psychol. Sci. 19, 103-108 (2008).
42. Shadmehr, R., De Xivry, J. J. O., Xu-Wilson, M. & Shih, T. Y. Temporal Discounting of Reward and the Cost of Time in Motor Control. J. Neurosci. 30, 10507-10516 (2010).
43. Shadmehr, R. Control of movements and temporal discounting of reward. Curr. Opin. Neurobiol. 20, 726-730 (2010).
44. Manohar, S. G. et al. Reward Pays the Cost of Noise Reduction in Motor and Cognitive Control. Curr. Biol. 25, 1707-1716 (2015).
45. DeSimone, J. C., Everling, S. & Heath, M. The antisaccade task: visual distractors elicit a location-independent planning 'cost'. PloS One 10, (2015).
46. Weiler, J., Hassall, C. D., Krigolson, O. E. & Heath, M. The unidirectional prosaccade switch-cost: Electroencephalographic evidence of task-set inertia in oculomotor control. Behav. Brain Res. 278, 323-329 (2015).
47. Chiau, H.-Y. et al. Trial type probability modulates the cost of antisaccades. J. Neurophysiol. 106, 515-526 (2011).
48. Chiu, Y.-C. & Yantis, S. A domain-independent source of cognitive control for task sets: shifting spatial attention and switching categorization rules. J. Neurosci. 29, 3930-3938 (2009).
49. Schmidt, L., Lebreton, M., Clery-Melin, M.-L., Daunizeau, J. & Pessiglione, M. Neural Mechanisms Underlying Motivation of Mental Versus Physical Effort. Plos Biol. 10, (2012).
50. Norbury, A. & Husain, M. Sensation-seeking: Dopaminergic modulation and risk for psychopathology. Behav. Brain Res. 288, 79-93 (2015).
51. Floresco, S. B., Onge, J. R. S., Ghods-Sharifi, S. & Winstanley, C. A. Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making. Cogn. Affect. Behav. Neurosci. 8, 375-389 (2008).
52. Rushworth, M. F. S. & Behrens, T. E. J. Choice, uncertainty and value in prefrontal and cingulate cortex. Nat. Neurosci. 11, 389-397 (2008).
53. Gan, J. O., Walton, M. E. & Phillips, P. E. M. Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat. Neurosci. 13, 25-27 (2010).
54. Apps, M. A. & Ramnani, N. The Anterior Cingulate Gyrus Signals the Net Value of Others' Rewards. J. Neurosci. 34, 6190-6200 (2014).
55. Pessiglione, M. et al. How the brain translates money into force: a neuroimaging study of subliminal motivation. Science 316, 904-906 (2007).
56. Schouppe, N., Demanet, J., Boehler, C. N., Ridderinkhof, K. R. & Notebaert, W. The role of the striatum in effort-based decision-making in the absence of reward. J. Neurosci. 34, 2148-2154 (2014).
57. Vassena, E. et al. Overlapping neural systems represent cognitive effort and reward anticipation. PloS One 9, (2014).
58. Kurniawan, I. T. et al. Choosing to Make an Effort: The Role of Striatum in Signaling Physical Effort of a Chosen Action. J. Neurophysiol. 104, 313-321 (2010).
59. Burke, C. J., Brunger, C., Kahnt, T., Park, S. Q. & Tobler, P. N. Neural Integration of Risk and Effort Costs by the Frontal Pole: Only upon Request. J. Neurosci. 33, 1706-+ (2013).
60. Dalley, J. W., Everitt, B. J. & Robbins, T. W. Impulsivity, Compulsivity, and Top-Down Cognitive Control. Neuron 69, 680-694 (2011).
61. Hartmann, M. N., Hager, O. M., Tobler, P. N. & Kaiser, S. Parabolic discounting of monetary rewards by physical effort. Behav. Processes 100, 192-196 (2013).