Medial prefrontal cortical activity reflects dynamic re-evaluation during voluntary persistence

Nature Neuroscience

Volumn 18, Issue 5, 2015, Pages 760-766

  McGuire, Joseph T ^a   Kable, Joseph W ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANTERIOR INSULA; AROUSAL; ARTICLE; BOLD SIGNAL; BRAIN FUNCTION; DECISION MAKING; EXECUTIVE FUNCTION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HEART RATE; HUMAN; HUMAN EXPERIMENT; IMPULSIVENESS; MALE; MEDIAL PREFRONTAL CORTEX; NEUROIMAGING; OPTIMAL FORAGING; PERSONALITY; POSTERIOR CINGULATE; POSTERIOR PARIETAL CORTEX; PRIORITY JOURNAL; RESPONSE TIME; REWARD; SELF CONTROL; SUPERIOR TEMPORAL GYRUS; VENTRAL STRIATUM; VENTROMEDIAL PREFRONTAL CORTEX; VOLUNTARY PERSISTENCE; ADOLESCENT; COGNITION; GAME; NUCLEAR MAGNETIC RESONANCE IMAGING; OXIMETRY; PHYSIOLOGY; PREFRONTAL CORTEX; TIME FACTOR; YOUNG ADULT;

ADOLESCENT; ADULT; CHOICE BEHAVIOR; DECISION MAKING; FEMALE; FUNCTIONAL NEUROIMAGING; GAMES, EXPERIMENTAL; HEART RATE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; OXIMETRY; PREFRONTAL CORTEX; REWARD; TIME FACTORS; VOLITION; YOUNG ADULT;

EID: 84928701390     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.3994     Document Type: Article

References (67)

1. Mischel, W. & Ebbesen, E.B. Attention in delay of gratifcation. J. Pers. Soc. Psychol. 16, 329-337 (1970).
2. Baumeister, R.F., Vohs, K.D. & Tice, D.M. The strength model of self-control. Curr. Dir. Psychol. Sci. 16, 351-355 (2007).
3. Bartra, O., McGuire, J.T. & Kable, J.W. The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage 76, 412-427 (2013).
4. Clithero, J.A. & Rangel, A. Informatic parcellation of the network involved in the computation of subjective value. Soc. Cogn. Affect. Neurosci. 9, 1289-1302 (2013).
5. Liu, X., Hairston, J., Schrier, M. & Fan, J. Common and distinct networks underlying reward valence and processing stages: a meta-analysis of functional neuroimaging studies. Neurosci. Biobehav. Rev. 35, 1219-1236 (2011).
6. Levy, D.J. & Glimcher, P.W. The root of all value: A neural common currency for choice. Curr. Opin. Neurobiol. 22, 1027-1038 (2012).
7. Kable, J.W. & Glimcher, P.W. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10, 1625-1633 (2007).
8. Kable, J.W. & Glimcher, P.W. An "as soon as possible" effect in human intertemporal decision making: Behavioral evidence and neural mechanisms. J. Neurophysiol. 103, 2513-2531 (2010).
9. Hare, T.A., Camerer, C.F. & Rangel, A. Self-control in decision-making involves modulation of the vmPFC valuation system. Science 324, 646-648 (2009).
10. Mischel, W., Ayduk, O. & Mendoza-Denton, R. Sustaining delay of gratifcation over time: a hot-cool systems perspective. in Time and Decision: Economic and Psychological Perspectives on Intertemporal Choice (eds. Loewenstein, G., Read, D. & Baumeister, R.F.) 175-200 (Russell Sage Foundation, New York, 2003).
11. Metcalfe, J. & Mischel, W. A hot/cool-system analysis of delay of gratifcation: dynamics of willpower. Psychol. Rev. 106, 3-19 (1999).
12. McGuire, J.T. & Kable, J.W. Rational temporal predictions can underlie apparent failures to delay gratifcation. Psychol. Rev. 120, 395-410 (2013).
13. McGuire, J.T. & Kable, J.W. Decision makers calibrate behavioral persistence on the basis of time-interval experience. Cognition 124, 216-226 (2012).
14. Rachlin, H. The Science of Self Control (Harvard University Press, 2000).
15. Dasgupta, P. & Maskin, E. Uncertainty and hyperbolic discounting. Am. Econ. Rev. 95, 1290-1299 (2005).
16. Kim, H., Shimojo, S. & O'Doherty, J.P. Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex. Cereb. Cortex 21, 769-776 (2011).
17. Hare, T.A., Malmaud, J. & Rangel, A. Focusing attention on the health aspects of foods changes value signals in vmPFC and improves dietary choice. J. Neurosci. 31, 11077-11087 (2011).
18. Hampton, A.N., Bossaerts, P. & O'Doherty, J.P. The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J. Neurosci. 26, 8360-8367 (2006).
19. Daw, N.D., Gershman, S.J., Seymour, B., Dayan, P. & Dolan, R.J. Model-based infuences on humans' choices and striatal prediction errors. Neuron 69, 1204-1215 (2011).
20. Hutcherson, C.A., Plassmann, H., Gross, J.J. & Rangel, A. Cognitive regulation during decision making shifts behavioral control between ventromedial and dorsolateral prefrontal value systems. J. Neurosci. 32, 13543-13554 (2012).
21. Casey, B.J. et al. Behavioral and neural correlates of delay of gratifcation 40 years later. Proc. Natl. Acad. Sci. USA 108, 14998-15003 (2011).
22. Figner, B. et al. Lateral prefrontal cortex and self-control in intertemporal choice. Nat. Neurosci. 13, 538-539 (2010).
23. Heatherton, T.F. & Wagner, D.D. Cognitive neuroscience of self-regulation failure. Trends Cogn. Sci. 15, 132-139 (2011).
24. Charnov, E.L. Optimal foraging, the marginal value theorem. Theor. Popul. Biol. 9, 129-136 (1976).
25. McNamara, J. Optimal patch use in a stochastic environment. Theor. Popul. Biol. 21, 269-288 (1982).
26. Hayden, B.Y., Pearson, J.M. & Platt, M.L. Neuronal basis of sequential foraging decisions in a patchy environment. Nat. Neurosci. 14, 933-939 (2011).
27. Fawcett, T.W., McNamara, J.M. & Houston, A.I. When is it adaptive to be patient? A general framework for evaluating delayed rewards. Behav. Processes 89, 128-136 (2012).
28. Nickerson, R.S. Response time to the second of two successive signals as a function of absolute and relative duration of intersignal interval. Percept. Mot. Skills 21, 3-10 (1965).
29. Griffths, T.L. & Tenenbaum, J.B. Optimal predictions in everyday cognition. Psychol. Sci. 17, 767-773 (2006).
30. Montague, P.R., Dayan, P. & Sejnowski, T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16, 1936-1947 (1996).
31. Fiorillo, C.D., Newsome, W.T. & Schultz, W. The temporal precision of reward prediction in dopamine neurons. Nat. Neurosci. 11, 966-973 (2008).
32. Cui, X., Stetson, C., Montague, P.R. & Eagleman, D.M. Ready.go: amplitude of the FMRI signal encodes expectation of cue arrival time. PLoS Biol. 7, e1000167 (2009).
33. Bueti, D., Bahrami, B., Walsh, V. & Rees, G. Encoding of temporal probabilities in the human brain. J. Neurosci. 30, 4343-4352 (2010).
34. Tootell, R.B.H. et al. The retinotopy of visual spatial attention. Neuron 21, 1409-1422 (1998).
35. Lacey, J.I. & Lacey, B.C. Some autonomic-central nervous system interrelationships. in Physiological Correlates of Emotion (ed. Black, P.) 205-227 (Academic Press, New York, 1970).
36. Schweighofer, N. et al. Humans can adopt optimal discounting strategy under realtime constraints. PLoS Comput. Biol. 2, e152 (2006).
37. Loewenstein, G. Anticipation and the valuation of delayed consumption. Econ. J. 97, 666-684 (1987).
38. Duckworth, A.L., Gendler, T.S. & Gross, J.J. Self-control in school-age children. Educ. Psychol. 49, 199-217 (2014).
39. Jimura, K., Chushak, M.S. & Braver, T.S. Impulsivity and self-control during intertemporal decision making linked to the neural dynamics of reward value representation. J. Neurosci. 33, 344-357 (2013).
40. Helfnstein, S.M. et al. Predicting risky choices from brain activity patterns. Proc. Natl. Acad. Sci. USA 111, 2470-2475 (2014).
41. Rushworth, M.F.S., Kolling, N., Sallet, J. & Mars, R.B. Valuation and decision-making in frontal cortex: one or many serial or parallel systems? Curr. Opin. Neurobiol. 22, 946-955 (2012).
42. Shenhav, A., Straccia, M.A., Cohen, J.D. & Botvinick, M.M. Anterior cingulate engagement in a foraging context refects choice diffculty, not foraging value. Nat. Neurosci. 17, 1249-1254 (2014).
43. Blanchard, T.C. & Hayden, B.Y. Neurons in dorsal anterior cingulate cortex signal postdecisional variables in a foraging task. J. Neurosci. 34, 646-655 (2014).
44. McClure, S.M., Berns, G.S. & Montague, P.R. Temporal prediction errors in a passive learning task activate human striatum. Neuron 38, 339-346 (2003).
45. Hollerman, J.R. & Schultz, W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat. Neurosci. 1, 304-309 (1998).
46. Berns, G.S., McClure, S.M., Pagnoni, G. & Montague, P.R. Predictability modulates human brain response to reward. J. Neurosci. 21, 2793-2798 (2001).
47. Hare, T.A., O'Doherty, J., Camerer, C.F., Schultz, W. & Rangel, A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 28, 5623-5630 (2008).
48. Howe, M.W., Tierney, P.L., Sandberg, S.G., Phillips, P.E.M. & Graybiel, A.M. Prolonged dopamine signaling in striatum signals proximity and value of distant rewards. Nature 500, 575-579 (2013).
49. Miyazaki, K.W. et al. Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards. Curr. Biol. 24, 2033-2040 (2014).
50. Janssen, P. & Shadlen, M.N. A representation of the hazard rate of elapsed time in macaque area LIP. Nat. Neurosci. 8, 234-241 (2005).
51. Brainard, D.H. The psychophysics toolbox. Spat. Vis. 10, 433-436 (1997).
52. Pelli, D.G. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat. Vis. 10, 437-442 (1997).
53. Luhmann, C.C., Chun, M.M., Yi, D.-J., Lee, D. & Wang, X.-J. Neural dissociation of delay and uncertainty in intertemporal choice. J. Neurosci. 28, 14459-14466 (2008).
54. Ungemach, C., Chater, N. & Stewart, N. Are probabilities overweighted or underweighted when rare outcomes are experienced (rarely)? Psychol. Sci. 20, 473-479 (2009).
55. Fitzgerald, T.H., Seymour, B., Bach, D.R. & Dolan, R.J. Differentiable neural substrates for learned and described value and risk. Curr. Biol. 20, 1823-1829 (2010).
56. Hertwig, R., Barron, G., Weber, E.U. & Erev, I. Decisions from experience and the effect of rare events in risky choice. Psychol. Sci. 15, 534-539 (2004).
57. Kaplan, E.L. & Meier, P. Nonparametric estimation from incomplete observations. J. Am. Stat. Assoc. 53, 457-481 (1958).
58. Gibbon, J. Scalar expectancy theory and Weber's law in animal timing. Psychol. Rev. 84, 279-325 (1977).
59. Rakitin, B.C. et al. Scalar expectancy theory and peak-interval timing in humans. J. Exp. Psychol. Anim. Behav. Process. 24, 15-33 (1998).
60. Jenkinson, M. & Smith, S. A global optimisation method for robust affne registration of brain images. Med. Image Anal. 5, 143-156 (2001).
61. Smith, S.M. et al. Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage 23, S208-S219 (2004).
62. Jenkinson, M., Beckmann, C.F., Behrens, T.E.J., Woolrich, M.W. & Smith, S.M. FSL. Neuroimage 62, 782-790 (2012).
63. Jenkinson, M., Bannister, P., Brady, M. & Smith, S. Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 17, 825-841 (2002).
64. Cox, R.W. AFNI: What a long strange trip it's been. Neuroimage 62, 743-747 (2012).
65. Cox, R.W. AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 29, 162-173 (1996).
66. Greve, D.N. & Fischl, B. Accurate and robust brain image alignment using boundary-based registration. Neuroimage 48, 63-72 (2009).
67. Nichols, T.E. & Holmes, A.P. Nonparametric permutation tests for functional neuroimaging: a primer with examples. Hum. Brain Mapp. 15, 1-25 (2002).