Anterior cingulate cortex instigates adaptive switches in choice by integrating immediate and delayed components of value in ventromedial prefrontal cortex

Journal of Neuroscience

Volumn 34, Issue 9, 2014, Pages 3340-3349

  Economides, Marcos ^a   Guitart Masip, Marc ^a,b   Kurth Nelson, Zeb ^a   Dolan, Raymond J ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b AGING RESEARCH CENTER   (Sweden)

Author keywords

Computational modeling; Control; Decision making; fMRI; Prefrontal cortex; Value

Indexed keywords

ACTION POTENTIAL; ADULT; ANTERIOR CINGULATE; ARTICLE; COGNITION; COMPUTER MODEL; DECISION MAKING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PRIORITY JOURNAL; RESPONSE TIME; VENTROMEDIAL PREFRONTAL CORTEX; YOUNG ADULT;

COMPUTATIONAL MODELING; CONTROL; DECISION-MAKING; FMRI; PREFRONTAL CORTEX; VALUE;

ADAPTATION, PHYSIOLOGICAL; ADULT; ASSOCIATION LEARNING; CHOICE BEHAVIOR; COMPUTER SIMULATION; FEMALE; GYRUS CINGULI; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MALE; MODELS, BIOLOGICAL; OXYGEN; PREFRONTAL CORTEX; PSYCHOMOTOR PERFORMANCE; REACTION TIME; REWARD; YOUNG ADULT;

EID: 84894411038     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.4313-13.2014     Document Type: Article

References (54)

1. Badre D (2008) Cognitive control, hierarchy, and the rostro-caudal organization of the frontal lobes. Trends Cogn Sci 12:193-200. CrossRef Medline
2. Baliki MN, Mansour A, Baria AT, Huang L, Berger SE, Fields HL, Apkarian AV (2013) Parceling human accumbens into putative core and shell dissociates encoding of values for reward and pain. J Neurosci 33:16383-16393. CrossRef Medline
3. Balleine BW, Dickinson A (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37:407-419. CrossRef Medline
4. Barber AD, Carter CS (2005) Cognitive control involved in overcoming prepotent response tendencies and switching between tasks. Cereb Cortex 15:899-912. CrossRef Medline
5. Barbey AK, Koenigs M, Grafman J (2013) Dorsolateral prefrontal contributions to human working memory. Cortex 49:1195-1205. CrossRef Medline
6. Basten U, Biele G, Heekeren HR, Fiebach CJ (2010) How the brain integrates costs and benefits during decision making. Proc Natl Acad Sci U S A 107:21767-21772. CrossRef Medline
7. Boorman ED, Rushworth MF, Behrens TE (2013) Ventromedial prefrontal and anterior cingulate cortex adopt choice and default reference frames during sequential multi-alternative choice. J Neurosci 33:2242-2253. CrossRef Medline
8. Botvinick MM (2007) Conflict monitoring and decision making: reconciling two perspectives on anterior cingulate function. Cogn Affect Behav Neurosci 7:356-366. CrossRef Medline
9. Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD (2001) Conflict monitoring and cognitive control. Psychol Rev 108:624-652. CrossRef Medline
10. Buschman TJ, Denovellis EL, Diogo C, Bullock D, Miller EK (2012) Synchronous oscillatory neural ensembles for rules in the prefrontal cortex. Neuron 76:838-846. CrossRef Medline
11. Curtis CE, D'Esposito M (2003) Persistent activity in the prefrontal cortex during working memory. Trends Cogn Sci 7:415-423. CrossRef Medline
12. Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8:1704-1711. CrossRef Medline
13. Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ (2006) Cortical substrates for exploratory decisions in humans. Nature 441:876-879. CrossRef Medline
14. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ (2011) Model-based influences on humans' choices and striatal prediction errors. Neuron 69:1204-1215. CrossRef Medline
15. Dayan P (2008) The role of value systems in decision making. In: Better than conscious? Decision making, the human mind, and implications for institutions (C. Engel, S. Wolf, eds), pp 51-70. Cambridge, MA: Massachusetts Institute of Technology.
16. De Martino B, Fleming SM, Garrett N, Dolan RJ (2013) Confidence in value-based choice. Nat Neurosci 16:105-110. CrossRef Medline
17. Diekhof EK, Gruber O (2010) When desire collides with reason: functional interactions between anteroventral prefrontal cortex and nucleus accumbens underlie the human ability to resist impulsive desires. J Neurosci 30:1488-1493. CrossRef Medline
18. Gehring WJ, Willoughby AR (2002) The medial frontal cortex and the rapid processing of monetary gains and losses. Science 295:2279-2282. CrossRef Medline
19. Gläscher J, Daw N, Dayan P, O'Doherty JP (2010) States versus rewards: dissociable neural prediction error signals underlying model-based and modelfree reinforcement learning. Neuron 66:585-595. CrossRef Medline
20. Guitart-Masip M, Huys QJ, Fuentemilla L, Dayan P, Duzel E, Dolan RJ (2012) Go and no-go learning in reward and punishment: interactions between affect and effect. Neuroimage 62:154-166. CrossRef Medline
21. Hare TA, Camerer CF, Rangel A (2009) Self-control in decision-making involves modulation of the vmPFC valuation system. Science 324:646-648. CrossRef Medline
22. Hare TA, Malmaud J, Rangel A (2011) Focusing attention on the health aspects of foods changes value signals in vmPFC and improves dietary choice. J Neurosci 31:11077-11087. CrossRef Medline
23. Hunt LT, Kolling N, Soltani A, Woolrich MW, Rushworth MF, Behrens TE (2012) Mechanisms underlying cortical activity during value-guided choice. Nat Neurosci 15:470-476, S1-3. CrossRef Medline
24. Hutton C, Josephs O, Stadler J, Featherstone E, Reid A, Speck O, Bernarding J, Weiskopf N (2011) The impact of physiological noise correction on fMRI at 7 T. Neuroimage 57:101-112. CrossRef Medline
25. Huys QJ, Cools R, Gölzer M, Friedel E, Heinz A, Dolan RJ, Dayan P (2011) Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding. PLoS Comput Biol 7:e1002028. CrossRef Medline
26. Ide JS, Shenoy P, Yu AJ, Li CS (2013) Bayesian prediction and evaluation in the anterior cingulate cortex. J Neurosci 33:2039-2047. CrossRef Medline
27. Kable JW, GlimcherPW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10:1625-1633. CrossRef Medline
28. Kass R, Raftery A (1995) Bayes factors. J Am Stat Assoc 90:773-795.
29. Kerns JG, Cohen JD, MacDonald AW 3rd, Cho RY, Stenger VA, Carter CS (2004) Anterior cingulate conflict monitoring and adjustments in control. Science 303:1023-1026. CrossRef Medline
30. Kolling N, Behrens TE, Mars RB, Rushworth MF (2012) Neural mechanisms of foraging. Science 336:95-98. CrossRef Medline
31. Liston C, Matalon S, Hare TA, Davidson MC, Casey BJ (2006) Anterior cingulate and posterior parietal cortices are sensitive to dissociable forms of conflict in a task-switching paradigm. Neuron 50:643-653. CrossRef Medline
32. Litt A, Plassmann H, Shiv B, Rangel A (2011) Dissociating valuation and saliency signals during decision-making. Cereb Cortex 21:95-102. CrossRef Medline
33. Mansouri FA, Tanaka K, Buckley MJ (2009) Conflict-induced behavioural adjustment: a clue to the executive functions of the prefrontal cortex. Nat Rev Neurosci 10:141-152. CrossRef Medline
34. McClure SM, Laibson DI, Loewenstein G, Cohen JD (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306: 503-507. CrossRef Medline
35. McLaren DG, Ries ML, Xu G, Johnson SC (2012) A generalized form of context-dependent psychophysiological interactions (gPPI): a comparison to standard approaches. Neuroimage 61:1277-1286. CrossRef Medline
36. Narayanan NS, Prabhakaran V, Bunge SA, Christoff K, Fine EM, Gabrieli JD (2005) The role of the prefrontal cortex in the maintenance of verbal working memory: an event-related FMRI analysis. Neuropsychology 19: 223-232. CrossRef Medline
37. O'Reilly JX, Schüffelgen U, Cuell SF, Behrens TE, Mars RB, Rushworth MF (2013) Dissociable effects of surprise and model update in parietal and anterior cingulate cortex. Proc Natl Acad Sci U S A 110:E3660-E3669. CrossRef Medline
38. Otto AR, Gershman SJ, Markman AB, Daw ND (2013) The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive. Psychol Sci 24:751-761. CrossRef Medline
39. OwenAM (1997) Cognitive planning in humans: neuropsychological, neuroanatomical and neuropharmacological perspectives. Prog Neurobiol 53:431-450. CrossRef Medline
40. Plassmann H, O'Doherty JP, Rangel A (2010) Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making. J Neurosci 30:10799-10808. CrossRef Medline
41. Pochon JB, Riis J, Sanfey AG, Nystrom LE, Cohen JD (2008) Functional imaging of decision conflict. J Neurosci 28:3468-3473. CrossRef Medline
42. Postle BR (2006) Working memory as an emergent property of the mind and brain. Neuroscience 139:23-38. CrossRef Medline
43. Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9:545-556. CrossRef Medline
44. Rangel A, Hare T (2010) Neural computations associated with goal-directed choice. Curr Opin Neurobiol 20:262-270. CrossRef Medline
45. Rushworth MF, Walton ME, Kennerley SW, BannermanDM (2004) Action sets and decisions in the medial frontal cortex. Trends Cogn Sci 8:410-417. CrossRef Medline
46. Rushworth MF, Noonan MP, Boorman ED, Walton ME, Behrens TE (2011) Frontal cortex and reward-guided learning and decision-making. Neuron 70:1054-1069. CrossRef Medline
47. Schultz W (2000) Multiple reward signals in the brain. Nat Rev Neurosci 1:199-207. CrossRef Medline
48. Shenhav A, Botvinick MM, Cohen JD (2013) The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron 79: 217-240. CrossRef Medline
49. Stokes MG, Kusunoki M, Sigala N, Nili H, Gaffan D, Duncan J (2013) Dynamic coding for cognitive control in prefrontal cortex. Neuron 78:364-375. CrossRef Medline
50. van den Heuvel OA, Groenewegen HJ, Barkhof F, Lazeron RH, van Dyck R, Veltman DJ (2003) Frontostriatal system in planning complexity: a parametric functional magnetic resonance version of Tower of London task. Neuroimage 18:367-374. CrossRef Medline
51. Wallis JD, Miller EK (2003) Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur J Neurosci 18:2069-2081. CrossRef Medline
52. Walton ME, Croxson PL, Behrens TE, Kennerley SW, RushworthMF (2007) Adaptive decision making and value in the anterior cingulate cortex. Neuroimage 36 [Suppl 2]:T142-154.
53. CrossRef Wunderlich K, Dayan P, Dolan RJ (2012) Mapping value based planning and extensively trained choice in the human brain. Nat Neurosci 15:786-791. CrossRef Medline
54. Yoshida W, Ishii S (2006) Resolution of uncertainty in prefrontal cortex. Neuron 50:781-789. CrossRef Medline