Medial prefrontal cortex predicts internally driven strategy shifts

Neuron

Volumn 86, Issue 1, 2015, Pages 331-340

  Schuck, Nicolas W ^a,b,c   Gaschler, Robert ^b,d   Wenke, Dorit ^b   Heinzle, Jakob ^e,f   Frensch, Peter A ^b   Haynes, John Dylan ^f,g,h   Reverberi, Carlo ^f,i  

^a PRINCETON UNIVERSITY   (United States)

^b HUMBOLDT UNIVERSITY   (Germany)

^c MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

^d University of Koblenz Landau   (Germany)

^e UNIVERSITY OF ZURICH   (Switzerland)

^f CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

^g MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

^h OTTO VON GUERICKE UNIVERSITY   (Germany)

ⁱ UNIVERSITY OF MILANO BICOCCA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; CONTROLLED STUDY; EXECUTIVE FUNCTION; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MEDIAL PREFRONTAL CORTEX; NEUROIMAGING; NORMAL HUMAN; PREDICTION; PRIORITY JOURNAL; STIMULUS RESPONSE; STRATEGIC PLANNING; ATTENTION; BLOOD; DECISION MAKING; HEMISPHERIC DOMINANCE; IMAGE PROCESSING; NUCLEAR MAGNETIC RESONANCE IMAGING; PHOTOSTIMULATION; PHYSIOLOGY; PREFRONTAL CORTEX; REACTION TIME; RECEIVER OPERATING CHARACTERISTIC; SUPPORT VECTOR MACHINE; VASCULARIZATION; VISION; YOUNG ADULT;

OXYGEN;

ADULT; ATTENTION; DECISION MAKING; FEMALE; FUNCTIONAL LATERALITY; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; OXYGEN; PHOTIC STIMULATION; PREFRONTAL CORTEX; REACTION TIME; ROC CURVE; SUPPORT VECTOR MACHINE; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84930375772     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2015.03.015     Document Type: Article

References (54)

1. Barbey A.K., Krueger F., Grafman J. Structured event complexes in the medial prefrontal cortex support counterfactual representations for future planning. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2009, 364:1291-1300.
2. Botvinick M.M., Braver T.S., Barch D.M., Carter C.S., Cohen J.D. Conflict monitoring and cognitive control. Psychol. Rev. 2001, 108:624-652.
3. Cohen J.D., McClure S.M., Yu A.J. Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2007, 362:933-942.
4. Collins A., Koechlin E. Reasoning, learning, and creativity: frontal lobe function and human decision-making. PLoS Biol. 2012, 10:e1001293.
5. Daw N.D., O'Doherty J.P., Dayan P., Seymour B., Dolan R.J. Cortical substrates for exploratory decisions in humans. Nature 2006, 441:876-879.
6. Dehaene S., Kerszberg M., Changeux J.P. A neuronal model of a global workspace in effortful cognitive tasks. Proc. Natl. Acad. Sci. USA 1998, 95:14529-14534.
7. Desimone R., Duncan J. Neural mechanisms of selective visual attention. Annu. Rev. Neurosci. 1995, 18:193-222.
8. Doll B.B., Jacobs W.J., Sanfey A.G., Frank M.J. Instructional control of reinforcement learning: a behavioral and neurocomputational investigation. Brain Res. 2009, 1299:74-94.
9. Donoso M., Collins A.G.E., Koechlin E. Human cognition. Foundations of human reasoning in the prefrontal cortex. Science 2014, 344:1481-1486.
10. Dosenbach N.U.F., Visscher K.M., Palmer E.D., Miezin F.M., Wenger K.K., Kang H.C., Burgund E.D., Grimes A.L., Schlaggar B.L., Petersen S.E. A core system for the implementation of task sets. Neuron 2006, 50:799-812.
11. Dreisbach G., Haider H. That's what task sets are for: shielding against irrelevant information. Psychol. Res. 2008, 72:355-361.
12. Duncan J. An adaptive coding model of neural function in prefrontal cortex. Nat. Rev. Neurosci. 2001, 2:820-829.
13. Durstewitz D., Vittoz N.M., Floresco S.B., Seamans J.K. Abrupt transitions between prefrontal neural ensemble states accompany behavioral transitions during rule learning. Neuron 2010, 66:438-448.
14. Freedman D.J., Riesenhuber M., Poggio T., Miller E.K. Categorical representation of visual stimuli in the primate prefrontal cortex. Science 2001, 291:312-316.
15. Frensch P.A., Haider H., Ruenger D., Neugebauer U., Voigt S., Werg J. The route from implicit learning to verbal expression of what has been learned: Verbal report of incidentally experienced environmental regularity. Attention and Implicit Learning 2003, Volume 48:335-366. Advances in Consciousness Research.
16. Gaschler R., Frensch P.A., Cohen A., Wenke D. Implicit sequence learning based on instructed task set. J.Exp. Psychol. Learn. Mem. Cogn. 2012, 38:1389-1407.
17. Hayden B.Y., Pearson J.M., Platt M.L. Neuronal basis of sequential foraging decisions in a patchy environment. Nat. Neurosci. 2011, 14:933-939.
18. Haynes J.-D., Sakai K., Rees G., Gilbert S., Frith C., Passingham R.E. Reading hidden intentions in the human brain. Curr. Biol. 2007, 17:323-328.
19. Holroyd C.B., Yeung N. Motivation of extended behaviors by anterior cingulate cortex. Trends Cogn. Sci. 2012, 16:122-128.
20. Jeannerod M. Neural simulation of action: a unifying mechanism for motor cognition. Neuroimage 2001, 14:S103-S109.
21. Jepma M., Nieuwenhuis S. Pupil diameter predicts changes in the exploration-exploitation trade-off: evidence for the adaptive gain theory. J.Cogn. Neurosci. 2011, 23:1587-1596.
22. Johnson A., Redish A.D. Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J.Neurosci. 2007, 27:12176-12189.
23. Karlsson M.P., Tervo D.G.R., Karpova A.Y. Network resets in medial prefrontal cortex mark the onset of behavioral uncertainty. Science 2012, 338:135-139.
24. Koechlin E., Ody C., Kouneiher F. The architecture of cognitive control in the human prefrontal cortex. Science 2003, 302:1181-1185.
25. Kolling N., Behrens T.E.J., Mars R.B., Rushworth M.F.S. Neural mechanisms of foraging. Science 2012, 336:95-98.
26. Kounios J., Beeman M. The cognitive neuroscience of insight. Annu. Rev. Psychol. 2014, 65:71-93.
27. Kriegeskorte N., Goebel R., Bandettini P. Information-based functional brain mapping. Proc. Natl. Acad. Sci. USA 2006, 103:3863-3868.
28. Luo J., Knoblich G. Studying insight problem solving with neuroscientific methods. Methods 2007, 42:77-86.
29. March J.G. Exploration and exploitation in organizational learning. Organ. Sci. 1991, 2:71-87.
30. Meiran N. Reconfiguration of processing mode prior to task performance. J.Exp. Psychol. Learn. Mem. Cogn. 1996, 22:1423-1442.
31. Miller E.K., Cohen J.D. An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 2001, 24:167-202.
32. Momennejad I., Haynes J.D. Encoding of prospective tasks in the human prefrontal cortex under varying task loads. J.Neurosci. 2013, 33:17342-17349.
33. Monsell S. Task switching. Trends Cogn. Sci. 2003, 7:134-140.
34. Nassar M.R., Wilson R.C., Heasly B., Gold J.I. An approximately Bayesian delta-rule model explains the dynamics of belief updating in a changing environment. J.Neurosci. 2010, 30:12366-12378.
35. Pezzulo G., van der Meer M.A.A., Lansink C.S., Pennartz C.M.A. Internally generated sequences in learning and executing goal-directed behavior. Trends Cogn. Sci. 2014, 18:647-657.
36. Reverberi C., Toraldo A., D'Agostini S., Skrap M. Better without (lateral) frontal cortex? Insight problems solved by frontal patients. Brain 2005, 128:2882-2890.
37. Reverberi C., Görgen K., Haynes J.-D. Distributed representations of rule identity and rule order in human frontal cortex and striatum. J.Neurosci. 2012, 32:17420-17430.
38. Rich E.L., Shapiro M. Rat prefrontal cortical neurons selectively code strategy switches. J.Neurosci. 2009, 29:7208-7219.
39. Rose M., Haider H., Büchel C. The emergence of explicit memory during learning. Cereb. Cortex 2010, 20:2787-2797.
40. Sakai K. Task set and prefrontal cortex. Annu. Rev. Neurosci. 2008, 31:219-245.
41. Sakai K., Passingham R.E. Prefrontal set activity predicts rule-specific neural processing during subsequent cognitive performance. J.Neurosci. 2006, 26:1211-1218.
42. Sakai K., Rowe J.B., Passingham R.E. Active maintenance in prefrontal area 46 creates distractor-resistant memory. Nat. Neurosci. 2002, 5:479-484.
43. Schuck N.W., Frensch P.A., Schjeide B.-M.M., Schröder J., Bertram L., Li S.-C. Effects of aging and dopamine genotypes on the emergence of explicit memory during sequence learning. Neuropsychologia 2013, 51:2757-2769.
44. Shenhav A., Botvinick M.M., Cohen J.D. The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron 2013, 79:217-240.
45. Shenhav A., Straccia M.A., Cohen J.D., Botvinick M.M. Anterior cingulate engagement in a foraging context reflects choice difficulty, not foraging value. Nat. Neurosci. 2014, 17:1249-1254.
46. Soon C.S., He A.H., Bode S., Haynes J.-D. Predicting free choices for abstract intentions. Proc. Natl. Acad. Sci. USA 2013, 110:6217-6222.
47. Stokes M.G., Kusunoki M., Sigala N., Nili H., Gaffan D., Duncan J. Dynamic coding for cognitive control in prefrontal cortex. Neuron 2013, 78:364-375.
48. Sutton R. Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. Proceedings of the Seventh International Conference on Machine Learning 1990, 216-224.
49. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction 1998, A Bradford Book.
50. Wilson R.C., Takahashi Y.K., Schoenbaum G., Niv Y. Orbitofrontal cortex as a cognitive map of task space. Neuron 2014, 81:267-279.
51. Wisniewski D., Reverberi C., Tusche A., Haynes J.-D. The Neural Representation of Voluntary Task-Set Selection in Dynamic Environments. Cereb. Cortex 2014, bhu155.
52. Woolgar A., Hampshire A., Thompson R., Duncan J. Adaptive coding of task-relevant information in human frontoparietal cortex. J.Neurosci. 2011, 31:14592-14599.
53. Yu A.J., Dayan P. Uncertainty, neuromodulation, and attention. Neuron 2005, 46:681-692.
54. Zhao J., Al-Aidroos N., Turk-Browne N.B. Attention is spontaneously biased toward regularities. Psychol. Sci. 2013, 24:667-677.