Disruption of Dorsolateral Prefrontal Cortex Decreases Model-Based in Favor of Model-free Control in Humans

Neuron

Volumn 80, Issue 4, 2013, Pages 914-919

  Smittenaar, Peter ^a   FitzGerald, Thomas H B ^a   Romei, Vincenzo ^a,b   Wright, Nicholas D ^a   Dolan, Raymond J ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF ESSEX   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; BRAIN DEPTH STIMULATION; BRAIN FUNCTION; CONNECTOME; CONTROLLED STUDY; CORRELATION ANALYSIS; DECISION MAKING; DEPTH PERCEPTION; FEMALE; HUMAN; HUMAN EXPERIMENT; LEARNING ALGORITHM; MALE; NORMAL HUMAN; PREFRONTAL CORTEX; PRIORITY JOURNAL; THETA RHYTHM; TRANSCRANIAL MAGNETIC STIMULATION; WORKING MEMORY;

ADOLESCENT; ADULT; BEHAVIOR; CHOICE BEHAVIOR; FEMALE; FUNCTIONAL LATERALITY; HUMANS; MALE; MEMORY, SHORT-TERM; MODELS, NEUROLOGICAL; PREFRONTAL CORTEX; PSYCHOMOTOR PERFORMANCE; THETA RHYTHM; TRANSCRANIAL MAGNETIC STIMULATION; YOUNG ADULT;

EID: 84888025934     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2013.08.009     Document Type: Article

References (36)

1. Abe H., Lee D. Distributed coding of actual and hypothetical outcomes in the orbital and dorsolateral prefrontal cortex. Neuron 2011, 70:731-741.
2. Balleine B.W., O'Doherty J.P. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 2010, 35:48-69.
3. Bates, D., Maechler, M., and Bolker, B. (2012). lme4: Linear mixed-effects models using S4 classes. R package version 0.999999-0, http://cran.r-project.org/package=lme4.
4. Boorman E.D., Behrens T.E., Woolrich M.W., Rushworth M.F. How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 2009, 62:733-743.
5. Cools R., Gibbs S.E., Miyakawa A., Jagust W., D'Esposito M. Working memory capacity predicts dopamine synthesis capacity in the human striatum. J.Neurosci. 2008, 28:1208-1212.
6. Daw N.D., Niv Y., Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 2005, 8:1704-1711.
7. Daw N.D., Gershman S.J., Seymour B., Dayan P., Dolan R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 2011, 69:1204-1215.
8. Dayan P., Niv Y. Reinforcement learning: the good, the bad and the ugly. Curr. Opin. Neurobiol. 2008, 18:185-196.
9. de Wit S., Corlett P.R., Aitken M.R., Dickinson A., Fletcher P.C. Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans. J.Neurosci. 2009, 29:11330-11338.
10. de Wit S., Barker R.A., Dickinson A.D., Cools R. Habitual versus goal-directed action control in Parkinson disease. J.Cogn. Neurosci. 2011, 23:1218-1229.
11. de Wit S., Standing H.R., Devito E.E., Robinson O.J., Ridderinkhof K.R., Robbins T.W., Sahakian B.J. Reliance on habits at the expense of goal-directed control following dopamine precursor depletion. Psychopharmacology (Berl.) 2012, 219:621-631.
12. Everitt B.J., Robbins T.W. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 2005, 8:1481-1489.
13. Feredoes E., Heinen K., Weiskopf N., Ruff C., Driver J. Causal evidence for frontal involvement in memory target maintenance by posterior brain areas during distracter interference of visual working memory. Proc. Natl. Acad. Sci. USA 2011, 108:17510-17515.
14. Fuster J. The Prefrontal Cortex 2008, Academic Press, London.
15. Gallagher M., McMahan R.W., Schoenbaum G. Orbitofrontal cortex and representation of incentive value in associative learning. J.Neurosci. 1999, 19:6610-6614.
16. Gershman S.J., Markman A.B., Otto A.R. Retrospective Revaluation in Sequential Decision Making: A Tale of Two Systems. J.Exp. Psychol. Gen. 2012, Published online December 10, 2012. 10.1037/a0030844.
17. Gläscher J., Daw N., Dayan P., O'Doherty J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 2010, 66:585-595.
18. Hikosaka O. Basal ganglia mechanisms of reward-oriented eye movement. Ann. N Y Acad. Sci. 2007, 1104:229-249.
19. Højsgaard, S. (2006). The doBy package. R News 6, 47. http://www.r-project.org/doc/Rnews/Rnews_2006-2.pdf.
20. Huang Y.Z., Edwards M.J., Rounis E., Bhatia K.P., Rothwell J.C. Theta burst stimulation of the human motor cortex. Neuron 2005, 45:201-206.
21. Killcross S., Coutureau E. Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb. Cortex 2003, 13:400-408.
22. Knoch D., Pascual-Leone A., Meyer K., Treyer V., Fehr E. Diminishing reciprocal fairness by disrupting the right prefrontal cortex. Science 2006, 314:829-832.
23. Ko J.H., Monchi O., Ptito A., Bloomfield P., Houle S., Strafella A.P. Theta burst stimulation-induced inhibition of dorsolateral prefrontal cortex reveals hemispheric asymmetry in striatal dopamine release during a set-shifting task: a TMS-[(11)C]raclopride PET study. Eur. J. Neurosci. 2008, 28:2147-2155.
24. Lee D., Seo H. Mechanisms of reinforcement learning and decision making in the primate dorsolateral prefrontal cortex. Ann. N Y Acad. Sci. 2007, 1104:108-122.
25. Liljeholm M., O'Doherty J.P. Contributions of the striatum to learning, motivation, and performance: an associative account. Trends Cogn. Sci. 2012, 16:467-475.
26. McNab F., Klingberg T. Prefrontal cortex and basal ganglia control access to working memory. Nat. Neurosci. 2008, 11:103-107.
27. Miller E.K., Cohen J.D. An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 2001, 24:167-202.
28. Mull B.R., Seyal M. Transcranial magnetic stimulation of left prefrontal cortex impairs working memory. Clin. Neurophysiol. 2001, 112:1672-1675.
29. Otto A.R., Gershman S.J., Markman A.B., Daw N.D. The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive. Psychol. Sci. 2013, 24:751-761.
30. Preuss T.M. Do rats have prefrontal cortex? The Rose-Woolsey-Akert program reconsidered. J.Cogn. Neurosci. 1995, 7:1-24.
31. R Development Core Team (2011). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna. http://cran.r-project.org/.
32. Uylings H.B., Groenewegen H.J., Kolb B. Do rats have a prefrontal cortex?. Behav. Brain Res. 2003, 146:3-17.
33. Wunderlich K., Dayan P., Dolan R.J. Mapping value based planning and extensively trained choice in the human brain. Nat. Neurosci. 2012, 15:786-791.
34. Wunderlich K., Smittenaar P., Dolan R.J. Dopamine enhances model-based over model-free choice behavior. Neuron 2012, 75:418-424.
35. Xue G., Juan C.H., Chang C.F., Lu Z.L., Dong Q. Lateral prefrontal cortex contributes to maladaptive decisions. Proc. Natl. Acad. Sci. USA 2012, 109:4401-4406.
36. Yin H.H., Knowlton B.J., Balleine B.W. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur. J. Neurosci. 2004, 19:181-189.