Frontal cortex and the discovery of abstract action rules

Neuron

Volumn 66, Issue 2, 2010, Pages 315-326

  Badre, David ^a   Kayser, Andrew S ^b   D'Esposito, Mark ^c  

^a BROWN UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

SYSNEURO

Indexed keywords

ADAPTIVE BEHAVIOR; ADULT; ARTICLE; BRAIN FUNCTION; BRAIN REGION; CONTROLLED STUDY; FEMALE; FRONTAL CORTEX; HUMAN; HUMAN EXPERIMENT; MALE; NEUROANATOMY; PRIORITY JOURNAL; PROBLEM SOLVING; REINFORCEMENT; RESPONSE TIME; STIMULUS RESPONSE; TASK PERFORMANCE;

ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; BRAIN MAPPING; CUES; FEMALE; FRONTAL LOBE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; NERVE NET; NEURONS; NEUROPSYCHOLOGICAL TESTS; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME;

EID: 77952341346     PISSN: 08966273     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuron.2010.03.025     Document Type: Article

References (85)

1. Alexander G.E., DeLong M.R., Strick P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 1986, 9:357-381.
2. Asaad W.F., Rainer G., Miller E.K. Neural activity in the primate prefrontal cortex during associative learning. Neuron 1998, 21:1399-1407.
3. Badre D. Cognitive control, hierarchy, and the rostro-caudal organization of the frontal lobes. Trends Cogn. Sci. 2008, 12:193-200.
4. Badre D., D'Esposito M. Functional magnetic resonance imaging evidence for a hierarchical organization of the prefrontal cortex. J. Cogn. Neurosci. 2007, 19:2082-2099.
5. Badre D., Wagner A.D. Selection, integration, and conflict monitoring; assessing the nature and generality of prefrontal cognitive control mechanisms. Neuron 2004, 41:473-487.
6. Badre D., Wagner A.D. Computational and neurobiological mechanisms underlying cognitive flexibility. Proc. Natl. Acad. Sci. USA 2006, 103:7186-7191.
7. Badre D., Hoffman J., Cooney J.W., D'Esposito M. Hierarchical cognitive control deficits following damage to the human frontal lobe. Nat. Neurosci. 2009, 12:515-522.
8. Boettiger C.A., D'Esposito M. Frontal networks for learning and executing arbitrary stimulus-response associations. J. Neurosci. 2005, 25:2723-2732.
9. Botvinick M.M. Multilevel structure in behaviour and in the brain: A model of Fuster's hierarchy. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2007, 362:1615-1626.
10. Botvinick M.M. Hierarchical models of behavior and prefrontal function. Trends Cogn. Sci. 2008, 12:201-208.
11. Botvinick M., Plaut D.C. Doing without schema hierarchies: a recurrent connectionist approach to normal and impaired routine sequential action. Psychol. Rev. 2004, 111:395-429.
12. Botvinick M.M., Cohen J.D., Carter C.S. Conflict monitoring and anterior cingulate cortex: an update. Trends Cogn. Sci. 2004, 8:539-546.
13. Brasted P.J., Wise S.P. Comparison of learning-related neuronal activity in the dorsal premotor cortex and striatum. Eur. J. Neurosci. 2004, 19:721-740.
14. Braver T.S., Reynolds J.R., Donaldson D.I. Neural mechanisms of transient and sustained cognitive control during task switching. Neuron 2003, 39:713-726.
15. Buckner R.L. Functional-anatomic correlates of control processes in memory. J. Neurosci. 2003, 23:3999-4004.
16. Bunge S.A. How we use rules to select actions: A review of evidence from cognitive neuroscience. Cogn. Affect. Behav. Neurosci. 2004, 4:564-579.
17. Bunge S.A., Zelazo P.D. A brain-based account of the development of rule use in childhood. Current Directions in Psychological Science 2006, 15:118-121.
18. Bussey T.J., Wise S.P., Murray E.A. The role of ventral and orbital prefrontal cortex in conditional visuomotor learning and strategy use in rhesus monkeys (Macaca mulatta). Behav. Neurosci. 2001, 115:971-982.
19. Chase W.G., Simon H.A. The mind's eye in chess. Visual Information Processing 1973, 215-281. Academic Press, New York. W.G. Chase (Ed.).
20. Christoff K., Keramatian K. Abstraction of mental representations: Theoretical considerations and neuroscientific evidence. Perspectives on Rule-Guided Behavior 2007, Oxford University Press, New York. S.A. Bunge, J.D. Wallis (Eds.).
21. Chumbley J.R., Friston K.J. False discovery rate revisited: FDR and topological inference using Gaussian random fields. Neuroimage 2009, 44:62-70.
22. Cohen M.X., Frank M.J. Neurocomputational models of basal ganglia function in learning, memory and choice. Behav. Brain Res. 2009, 199:141-156.
23. Cohen J.D., Dunbar K., McClelland J.L. On the control of automatic processes: A parallel distributed processing account of the Stroop effect. Psychol. Rev. 1990, 97:332-361.
24. Cools R., Clark L., Owen A.M., Robbins T.W. Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. J. Neurosci. 2002, 22:4563-4567.
25. D'Esposito M., Detre J.A., Alsop D.C., Shin R.K., Atlas S., Grossman M. The neural basis of the central executive system of working memory. Nature 1995, 378:279-281.
26. Dale A.M. Optimal experimental design for event-related fMRI. Hum. Brain Mapp. 1999, 8:109-114.
27. Dale A.M., Fischl B., Sereno M.I. Cortical surface-based analysis. I. Segmentation and surface reconstruction. Neuroimage 1999, 9:179-194.
28. Daw N.D., Niv Y., Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 2005, 8:1704-1711.
29. Dayan P., Balleine B.W. Reward, motivation, and reinforcement learning. Neuron 2002, 36:285-298.
30. di Pellegrino G., Wise S.P. Visuospatial versus visuomotor activity in the premotor and prefrontal cortex of a primate. J. Neurosci. 1993, 13:1227-1243.
31. Duncan J. An adaptive coding model of neural function in prefrontal cortex. Nat. Rev. Neurosci. 2001, 2:820-829.
32. Estes W.K. An associative basis for coding and organization in memory. Coding Processes in Human Memory 1972, 161-190. V. H. Winston & Sons, Washington, D.C. A.W. Melton, E. Martin (Eds.).
33. Fischl B., Sereno M.I., Dale A.M. Cortical surface-based analysis. II: Inflation, flattening, and a surface-based coordinate system. Neuroimage 1999, 9:195-207.
34. Frank M.J., Claus E.D. Anatomy of a decision: Striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol. Rev. 2006, 113:300-326.
35. Frank M.J., Seeberger L.C., O'Reilly R. By carrot or by stick: Cognitive reinforcement learning in parkinsonism. Science 2004, 306:1940-1943.
36. Fujii N., Graybiel A.M. Time-varying covariance of neural activities recorded in striatum and frontal cortex as monkeys perform sequential-saccade tasks. Proc. Natl. Acad. Sci. USA 2005, 102:9032-9037.
37. Gick M.L., Holyoak K.J. Schema induction and analogical transfer. Cognitive Psychology 1983, 15:1-38.
38. Goebel R., Roebroeck A., Kim D.S., Formisano E. Investigating directed cortical interactions in time-resolved fMRI data using vector autoregressive modeling and Granger causality mapping. Magn. Reson. Imaging 2003, 21:1251-1261.
39. Grahn J.A., Parkinson J.A., Owen A.M. The cognitive functions of the caudate nucleus. Prog. Neurobiol. 2008, 86:141-155.
40. Grahn J.A., Parkinson J.A., Owen A.M. The role of the basal ganglia in learning and memory: Neuropsychological studies. Behav. Brain Res. 2009, 199:53-60.
41. Graybiel A.M. The basal ganglia and chunking of action repertoires. Neurobiol. Learn. Mem. 1998, 70:119-136.
42. Greeno J.G., Simon H.A. Processes for sequence production. Psychological Review 1974, 81:187-197.
43. Hadj-Bouziane F., Meunier M., Boussaoud D. Conditional visuo-motor learning in primates: a key role for the basal ganglia. J. Physiol. (Paris) 2003, 97:567-579.
44. Hazy T.E., Frank M.J., O'reilly R.C. Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2007, 362:1601-1613.
45. Hoshi E., Tanji J. Differential involvement of neurons in the dorsal and ventral premotor cortex during processing of visual signals for action planning. J. Neurophysiol. 2006, 95:3596-3616.
46. Hoshi E., Tanji J. Distinctions between dorsal and ventral premotor areas: Anatomical connectivity and functional properties. Curr. Opin. Neurobiol. 2007, 17:234-242.
47. Houk J.C., Wise S.P. Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. Cereb. Cortex 1995, 5:95-110.
48. Kayser A.S., Sun F.T., D'Esposito M. A comparison of Granger causality and coherency in fMRI-based analysis of the motor system. Hum. Brain Mapp. 2009, 30:3475-3494.
49. Koechlin E., Jubault T. Broca's area and the hierarchical organization of human behavior. Neuron 2006, 50:963-974.
50. Koechlin E., Summerfield C. An information theoretical approach to prefrontal executive function. Trends Cogn. Sci. 2007, 11:229-235.
51. Koechlin E., Ody C., Kouneiher F. The architecture of cognitive control in the human prefrontal cortex. Science 2003, 302:1181-1185.
52. Lashley K.S. The problem of serial order in behavior. Cerebral Mechanisms in Behavior 1951, 112-136. Wiley, New York. L.A. Jeffress (Ed.).
53. Loh M., Pasupathy A., Miller E.K., Deco G. Neurodynamics of the prefrontal cortex during conditional visuomotor associations. J. Cogn. Neurosci. 2008, 20:421-431.
54. Lucchetti C., Bon L. Time-modulated neuronal activity in the premotor cortex of macaque monkeys. Exp. Brain Res. 2001, 141:254-260.
55. Miller E.K., Cohen J.D. An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 2001, 24:167-202.
56. Miller G.A., Galanter E., Pribram K.H. Plans and the Structure of Behavior 1960, Holt, Rinehart and Winston, Inc., New York.
57. Mitz A.R., Godschalk M., Wise S.P. Learning-dependent neuronal activity in the premotor cortex: activity during the acquisition of conditional motor associations. J. Neurosci. 1991, 11:1855-1872.
58. Murray E.A., Bussey T.J., Wise S.P. Role of prefrontal cortex in a network for arbitrary visuomotor mapping. Exp. Brain Res. 2000, 133:114-129.
59. Newell A. Unified Theories of Cognition 1990, Harvard University Press, Cambridge, MA.
60. O'Reilly R.C., Frank M.J. Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput. 2006, 18:283-328.
61. O'Reilly R.C., Frank M.J., Hazy T.E., Watz B. PVLV: The primary value and learned value Pavlovian learning algorithm. Behav. Neurosci. 2007, 121:31-49.
62. Packard M.G., Knowlton B.J. Learning and memory functions of the Basal Ganglia. Annu. Rev. Neurosci. 2002, 25:563-593.
63. Paine R.W., Tani J. How hierarchical control self-organizes in artificial adaptive systems. Adaptive Behavior 2005, 13:211-225.
64. Passingham R.E. Premotor cortex and preparation for movement. Exp. Brain Res. 1988, 70:590-596.
65. Passingham R.E. Premotor cortex and the retrieval of movement. Brain Behav. Evol. 1989, 33:189-192.
66. Passingham R.E. The Frontal Lobes and Voluntary Action 1993, Oxford University Press, Oxford, UK.
67. Pasupathy A., Miller E.K. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 2005, 433:873-876.
68. Petrides M. Deficits in non-spatial conditional associative learning after periarcuate lesions in the monkey. Behav. Brain Res. 1985, 16:95-101.
69. Petrides M. Deficits on conditional associative-learning tasks after frontal- and temporal-lobe lesions in man. Neuropsychologia 1985, 23:601-614.
70. Petrides M. Conditional learning and the primate frontal cortex. The Frontal Lobes Revisited 1987, 91-108. IRBN Press, New York. E. Perecman (Ed.).
71. Petrides M. Lateral prefrontal cortex: architectonic and functional organization. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2005, 360:781-795.
72. Petrides M. The rostro-caudal axis of cognitive control processing within lateral frontal cortex. From Monkey Brain to Human Brain: A Fyssen Foundation Symposium 2006, 293-314. MIT Press, Cambridge, MA. S. Dehaene, J.-R. Duhamel, M.D. Hauser, G. Rizzolatti (Eds.).
73. Race E.A., Shanker S., Wagner A.D. Neural priming in human frontal cortex: Multiple forms of learning reduce demands on the prefrontal executive system. J Cogn Neurosci. 2008, 21:1766-1781.
74. Roebroeck A., Formisano E., Goebel R. Mapping directed influence over the brain using Granger causality and fMRI. Neuroimage 2005, 25:230-242.
75. Schönberg T., Daw N.D., Joel D., O'Doherty J.P. Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J. Neurosci. 2007, 27:12860-12867.
76. Seger C.A. How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feedback. Neurosci. Biobehav. Rev. 2008, 32:265-278.
77. Seger C.A., Cincotta C.M. The roles of the caudate nucleus in human classification learning. J. Neurosci. 2005, 25:2941-2951.
78. Seger C.A., Cincotta C.M. Dynamics of frontal, striatal, and hippocampal systems during rule learning. Cereb. Cortex 2006, 16:1546-1555.
79. Smith A.C., Frank L.M., Wirth S., Yanike M., Hu D., Kubota Y., Graybiel A.M., Suzuki W.A., Brown E.N. Dynamic analysis of learning in behavioral experiments. J. Neurosci. 2004, 24:447-461.
80. Stuss D.T., Benson D.F. The frontal lobes and control of cognition and memory. The Frontal Lobes Revisited 1987, 141-158. The IRBN Press, New York. E. Perecman (Ed.).
81. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction 1998, MIT Press, Cambridge, MA.
82. Toni I., Krams M., Turner R., Passingham R.E. The time course of changes during motor sequence learning: a whole-brain fMRI study. Neuroimage 1998, 8:50-61.
83. Tremblay L., Hollerman J.R., Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate striatum. J. Neurophysiol. 1998, 80:964-977.
84. Wallis J.D., Anderson K.C., Miller E.K. Single neurons in prefrontal cortex encode abstract rules. Nature 2001, 411:953-956.
85. White I.M., Wise S.P. Rule-dependent neuronal activity in the prefrontal cortex. Exp. Brain Res. 1999, 126:315-335.