Multilevel structure in behaviour and in the brain: A model of Fuster's hierarchy

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 362, Issue 1485, 2007, Pages 1615-1626

  Botvinick, Matthew M ^a  

^a PRINCETON UNIVERSITY   (United States)

Author keywords

Neural networks; Prefrontal cortex; Sequential action

Indexed keywords

BRAIN; DECISION MAKING; ENVIRONMENTAL CUE; NEUROLOGY; SIMULATION;

EID: 34548580806     PISSN: 09628436     EISSN: None     Source Type: Journal    
DOI: 10.1098/rstb.2007.2056     Document Type: Article

References (65)

1. Agre, P. E. 1988 The dynamic structure of everyday life (Tech. Rep. No. 1085). Cambridge, MA: Massachusetts Institute of Technology, Artificial Intelligence Laboratory.
2. Aldridge, J. W. & Berridge, K. C. 1998 Coding of serial order by neostriatal neurons: a 'natural action' approach to movement sequence. J. Neurosci. 18, 2777-2787.
3. Botvinick, M. & Bylsma, L. M. 2005 Distraction and action slips in an everyday task: evidence for a dynamic representation of task context. Psychon. Bull. Rev. 12, 1011-1017.
4. Botvinick, M. & Plaut, D. C. 2002 Representing task context: proposals based on a connectionist model of action. Psychol. Res. 66, 298-311. (doi:10.1007/s00426-002-0103-8)
5. Botvinick, M. & Plaut, D. C. 2004 Doing without schema hierarchies: a recurrent connectionist approach to normal and impaired routine sequential action. Psychol. Rev. 111, 395-429. (doi:10.1037/0033-295X.111.2. 395)
6. Botvinick, M. & Plaut, D. C. 2006a Such stuff as habits are made on: a reply to Cooper and Shallice (2006). Psychol. Rev. 113, 917-928. (doi:10.1037/0033-295X.113.4.917)
7. Botvinick, M. & Plaut, D. C. 2006b Short-term memory for serial order: a recurrent neural network model. Psychol. Rev. 113, 201-233. (doi:10.1037/0033-295X.113.2.201)
8. Cleeremans, A. 1993 Mechanisms of implicit learning: connectionist models of sequence processing. Cambridge, MA: MIT Press.
9. Cooper, R. P. 2003 Mechanisms for the generation and regulation of sequential behaviour. Philos. Psychol. 16, 389-416. (doi:10.1080/0951508032000121779)
10. Cooper, R. P. In press. Tool use and related errors in Ideational Apraxia: the quantitative simulation of patient error profiles. Cortex.
11. Cooper, R. P. & Shallice, T. 2000 Contention scheduling and the control of routine activities. Cogn. Neuropsychol. 22, 959-1004. (doi:10.1080/02643290442000419)
12. Cooper, R. P. & Shallice, T. 2006 Hierarchical schemas and goals in the control of sequential behaviour. Psychol. Rev. 113, 887-916. (doi:10.1037/0033-295X.113.4.887)
13. Cooper, R. P., Schwartz, M. F., Yule, P. G. & Shallice, T. 2005 The simulation of action disorganization in complex activities of daily living. Cogn. Neuropsychol. 22, 959-1004. (doi:10.1080/02643290442000419)
14. Courtney, S. M. 2004 Attention and cognitive control as emergent properties of information representation in working memory. Cogn. Affect. Behav. Neurosci. 4, 501-516.
15. Durstewitz, D., Seamans, J. K. & Sejnowski, T. J. 2000 Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. J. Neurophysiol. 83, 1733-1750.
16. Elman, G. 1990 Finding structure in time. Cogn. Sci. 14, 179-211. (doi:10.1016/0364-0213(90)90002-E)
17. Estes, W. K. 1972 An associative basis for coding and organization in memory. In Coding processes in human memory (eds A. W. Melton & E. Martin), pp. 161-190. Washington, DC: V.H. Winston & Sons.
18. Fuster, J. M. 1990 Prefrontal cortex and the bridging of temporal gaps in the perception-action cycle. Ann. NY Acad. Sci. 608, 318-329. (doi:10.1111/j.1749-6632.1990. tb48901.x)
19. Fuster, J. M. 1997 The prefrontal cortex: anatomy, physiology, and neuropsychology of the frontal lobe. Philadelphia, PA: Lippincott-Raven.
20. Fuster, J. M. 2001 The prefrontal cortex - an update: time is of the essence. Neuron 30, 319-333. (doi:10.1016/S0896-6273(01)00285-9)
21. Fuster, J. M. 2004 Upper processing stages of the perception-action cycle. Trends Cogn. Sci. 8, 143-145. (doi:10.1016/ j.tics.2004.02.004)
22. Grafman, J. 1995 Similarities and distinctions among current models of prefrontal cortical functions. In Structure and functions of the human prefrontal cortex (eds J. Grafman, K. J. Holyoak & F. Boiler), pp. 337-368. New York, NY: New York Academy of Sciences.
23. Grafman, J. 2002 The human prefrontal cortex has evolved to represent components of structured event complexes. In Handbook of neuropsychology (ed. J. Grafman). Amsterdam, The Netherlands: Elsevier.
24. Grossberg, S. 1986a The adaptive self-organization of serial order in behaviour. In Pattern recognition by humans and machines, vol. 1 (eds E. C. Schwab & H. C. Nusbaum) Speech perception, pp. 187-294. New York, NY: Academic Press.
25. Grossberg, S. 1986b The adaptive self-organization of serial order in behaviour: speech, language, and motor control. In Pattern recognition by humans and machines, vol. 1 (eds E. C. Schwab & H. C. Nusbaum) Speech perception, pp. 187-294. New York, NY: Academic Press.
26. Haber, S. N., Fudge, J. L. & McFarland, N. R. 2000 Striatonigral pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J. Neurosci. 20, 2369-2382.
27. Hazy, T. E., Frank, M. J. & O'Reilly, R. C. 2006 Banishing the homunculus: making working memory work. Neuroscience 139, 105-118.
28. Hinton, G. E., McClelland, J. L. & Rumelhart, D. E. 1986 Distributed representations. In Parallel distributed processing: explorations in the microstructure of cognition (eds D. E. Rumelhart & J. L. McClelland). Cambridge, MA: MIT Press.
29. Houghton, G. 1990 The problem of serial order: a neural network model of sequence learning and recall. In Current research in natural language generation (eds R. Dale, C. Nellish & M. Zock), pp. 287-318. San Diego, CA: Academic Press.
30. Houghton, G. & Hartley, T. 1995 Parallel models of serial behaviour: Lashley revisited. Psyche 2.
31. Houk, J. C. & Wise, S. P. 1995 Distributed modular architecture linking basal ganglia, cerebellum and cerebral cortex: its role in planning and controlling action. Cereb. Cortex 5, 95-110. (doi:10.1093/cercor/ 5.2.95)
32. Humphreys, G. W. & Forde, E. M. E. 1998 Disordered action schemas and action disorganization syndrome. Cogn. Neuropsychol. 15, 802.
33. Humphreys, G. W., Forde, E. M. E. & Francis, D. 2000 The organization of sequential actions. In Attention and performance XVIII (eds S. Monsell & J. Driver), pp. 425-472. Cambridge, MA: MIT Press.
34. Joel, D. & Weiner, I. 1994 The organization of the basal ganglia-thalamocortical circuits: open interconnected rather than closed segregated. Neuroscience 63, 363-379. (doi:10.1016/0306-4522(94) 90536-3)
35. Koechlin, E., Ody, C. & Kouneiher, F. 2003 The architecture of cognitive control in the human prefrontal cortex. Science 302, 1181-1185. (doi:10.1126/science.1088545)
36. Kruskal, J. B. & Wish, M. 1978 Multidimensional scaling. Beverly Hills, CA: Sage Publications.
37. Lashley, K. S. 1951 The problem of serial order in behaviour. In Cerebral mechanisms in behaviour: the Hixon symposium (ed. L. A. Jeffress), pp. 112-136. New York, NY: Wiley.
38. Lisman, J. E., Fellous, J.-M. & Wang, X.-J. 1998 A role for NMDA-receptor channels in working memory. Nat. Neurosci. 1, 273-275. (doi:10.1038/1086)
39. Middleton, F. A. & Strick, P. L. 2000 Basal ganglia and cerebellar loops: motor and cognitive circuits. Brain Res. Rev. 31, 236-250. (doi:10.1016/S0165-0173(99)00040-5)
40. Miller, E. K. & Cohen, J. D. 2001 An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 24, 167-202. (doi:10.1146/annurev.neuro.24.1.167)
41. Moody, S. L., Wise, S. P., di Pellegrino, G. & Zipser, D. 1998 A model that accounts for activity in primate frontal cortex during a delayed matching-to-sample task. J. Neurosci. 18, 399-410.
42. Norman, D. A. 1981 Categorization of action slips. Psychol. Rev. 88, 1-14. (doi:10.1037/0033-295X.88.1.1)
43. Norman, D. A. & Shallice, T. 1986 Attention to action: willed and automatic control of behaviour. In Consciousness and self-regulation: advances in research and theory (eds R. J. Davidson, G. E. Schwartz & D. Shapiro). New York, NY: Plenum Press.
44. O'Reilly, R. C. & Frank, M. J. 2006 Making working memory work: a computational model of learning in prefrontal cortex and basal ganglia. Neural Comput. 18, 283-328. (doi:10.1162/089976606775093909)
45. O'Reilly, R. C. & Munakata, Y. 2000a Computational explorations in cognitive neuroscience. Cambridge, MA: MIT Press.
46. O'Reilly, R. C. & Munakata, Y. 20006 Computational explorations in cognitive neuroscience: understanding the mind by simulating the brain. Cambridge, MA: MIT Press.
47. O'Reilly, R. C., Braver, T. S. & Cohen, J. D. 1999 A biologically-based computational model of working memory. In Models of working memory: mechanisms of active maintenance and executive control (eds A. Miyake & P. Shah), pp. 375-411. New York, NY: Cambridge University Press.
48. Paine, R. W. & Tani, J. 2005 How hierarchical control self-organizes in artificial adaptive systems. Adapt. Behav. 13, 211-225. (doi:10.1177/105971230501300303)
49. Reason, J. T. 1990 Human error. Cambridge, UK: Cambridge University Press.
50. Redgrave, P., Prescott, T. & Gurney, K. N. 1999 The basal ganglia: a vertebrate solution to the selection problem? Neuroscience 89, 1009-1023. (doi:10.1016/S0306-4522(98) 00319-4)
51. Rumelhart, D. & Norman, D. A. 1982 Simulating a skilled typist: a study of skilled cognitive-motor performance. Cogn. Sci. 6, 1-36. (doi:10.1016/S0364-0213(82)80004-9)
52. Salinas, E. 2004 Fast remapping of sensory stimuli onto motor actions on the basis of contextual modulation. J. Neurosci. 24, 1113-1118. (doi:10.1523/JNEUROSCI. 4569-03.2004)
53. Schank, R. C. & Abelson, R. P. 1977 Scripts, plans, goals and understanding. Hillsdale, NJ: Erlbaum.
54. Schwartz, M. F., Montgomery, M. W., Buxbaum, L. F., Lee, S. S., Carew, T. G. & Coslett, H. B. 1998 Naturalistic action impairment in closed head injury. Neuropsychology 12, 13-28. (doi:10.1037/0894-4105.12.1.13)
55. Servan-Schreiber, D., Cleeremans, A. & McClelland, J. L. 1991 Graded-state machines: the representation of temporal contingencies in simple recurrent networks. Mach. Learn. 7, 161-193.
56. Seth, A. 2007 The ecology of action selection: insights from artificial life. Phil. Trans. R. Soc. B 362, 1545-1558. (doi: 10.1098/rstb.2007.2052)
57. Sirigu, A., Zalla, T., Pillon, B., Dubois, B., Grafman, J. & Agid, Y. 1995 Selective impairments in managerial knowledge in patients with pre-frontal cortex lesions. Cortex 31, 301-316.
58. Tanji, J. 2001 Sequential organization of multiple movements: involvement of cortical motor areas. Annu. Rev. Neurosci. 24, 631-651. (doi:10.1146/annurev. neuro.24.1.631)
59. Tyrrell, T. 1993 The use of hierarchies for action selection. Adapt. Behav. 1, 387-420.
60. Williams, R. J. & Zipser, D. 1995 Gradient-based learning algorithms for recurrent neural networks and their computational complexity. In Backpropagation: theory, architectures and applications (eds Y. Chauvin & D. E. Rumelhart), pp. 433-486. Hillsdale, NJ: Erlbaum.
61. Xiaohui, X. & Seung, S. 2003 Equivalence of backpropagation and contrastive Hebbian learning in a layered network. Neural Comput. 15, 441-454. (doi:10.1162/ 089976603762552988)
62. Zalla, T., Pradat-Diehl, P. & Sirigu, A. 2003 Perception of action boundaries in patients with frontal lobe damage. Neuropsychologia 41, 1619-1627. (doi:10.1016/S0028-3932(03)00098-8)
63. Zipser, D. 1991 Recurrent network model of the neural mechanism of short-term active memory. Neural Comput. 3, 179-193.
64. Zipser, D. & Anderson, R. A. 1988 A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons. Nature 331, 679-684. (doi:10.1038/331679a0)
65. Zipser, D., Kehoe, B., Littlewort, G. & Fuster, J. 1993 A spiking network model of short-term active memory. J. Neurosci. 13, 3406-3420.