Conditional Routing of Information to the Cortex: A Model of the Basal Ganglia's Role in Cognitive Coordination

Psychological Review

Volumn 117, Issue 2, 2010, Pages 541-574

  Stocco, Andrea ^a   Lebiere, Christian ^a   Anderson, John R ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

basal ganglia; computational modeling; neural networks; procedural learning

Indexed keywords

DOPAMINE;

ARTICLE; AUTOMATISM; BASAL GANGLION; BRAIN CORTEX; COGNITION; CONDITIONING; HUMAN; HUNTINGTON CHOREA; LEARNING; NERVE CELL NETWORK; PARKINSON DISEASE; PATHOPHYSIOLOGY; PHYSIOLOGY;

AUTOMATISM; BASAL GANGLIA; CEREBRAL CORTEX; COGNITION; CONDITIONING (PSYCHOLOGY); DOPAMINE; HUMANS; HUNTINGTON DISEASE; LEARNING; NERVE NET; PARKINSON DISEASE;

EID: 77953152738     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0019077     Document Type: Article

References (233)

1. Ajjanagadde V., and Shastri L. Rules and variables in neural nets. Neural Computation 3 (1991) 121-134
2. Albin R.L., Reiner A., Anderson K.D., Dure L.S.T., Handelin B., Balfour R., and Young A.B. Preferential loss of striato-external pallidal projection neurons in presymptomatic Huntington's disease. Annals of Neurology 31 (1992) 425-430
3. Albin R.L., Young A.B., and Penney J.B. The functional anatomy of basal ganglia disorders. Trends in Neurosciences 12 (1989) 366-375
4. Alexander G.E., DeLong M.R., and Strick P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience 9 (1986) 357-381
5. Amit D.J. Modeling brain function (1993), Cambridge University Press, New York, NY
6. Amos A. A computational model of information processing in the frontal cortex and basal ganglia. Journal of Cognitive Neuroscience 12 (2000) 505-519
7. Anderson J.R. The architecture of cognition (1983), Erlbaum, Mahwah, NJ
8. Anderson J.R. Human symbol manipulation within an integrated cognitive architecture. Cognitive Science 29 (2005) 313-341
9. Anderson J.R. How can the human mind occur in the physical universe?. 1st ed. (2007), Oxford University Press, New York, NY
10. Anderson J.R., Albert M.V., and Fincham J.M. Tracing problem solving in real time: fMRI analysis of the subject-paced Tower of Hanoi. Journal of Cognitive Neuroscience 17 (2005) 1261-1274
11. Anderson J.R., Fincham J.M., Qin Y., and Stocco A. A central circuit of the mind. Trends in Cognitive Sciences 12 (2008) 136-143
12. Anderson J.R., Taatgen N.A., and Byrne M.D. Learning to achieve perfect timesharing: Architectural implications of Hazeltine, Teague, and Ivry (2002). Journal of Experimental Psychology: Human Perception and Performance 31 (2005) 749-761
13. Apicella P. Tonically active neurons in the primate striatum and their role in the processing of information about motivationally relevant events. European Journal of Neuroscience 16 (2002) 2017-2026
14. Apicella P. Leading tonically active neurons of the striatum from reward detection to context recognition. Trends in Neurosciences 30 (2007) 299-306
15. Arbib M.A. Towards a neurally-inspired computer architecture. Natural Computing 2 (2003) 1-46
16. Ashby F.G., Ell S.W., Valentin V.V., and Casale M.B. FROST: A distributed neurocomputational model of working memory maintenance. Journal of Cognitive Neuroscience 17 (2005) 1728-1743
17. Ashby F.G., Ennis J.M., and Spiering B.J. A neurobiological theory of automaticity in perceptual categorization. Psychological Review 114 (2007) 632-656
18. Atallah H.E., Frank M.J., and O'Reilly R.C. Hippocampus, cortex, and basal ganglia: Insights from computational models of complementary learning systems. Neurobiology of Learning and Memory 82 (2004) 253-267
19. Bar-Gad I., Havazelet-Heimer G., Goldberg J.A., Ruppin E., and Bergman H. Reinforcement-driven dimensionality reduction-A model for information processing in the basal ganglia. Journal of Basic and Clinical Physiology and Pharmacology 11 (2000) 305-320
20. Barto A.G. Adaptive critics and the basal ganglia. In: Houk J.C., Davis J.L., and Beiser D.G. (Eds). Models of information processing in the basal ganglia (1995), MIT Press, Cambridge, MA 215-232
21. Beiser D.G., and Houk J.C. Model of cortical-basal ganglionic processing: Encoding the serial order of sensory events. Journal of Neurophysiology 79 (1998) 3168-3188
22. Berns G., and Sejnowski T.J. A computational model of how the basal ganglia produce sequences. Journal of Cognitive Neuroscience 10 (1998) 108-121
23. Bevan M.D., Booth P.A., Eaton S.A., and Bolam J.P. Selective innervation of neostriatal interneurons by a subclass of neuron in the globus pallidus of the rat. Journal of Neuroscience 18 (1998) 9438-9452
24. Bevan M.D., and Wilson C.J. Mechanisms underlying spontaneous oscillation and rhythmic firing in rat subthalamic neurons. Journal of Neuroscience 19 (1999) 7617-7628
25. Bienenstock E.L., Cooper L.N., and Munro P.W. Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visual cortex. Journal of Neuroscience 2 (1982) 32-48
26. Bolam J.P., Hanley J.J., Booth P.A., and Bevan M.D. Synaptic organisation of the basal ganglia. Journal of Anatomy 196 (2000) 527-542
27. Braitenberg V., and Schüz A. Anatomy of the cortex: Statistics and geometry (1991), Springer Verlag, Heidelberg, Germany
28. Braver T.S., Cohen J.D., Nystrom L.E., Jonides J., Smith E.E., and Noll D.C. A parametric study of prefrontal cortex involvement in human working memory. NeuroImage 5 (1997) 49-62
29. Brown J., Bullock D., and Grossberg S. How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. Journal of Neuroscience 19 (1999) 10502-10511
30. Brown L.L., Schneider J.S., and Lidsky T.I. Sensory and cognitive functions of the basal ganglia. Current Opinion in Neurobiology 7 (1997) 157-163
31. Brown T.H., Kairiss E.W., and Keenan C.L. Hebbian synapses: Biophysical mechanisms and algorithms. Annual Review of Neuroscience 13 (1990) 475-511
32. Bruno R.M., and Sakmann B. Cortex is driven by weak but synchronously active thalamocortical synapses. Science 312 (2006, June 16) 1622-1627
33. Calabresi P., Gubellini P., Centonze D., Picconi B., Bernardi G., Chergui K., and Greengard P. Dopamine and cAMP-regulated phosphoprotein 32 kDa controls both striatal long-term depression and long-term potentiation, opposing forms of synaptic plasticity. Journal of Neuroscience 20 (2000) 8443-8451
34. Carelli R.M., Wolske M., and West M.O. Loss of lever press-related firing of rat striatal forelimb neurons after repeated sessions in a lever pressing task. Journal of Neuroscience 17 (1997) 1804-1814
35. Carman J.B., Cowan W.M., and Powell T.P. The organization of cortico-striate connexions in the rabbit. Brain 86 (1963) 525-562
36. Chein J.M., and Schneider W. Neuroimaging studies of practice-related change: fMRI and meta-analytic evidence of a domain-general control network for learning. Cognitive Brain Research 25 (2005) 607-623
37. Chesselet M.F., and Delfs J.M. Basal ganglia and movement disorders: An update. Trends in Neurosciences 19 (1996) 417-422
38. Chevalier G., and Deniau J.M. Disinhibition as a basic process in the expression of striatal functions. Trends in Neurosciences 13 (1990) 277-280
39. Clower D.M., Dum R.P., and Strick P.L. Basal ganglia and cerebellar inputs to 'AIP.'. Cerebral Cortex 15 (2005) 913-920
40. Cohen N.J., and Squire L.R. Preserved learning and retention of pattern-analyzing skill in amnesia: Dissociation of knowing how and knowing that. Science 210 (1980, October 10) 207-210
41. Contreras-Vidal J.L., and Schultz W. A predictive reinforcement model of dopamine neurons for learning approach behavior. Journal of Computational Neuroscience 6 (1999) 191-214
42. Cooper J.A., Sagar H.J., Doherty S.M., Jordan N., Tidswell P., and Sullivan E.V. Different effects of dopaminergic and anticholinergic therapies on cognitive and motor function in Parkinson's disease: A follow-up study of untreated patients. Brain 115 (1992) 1701-1725
43. Dagher A., Owen A.M., Boecker H., and Brooks D.J. The role of the striatum and hippocampus in planning: A PET activation study in Parkinson's disease. Brain 124 (2001) 1020-1032
44. Danker J.F., Gunn P., and Anderson J.R. A rational account of memory predicts left prefrontal activation during controlled retrieval. Cerebral Cortex 18 (2008) 2674-2685
45. Dayan P., and Abbott L.F. Theoretical neuroscience: Computational and mathematical modeling of neural systems (2001), MIT Press, Cambridge, MA
46. DeLong M.R. Primate models of movement disorders of basal ganglia origin. Trends in Neurosciences 13 (1990) 281-285
47. Destrebecqz A., and Cleeremans A. Can sequence learning be implicit? New evidence with the process dissociation procedure. Psychonomic Bulletin & Review 8 (2001) 343-350
48. Dominey P., Arbib M.A., and Joseph J. A model of corticostriatal plasticity for learning oculomotor associations and sequences. Journal of Cognitive Neuroscience 7 (1995) 311-336
49. Doyon J., Owen A.M., Petrides M., Sziklas V., and Evans A.C. Functional anatomy of visuomotor skill learning in human subjects examined with positron emission tomography. European Journal of Neuroscience 8 (1996) 637-648
50. Faure A., Haberland U., Conde F., and El Massioui N. Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. Journal of Neuroscience 25 (2005) 2771-2780
51. Fernandez-Ruiz J., Wang J., Aigner T.G., and Mishkin M. Visual habit formation in monkeys with neurotoxic lesions of the ventrocaudal neostriatum. Proceedings of the National Academy of Sciences, USA 98 (2001) 4196-4201
52. Fiorillo C.D., Tobler P.N., and Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299 (2003, March 21) 1898-1902
53. Frank M.J., and Claus E.D. Anatomy of a decision: Striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychological Review 113 (2006) 300-326
54. Frank M.J., Loughry B., and O'Reilly R.C. Interactions between frontal cortex and basal ganglia in working memory: A computational model. Cognitive, Affective & Behavioral Neuroscience 1 (2001) 137-160
55. Frank M.J., Samanta J., Moustafa A.A., and Sherman S.J. Hold your horses: Impulsivity, deep brain stimulation, and medication in Parkinsonism. Science 318 (2007, October 25) 1309-1312
56. Frank M.J., Seeberger L.C., and O'Reilly R.C. By carrot or by stick: Cognitive reinforcement learning in Parkinsonism. Science 306 (2004, December 10) 1940-1943
57. Gabrieli J.D.E. Cognitive neuroscience of human memory. Annual Review of Psychology 49 (1998) 87-115
58. Gabrieli J.D.E., Singh J., Stebbins G.T., and Goetz C.G. Reduced working memory span in Parkinson's disease: Evidence for the role of a frontostriatal system in working and strategic memory. Neuropsychology 10 (1996) 322-332
59. Gerfen C.R. The neostriatal mosaic: Compartmentalization of corticostriatal input and striatonigral output systems. Nature 311 (1984, October 4) 461-464
60. Gerfen C.R. The neostriatal mosaic: Multiple levels of compartmental organization in the basal ganglia. Annual Review of Neuroscience 15 (1992) 285-320
61. Gerfen C.R., Baimbridge K.G., and Miller J.J. The neostriatal mosaic: Compartmental distribution of calcium-binding protein and parvalbumin in the basal ganglia of the rat and monkey. Proceedings of the National Academy of Sciences, USA 82 (1985) 8780-8784
62. Gerfen C.R., Engber T.M., Mahan L.C., Susel Z., Chase T.N., Monsma Jr. F.J., and Sibley J.R. D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons. Science 250 (1990, December 7) 1429-1432
63. Gerfen C.R., Staines W.A., Arbuthnott G.W., and Fibiger H.C. Crossed connections of the substantia nigra in the rat. Journal of Comparative Neurology 207 (1982) 283-303
64. Gerstner W., and Kistler W.M. Mathematical formulations of Hebbian learning. Biological Cybernetics 87 (2002) 404-415
65. Gillies A., and Arbuthnott G.W. Computational models of the basal ganglia. Movement Disorders 15 (2000) 762-770
66. Glass M., Dragunow M., and Faull R.L. The pattern of neurodegeneration in Huntington's disease: A comparative study of cannabinoid, dopamine, adenosine and GABA(A) receptor alterations in the human basal ganglia in Huntington's disease. Neuroscience 97 (2000) 505-519
67. Gluck M.A., and Bower G.H. From conditioning to category learning: An adaptive network model. Journal of Experimental Psychology: General 117 (1988) 227-247
68. Gluck M.A., Shohamy D., and Myers C. How do people solve the "weather prediction" task? Individual variability in strategies for probabilistic category learning. Learning & Memory 9 (2002) 408-418
69. Goel V., Buchel C., Frith C., and Dolan R.J. Dissociation of mechanisms underlying syllogistic reasoning. NeuroImage 12 (2000) 504-514
70. Granger R. Engines of the brain: The computational instruction set of human cognition. AI Magazine 27 (2006) 15-31
71. Graveland G.A., Williams R.S., and DiFiglia M. A Golgi study of the human neostriatum: Neurons and afferent fibers. Journal of Comparative Neurology 234 (1985) 317-333
72. Graybiel A.M. The basal ganglia. Current Biology 10 (2000) R509-R511
73. Graybiel A.M. The basal ganglia: Learning new tricks and loving it. Current Opinion in Neurobiology 15 (2005) 638-644
74. Graybiel A.M., and Ragsdale Jr. C.W. Histochemically distinct compartments in the striatum of human, monkeys, and cat demonstrated by acetylthiocholinesterase staining. Proceedings of the National Academy of Sciences, USA 75 (1978) 5723-5726
75. Gurney K., Prescott T.J., and Redgrave P. A computational model of action selection in the basal ganglia: I. A new functional anatomy. Biological Cybernetics 84 (2001) 401-410
76. Haber S.N. The primate basal ganglia: Parallel and integrative networks. Journal of Chemical Neuroanatomy 26 (2003) 317-330
77. Haber S.N., Fudge J.L., and McFarland N.R. Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. Journal of Neuroscience 20 (2000) 2369-2382
78. Hajos M., and Greenfield S.A. Synaptic connections between pars compacta and pars reticulata neurones: Electrophysiological evidence for functional modules within the substantia nigra. Brain Research 660 (1994) 216-224
79. Hattori T., Fibiger H.C., and McGeer P.L. Demonstration of a pallido-nigral projection innervating dopaminergic neurons. Journal of Comparative Neurology 162 (1975) 487-504
80. Hawkins J., and Blakeslee S. On intelligence (2004), Times Books, New York, NY
81. Hazeltine E., Teague D., and Ivry R.B. Simultaneous dual-task performance reveals parallel response selection after practice. Journal of Experimental Psychology: Human Perception and Performance 28 (2002) 527-545
82. Hikosaka O., Rand M.K., Miyachi S., and Miyashita K. Learning of sequential movements in the monkey: Process of learning and retention of memory. Journal of Neurophysiology 74 (1995) 1652-1661
83. Hill N.M., and Schneider W. Brain changes in the development of expertise: Neurological evidence on skill-based adaptations. In: Ericsson K.A., Charness N., Feltovich P., and Hoffman R. (Eds). Cambridge handbook of expertise and expert performance (2006), Cambridge University Press, New York, NY 653-682
84. Hoover J.E., and Strick P.L. Multiple output channels in the basal ganglia. Science 259 (1993, February 5) 819-821
85. Houk J.C. Agents of the mind. Biological Cybernetics 92 (2005) 427-437
86. Houk J.C., Adams J.L., and Barto A.G. A model of how the basal ganglia generate and use signals that predict reinforcement. In: Houk J.C., Davis J.L., and Beiser D.G. (Eds). Models of information processing in the basal ganglia (1995), MIT Press, Cambridge, MA 249-270
87. Hubert V., Beaunieux H., Chetelat G., Platel H., Landeau B., Danion J.M., and Eustache F. The dynamic network subserving the three phases of cognitive procedural learning. Human Brain Mapping 28 (2007) 1415-1429
88. Humphries M.D., Stewart R.D., and Gurney K.N. A physiologically plausible model of action selection and oscillatory activity in the basal ganglia. Journal of Neuroscience 26 (2006) 12921-12942
89. Jackson G.M., Jackson S.R., Harrison J., Henderson L., and Kennard C. Serial reaction time learning and Parkinson's disease: Evidence for a procedural learning deficit. Neuropsychologia 33 (1995) 577-593
90. Jaeger D., Kita H., and Wilson C.J. Surround inhibition among projection neurons is weak or nonexistent in the rat neostriatum. Journal of Neurophysiology 72 (1994) 2555-2558
91. Jankovic J. Parkinson's disease: Clinical features and diagnosis. Journal of Neurology, Neurosurgery & Psychiatry 79 (2008) 368-376
92. Joel D., Niv Y., and Ruppin E. Actor-critic models of the basal ganglia: New anatomical and computational perspectives. Neural Networks 15 (2002) 535-547
93. Joel D., and Weiner I. The organization of the basal ganglia-thalamocortical circuits: Open interconnected rather than closed segregated. Neuroscience 63 (1994) 363-379
94. Joel D., and Weiner I. The connections of the dopaminergic system with the striatum in rats and primates: An analysis with respect to the functional and compartmental organization of the striatum. Neuroscience 96 (2000) 451-474
95. Jog M.S., Kubota Y., Connolly C.I., Hillegaart V., and Graybiel A.M. Building neural representations of habits. Science 286 (1999, November 26) 1745-1749
96. Juraska J.M., Wilson C.J., and Groves P.M. The substantia nigra of the rat: A Golgi study. Journal of Comparative Neurology 172 (1970) 585-600
97. Just M.A., and Carpenter P.A. A capacity theory of comprehension: Individual differences in working memory. Psychological Review 99 (1992) 122-149
98. Just M.A., and Varma S. The organization of thinking: What functional brain imaging reveals about the neuroarchitecture of complex cognition. Cognitive, Affective, & Behavioral Neuroscience 7 (2007) 153-191
99. Kawaguchi Y. Neostriatal cell subtypes and their functional roles. Neurosciences Research 27 (1997) 1-8
100. Kelly R.M., and Strick P.L. Macro-architecture of basal ganglia loops with the cerebral cortex: Use of rabies virus to reveal multisynaptic circuits. Progress in Brain Research 143 (2004) 449-459
101. Kemp J.M., and Powell T.P. The cortico-striate projection in the monkey. Brain 93 (1970) 525-546
102. Kesner R.P., Bolland B.L., and Dakis M. Memory for spatial locations, motor responses, and objects: Triple dissociation among the hippocampus, caudate nucleus, and extrastriate visual cortex. Experimental Brain Research 93 (1993) 462-470
103. Kita H., and Kitai S.T. Glutamate decarboxylase immunoreactive neurons in rat neostriatum: Their morphological types and populations. Brain Research 447 (1988) 346-352
104. Knowlton B.J., Mangels J.A., and Squire L.R. A neostriatal habit learning system in humans. Science 273 (1996, September 6) 1399-1402
105. Knowlton B.J., Squire L.R., and Gluck M.A. Probabilistic classification learning in amnesia. Learning & Memory 1 (1994) 106-120
106. Koos T., and Tepper J.M. Inhibitory control of neostriatal projection neurons by GABAergic interneurons. Nature Neuroscience 2 (1999) 467-472
107. Koos T., and Tepper J.M. Dual cholinergic control of fast-spiking interneurons in the neostriatum. Journal of Neuroscience 22 (2002) 529-535
108. Koos T., Tepper J.M., and Wilson C.J. Comparison of IPSCs evoked by spiny and fast-spiking neurons in the neostriatum. Journal of Neuroscience 24 (2004) 7916-7922
109. Kötter R., and Wickens J. Interactions of glutamate and dopamine in a computational model of the striatum. Journal of Computational Neuroscience 2-3 (1995) 195-214
110. Laird J.E., Newell A., and Rosenbloom P.S. SOAR: An architecture for general intelligence. Artificial Intelligence 33 (1987) 1-64
111. Laird J.E., Rosenbloom P.S., and Newell A. Chunking in SOAR: The anatomy of a general learning mechanism. Machine Learning 1 (1986) 11-46
112. Lawrence A.D., Sahakian B.J., and Robbins T.W. Cognitive functions and corticostriatal circuits: Insights from Huntington's disease. Trends in Cognitive Sciences 2 (1998) 379-388
113. Lebiere C., and Anderson J.R. A connectionist implementation of the ACT-R production system. Proceedings of the Fifteenth Annual Conference of the Cognitive Science Society (1993), Erlbaum, Mahwah, NJ 635-640
114. Levin B.E., Llabre M.M., and Weiner W.J. Cognitive impairments associated with early Parkinson's disease. Neurology 39 (1989) 557-561
115. Lewis S.J., Dove A., Robbins T.W., Barker R.A., and Owen A.M. Striatal contributions to working memory: A functional magnetic resonance imaging study in humans. European Journal of Neuroscience 19 (2004) 755-760
116. Mallet N., Le Moine C., Charpier S., and Gonon F. Feedforward inhibition of projection neurons by fast-spiking GABA interneurons in the rat striatum in vivo. Journal of Neuroscience 25 (2005) 3857-3869
117. McFarland N.R., and Haber S.N. Thalamic relay nuclei of the basal ganglia form both reciprocal and nonreciprocal cortical connections, linking multiple frontal cortical areas. Journal of Neuroscience 22 (2002) 8117-8132
118. McNab F., and Klingberg T. Prefrontal cortex and basal ganglia control access to working memory. Nature Neuroscience 11 (2008) 103-107
119. Meyer D.E., and Kieras D.E. A computational theory of executive cognitive processes and multiple-task performance: 1. Basic mechanisms. Psychological Review 104 (1997) 3-65
120. Meyer D.E., and Kieras D.E. A computational theory of executive cognitive processes and multiple-task performance: 2. Accounts of psychological refractory-period phenomena. Psychological Review 104 (1997) 749-791
121. Middleton F.A., and Strick P.L. Anatomical evidence for cerebellar and basal ganglia involvement in higher cognitive function. Science 266 (1994, October 21) 458-461
122. Middleton F.A., and Strick P.L. The temporal lobe is a target of output from the basal ganglia. Proceedings of the National Academy of Sciences, USA 93 (1996) 8683-8687
123. Middleton F.A., and Strick P.L. Basal ganglia output and cognition: Evidence from anatomical, behavioral, and clinical studies. Brain and Cognition 42 (2000) 183-200
124. Miller J.D., Sanghera M.K., and German D.C. Mesencephalic dopaminergic unit activity in the behaviorally conditioned rat. Life Sciences 29 (1981) 1255-1263
125. Mink J.W., and Thach W.T. Basal ganglia intrinsic circuits and their role in behavior. Current Opinion in Neurobiology 3 (1993) 950-957
126. Mishkin M., and Petri H.L. Memories and habits: Some implications for the analysis of learning and retention. In: Squire L.R., and Butters N. (Eds). Neuropsychology of memory (1984), Guilford Press, New York, NY 287-296
127. Miyachi S., Hikosaka O., Miyashita K., Karadi Z., and Rand M.K. Differential roles of monkey striatum in learning of sequential hand movement. Experimental Brain Research 115 (1997) 1-5
128. Moazami-Goudarzi M., Sarnthein J., Michels L., Moukhtieva R., and Jeanmonod D. Enhanced frontal low and high frequency power and synchronization in the resting EEG of Parkinsonian patients. NeuroImage 41 (2008) 985-997
129. Monchi O., Taylor J.G., and Dagher A. A neural model of working memory processes in normal subjects, Parkinson's disease and schizophrenia for fMRI design and predictions. Neural Networks 13 (2000) 953-973
130. Montague P.R., Hyman S.E., and Cohen J.D. Computational roles for dopamine in behavioural control. Nature 431 (2004, October 14) 760-767
131. Montague P.R., King-Casas B., and Cohen J.D. Imaging valuation models in human choice. Annual Review of Neuroscience 29 (2006) 417-448
132. Morris G., Arkadir D., Nevet A., Vaadia E., and Bergman H. Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 43 (2004) 133-143
133. Muslimovic D., Post B., Speelman J.D., and Schmand B. Cognitive profile of patients with newly diagnosed Parkinson disease. Neurology 65 (2005) 1239-1245
134. Nakanishi H., Kita H., and Kitai S.T. Intracellular study of rat substantia nigra pars reticulata neurons in an in vitro slice preparation: Electrical membrane properties and response characteristics to subthalamic stimulation. Brain Research 437 (1987) 45-55
135. Nambu A., Tokuno H., Hamada I., Kita H., Imanishi M., Akazawa T., and Hasegawa N. Excitatory cortical inputs to pallidal neurons via the subthalamic nucleus in the monkey. Journal of Neurophysiology 84 (2000) 289-300
136. Nambu A., Tokuno H., and Takada M. Functional significance of the cortico-subthalamo-pallidal "hyperdirect" pathway. Neuroscience Research 43 (2002) 111-117
137. Newell A.N. Production systems: Models of control structure. In: Chase W.G. (Ed). Visual information processing (1973), Academic Press, New York, NY 526-547
138. Newell A.N. Unified theories of cognition (1990), Harvard University Press, Cambridge, MA
139. Nicola S.M., Surmeier J., and Malenka R.C. Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. Annual Review of Neuroscience 23 (2000) 185-215
140. Nissen M.J., and Bullemer P. Attention requirements of learning: Evidence from performance measures. Cognitive Psychology 19 (1987) 1-32
141. O'Doherty J.P. Reward representations and reward-related learning in the human brain: Insights from neuroimaging. Current Opinion in Neurobiology 14 (2004) 769-776
142. O'Doherty J.P., Deichmann R., Critchley H.D., and Dolan R.J. Neural responses during anticipation of a primary taste reward. Neuron 33 (2002) 815-826
143. O'Reilly R.C. Biologically plausible error-driven learning using local activation differences: The generalized recirculation algorithm. Neural Computation 8 (1996) 895-938
144. O'Reilly R.C., Braver T.S., and Cohen J.D. A biologically-based computational model of working memory. In: Miyake A., and Shah P. (Eds). Models of working memory: Mechanisms of active maintenance and executive control (1999), Cambridge University Press, New York, NY 375-411
145. O'Reilly R.C., and Frank M.J. Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia. Neural Computation 18 (2006) 283-328
146. O'Reilly R.C., and Munakata Y. Computational explorations in cognitive neuroscience (2000), MIT Press, Cambridge, MA
147. Owen A.M. Cognitive dysfunction in Parkinson's disease: The role of frontostriatal circuitry. The Neuroscientist 10 (2004) 525-537
148. Owen A.M., Doyon J., Petrides M., and Evans A.C. Planning and spatial working memory: A positron emission tomography study in humans. European Journal of Neuroscience 8 (1996) 353-364
149. Owen A.M., Iddon J.L., Hodges J.R., Summers B.A., and Robbins T.W. Spatial and nonspatial working memory at different stages of Parkinson's disease. Neuropsychologia 35 (1997) 519-532
150. Packard M.G., Hirsh R., and White N.M. Differential effects of fornix and caudate nucleus lesions on two radial maze tasks: Evidence for multiple memory systems. Journal of Neuroscience 9 (1989) 1465-1472
151. Packard M.G., and Knowlton B.J. Learning and memory functions of the basal ganglia. Annual Review of Neuroscience 25 (2002) 563-593
152. Packard M.G., and McGaugh J.L. Double dissociation of fornix and caudate nucleus lesions on acquisition of two water maze tasks: Further evidence for multiple memory systems. Behavioral Neuroscience 106 (1992) 439-446
153. Packard M.G., and McGaugh J.L. Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiology of Learning and Memory 65 (1996) 65-72
154. Pakhotin P., and Bracci E. Cholinergic interneurons control the excitatory input to the striatum. Journal of Neuroscience 27 (2007) 391-400
155. Parent A., and Hazrati L.N. Functional anatomy of the basal ganglia: II. The place of subthalamic nucleus and external pallidum in basal ganglia circuitry. Brain Research Reviews 20 (1995) 128-154
156. Parthasarathy H.B., Schall J.D., and Graybiel A.M. Distributed but convergent ordering of corticostriatal projections: Analysis of the frontal eye field and the supplementary eye field in the macaque monkey. Journal of Neuroscience 12 (1992) 4468-4488
157. Pasupathy A., and Miller E.K. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433 (2005, February 24) 873-876
158. Paulsen J.S., Butters N., Salmon D.P., Heindel W.C., and Swenson M.R. Prism adaptation in Alzheimer's and Huntington's disease. Neuropsychology 7 (1993) 73-81
159. Peigneux P., Maquet P., Meulemans T., Destrebecqz A., Laureys S., Degueldre C., and Cleeremans A. Striatum forever, despite sequence learning variability: A random effect analysis of PET data. Human Brain Mapping 10 (2000) 179-194
160. Penney Jr. J.B., and Young A.B. Striatal inhomogeneities and basal ganglia function. Movement Disorders 1 (1986) 3-15
161. Plate T.A. Holographic reduced representations. IEEE Transactions on Neural Networks 6 (1995) 623-641
162. Plenz D. When inhibition goes incognito: Feedback interaction between spiny projection neurons in striatal function. Trends in Neurosciences 26 (2003) 436-443
163. Plenz D., and Kital S.T. A basal ganglia pacemaker formed by the subthalamic nucleus and external globus pallidus. Nature 400 (1999, August 12) 677-682
164. Prat, C. S., & Just, M. A. (2010). Exploring the cortical dynamics underpinning individual differences in sentence comprehension. Manuscript submitted for publication.
165. Prat C.S., Keller T.A., and Just M.A. Individual differences in sentence comprehension: A functional magnetic resonance imaging investigation of syntactic and lexical processing demands. Journal of Cognitive Neuroscience 19 (2007) 1950-1963
166. Preuschoff K., Bossaerts P., and Quartz S.R. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51 (2006) 381-390
167. Qin Y., Sohn M.-H., Anderson J.R., Stenger V.A., Fissell K., Goode A., and Carter C.S. Predicting the practice effects on the blood oxygenation level-dependent (BOLD) function of fMRI in a symbolic manipulation task. Proceedings of the National Academy of Sciences, USA 100 (2003) 4951-4956
168. Raichle M.E., Fiez J.A., Videen T.O., MacLeod A.M., Pardo J.V., Fox P.T., and Petersen S.E. Practice-related changes in human brain functional anatomy during nonmotor learning. Cerebral Cortex 4 (1994) 8-26
169. Rauch S.L., Whalen P.J., Savage C.R., Curran T., Kendrick A., Brown H.D., and Rosen B.R. Striatal recruitment during an implicit sequence learning task as measured by functional magnetic resonance imaging. Human Brain Mapping 5 (1997) 124-132
170. Ravizza S.M., and Ivry R.B. Comparison of the basal ganglia and cerebellum in shifting attention. Journal of Cognitive Neuroscience 13 (2001) 285-297
171. Reder L.M., Park H., and Kieffaber P.D. Memory systems do not divide on consciousness: Reinterpreting memory in terms of activation and binding. Psychological Bulletin 135 (2009) 23-49
172. Redgrave P., and Gurney K. The short-latency dopamine signal: A role in discovering novel actions?. Nature Reviews Neuroscience 7 (2006) 967-975
173. Redgrave P., Prescott T.J., and Gurney K. The basal ganglia: A vertebrate solution to the selection problem?. Neuroscience 89 (1999) 1009-1023
174. Reiner A., Albin R.L., Anderson K.D., D'Amato C.J., Penney J.B., and Young A.B. Differential loss of striatal projection neurons in Huntington disease. Proceedings of the National Academy of Sciences, USA 85 (1988) 5733-5737
175. Reynolds J.N., Hyland B.I., and Wickens J.R. Modulation of an afterhyperpolarization by the substantia nigra induces pauses in the tonic firing of striatal cholinergic interneurons. Journal of Neuroscience 24 (2004) 9870-9877
176. Reynolds J.N., and Wickens J.R. The corticostriatal input to giant aspiny interneurons in the rat: A candidate pathway for synchronising the response to reward-related cues. Brain Research 1011 (2004) 115-128
177. Rolls E.T., and Treves A. Neural networks and brain function (1998), Oxford University Press, New York, NY
178. Rouzaire-Dubois B., and Scarnati E. Pharmacological study of the cortical-induced excitation of subthalamic nucleus neurons in the rat: Evidence for amino acids as putative neurotransmitters. Neuroscience 21 (1987) 429-440
179. Rumelhart D.E., Hinton G.E., and Williams R.J. Learning representations by back-propagating errors. Nature 323 (1986, October 9) 533-536
180. Rymar V.V., Sasseville R., Luk K.C., and Sadikot A.F. Neurogenesis and stereological morphometry of calretinin-immunoreactive GABAergic interneurons of the neostriatum. Journal of Comparative Neurology 469 (2004) 325-339
181. Rypma B., Prabhakaran V., Desmond J.E., Glover G.H., and Gabrieli J.D.E. Load-dependent roles of frontal brain regions in the maintenance of working memory. NeuroImage 9 (1999) 216-226
182. Schultz W. Predictive reward signal of dopamine neurons. Journal of Neurophysiology 80 (1998) 1-27
183. Schultz W. Getting formal with dopamine and reward. Neuron 36 (2002) 241-263
184. Schultz W., Apicella P., and Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. Journal of Neuroscience 13 (1993) 900-913
185. Schultz W., Dayan P., and Montague P.R. A neural substrate of prediction and reward. Science 275 (1997, March 14) 1593-1599
186. Schumacher E.H., Seymour T.L., Glass J.M., Fencsik D.E., Lauber E.J., Kieras D.E., and Meyer D.E. Virtually perfect time sharing in dual-task performance: Uncorking the central cognitive bottleneck. Psychological Science 12 (2001) 101-108
187. Seger C.A., and Cincotta C.M. The roles of the caudate nucleus in human classification learning. Journal of Neuroscience 25 (2005) 2941-2951
188. Shallice T. Specific impairments of planning. Philosophical Transactions of the Royal Society of London 298 (1982) 199-209
189. Shanks D.R., and St. John M.F. Characteristics of dissociable human learning systems. Behavioral and Brain Sciences 17 (1994) 367-447
190. Shiffrin R.M., and Schneider W. Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. Psychological Review 84 (1977) 127-190
191. Shink E., Bevan M.D., Bolam J.P., and Smith Y. The subthalamic nucleus and the external pallidum: Two tightly interconnected structures that control the output of the basal ganglia in the monkey. Neuroscience 73 (1996) 335-357
192. Smith A.D., and Bolam J.P. The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurons. Trends in Neurosciences 13 (1990) 259-265
193. Smith Y., Raju D.V., Pare J.F., and Sidibe M. The thalamostriatal system: A highly specific network of the basal ganglia circuitry. Trends in Neurosciences 27 (2004) 520-527
194. Smolensky P. Tensor product variable binding and the representation of symbolic structures in connectionist systems. Artificial Intelligence 46 (1990) 159-216
195. Sohn M.-H., Goode A., Stenger V.A., Carter C.S., and Anderson J.R. Competition and representation during memory retrieval: Roles of the prefrontal cortex and the posterior parietal cortex. Proceedings of the National Academy of Sciences, USA 100 (2003) 7412-7417
196. Somogyi P., Bolam J.P., and Smith A.D. Monosynaptic cortical input and local axon collaterals of identified striatonigral neurons: A light and electron microscopic study using the Golgi-peroxidase transport-degeneration procedure. Journal of Comparative Neurology 195 (1981) 567-584
197. Sprengelmeyer R., Canavan A.G., Lange H.W., and Homberg V. Associative learning in degenerative neostriatal disorders: Contrasts in explicit and implicit remembering between Parkinson's and Huntington's diseases. Movement Disorders 10 (1995) 51-65
198. Squire L.R. Declarative and nondeclarative memory: Multiple brain systems supporting learning and memory. Journal of Cognitive Neuroscience 4 (1992) 232-243
199. Squire L.R., and Zola S.M. Structure and function of declarative and nondeclarative memory systems. Proceedings of the National Academy of Sciences, USA 93 (1996) 13515-13522
200. Stewart, T. C., & Eliasmith, C. (2008). Building production systems with realistic spiking neurons. In V. Sloutsky, B. Love, & K. McRae (Eds.), Proceedings of the 30th annual meeting of the Cognitive Science Society. Austin, TX: Cognitive Science Society.
201. Stocco A., and Anderson J.R. Endogenous control and task representation: An fMRI study of algebraic problem solving. Journal of Cognitive Neuroscience 20 (2008) 1300-1314
202. Stoffers D., Bosboom J.L., Deijen J.B., Wolters E., Stam C.J., and Berendse H.W. Increased cortico-cortical functional connectivity in early-stage Parkinson's disease: An MEG study. NeuroImage 41 (2008) 212-222
203. Suri R.E., Bargas J., and Arbib M.A. Modeling functions of striatal dopamine modulation in learning and planning. Neuroscience 103 (2001) 65-85
204. Suri R.E., and Schultz W. Learning of sequential movements by neural network model with dopamine-like reinforcement signal. Experimental Brain Research 121 (1998) 350-354
205. Suri R.E., and Schultz W. A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience 91 (1999) 871-890
206. Sutton R.S. Learning to predict by the methods of temporal differences. Machine Learning 3 (1988) 9-44
207. Sutton R.S., and Barto A.G. Reinforcement learning: An introduction (1998), MIT Press, Cambridge, MA
208. Taatgen N.A. Modeling parallelization and flexibility improvements in skill acquisition: From dual tasks to complex dynamic skills. Cognitive Science 29 (2005) 421-455
209. Taatgen N.A., and Lee F.J. Production compilation: A simple mechanism to model complex skill acquisition. Human Factors 45 (2003) 61-76
210. Teicher M.H., Anderson C.M., Polcari A., Glod C.A., Maas L.C., and Renshaw P.F. Functional deficits in basal ganglia of children with attention-deficit/hyperactivity disorder shown with functional magnetic resonance imaging relaxometry. Nature Medicine 6 (2000) 470-473
211. Teichmann M., Dupoux E., Kouider S., and Bachoud-Levi A.C. The role of the striatum in processing language rules: Evidence from word perception in Huntington's disease. Journal of Cognitive Neuroscience 18 (2006) 1555-1569
212. Teng E., Stefanacci L., Squire L.R., and Zola S.M. Contrasting effects on discrimination learning after hippocampal lesions and conjoint hippocampal-caudate lesions in monkeys. Journal of Neuroscience 20 (2000) 3853-3863
213. Tepper J.M., and Bolam J.P. Functional diversity and specificity of neostriatal interneurons. Current Opinion in Neurobiology 14 (2004) 685-692
214. A receptor-mediated inhibition of rat substantia nigra dopaminergic neurons by pars reticulata projection neurons. Journal of Neuroscience 15 (1995) 3092-3103
215. Terman D., Rubin J.E., Yew A.C., and Wilson C.J. Activity patterns in a model for the subthalamopallidal network of the basal ganglia. Journal of Neuroscience 22 (2002) 2963-2976
216. Thompson-Schill S.L., D'Esposito M., and Kan I.P. Effects of repetition and competition on activity in left prefrontal cortex during word generation. Neuron 23 (1999) 513-522
217. Tobler P.N., Fiorillo C.D., and Schultz W. Adaptive coding of reward value by dopamine neurons. Science 307 (2005, March 11) 1642-1645
218. Tom S.M., Fox C.R., Trepel C., and Poldrack R.A. The neural basis of loss aversion in decision-making under risk. Science 315 (2007, January 26) 515-518
219. Touretzky D., and Hinton G.H. A distributed connectionist production system. Cognitive Science 12 (1988) 423-466
220. Tunstall M.J., Oorschot D.E., Kean A., and Wickens J.R. Inhibitory interactions between spiny projection neurons in the rat striatum. Journal of Neurophysiology 88 (2002) 1263-1269
221. Ullman M.T., Corkin S., Coppola M., Hickok G., Growdon J.H., Koroshetz W.J., and Pinker S. A neural dissociation within language: Evidence that the mental dictionary is part of declarative memory, and that grammatical rules are processed by the procedural system. Journal of Cognitive Neuroscience 9 (1997) 266-276
222. Walker F.O. Huntington's disease. Lancet 369 (2007) 218-228
223. Wickens J.R., Alexander M.E., and Miller R. Two dynamic modes of striatal function under dopaminergic-cholinergic control: Simulation and analysis of a model. Synapse 8 (1991) 1-12
224. Wickens J.R., and Arbuthnott G.W. The corticostriatal system on computer simulation: An intermediate mechanism for sequencing of actions. Progress in Brain Research 99 (1993) 325-339
225. Wickens J.R., Begg A.J., and Arbuthnott G.W. Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro. Neuroscience 70 (1996) 1-5
226. Willingham D.B., and Koroshetz W.J. Evidence for dissociable motor skills in Huntington's disease patients. Psychobiology 21 (1993) 173-182
227. Wilson C.J. The generation of natural firing patterns in neostriatal neurons. Progress in Brain Research 99 (1993) 277-297
228. Wilson C.J., and Groves P.M. Fine structure and synaptic connections of the common spiny neuron of the rat neostriatum: A study employing intracellular inject of horseradish peroxidase. Journal of Comparative Neurology 194 (1980) 599-615
229. Wilson C.J., and Groves P.M. Spontaneous firing patterns of identified spiny neurons in the rat neostriatum. Brain Research 220 (1981) 67-80
230. Xie X., and Seung S. Equivalence of backpropagation and contrastive Hebbian learning in a layered network. Neural Computation 15 (2003) 441-454
231. Yelnik J., Francois C., Percheron G., and Tande D. Morphological taxonomy of the neurons of the primate striatum. Journal of Comparative Neurology 313 (1991) 273-294
232. Zhang Y., Bertolino A., Fazio L., Blasi G., Rampino A., Romano R., and Sadée W. Polymorphisms in human dopamine D2 receptor gene affect gene expression, splicing, and neuronal activity during working memory. Proceedings of the National Academy of Sciences, USA 104 (2007) 20552-20557
233. Zheng T., and Wilson C.J. Corticostriatal combinatorics: The implications of corticostriatal axonal arborizations. Journal of Neurophysiology 87 (2002) 1007-1017