Network models of the basal ganglia

Current Opinion in Neurobiology

Volumn 7, Issue 2, 1997, Pages 185-190

  Beiser, David G ^a   Hua, Sherwin E ^a   Houk, James C ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE;

BASAL GANGLION; BEHAVIOR; BRAIN FUNCTION; CORPUS STRIATUM; HUMAN; LEARNING; MATHEMATICAL MODEL; PATTERN RECOGNITION; PRIORITY JOURNAL; REINFORCEMENT; REVIEW; THALAMUS;

EID: 0030979452     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0959-4388(97)80006-2     Document Type: Article

References (38)

1. Graybiel AM. Building action repertoires: memory and learning functions of the basal ganglia. Curr Opin Neurobiol. 5:1995;733-741.
2. Alexander GE, Crutcher MD, DeLong MR. Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, 'prefrontal' and 'Iimbic' functions. Prog Brain Res. 85:1990;119-146.
3. Middleton FA, Strick PL. New concepts about the organization of basal ganglia output. Marsden CD, Obeso JA, Ohye C, DeLong MR. Advances in Neurology, The Basal Ganglia and New Surgical Treatment for Parkinson's Disease. 1997;Lippincott-Raven, Philadelphia. in press.
4. Houk JC. Information processing in modular circuits linking basal ganglia and cerebral cortex. Houk JC, Davis JL, Beiser DG. Models of Information Processing in the Basal Ganglia. 1995;3-9 MIT Press, Cambridge, MA.
5. of outstanding interest Wickens JR, Kotter R, Alexander ME. Effects of local connectivity on striatal function: stimulation and analysis of a model. Synapse. 20:1995;281-298 This model of the striatum explores the effects of homogeneity and symmetry within relatively large networks of collaterally inhibited spiny neurons. Careful attention is given to the biophysical properties and responses of individual spiny neurons. The authors' results suggest a possible mechanism for the choreic movements of Huntington's patients.
6. of outstanding interest Kotter R, Wickens J. Interactions of glutamate and dopamine in a computational model of the striatum. of special interest J Comput Neurosci. 2:1995;195-214 A network similar to that of Wickens et al. [5] is used to model the spatiotemporal interactions of normal, dopamine-depleted, and dopamine-agonist-treated spiny neurons. The authors' results demonstrate that interesting patterns of activation can be produced by an inhibitory network with homogeneous connections.
7. of outstanding interest Fukai T, Tanaka S. A simple neural network exhibiting selective activation of neuronal ensembles: from winner-take-all to winners-share-all. Neural Computation. 9:1997;197-238 This paper provides a thorough analytical discussion of competitive inhibition, which would appear to have relevance to the study of striatal dynamics.
8. Wilson CJ. Basal ganglia. Shepherd GM. The Synaptic Organization of the Brain. 1990;279-316 Oxford Univeristy Press, New York.
9. of special interest Connolly CI, Burns JB. A state-space striatal model. Houk JC, Davis JL, Beiser DG. Models of information Processing in the Basal Ganglia. 1995;163-183 MIT Press, Cambridge, MA, Unlike the majority of striatal models, this abstract treatment focuses on the computational role of subthreshold fluctuations in membrane potential. The striatum is modeled as an electronic grid of units that individually correspond to different states within a limb's configuration space.
10. of special interest Woodward DJ, Kirillov AB, Myre CD, Sawyer SF. Neostriatal circuitry as a scalar memory: modeling and ensemble neuron recording. Houk JC, Davis JL, Beiser DG. Models of Information Processing in the Basal Ganglia. 1995;315-336 MIT Press, Cambridge, MA, Networks of inhibitory units in the neostriatum can produce sustained activations and thus support a type of working memory. The authors discuss the problem of decoding such a distributed working memory.
11. of special interest Graybiel AM, Kimura M. Adaptive neural networks in the basal ganglia. Houk JC, Davis JL, Beiser DG. Models of Information Processing in the Basal Ganglia. 1995;103-116 MIT Press, Cambridge, MA, The authors describe patterns of convergent projections that would appear to provide a single area of the striatum with several homologous body part representations from different areas of the cerebral cortex.
12. of special interest Strick PL, Dum RP, Picard N. Macro-organization of the circuits connecting the basal ganglia with the cortical motor areas. Houk JC, Davis JL, Beiser DG. Models of Information Processing in the Basal Ganglia. 1995;117-130 MIT Press, Cambridge, MA, This paper presents anatomical evidence supporting the hypothesis that the dominant architecture of the basal ganglia is one of closed trans-striatal loops interconnecting topographically specific regions of the basal ganglia with cortical motor areas.
13. of special interest Contreras-Vidal JL, Stelmach GE. A neural model of basal ganglia-thalamocortical relations in normal and parkinsonian movement. Biol Cybern. 73:1995;467-476 This model emphasizes the oppositional balance of signals in the direct and indirect pathways from the striatum to the internal globus pallidus. It is suggested that this balance is disturbed by dopamine-dependent changes in D1 and D2 receptor expression in these pathways. This straightforward model casts the circuits of the basal ganglia as single-input/single-output filters.
14. of special interest Contreras-Vidal JL, Teulings HL, Stelmach GE. Micrographia in Parkinson's disease. Neuroreport. 6:1995;2089-2092 The model of Contreras-Vidal and Stelmach [13] is attached to a model of trajectory formation [15]. The composite model is altered to simulate the effects of Parkinson's disease and applied to the task of cursive writing.
15. Bullock D, Grossberg S, Mannes C. A neural network model for cursive script production. Biol Cybern. 70:1993;15-28.
16. of special interest Berns GS, Sejnowski TJ. How the basal ganglia make decisions. Damasio AR, Damasio H, Christen Y. The Neurobiology of Decision Making. 1996;101-113 Springer-Verlag, Berlin, This model explores how timing differences between the direct and indirect pathways linking the striatum and pallidum could play a role in the selection of competing motor programs.
17. of special interest Jackson S, Houghton G. Sensorimotor selection and the basal ganglia: a neural network model. Houk JC, Davis JL, Beiser DG. Models of Information Processing in the Basal Ganglia. 1995;337-367 MIT Press, Cambridge, MA, This model, while lacking in detail, suggests an interesting role for the basal ganglia in mediating attention.
18. of special interest Arbib MA, Dominey PF. Modeling the roles of basal ganglia in timing and sequencing saccadic eye movements. Houk JC, Davis JL, Beiser DG. Models of Information Processing in the Basal Ganglia. 1995;149-162 MIT Press, Cambridge, MA, This model integrates the basal ganglia with the saccade-generating centers of the brainstem. It includes several interesting elements of basal ganglia processing, including corticothalamic working memory loops and dopamine-mediated reinforcement learning in the striatum.
19. of outstanding interest Dominey PF. Complex sensory-motor sequence learning based on recurrent state representation and reinforcement learning. Biol Cybern. 73:1995;265-274 A model similar to that of Dominey et al. [20] is applied to a complex sequence reproduction task.
20. of outstanding interest Dominey PF, Arbib MA, Joseph JP. A model of corticostriatal plasticity for learning oculomotor associations and sequences. J Cogn Neurosci. 7:1995;311-336 An interesting, though somewhat complex, model of oculomotor control applied to conditional visual discrimination and sequence reproduction tasks. The model utilizes recurrence to provide contextual inputs regarding previous states. Reinforcement learning is used to associate sensorimotor contexts with correct saccades.
21. of outstanding interest Beiser DG, Houk JC. Model of cortical-basal ganglionic processing: encoding the serial order of sensory events. J Neurophysiol. 1997; This paper presents a modular network that encodes serial inputs within spatial patterns of activity in the prefrontal cortex.The responses of the model's units resemble those observed in single-unit studies of sequential tasks [22-24]. In addition, the network does not require training.
22. Barone P, Joseph JP. Prefrontal cortex and spatial sequencing in the macaque monkey. Exp Brain Res. 78:1989;447-464.
23. Kermadi I, Jurquet Y, Arzi M, Joseph JP. Neural activity in the caudate nucleus of monkeys during spatial sequencing. Exp Brain Res. 94:1993;352-356.
24. Kermadi I, Joseph JP. Activity in the caudate nucleus of monkey during spatial sequencing. J Neurophysiol. 74:1995;911-933.
25. of outstanding interest Barto AG. Adaptive critics and the basal ganglia. Houk JC, Davis JL, Beiser DG. Models of Information Processing in the Basal Ganglia. 1995;215-232 MIT Press, Cambridge, MA, The mathematical underpinnings of the adaptive critic variant of reinforcement learning is discussed in a simple, and intuitive, manner.
26. of outstanding interest Houk JC, Adams JL, Barto AG. A model of how the basal ganglia generate and use neural signals that predict reinforcement. Houk JC, Davis JL, Beiser DG. Models of Information Processing in the Basal Ganglia. 1995;249-270 MIT Press, Cambridge, MA, A conceptual model that compares the local circuit of the striosomal spiny neurons to that of an adaptive critic. A detailed mechanism involving both intracellular and intercellular signals is outlined as a possible account for the reward-predicting behavior observed in some spiny neurons.
27. of special interest Gray JA. A model of the limbic system and basal ganglia: applications to anxiety and schizophrenia. Gazzaniga MS. The Cognitive Neurosciences. 1995;1165-1176 MIT press, Cambridge, MA, This conceptual model is given a psychiatric twist that emphasizes how information-processing operations in the limbic system and ventral striatum help the organism identify series of linked subgoals that are seen to be essential in guiding behavior.
28. of special interest Kimura M, Graybiel AM. Role of the basal ganglia in sensory motor association learning. Kimura M, Graybiel AM. Functions of the Cortico-Basal Ganglia Loop. 1195;2-17 Springer-Verlag, Tokyo, This conceptual model provides a link between the limbic system and motor output. It suggests that the nigrostriatal dopamine projections may serve as a phasic reinforcement signal, as well as a gating signal, during the expression of learned responses.
29. Miyashita Y. Inferior temporal cortex: where visual perception meets memory. Annu Rev Neurosci. 16:1993;245-263.
30. of special interest Amit DJ. The Hebbian paradigm reintegrated: local reverberations as internal representations. Behav Brain Sci. 18:1995;617-657 The author proposes that local reverberatory networks with attractor dynamics are a general feature of cortical function.
31. of special interest Lukashin AV, Amirikian BR, Mozhaev VL, Wilcox GL, Georgopoulos AP. Modeling motor cortical operations by an attractor network of stochastic neurons. Biol Cybern. 74:1996;255-261 Whereas point attractors may underlie associative memory, the authors propose that dynamic attractors underlie the generation of the population direction vector. In their model, dynamic attractors allow the temporal evolution of the population vector, leading to the generation of movement trajectories.
32. of outstanding interest Houk JC, Wise SP. Distributed modular architectures linking basal ganglia, cerebellum and cerebral cortex: their role in planning and controlling action. Cereb Cortex. 5:1995;95-110 This paper presents an integrated model of motor control. The basal ganglia select behaviorally relevant motor programs whereas the cerebellum shapes and executes the command. Modular architectures in these areas cooperate to sculpt activity in corresponding cortical modules, which are able to learn and automate movements.
33. of outstanding interest Houk JC. On the role of the cerebellum and basal gangalia in cognitive information processing. De Zeeuw CI, Strata P, Voogd J. Progress in Brain Research. 1997;545-554 Elsevier Science, Amsterdam, The author outlines a theory of how thought processes, such as the instantiation of working memory in the prefrontal cortex, utilize modular signal processing operations in a manner analogous to signal processing in movement control. Mechanisms for distributed learning are also discussed.
34. of outstanding interest Amit DJ, Brunel N. Learning internal representations in an attractor neural network with analogue neurons. Network. 6:1995;359-388 Hebbian learning in an attractor network is explored. The model, which has dual activation and learning dynamics, operates in a palimpsest fashion in which attractors learn the statistics of stimuli presented. Attractors representing stimuli that are no longer presented are forgotten.
35. of special interest Hua SA, Houk JC. Cerebellar guidance of premotor network development and sensorimotor learning. Learning Mem. 1997; A recurrent network comprised of three layers of units endowed with Hebbian synapses and weight normalization is used to model the development of a subcortical channel that interconnects the motor cortex and cerebellum. The developed network is then used to model adult plasticity in the motor cortex. This model illustrates a simple mechanism for exporting subcortical knowledge to the cerebral cortex where it can be utilized in a more efficient manner. These concepts are also applicable to subcortical channels through the basal ganglia.
36. of special interest Hikosaka O, Rand MK, Miyachi S, Miyashita K. Procedural learning in the monkey. Kimura M, Graybiel AM. Functions of the Cortico-Basal Ganglia Loop. 1995;18-30 Springer-Verlag, Tokyo, This paper reports experimental results of a sequential paradigm designed to differentiate procedural from declarative learning. In addition, an interesting conceptual model involving both corticostriatal and corticocortical plasticity is discussed.
37. Wise SP, Houk JC. Modular neuronal architecture for planning and controlling behavior. Biol Commun Dan R Acad Sci Left. 43:1994;21-33.
38. Middleton FA, Strick PS. New concepts regarding the organization of basal ganglia and cerebellar output. Ito M, Miyashita Y. Uehara Memorial Foundation Symposium on Integrative and Molecular Approach to Brain Function. 1997;253-271 Elsevier Science, Tokyo.