Action selection and refinement in subcortical loops through basal ganglia and cerebellum

Modelling Natural Action Selection

Volumn , Issue , 2011, Pages 176-207

  Houk, James C ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84923618675     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1017/CBO9780511731525.014     Document Type: Chapter

References (103)

1. Andreasen, N. C. (1999). A unitary model of schizophrenia: Bleuler's 'fragmented phrene' as schizencephaly. Arch. Gen. Psychiatry 56: 781-7.
2. Arbib, M. A., A. Billard, M. Iacoboni, and E. Oztop (2000). Synthetic brain imaging: grasping, mirror neurons and imitation. Neural. Netw. 13(8-9): 975-97.
3. Barringer, C., A. G. Barto, and J. C. Houk (2008). Simulated reaching supports the Normalized Predicted Error (NPE) discrete control hypothesis for on-line error correction of voluntary movements. Society for Neuroscience. November 2008, Washington DC.
4. Barto, A. G., A. H. Fagg, N. Sitkoff, and J. C. Houk (1999). A cerebellar model of timing and prediction in the control of reaching. Neural Comput. 11: 565-594.
5. Beiser, D. G. and J. C. Houk (1998). Model of cortical-basal ganglionic processing: encoding the serial order of sensory events. J. Neurophysiol. 79: 3168-88.
6. Berlim, M. T., B. S. Mattevi, P. Belmonte-de-Abreu, and T. J. Crow (2003). The etiology of schizophrenia and the origin of language: Overview of a theory. Compr. Psychiat. 44: 7-14.
7. Berthier, N. E., S. P. Singh, A. G. Barto, and J. C. Houk (1993). Distributed representation of limb motor programs in arrays of adjustable pattern generators. J. Cogn. Neurosci. 5: 56-78.
8. Bhushan, N. and R. Shadmehr (1999). Evidence for a forward dynamics model in human adaptive motor control. In Advances in Neural Processing Systems, Vol. 11, ed. M. S. Kearns, S. A. Solla, and D. A. Cohn. Cambridge, MA: MIT Press, pp. 3-9.
9. Bliss T. V. P. and G. L. Collingridge (1993). A synaptic model of memory: long-term potentiation in the hippocampus. Nature 361: 31-9.
10. Booth, J. R., L. Wood, D. Lu, J. C. Houk, and T. Bitan (2007). The role of the basal ganglia and cerebellum in language processing. Brain Res. 1133(1): 136-44.
11. Borrell, J., J. M. Vela, A. Arevalo-Martin, E. Molina-Holgado, and C. Guaza (2002). Prenatal immune challenge disrupts sensorimotor gating in adult rats. Implications for the etiopathogenesis of schizophrenia. Neuropsychopharmacology 26(2): 204-15.
12. Botvinick, M. M. and D. C. Plaut (2006). Short-term memory for serial order: a recurrent neural network model. Psychol. Rev. 113: 201-33.
13. Botvinick, M. M., J. Wang, E. Cowan, et al. (2009). An analysis of immediate serial recall performance in a Macaque. Anim. Cogn. doi 10: 1007/s10071-009-0226.
14. Bowery, N. G., A. L. Hudson, and G. W. Price (1987). GABAA and GABAB receptor site distribution in the rat central nervous system. Neuroscience 20(2): 365-83.
15. Bowery, N. G., K. Parry, G. Goodrich, I. Illinsky, and K. Kultas-Illinsky (1999). Distribution of GABA(B) binding sites in the thalamus and basal ganglia of the rhesus monkey (Macaca mulatta). Neuropharmacology 38(11): 1675-82.
16. Brasted, P. J. and S. P. Wise (2004). Comparison of learning-related neuronal activity in the dorsal premotor cortex and striatum. Eur. J. Neurosci. 19: 721-40.
17. Breese, C. R., C. Adams, J. Logel, et al. (1997). Comparison of the regional expression of nicotinic acetylcholine receptor 7 mRNA and [125I]-_-Bungarotoxzin binding in human postmortem brain. J. Comp. Neurol. 387: 385-398.
18. Calabresi, P., N. B. Mercuri, M. DeMurtas, and G. Bernardi (1991). Involvement of GABA systems in feedback regulation of glutamate-and GABA-mediated synaptic potentials in rat neostriatum. J. Physiol. 440: 581-99.
19. Carelli, R. M., M. Wolske, and M. O. West (1997). Loss of lever press-related firing of rat striatal forelimb neurons after repeated sessions in a lever pressing task. J. Neurosci. 17(5): 1804-14.
20. Crow, T. J. (1997). Is schizophrenia the price that Homo sapiens pays for language? Schizophr. Res. 28(2-3): 127-41.
21. Doya, K. (1999). What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? Neural Networks 12: 961-74.
22. Elman, J. L. (2004). An alternative view of the mental lexicon. Trends Cogn. Sci. 8: 301-306.
23. Enna, S. J. and N. G. Bowery (2004). GABAb receptor alterations as indicators of physiological and pharmacological function. Biochem. Pharma. 68: 1541-8.
24. Felleman, D. J. and D. C. Van Essen (1991). Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1(1): 1-47.
25. Fishbach, A., S. A. Roy, C. Bastianen, L. E. Miller, and J. C. Houk (2005). Kinematic properties of on-line error corrections in the monkey. Exp. Br. Res. 164: 442-57.
26. Fishbach, A., S. A. Roy, C. Bastianen, L. E. Miller, and J. C. Houk (2007). Deciding when and how to correct a movement: discrete submovements as a decision making process. Exp. Br. Res. 177: 45-63.
27. Frank, M. J. (2005). Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. J. Cogn. Neurosci. 17: 51-72.
28. Fraser, D., S. Park, G. Clark, D. Yohanna, and J. C. Houk (2004). Spatial serial order processing in schizophrenia. Schizophr. Res. 70(2-3): 203-13.
29. Fraser D., P. Reber, T. Parrish, et al. (2008). Cortical neural correlates of serial order recall: cognitive and motor decoding. Society for Neuroscience 38th Annual Meeting, November 2008, program ID# 484. 28.
30. Freedman, R., S. Leonard, A. Oliney, et al. (2001). Evidence for the multigenic inheritance of schizophrenia. Am. J. Med. Gen. 105: 794-800.
31. Freeman, W. J. (2000). Mesoscopic neurodynamics: from neuron to brain. J. Physiol. Paris 94(5-6): 303-22.
32. Gdowski, M. J., L. E. Miller, C. Bastianen, E. K. Nenonene, and J. C. Houk (2007). Signaling patterns of globus pallidus internal segment neurons during forearm rotation. Brain Res. 1155: 56-69.
33. Georgopoulos, A. P. (1995). Motor cortex and cognitive processing. In The Cognitive Neurosciences, ed. M. S. Gazzaniga. Cambridge, MA: MIT Press, pp 507-517.
34. Gibson, A. R., J. C. Houk, and N. J. Kohlerman (1985). Relation between red nucleus discharge and movement parameters in trained macaque monkeys. J. Physiol. (Lond.) 358: 551.
35. Gruber, A. J., S. A. Solla, D. J. Surmeier, and J. C. Houk (2003). Modulation of striatal single units by expected reward: a spiny neuron model displaying dopamine-induced bistability. J. Neurophys. 90: 1095-114.
36. Gurney, K., T. J. Prescott, and P. Redgrave (2001). A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biol. Cybern. 84: 401-410.
37. Gusnard, D. A. and M. E. Raichle (2001) Searching for a baseline: functional imaging and the resting human brain. Nature Rev. Neurosci. 2: 685-94.
38. Hauser, M. D., N. Chomsky, and W. T. Fitch (2002). The faculty of language: what it is, who has it, and how did it evolve. Science 298: 1569-79.
39. Holdefer, R. N., J. C. Houk, and L. E. Miller (2005). Movement-related discharge in the cerebellar nuclei persists after local injections of GABA-A antagonists. J. Neurophysiol. 93(1): 35-43.
40. Houk, J. C. (2001). Neurophysiology of frontal-subcortical loops. In Frontal-Subcortical Circuits in Psychiatry and Neurology, ed. D. G. Lichter and J. L. Cummings. New York: Guilford Publications, pp. 92-113.
41. Houk, J. C. (2005). Agents of the mind. Biol. Cybern. 92: 427-37.
42. Houk J. C. (2007). Models of basal ganglia. Scholarpedia, p. 22663. Available at http://www. scholarpedia. org/article/Models of Basal Ganglia.
43. Houk, J. C. (2010). Voluntary movement: control, learning and memory. In Encyclopedia of Behavioral Neuroscience, ed. G. F. Koob, M. Le Moal, and R. F. Thompson. Oxford: Academic Press, pp. 455-8.
44. Houk, J. C., J. L. Adams, and A. G. Barto (1995). A model of how the basal ganglia generates and uses neural signals that predict reinforcement. In Models of Information Processing in the Basal Ganglia, ed. J. C. Houk, J. L. Davis, and D. G. Beiser. Cambridge, MA: MIT Press, pp. 249-74.
45. Houk, J. C., C. Bastianen, D. Fansler, et al. (2007). Action selection in subcortical loops through the basal ganglia and cerebellum. Phil. Trans. R. Soc. B. 362: 1573-83.
46. Houk, J. C., A. H. Fagg, and A. G. Barto (2002). Fractional power damping model of joint motion. In Progress in Motor Control: Structure-Function Relations in Voluntary Movements, Vol. 2, ed. C. A. Wrisberg and M. Latash. Champaign, IL: Human Kinetics, pp. 147-78.
47. Houk, J. C., J. Keifer, and A. G. Barto (1993). Distributed motor commands in the limb premotor network. Trends Neurosci. 16: 27-33.
48. Houk, J. C. and E. Mugnaini (2003). Cerebellum. In Fundamental Neuroscience, ed. L. R. Squire et al. Oxford: Academic Press, pp. 841-72.
49. Houk J. C., E. Mugnaini, and E. Redei (2009). Maternal immune activation in combination with allelic variations of imprinted genes may explain the etiology of schizophrenia. Soc. Neurosci. Abst. #2009-S-17652-SfN (745. 16).
50. Houk, J. C. and S. P. Wise (1995). Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. Cerebral Cortex 5: 95-110.
51. Hua S. E. and J. C. Houk (1997). Cerebellar guidance of premotor network development and sensorimotor learning. Learn. Mem. 4: 63-76.
52. Huxley, J., E. Mayr, H. Osmond, and A. Hoffer (1964) Schizophrenia as a genetic morphism. Nature 204: 220-1.
53. Karniel, A. and G. F. Inbar (1999). The use of a nonlinear muscle model in explaining the relationship between duration, amplitude, and peak velocity of human rapid movements. J. Motor Behav. 31(3): 203-206.
54. Kawato, M., M. Katayama, H. Gomi, and Y. Koike (1992). Coordinated arm movements: Virtual trajectory control hypothesis and learning inverse models. International Symposium on Information Sciences, Iizuka Kyusyuu, Japan.
55. Kelly, R. M. and P. L. Strick (2003). Cerebellar loops with motor cortex and prefrontal cortex of a nonhuman primate. J. Neurosci. 23: 8432-44.
56. Kelly, R. M. and P. L. Strick (2004). Macro-architecture of basal ganglia loops with the cerebral cortex: use of rabies virus to reveal multisynaptic circuits. Prog. Brain Res. 143: 449-59.
57. Kincaid, A. E., T. Zheng, and C. J. Wilson (1998). Connectivity and convergence of single corticostriatal axons. J. Neurosci. 18(12): 4722-31.
58. Koerding, K. (2007). Decision theory: what 'should' the nervous system do? Science 318(5850): 606-10.
59. Kuttner, R. E., A. B. Lorincz, and D. A. Swan (1967). The schizophrenia gene and social evolution. Psychol. Rep. 20: 407-12.
60. Lacey, C. J., J. Boyes, O. Gerlach, et al. (2005). GABAb receptors at glutamatergic synapses in the rat striatum. Neuroscience 136: 1083-95.
61. Lashley, K. S. (1951). The problem of serial order in behavior. In Cerebral Mechanisms in Behavior, ed. L. A. Jeffres. New York: John Wiley and Sons, Inc., pp. 112-36.
62. Lein, E. S., M. J. Hawrylycz, N. Ao, et al. (2006). Genome-wide atlas of gene expression in the adult mouse brain. Nature 445(7124): 168-76.
63. Logothetis, N. (2002). The neural basis of the blood-oxygen-level-dependent functional magnetic resonance imaging signal. Phil. Trans. R. Soc. Lond. B 357: 1003-1037.
64. Lu, X., O. Hikosaka, and S. Miyachi (1998). Role of monkey cerebellar nuclei in skill for sequential movement. J. Neurophysiol. 79: 2245-54.
65. Martin, S. C., S. J. Russek, and D. H. Farb (2001). Human GABAbR genomic structure: evidence for splice variants in GABAbR1 but not GABAbR2. Gene 278: 63-79.
66. Matsuzaka, Y., N. Picard, and P. L. Strick (2007). Skill representation in the primary motor cortex after long-term practice. J. Neurophysiol. 97(2): 1819-32.
67. Matthysse, S., P. S. Holzman, J. F. Gusella, et al. (2004). Linkage of eye movement dysfunction to chromosome 6p in schizophrenia: additional evidence. Am. J. Med. Genet. B Neuropsychiatr. Genet. 128(1): 30-6.
68. Merzenich, M., B. Wright, W. Jenkins, et al. (1996). Cortical plasticity underlying perceptual, motor, and cognitive skill development: implications for neurorehabilitation. Cold Spring Harb. Symp. Quant. Biol. 61: 1-8.
69. Miller, G. A. (1956). The magical number seven, plus or minus two: some limits to our capacity for processing information. J. Exp. Psychol. 41: 329-35.
70. Newman, P. P. and H. Reza (1979). Functional relationships between the hippocampus and the cerebellum: an electrophysiological study of the cat. J. Physiol. 287: 405-26.
71. Nicola, S. M., J. Surmeier, and R. C. Malenka (2000). Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. Annu. Rev. Neurosci. 23: 185-215.
72. Nisenbaum, E. S., T. W. Berger, and A. A. Grace (1993). Depression of glutamatergic and GABAergic synaptic responses in striatal spiny neurons by stimulation of presynaptic GABAB receptors. Synapse 14(3): 221-42.
73. Novak, K. E. (2001). Neural control of discrete movement segments/the role of the cerebellum in the control and learning of movements. Doctoral thesis in Biomedical Engineering. Evanston, Northwestern University.
74. Novak K. E., L. E. Miller, and J. C. Houk (2000). Kinematic properties of rapid hand movements in knob turning task. Exp. Brain Res. 132(4): 419-33.
75. Novak, K. E., L. E. Miller, and J. C. Houk (2002). The use of overlapping submovements in the control of rapid hand movements. Exp. Brain Res. 144: 351-64.
76. Novak, K. E., L. E. Miller, and J. C. Houk (2003). Features of motor performance that drive adaptation in rapid hand movements. Exp. Brain Res. 148: 388-400.
77. Ohta, H. andY. P. Gunji (2006). Recurrent neural network architecturewith pre-synaptic inhibition for incremental learning. Neural Networks 19(8): 1106-19.
78. Pasupathy, A. and E. K. Miller (2005). Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433(7028): 873-6.
79. Patterson, P. H. (2007). Neuroscience. Maternal effects on schizophrenia risk. Science 318(5850): 576-7.
80. Plenz, D. (2003). When inhibition goes incognito: feedback interaction between spiny projection neurons in striatal function. TINS 26: 14427-32.
81. Prescott, T. J. (2005). Forced moves or good tricks in design space? Great moments in the evolution of the neural substrate for action selection. Adapt. Behav. 15(1): 9-31.
82. Preuss, T. M. (1995). Do rats have prefrontal cortex? The Rose-Woolsey-Akert program reconsidered. J. Cogn. Neurosci. 7(1): 1-24.
83. Raymond, J. L., S. G. Lisberger, and M. D. Mauk (1996). The cerebellum: a neuronal learning machine? Science 272: 1126-31.
84. Redgrave, P., T. J. Prescott, and K. Gurney (1999). The basal ganglia: a vertebrate solution to the selection problem? Neuroscience 89(4): 1009-23.
85. Roy, S. A., C. Bastianen, E. Nenonene, et al. (2003). Neural correlates of corrective submovement formation in the basal ganglia and motor cortex. Society for the Neural Control of Movement Abstracts.
86. Roy S., E. Tunik, C. Bastianen, et al. (2008). Firing patterns of GPi neurons associated with primary movements and corrective submovements. Society for Neuroscience, November 2008, Washington D. C.
87. Rubchinsky, L. L., N. Kopel, and K. A. Sigvardt (2003). Modeling facilitation and inhibition of competing motor programs in basal ganglia subthalamic nucleus-pallidal circuits. PNAS 100: 14427-32.
88. Sekerkova, G., E. Ilijic, and E. Mugnaini (2004). Bromodeoxyuridine administered during neurogenesis of the projection neurons causes cerebellar defects in rat. J. Comp. Neurol. 470(3): 221-39.
89. Shadmehr, R. and F. A. Mussa-Ivaldi (1994). Adaptive representation of dynamics during learning of a motor task. J. Neurosci. 14(5 Pt 2): 3208-24.
90. Shi, L., S. E. Smith, N. Malkova, et al. (2009). Activation of the maternal immune system alters cerebellar development in the offspring. Brain Behav. Immun. 23(1): 116-23.
91. Siddique, T. (2007). Neurobiology of mental health. Pak. J. Neurol. Sci. 2(4): 230-4.
92. Smith, S. E., J. Li, K. Garbett, K. Mirnics, and P. H. Patterson (2007). Maternal immune activation alters fetal brain development through interleukin-6. J. Neurosci. 27(40): 10695-702.
93. Smith, M. A. and R. Shadmehr (2005). Intact ability to learn internal models of arm dynamics in Huntington's disease but not cerebellar degeneration. J. Neurophysiol. 93(5): 2809-21.
94. Stefan, M., K. C. Claiborn, E. Stasiek, et al. (2005). Genetic mapping of putative Chrna7 and Luzp2 neuronal transcriptional enhancers due to impact of a transgene-insertion and 6. 8 Mb deletion in a mouse model of Prader-Willi and Angelman syndromes. BMC Genomics 6: 157.
95. Sternad, D. and S. Schaal (1999). Segmentation of endpoint trajectories does not imply segmented control. Exp. Brain Res. 124(1): 118-36.
96. Sutton, R. S. and A. G. Barto (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
97. Tepper, J. M., T. Koos, and C. J. Wilson (2004). GABAergic microcircuits in the neostriatum. Trends Neurosci. 27(11): 662-9.
98. Toni, I., J. Rowe, K. E. Stephan, and R. E. Passingham (2002). Changes of cortico-striatal effective connectivity during visuomotor learning. Cerebral Cortex 12: 1040-1047.
99. Tunik, E., J. C. Houk, and S. T. Grafton (2009). Basal ganglia contribution to the initiation of corrective submovements. Neuroimage 47: 1757-66.
100. Wang, J., G. Dam, S. Yildirim, et al. (2008). Reciprocity between the cerebellum and the cerebral cortex: nonlinear dynamics in microscopic modules for generating voluntary motor commands. Complexity 14(2): 29-45.
101. Wang, L., D. Mamah, M. P. Harms, et al. (2008). Progressive deformation of deep brain nuclei and hippocampal-amygdala formation in schizophrenia. Biol. Psychiatry 64(12): 1060-8.
102. Wise, S. P. (2008) Forward frontal fields: phylogeny and fundamental function. Trends Neurosci. 31: 599-608.
103. Woodworth, R. S. (1899). The accuracy of voluntary movement. Psychol. Rev. 3(2): 1-114.