A cerebellar model of timing and prediction in the control of reaching

Neural Computation

Volumn 11, Issue 3, 1999, Pages 565-594

  Barto, Andrew G ^a   Fagg, Andrew H ^a   Sitkoff, Nathan ^a   Houk, James C ^b  

^a Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTATION; ANIMAL; ARM; BIOLOGICAL MODEL; CEREBELLUM; COMPUTER SIMULATION; FEEDBACK SYSTEM; HUMAN; LEARNING; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY; REVIEW; TIME;

ADAPTATION, PHYSIOLOGICAL; ANIMALS; ARM; CEREBELLUM; COMPUTER SIMULATION; FEEDBACK; HUMANS; LEARNING; MODELS, NEUROLOGICAL; MOVEMENT; TIME FACTORS;

EID: 0033111390     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976699300016575     Document Type: Article

References (85)

1. Albus, J. S. (1971). A theory of cerebellar function. Mathematical Biosciences, 10, 25-61.
2. Alstermark, B., Eide, E., Górska, T., Lundberg, A., & Pettersson, L. G. (1984). Visually guided switching of forelimb target reaching in cats. Acta. Physiol. Scand., 120, 151-153.
3. Alstermark, B., T. Górska, A. L., Pettersson, L. G., & Walkowska, M. (1987b). Effect of different spinal cord lesions on visually guided switching of target-reaching in cats. Neuroscience Research, 5, 63-67.
4. Alstermark, B., Lundberg, A., Pinter, M. J., & Sadaki, S. (1987a). Long C3-C5 propriospinal neurones in the cat. Brain Research, 404, 382-388.
5. Andersson, G., & Armstrong, D. M. (1987). Complex spikes in Purkinje cells in the lateral vermis (b zone) of the cat cerebellum during locomotion. Journal of Physiology, London, 385, 107-134.
6. Andersson, G., Campbell, N. C., Ekerot, C. F., Hesslow, G., & Oscarsson, O. (1984). Integration of mossy fiber and climbing fiber inputs to Purkinje cells. Experimental Brain Research (Suppl), 9, 145-150.
7. Arai, K., Keller, E. L., & Edelman, J. A. (1994). Two-dimensional neural network model of the primate saccadic system. Neural Networks, 7, 1115-1135.
8. Barto, A. G., Buckingham, J. T., & Houk, J. C. (1996). A predictive switching model of cerebellar movement control. In D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo (Eds.), Advances in neural information processing systems: Proceedings of the 1995 Conference (pp. 138-144). Cambridge, MA: MIT Press.
9. Benson, M. W., Bree, G. M., Kinahan, P. E., & Hoffmann, G. W. (1987). A teachable neural network based on an unorthodox neuron. Physica D, 22, 233-246.
10. Berthier, N. E., Singh, S. P., Barto, A. G., & Houk, J. C. (1993). Distributed representations of limb motor programs in arrays of adjustable pattern generators. Journal of Cognitive Neuroscience, 5, 56-78.
11. Bizzi, E., Hogan, N., Mussa-Ivaldi, F. A., & Gister, S. (1992). Does the nervous system use equilibrium-point control to guide single and multiple joint movements? Behavioral and Brain Sciences, 15, 603-613.
12. Buckingham, J. T., Barto, A. G., & Houk, J. C. (1995). Adaptive predictive control with a cerebellar model. In Proceedings of the 1995 World Congress on Neural Networks (pp. 373-380). Mahwah, NJ: Erlbaum.
13. Buckingham, J. T., & Willshaw, D. (1992). A note on the storage capacity of the associative net. Network: Computation in Neural Systems, 3(4), 404-414.
14. Campbell, N. C., Ekerot, C. F., Hesslow, G., & Oscarsson, O. (1983). Dendritic plateau potentials evoked in Purkinje cells by parallel fibre volleys in the cat. Journal of Physiology (Lond), 340, 209-223.
15. Chen, C., & Thompson, R. F. (1995). Temporal specificity of long-term depression in parallel fiber - Purkinje synapses in rat cerebellar slice. Learning and Memory, 2, 185-198.
16. Crepel, F., Hemart, N., Jaillard, D., & Daniel, H. (1996). Cellular mechanisms of long-term depression in the cerebellum. Behavioral and Brain Sciences, 29(3), 347.
17. Dean, P. (1995). Modelling the role of the cerebellar fastigial nuclei in producing accurate saccades: The importance of burst timing. Neuroscience, 68, 1059-1077.
18. Ekerot, C. F., & Kano, M. (1989). Stimulation parameters influencing climbing fiber induced long-term depression of parallel fiber synapses. Neuroscience Research, 6, 264-268.
19. Ekerot, C. F., & Oscarsson, O. (1981). Prolonged depolarization elicited in Purkinje cell dendrites by climbing fiber impulses in the cat. Journal of Physiology (Lond), 318, 207-221.
20. Fagg, A. H., Sitkoff, N., Barto, A. G., & Houk, J. C. (1997a). Cerebellar learning for control of a two-link arm in muscle space. In Proceedings of the IEEE Conference on Robotics and Automation (pp. 2638-2644).
21. Fagg, A. H., Sitkoff, N., Barto, A. G., & Houk, J. C. (1997b). A model of cerebellar learning for control of arm movements using muscle synergies. In Proceedings of the IEEE Symposium on Computational Intelligence in Robotics and Automation (pp. 6-12).
22. Feldman, A. (1966). Functional tuning of the nervous system with control of movement or maintenance of a steady posture. II Controllable parameters of the muscle. Biophysics, 11, 565-578.
23. Feldman, A. (1974). Change in length of the muscle as a consequence of the shift in equilibrium in the muscle-load system. Biophysics, 19, 544-548.
24. Fu, Q.-G., Mason, C. R., Flament, D., Coltz, J. D., & Ebner, T. J. (1997). Movement kinematics encoded in complex spike discharge of primate cerebellar Purkinje cells. NeuroReport, 8, 523-529.
25. Gellman, R., Gibson, A. R., & Houk, J. C. (1983). Somatosensory properties of the inferior olive of the cat. Journal of Comparative Neurology, 215, 228-243.
26. Gellman, R., Gibson, A. R., & Houk, J. C. (1985). Inferior olivary neurons in the awake cat: Detection of contact and passive body displacement. Journal of Neurophysiology, 54, 40-60.
27. Georgopoulos, A. P., Kalaska, J. F., Caminiti, R., & Massey, J. T. (1983). Interruption of motor cortical discharge subserving aimed arm movements. Experimental Brain Research, 49, 327-340.
28. Ghez, C. (1979). Contributions of central programs to rapid limb movement in the cat. In H. Asanuma and V. J. Wilson (Eds.), Integration in the nervous system (pp. 305-320). Tokyo: Igaku-Shoin.
29. Ghez, C., Gordon, J., Ghilardi, M. F., Christakos, C. N., & Cooper, S. E. (1990). Roles of proprioceptive input in the programming of arm trajectories. In The Brain: Cold Spring Harbor Symp. Quant. Biol. (Vol. 55, pp. 837-847). Cold Spring Harbor, NY: Cold Springs Harbor Laboratory Press.
30. Ghez, C., & Martin, J. H. (1982). The control of rapid limb movement in the cat. III. Agonist-antagonist coupling. Experimental Brain Research, 45, 115-125.
31. Gielen, C. C. A. M., & Houk, J. C. (1984). Nonlinear viscosity of human wrist. Journal of Neurophysiology, 52, 553-569.
32. Gielen, C. C. A. M., & Houk, J. C. (1987). A model of the motor servo: Incorporating nonlinear spindle receptor and muscle mechanical properties. Biological Cybernetics, 57, 217-231.
33. Goodale, M. A., Pélisson, D., & Prablanc, C. (1986). Large adjustments in visually guided reaching do not depend on vision of the hand or perception of target displacement. Nature, 320, 748-750.
34. Goodwin, G. C., & Sin, K. S. (1984). Adaptive filtering prediction and control. Englewood Cliffs, NJ: Prentice Hall.
35. Gutman, A. M. (1991). Bistability of dendrites. International Journal of Neural Systems, 1, 291-304.
36. Gutman, A. M. (1994). Gelfand-Tsetlin principle of minimal afferentation and bistability of dendrites. International Journal of Neural Systems, 5, 83-86.
37. Hoffman, G. W. (1986). A neural network model based on the analogy with the immune system. Journal of Theoretical Biology, 122, 33-67.
38. Horn, K. M., Van Kan, P. L. D., & Gibson, A. R. (1996). Reduction of rostral dorsal acessory olive responses during reaching. Journal of Neurophysiology, 76, 4140-4151.
39. Houk, J. C. (1989). Cooperative control of limb movements by the motor cortex. In R. M. J. Cotterill (Ed.), Models of brain function (pp. 309-325). Cambridge: Cambridge University Press.
40. Houk, J. C., & Alford, S. (1996). Computational significance of the cellular mechanisms for synaptic plasticity in Purkinje cells. Behavioral and Brain Sciences, 19(3), 457.
41. Houk, J. C., & Barto, A. G. (1992). Distributed sensorimotor learning. In G. E. Stelmach and J. Requin (Eds.), Tutorials in motor behavior II (pp. 71-100). Amsterdam: Elsevier Science Publishers.
42. Houk, J. C., Buckingham, J. T., & Barto, A. G. (1996). Models of the cerebellum and motor learning. Behavioral and Brain Sciences, 19, 368-383.
43. Houk, J. C., Galiana, H. L., & Guitton, D. (1992). Cooperative control of gaze by the superior colliculus, brainstem and cerebellum. In G. E. Stelmach and J. Requin (Eds.), Tutorials in motor behavior II (pp. 443-474). Amsterdam: Elsevier Science Publishers.
44. Houk, J. C., Keifer, J., & Barto, A. G. (1993). Distributed motor commands in the limb premotor network. Trends in Neuroscience, 16, 27-33.
45. Houk, J. C., & Rymer, W. Z. (1981). Neural control of muscle length and tension. In V. B. Brooks (Ed.), Handbook of physiology: Sec. 1: Vol. 2. Motor control (pp. 247-323). Bethesda, MD: American Physiological Society.
46. Houk, J. C., Singh, S. P., Fisher, C., & Barto, A. G. (1990). An adaptive network inspired by the anatomy and physiology of the cerebellum. In T. Miller, R. S. Sutton, and P. J. Werbos (Eds.), Neural networks for control (pp. 301-348). Cambridge, MA: MIT Press.
47. Houk, J. C., & Wise, S. P. (1995). Distributed modular architectures linking basal ganglia, cerebellum and cerebral cortex: Their role in planning and controlling action. Cerebral Cortex, 5, 95-110.
48. Ito, M. (1984). The cerebellum and neural control. New York: Raven Press.
49. Kawato, M., & Gomi, H. (1992). A computational model of four regions of the cerebellum based on feedback-error learning. Biological Cybernetics, 68, 95-103.
50. Kawato, M., & Gomi, H. (1993). Feedback-error-learning model of cerebellar motor control. In N. Mano, I. Hamada, and M. R. DeLong (Eds.), Role of the cerebellum and basal ganglia in voluntary movement (pp. 51-61). Amsterdam: Elsevier Science.
51. Keeler, J. D. (1990). A dynamical system view of cerebellar function. Physica D, 42, 396-410.
52. Keller, E. L., & Robinson, D. A. (1971). Absence of stretch reflex in extraocular muscles of the monkey. Journal of Neurophysiology, 34, 908-919.
53. Kettner, R. E., Mahamud, S., Leung, H.-C., Barto, A. G., Houk, J. C., Peterson, B. W., & Sitkoff, N. (1997). Prediction of complex two-dimensional trajectories by the eye and by a cerebellar model of smooth eye movement. Journal of Neurophysiology, 77, 2115-2130.
54. Kiehn, O. (1991). Plateau potentials and active integration in the "final common pathway" for motor behavior. Trends in Neuroscience, 14, 68-73.
55. Kitazawa, S., Kimura, T., & Yin, P.-B. (1998). Cerebellar complex spikes encode both destinations and errors in arm movements. Nature, 392, 494-497.
56. Klopf, A. H. (1972). Brain function and adaptive systems - A heterostatic theory (Tech. Rep. No. AFCRL-72-0164). Bedford, MA: Air Force Cambridge Research Laboratories.
57. Klopf, A. H. (1982). The hedonistic neuron: A theory of memory, learning, and intelligence. Washington, DC: Hemisphere.
58. Klopf, A. H. (1988). A neuronal model of classical conditioning. Psychobiology, 16, 85-125.
59. Lev-Ram, V., Jiang, T., Wood, J., Lawrence, D. S., & Tsien, R. Y. (1997). Synergies and coincidence requirements between NO, cGMP, and Ca2+ in the induction of cerebellar long-term depression. Neuron, 18, 1025-1038.
60. Llinás, R., & Sugimori, M. (1980). Electrophysiological properties of in vitro Purkinje cell dendrites in mammalian cerebellar slices. Journal of Physiology (London), 305, 197-213.
61. Marr, D. (1969). A theory of cerebellar cortex. Journal of Physiology (London), 202, 437-470.
62. Miall, R. C., Weir, D. J., Wolpert, D. M., & Stein, J. F. (1993). Is the cerebellum a Smith predictor? Journal of Motor Behavior, 25, 203-216.
63. Optican, L. M. (1995). A field theory of saccade generation: Temporal-to-spatial transform in the superior colliculus. Vision Research, 35, 3313-3320.
64. Optican, L. M., & Robinson, D. A. (1980). Cerebellar-dependent adaptive control of primate saccadic system. Journal of Neurophysiology, 44, 1058-1076.
65. Pettersson, L.-G., Lundberg, A., Alstermark, B., Isa, T., & Tantisira, B. (1997). Effect of spinal cord lesions on forelimb target-reaching and on visually guided switching of target-reaching in the cat. Neuroscience Research, 29, 241-256.
66. Prablanc, C., & Martin, O. (1992). Automatic control during hand reaching at undetected two-dimensional target displacements. Journal of Neurophysiology, 67, 455-469.
67. Raymond, J. L., Lisberger, S. G., & Mauk, M. D. (1996). The cerebellum: A neuronal learning machine? Science, 272(5265), 1126-1131.
68. Robinson, D. A. (1975). Oculomotor control signals. In G. Lennerstrand & P. Bach-y-rita (Eds.), Basic mechanisms of ocular motility and their clinical implications (pp. 337-374). Oxford: Pergamon Press.
69. Sakurai, M. (1987). Synaptic modification of parallel fibre-Purkinje cell transmission in in vitro guinea-pig cerebellar slices. Journal of Physiology (London), 394, 463-480.
70. Schreurs, B. G., & Alkon, D. L. (1993). Rabbit cerebellar slice analysis of long-term depression and its role in classical conditioning. Brain Research, 631, 235-240.
71. Schreurs, B. G., Oh, M. M., & Alkon, D. L. (1996). Pairing-specific long-term depression of Purkinje cell excitatory postsynaptic potentials results from a classical conditioning procedure in the rabbit cerebellar slice. Journal of Physiology, 75, 1051-1060.
72. Schweighofer, N. (1995). Computational models of the cerebellum in the adaptive control of movements. Unpublished doctoral dissertation, University of Southern California, Los Angeles.
73. Schweighofer, N., Arbib, M. A., & Dominey, P. F. (1996a). A model of the cerebellum in adaptive control of saccadic gain I. The model and its biological substrate. Biological Cybernetics, 75, 19-28.
74. Schweighofer, N., Arbib, M. A., & Dominey, P. F. (1996b). A model of the cerebelllum in adaptive control of saccadic gain II. Simulation results. Biological Cybernetics, 75, 29-36.
75. Simpson, J. I., Wylie, D. R., & de Zeeuw, C. I. (1996). On climbing fiber signals and their consequence(s). Behavioral and Brain Sciences, 19, 384-398.
76. Sinkjaer, T., Wu, C. H., Barto, A. G., & Houk, J. C. (1990). Cerebellar control of endpoint position - A simulation model. In Proceedings of the 1990 International Joint Conference on Neural Networks (pp. II705-710). San Diego, CA.
77. Sutton, R. S., & Barto, A. G. (1981). Toward a modern theory of adaptive networks: Expectation and prediction. Psychological Review, 88, 135-170.
78. Sutton, R. S., & Barto, A. G. (1990). Time-derivative models of Pavlovian reinforcement. In M. Gabriel and J. Moore (Eds.), Learning and computational neuroscience: Foundations of adaptive networks (pp. 497-537). Cambridge, MA: MIT Press.
79. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
80. Tyrrell, T., & Willshaw, D. J. (1992). Cerebellar cortex: Its simulation and the relevance of Marr's theory. Proceedings of the Royal Society of London B, 336, 239-257.
81. Van Kan, P. L. E., Gibson, A. R., & Houk, J. C. (1993a). Movement-related inputs to intermediate cerebellum of the monkey. Journal of Neurophysiology, 69, 74-94.
82. Van Kan, P. L. E., Houk, J. C., & Gibson, A. R. (1993b). Output organization of intermediate cerebellum of the monkey. Journal of Neurophysiology, 69, 57-73.
83. Wang, L., & Ross, J. (1990). Synchronous neural networks of nonlinear threshold elements with hysteresis. Proceedings of the National Academy of Science USA, 87, 988-992.
84. Wu, C. H., Houk, J. C., Young, K. Y., & Miller, L. E. (1990). Nonlinear damping of limb motion. In J. M. Winters and S. L.-Y. Woo (Eds.), Multiple muscle systems: Biomechanics and movement organization (pp. 214-235). New York: Springer-Verlag.
85. Yuen, G. L., Hockberger, P. E., & Houk, J. C. (1995). Bistability in cerebellar Purkinje cell dendrites modelled with high-threshold calcium and delayed-rectifier potassium channels. Biological Cybernetics, 73, 375-388.