The cerebellum in action: A simulation and robotics study

European Journal of Neuroscience

Volumn 16, Issue 7, 2002, Pages 1361-1376

  Hofstötter, Constanze ^a   Mintz, Matti ^b   Verschure, Paul F M J ^a  

^a Institute of Neuroinformatics Zurich   (Switzerland)

^b TEL AVIV UNIVERSITY   (Israel)

Author keywords

Cerebellar cortex; Classical conditioning; Computational model; Learning; Real time behaviour; Response timing; Robot

Indexed keywords

ARTICLE; BEHAVIOR; CELL NUCLEUS; CEREBELLUM; CEREBELLUM CORTEX; CONDITIONING; LEARNING; MATHEMATICAL MODEL; MOTOR ACTIVITY; NERVE CELL PLASTICITY; PRIORITY JOURNAL; PURKINJE CELL; ROBOTICS; SIMULATION; SYNAPSE;

ANIMALS; CEREBELLUM; COMPUTER SIMULATION; CONDITIONING, CLASSICAL; HUMANS; NEURONAL PLASTICITY; ROBOTICS;

EID: 0036420767     PISSN: 0953816X     EISSN: None     Source Type: Journal    
DOI: 10.1046/j.1460-9568.2002.02182.x     Document Type: Article

References (97)

1. Aizenman, C.D. & Linden, D.J. (1999) Regulation of the rebound depolarization and spontaneous firing patterns of deep nuclear neurons in slices of rat cerebellum. J. Neurophysiol., 82, 1697-1709.
2. Aizenman, C.D., Manis, R. & Linden, D.J. (1998) Polarity of long-term synaptic gain change is related to postsynaptic spike firing at a cerebellar inhibitory synapse. Neuron, 21, 827-835.
3. Albus, J.S. (1971) A theory of cerebellar function. Math. Biosci., 10, 25-61.
4. Attwell, P.J.E., Rahman, S. & Yeo, C.H. (2001) Acquisition of eyeblink conditioning is critically dependent on normal function in cerebellar cortical lobule HVI. J. Neurosci., 21, 5715-5722.
5. Barto, A.G. & Sutton, R.S. (1982) Simulation of anticipatory responses in classical conditioning by a neuron-like adaptive element. Behav. Brain Res., 4, 221-235.
6. Bao, S., Chen, L., Kim, J.J & Thompson, R.F. (2002) Cerebellar cortical inhibition and classical eyeblink conditioning. Proc. Natl. Acad. Sci. USA, 99, 1592-1597.
7. Barto, A.G., Fagg, A.H., Sitkoff, N. & Houk, J.C. (1999) A cerebellar model of timing and prediction in the control of reaching. Neural Computation, 11, 565-594.
8. Bernardet, U., Blanchard, M. J. & Verschure, P.F.M.J. (2001) IQR: A distributed system for real-time real-world neuronal simulation. Neurocomputing, 44-46, 1043-1048.
9. Bloedel, R.J. & Bracha, V. (1998) Current concepts of climbing fiber function. Anat. Rec., 253, 118-126.
10. Bower, G.H. & Hillgard, E.R. (1981) Theories of Learning, 5th Edn. Prentice Hall Inc., Englewood Cliffs, NJ.
11. Braitenberg, A. & Atwood, R.P. (1958) Morphological observations on the cerebellar cortex. J. Comp. Neurol., 109, 1-27.
12. Chen, C. & Thompson, R.F. (1995) Temporal specificity of long-term depression in parallel fiber-Purkinje synapses in rat cerebellar slice. Learn. Mem., 2, 185-198.
13. Coenen, 0.J., Arnold, M.P., Jabrin, M.A. & Sejnowski, T.J. (2001) Parallel (r)ber coding in the cerebellum for life-long learning. Autonomous Robots, 11, 291-297.
14. De Zeeuw, C.L., Simpson, J.L., Hoogenraad, C.G., Galjart, N., Kaekkoek, S.K.E. & Ruigrok, T. (1998) Microcircuitry and function of the inferior olive. Trends. Neurosci., 21, 391-400.
15. Fiala, J.C., Grossberg, S. & Bullock, D. (1996) Metabotropic glutamate receptor activation in cerebellar Purkinje cells as substrate for adaptive timing of the classically conditioned eye-blink response. J. Neurosci., 16, 3760-3774.
16. Gardner, R.A. & Gardner, B.T. (1988) Feedforward versus feedback: An ethological alternative to the law of effect. Behav. Brain. Sci., 11, 429-493.
17. Gauk, V. & Jaeger, D. (2000) The control of rate and timing of spikes in the deep nuclei by inhibition. J. Neurosci., 20, 3006-3016.
18. Gluck, M., Allen, M.T., Myers, C.E. & Thompson, R.F. (2001) Cerebellar substrates for error correction in motor conditioning. Neurobiol. Learn. Mem., 76, 314-341.
19. Gormezano, L., Kehoe, E.J. & Marshall, B.S. (1983) Twenty years of classical conditioning with the rabbit. Prog. Psychobiol. Physiol. Psychol., 10, 197- 263.
20. Gruart, A., Guillazo-Blanch, G., Fernandez-Mas, R., Jimenez-Diaz, L. & Delgado-Gaxcia, J.M. (2000) Cerebellar posterior interpositus nucleus as an enhancer of classically conditioned eyelid responses in alert cats. J. Neurophysiol., 84, 2680-2690.
21. Hansel, C., Linden, D.J. & D'Angelo, E. (2001) Beyond parallel fiber LTD: The diversity of synaptic and nonsynaptic plasticty in the cerebellum. Nature Neurosci., 4, 467-475.
22. Hartell, N.A. (2002) Parallel fiber plasticity. Cerebellum, 1, 3-18.
23. Hesslow, G. (1994a) Correspondence between climbing fibre input and motor output in eyeblink-related areas in the cat cerebellar cortex. J. Physiol. (Lond.), 476, 229-244.
24. Hesslow, G. (1994b) Inhibition of classically conditioned eyeblink responses by stimulation of the cerebellar cortex in the decerebrate cat. J. Physiol. (Lond.), 476, 245-256.
25. Hesslow, G. & Ivarsson, M. (1994) Suppression of cerebellar Purkinje cells during conditioned responses in. Neuroreport, 5, 649-652.
26. Hesslow, G. & Ivarsson, M. (1996) Inhibition of the inferior olive during conditioned response in the decerebrate ferret. Exp. Brain Res., 110, 36-46.
27. Hesslow, G., Svensson, P. & Ivarsson, M. (1999) Learned movements elicited by direct stimulation of cerebellar mossy fiber afferents. Neuron, 24, 179-185.
28. Houk, J.C., Buckingham, J.T. & Barto, A.G. (1996) Models of the cerebellum and motor learning. Behav. Brain Sci., 19, 368-383.
29. Huang, J., Jabri, M.A., Coenen, O.J. & Sejnowski, T.J. (2000) Models of basal ganglia and cerebellum for sensimotor integration and predictive control. 7-8 September 2000, Humanoids 2000: First IEEE-RAS International Conference on Humanoid Robotics, MIT, MA, USA.
30. Hull, C.L. (1939) The problem of stimulus equivalence in behavior theory. Psycholog. Rev., 46, 9-30.
31. Ito, M. (1984) The modifiable neuronal network of the cerebellum. Jpn. J. Physiol., 5, 781-792.
32. Ito, M. (2001) Cerebellar long-term depression: Characterization, signal transduction, and functional roles. Physiol. Rev., 81, 1143-1195.
33. Ito, M. & Kano, M. (1982) Long-lasting depression of parallel fiber-Purkinje cell transmission induced by conjunctive stimulation of parallel fibers and climbing fibers. Neurosci. Lett., 33, 253-258.
34. Kawato, M. (1999) Internal models for motor control and trajectory planning. Curr. Opin. Neurobiol., 9, 718-727.
35. Kilgard, M.P. & Merzenich, M.M. (1998) Cortical map reorganization enabled by nucleus basalis activity. Science, 279, 1714-1718.
36. Kim, J.J., Krupa, D.J. & Thompson, R.F. (1998) Inhibitory cerebello-olivary projections and blocking effect in classical conditioning. Science, 279, 570-573.
37. Kim, J.J. & Thompson, R.F. (1997) Cerebellar circuits and synaptic mechanisms involved in classical eyeblink conditioning. Trends Neurosci., 20, 177-181.
38. Kistler, W.M. & van Hemmen, J.L. (1999) Delayed reverberation through time windows as a key to cerebellar funtion. Biol. Cybern., 81, 373-380.
39. Kitazawa, S. (2002) Neurobiology: Ready to unlearn. Nature, 416, 270-273.
40. Klopf, A. (1982) The Hedonistic Neuron: A Theory of Memory, Learning and Intelligence. Hemisphere, Washington DC.
41. Krupa, D.J. & Thompson, R.F. (1997) Reversible inactivation of the cerebellar interpositus nucleus completely prevents acquisition of the classically conditioned eye-blink response. Learn. Mem., 3, 545-556.
42. Kuroda, S., Yamamoto, K., Miyamoto, H., Doya, K. & Kawato, M. (2001) Statisttical characteristics of climbing fiber spikes necessary for efficient cerebellar learning. Biol. Cybern., 84, 183-192.
43. Lavond, D.G., Kim, J.J., & Thompson, R.F. (1993) Mammalian brain substrates of aversive classical conditioning. Annu. Rev. Psychol., 44, 317-342.
44. Lennartz, R.C. & Weinberger, N.M. (1992) Analysis of response systems in Pavlovian conditioning reveals rapidly versus slowly acquired conditioned responses: Support for two factors, implications for behavior and neurobiology. Psychobiology, 20, 93-119.
45. Linden, D.J. & Ahn, S. (1991) Activation of the presynaptic cAMP-dependent protein kinase is required for induction of cerebellar long-term potentiation. J. Neurosci., 19, 10221-10227.
46. Linden, D.L. & Conner, J.A. (1995) Long-term synaptic depression. Annu. Rev. Neurosci., 18, 319-357.
47. Llinas, R.R., Lang, E.J. & Welsh, J.P. (1997) The cerebellum, LTD, and memory: Alternative views. Learn. Mem., 3, 445-455.
48. MacKay, W.A. & Murphy, J.T. (1976) Integrative versus delay line characteristics of cerebellar cortex. Can. J. Neurol. Sci., 3, 85-97.
49. Mackintosh, N.J. (1974) The Psychology of Animal Learning. Academic Press, London.
50. Marr, D. (1969) A theory of cerebellar cortex. J. Neurophysiol., 202, 437-470.
51. Mauk, M.D. (1997) Roles of cerebellar cortex and nuclei in motor learning: Contradictions or clues? Neuron, 18, 343-346.
52. Mauk, M.D. & Thompson, R.F. (1987) Retention of classically conditioned eyelid responses following acute decerebration. Brain Res., 403, 89-95.
53. Mauk, M.D., Garcia, K.S., Medina, J.F. & Steele, P.M. (1998) Does cerebellar LTD mediate motor learning? Towards a resolution without a smoking gun. Neuron, 20, 359-362.
54. McCormick, D.A. & Thompson, R.F. (1984) Neuronal response of the rabbit cerebellum during acquisition and performance of a classically conditioned nictitating membrane-eyelid response. J. Neurosci., 4, 2811-2822.
55. Medina, J.F., Garcia, K.S., Nores, W.L., Taylor, X.M. & Mauk, M.D. (2000) Timing mechanisms in the cerebellum: Testing predictions of a large-scale computer simulation. J. Neurosci., 20, 5516-5525.
56. Medina, J.F. & Mauk, M.D. (2000) Computer simulation of cerebellar information processing. Nature Neurosci., 19, 1205-1211.
57. Medina, J.F., Nores, W.L. & Mauk, M.D. (2002) Inhibition of climbing fibres is a signal for the extinction of conditioned eyelid responses. Nature, 416, 330-333.
58. Mintz, M. & Wang-Ninio, Y. (2001) Two-stage theory of conditioning: Involvement of the cerebellum and the amygdala. Brain Res., 897, 150-156.
59. Miyata, M., Finch, E.F., Khiroug, L., Hashimoto, K., Hayasaka, S., Oda, S.L., Inouye, X.I., Takagishi, Y., Augustine, G.J. & Kano, M. (2000) Local calcium release in dendritic spines required for long-term synaptic depression. Neuron, 28, 233-244.
60. Montague, P.R. & Sejnowski, T.J. (1994) The predictive brain: temporal coincidence and temporal order in synaptic learning mechanism. Learn. Mem., 1, 1-33.
61. Moore, J.W. & Choi, J.S. (1997) Conditioned response timing and integration in the cerebellum. Learn. Mem., 4, 116-129.
62. Ohyama, T. & Mauk, M.D. (2001) Latent acquisition of timed responses in cerebellar cortex. J. Neurosci., 21, 682-690.
63. Pavlov, I.P. (1927) Conditioned Reflexes. Oxford University Press, Oxford.
64. Pavlov, I.P. (1928) Lectures on Conditioned Reflexes: Twenty-Five Years of Objective Study of the Higher Nervous Ability (Behavior) of Animals. International Publishers, New York.
65. Perret, S.P. (1998) Temporal discrimination in the cerebellar cortex during conditioned eyelid responses. Exp. Brain. Res., 121, 115-124.
66. Perrett, S.P. & Mauk, M.D. (1995) Extinction of conditioned eyelid responses requires the anterior lobe of cerebellar cortex. J. Neurosci., 15, 2074-2080.
67. Perrett, S.P., Ruiz, B.R. & Mauk, M.D. (1993) Cerebellar cortex lesions disrupt learning-dependent timing of conditioned eyelid responses. J. Neurosci., 13, 1708-1718.
68. Raman, I.M. & Bean, B.P. (1999) Ionic currents underlying spontaneous action potentials in isolated cerebellar Purkinje neurons. J. Neurosci., 19, 1663-1674.
69. Raymond, J.L., Lisberger, S.G. & Mauk, M.D. (1996) The cerebellum: A neuronal learning machine. Science, 272, 1126-1130.
70. Rogers, R.F., Britton, G.B. & Steinmetz, J.E. (2001) Learning-related interpositus activity is conserved across species as studied during eyeblink conditioning in the rat. Brain. Res., 905, 171-177.
71. Salin, P.A., Malenka, R.G. & Roger, A. (1996) Cyclic AMP mediates a presynaptic form of LTP at cerebellar parallel fiber synapses. Neuron, 16, 797-803.
72. Sanchez-Montanes, M.A., Verschure, P.F. & Koenig, P. (2000) Local and global gating of synaptic plasticity. Neural. Comput., 12, 519-529.
73. Sato, Y., Miura, A., Fushiki, H. & Kawasaki, T. (1992) Short-term modulation of cerebellar Purkinje cell activity after spontaneous climbing fiber input. J. Neurophysiol., 68, 2051-2062.
74. Schreurs, B.G., Oh, M.M. & Alkon, D.L. (1996) Pairing-specific long-term depression of Purkinje cell excitatory postsynaptic potentials results from a classical conditioning procedure in the rabbit cerebellar slice. J. Neurophysiol., 75, 1051-1060.
75. Schreurs, B.G., Pavel, A.G., Tomsic, D., Alkon, D.L. & Shi, T. (1998) Intracellular correlates of acquisition and long-term memory of classical conditioning in Purkinje cell dentrites in slices of rabbit cerebellar lobule HVI. J. Neurosci., 16, 5498-5507.
76. Schultz, W., Dayan, P. & Montague, P.R. (1997) A neural substrate of prediction and reward. Science, 275, 1593-1599.
77. Schultz, W. & Dickinson, A. (2000) Neuronal coding of prediction errors. Annu. Rev. Neurosci., 23, 473-500.
78. Sears, L.L. & Steinmetz, J.E. (1991) Dorsal accessory inferior olive activity diminishes during acquisition of the rabbit classically conditioned eyelid response. Brain Res., 545, 114-122.
79. Sherman, S.M. (2001) Tonic and burst firing: Dual modes of thalamocortical relay. Trends Neurosci., 24, 122-126.
80. 2+ activity. Neuroreport, 3, 231-234.
81. Spoelstra, I., Schweighofer, N. & Arbib, M.A. (2000) Cerebellar learning of accurate predicive control for fast-reaching movements. Biol. Cybern., 82, 312-333.
82. Steinmetz, J.E., Lavond, D.G. & Thompson, R.F. (1989) Classical conditioning in rabbits using pontine nucleus stimulation as a conditioned stimulus and inferior olive stimulation as an unconditioned stimulus. Synapse, 3, 225-233.
83. Steinmetz, J.E., Rosen, D.J., Chapman, P.F., Lavond, D.G. & Thompson, R.F. (1986) Classical conditioning of the rabbit eyelid response with a mossy-fiber stimulation CS: I. Pontine nuclei and middle cerebellar peduncle stimulation. Behav. Neurosci., 10, 878-887.
84. Sutton, R.S. & Barto, A.G. (1990) Time-derivative models of Pavlovian reinforcement. In Editor, A. & Editor, B. (eds), Learning and Computational Neuroscience: Foundations of Adaptive Networks, Chapter 12. MIT press, Location, pp 497-537.
85. Svensson, P. & Ivarsson, M. (1999) Short-lasting conditioned stimulus applied to the middle cerebellar peduncle elicits delayed conditioned eye blink responses in the decerebrate ferret. Eur. J. Neurosci., 11, 4333-4340.
86. Thompson, R.F., Berger, T.W. & Madden, I.V. (1983) Cellular processes of learning and memory in the mammalian CNS. Annu. Rev. Neurosci., 6, 447-491.
87. Thompson, R.F., Thompson, J.K., Kim, J.J, Krupa, D.J & Shinkman, P.G. (1998) The nature of reinforcement in cerebellar learning. Neurobiol. Learn. Mem., 70, 150-176.
88. Thorndike, E.L. (1898) Animal intelligence: An experimental study of the associative process in animals. Psychol. Monogr., 2.
89. Van der Smagt, P. (2000) Benchmarking cerebellar control. Robotics and Autonomous Systems, 32, 237-251.
90. Verschure, P.F.M.J. (1998) Synthetic epistomology: The acquisition, retention and expression of knowledge in natural and synthetic systems. In Proceedings of the 1998 World Congress on Computational Intelligencee, WCCI98, IEEE Press, Anchorage, Alaska, pp. 147-153.
91. Voegtlin, T. & Verschure, P.F.M.J. (1999) What can robots tell us about brains? A synthetic approach towards the study of learning and problem solving. Rev. Neurosci., 10, 291-310.
92. Wang, S.S.H, Denk, W. & Häusser, M. (2000) Coincidence detection in single dendritic spines mediated by calcium release. Nature Neurosci., 3, 1266-1273.
93. Webb, B. (2000) What does robotics offer animal behaviour? Anim. Behav., 60, 545-558.
94. Welsh, J.P. & Harvey, J.A. (1989) Cerebellar lesions and the nictitating membrane reflex: Performance deficits of the conditioned and unconditioned response. J. Neurosci., 9, 299-311.
95. Yeo, C.H., Hardiman, M.J. & Glickstein, M. (1985a) Classical conditioning of the nictitating membrane response of the rabbit. I. Lesions of the cerebellar nuclei. Exp. Brain Res., 60, 87-98.
96. Yeo, C.H., Hardiman, M.J. & Glickstein, M. (1985b) Classical conditioning of the nictitating membrane response of the rabbit. II: Lesions of the cerebellar cortex. Exp. Brain Res., 60, 99-113.
97. Yeo, C.H., Hardiman, M.J. & Glickstein, M. (1986) Classical conditioning of the nictitating membrane response of the rabbit. IV: Lesions of the inferior olive. Exp. Brain Res., 63, 81-92.