Cerebellar supervised learning revisited: Biophysical modeling and degrees-of-freedom control

Current Opinion in Neurobiology

Volumn 21, Issue 5, 2011, Pages 791-800

  Kawato, Mitsuo ^a   Kuroda, Shinya ^b   Schweighofer, Nicolas ^c  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^b UNIVERSITY OF TOKYO   (Japan)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AMPA RECEPTOR; CALCIUM ION; MITOGEN ACTIVATED PROTEIN KINASE; N METHYL DEXTRO ASPARTIC ACID RECEPTOR;

BIOLOGICAL MODEL; BIOPHYSICS; BRAIN CORTEX; BRAIN FUNCTION; CALCIUM TRANSPORT; CELL FUNCTION; CELL INTERACTION; CELL SYNCHRONIZATION; CEREBELLUM NUCLEUS; CORTICAL SYNCHRONIZATION; DENDRITIC SPINE; FEEDBACK SYSTEM; HUMAN; INTERNALIZATION; LEARNING; LEARNING ALGORITHM; LONG TERM DEPRESSION; LONG TERM POTENTIATION; NERVE CELL MEMBRANE STEADY POTENTIAL; NERVE CELL PLASTICITY; NERVE CONDUCTION; NERVE POTENTIAL; NEUROMODULATION; NEUROPHYSIOLOGY; NONHUMAN; OLIVARY NUCLEUS; POSTSYNAPTIC POTENTIAL; PREMOTOR CORTEX; PRESYNAPTIC POTENTIAL; PRIORITY JOURNAL; PROTEIN FUNCTION; PURKINJE CELL; REVIEW; SENSORIMOTOR FUNCTION; SYNAPTIC TRANSMISSION;

ACTION POTENTIALS; ANIMALS; BIOPHYSICS; CEREBELLUM; HUMANS; LEARNING; MODELS, BIOLOGICAL; NEURONAL PLASTICITY; NEURONS; NONLINEAR DYNAMICS;

EID: 80053405595     PISSN: 09594388     EISSN: 18736882     Source Type: Journal    
DOI: 10.1016/j.conb.2011.05.014     Document Type: Review

References (82)

1. Marr D. A theory of cerebellar cortex. J Physiol (London) 1969, 202:437-470.
2. Albus J. A theory of cerebellar function. Math Biosci 1971, 10:25-61.
3. Ito M. Neurophysiological aspects of the cerebellar motor control system. Int J Neurol 1970, 7:162-176.
4. Kawato M., Furukawa K., Suzuki R. A hierarchical neural-network model for control and learning of voluntary movement. Bio Cybern 1987, 57:169-185.
5. Kawato M. Internal models for motor control and trajectory planning. Curr Opin Neurobiol 1999, 9:718-727.
6. Dean P., Porrill J., Ekerot C., J{eth}ntell H. The cerebellar microcircuit as an adaptive filter: experimental and computational evidence. Nat Rev Neurosci 2010, 11:30-43.
7. D'Angelo E., De Zeeuw C. Timing and plasticity in the cerebellum: focus on the granular layer. Trends Neurosci 2009, 32:30-40.
8. Doya K. What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?. Neural Netw 1999, 12:961-974.
9. Ito M. The molecular organization of cerebellar long-term depression. Nat Rev Neurosci 2002, 3:896-902.
10. 2+ threshold dynamics detect spike timing in cerebellar Purkinje cells. J Neurosci 2005, 25:950-961.
11. Kotaleski J.H., Lester D., Blackwell K.T. Subcellular interactions between parallel fibre and climbing fibre signals in Purkinje cells predict sensitivity of classical conditioning to interstimulus interval. Integr Physiol Behav Sci 2002, 37:265-292.
12. Kuroda S., Schweighofer N., Kawato M. Exploration of signal transduction pathways in cerebellar long-term depression by kinetic simulation. J Neurosci 2001, 21:5693-5702.
13. Wang S.S., Denk W., Häusser M. Coincidence detection in single dendritic spines mediated by calcium release. Nat Neurosci 2000, 3:1266-1273.
14. Linden D.J. The return of the spike: postsynaptic action potentials and the induction of LTP and LTD. Neuron 1999, 22:661-666.
15. Caporale N., Dan Y. Spike timing-dependent plasticity: a Hebbian learning rule. Annu Rev Neurosci 2008, 31:25-46.
16. Urakubo H., Honda M., Tanaka K., Kuroda S. Experimental and computational aspects of signaling mechanisms of spike-timing-dependent plasticity. HFSP J 2009, 3:240-254.
17. Vetter P., Roth A., Häusser M. Propagation of action potentials in dendrites depends on dendritic morphology. J Neurophysiol 2001, 85:926-937.
18. Llinas R., Sugimori M. Electrophysiological properties of in vitro Purkinje cell dendrites in mammalian cerebellar slices. J Physiol 1980, 305:197-213.
19. Stuart G., Häusser M. Initiation and spread of sodium action potentials in cerebellar Purkinje cells. Neuron 1994, 13:703-712.
20. Wickens J.R., Begg A.J., Arbuthnott G.W. Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro. Neuroscience 1996, 70:1-5.
21. Shen W., Flajolet M., Greengard P., Surmejer D.J. Dichotomous dopaminergic control of striatal synaptic plasticity. Science 2008, 321:848-851.
22. Nakano T., Doi T., Yoshimoto J., Doya K. A kinetic model of dopamine- and calcium-dependent striatal synaptic plasticity. PLoS Comput Biol 2010, 6:e1000670.
23. Lindskog M., Kim M., Wikstrom M.A., Blackwell K.T., Kotaleski J.H. Transient calcium and dopamine increase PKA activity and DARPP-32 phosphorylation. PLoS Comput Biol 2006, 2:e119.
24. Fernandez E., Schiappa R., Girault J.A., Le Novere N. DARPP-32 is a robust integrator of dopamine and glutamate signals. PLoS Comput Biol 2006, 2:e176.
25. Barto A.G., Sutton R.S., Anderson C.W. Neuron-like elements that can solve difficult learning control problems. IEEE Trans Syst Man Cybern 1983, 13:835-846.
26. Okubo Y., Kakizawa S., Hirose K., Iino M. Cross talk between metabotropic and ionotropic glutamate receptor-mediated signaling in parallel fiber-induced inositol 1,4,5-trisphosphate production in cerebellar Purkinje cells. J Neurosci 2004, 24:9513-9520.
27. Markram H., Lubke J., Frotscher M., Sakmann B. Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 1997, 275:213-215.
28. Crick F. Memory and molecular turnover. Nature 1984, 312:101.
29. Lisman J. A mechanism for memory storage insensitive to molecular turnover: a bistable autophosphorylating kinase. Proc Natl Acad Sci USA 1985, 82:3055-3057.
30. Aslam N., Kubota Y., Wells D., Shouval H. Translational switch for long-term maintenance of synaptic plasticity. Mol Syst Biol 2009, 5:284.
31. Bhalla U.S., Iyengar R. Emergent properties of networks of biological signaling pathways. Science 1999, 283:381-387.
32. Momiyama A., Silver R.A., Häusser M., Notomi T., Wu Y., Shigemoto R., Cull-Candy S.G. The density of AMPA receptors activated by a transmitter quantum at the climbing fibre-Purkinje cell synapse in immature rats. J Physiol 2003, 549:75-92.
33. Tanaka J., Matsuzaki M., Tarusawa E., Momiyama A., Molnar E., Kasai H., Shigemoto R. Number and density of AMPA receptors in single synapses in immature cerebellum. J Neurosci 2005, 25:799-807.
34. Miller P., Zhabotinsky A.M., Lisman J.E., Wang X.J. The stability of a stochastic CaMKII switch: dependence on the number of enzyme molecules and protein turnover. PLoS Biol 2005, 3:e107.
35. Tanaka K., Augustine G.J. A positive feedback signal transduction loop determines timing of cerebellar long-term depression. Neuron 2008, 59:608-620.
36. 2+ requirements for cerebellar long-term synaptic depression: role for a postsynaptic leaky integrator. Neuron 2007, 54:787-800.
37. Ogasawara H., Kawato M. Bistable switches for synaptic plasticity. Sci Signal 2009, 2:pe7.
38. Le T.D., Shirai Y., Okamoto T., Tatsukawa T., Nagao S., Shimizu T., Ito M. Lipid signaling in cytosolic phospholipase A2alpha-cyclooxygenase-2 cascade mediates cerebellar long-term depression and motor learning. Proc Natl Acad Sci USA 2010, 107:3198-3203.
39. Doi T: Computational simulation of signaling pathways for cerebellar long-term depression. NAIST Doctoral Thesis 2006, 548.
40. Matsuda S., Launey T., Mikawa S., Hirai H. Disruption of AMPA receptor GluR2 clusters following long-term depression induction in cerebellar Purkinje neurons. EMBO J 2000, 19:2765-2774.
41. Hayer A., Bhalla U.S. Molecular switches at the synapse emerge from receptor and kinase traffic. PLoS Comput Biol 2005, 1:137-154.
42. Ajay S.M., Bhalla U.S. A role for ERKII in synaptic pattern selectivity on the time-scale of minutes. Eur J Neurosci 2004, 20:2671-2680.
43. Ogasawara H., Kawato M. The protein kinase Mζ network as a bistable switch to store neuronal memory. BMC Syst Biol 2010, 4:181.
44. Sdrulla A.D., Linden D.J. Double dissociation between long-term depression and dendritic spine morphology in cerebellar Purkinje cells. Nat Neurosci 2007, 10:546-548.
45. Cingolani L.A., Goda Y. Actin in action: the interplay between the actin cytoskeleton and synaptic efficacy. Nat Rev Neurosci 2008, 9:344-356.
46. Shigemoto R, Aziz W, Fukazawa Y, Wang W, Tarusawa E: Structural changes at parallel fiber-Purkinje cell synapses after long-term adaptation of horizontal optokinetic response in mice. Soc Neurosci 2010, online, program No. 551:17/H47.
47. Matsuda K., Miura E., Miyazaki T., Kakegawa W., Emi K., Narumi S., Fukazawa Y., Ito-Ishida A., Kondo T., Shigemoto R., et al. Cbln1 is a ligand for an orphan glutamate receptor δ2, a bidirectional synapse organizer. Science 2010, 328:363-368.
48. Schonewille M., Gao Z., Boele H.J., Vinueza Veloz M.F., Amerika W.E., Simek A.A., De Jeu M.T., Steinberg J.P., Takamiya K., Hoebeek F.E., et al. Reevaluating the role of LTD in cerebellar motor learning. Neuron 2011, 70:43-50.
49. De Schutter E., Antunes G. Stochastic modeling of LTD induction and AMPA receptor trafficking at the parallel fiber synapse. Neurosci Res 2010, 68S:e37.
50. Wils S., De Schutter E. STEPS: modeling and simulating complex reaction-diffusion systems with Python. Front Neuroinform 2009, 3:15.
51. Ogasawara H., Kawato M. Computational models of cerebellar long-term memory. Systems Biology, The Challenge of Complexity 2009, 169-182. Springer. S. Nakanishi, R. Kageyama, D. Watanabe (Eds.).
52. Fusi S., Drew P.J., Abbott L.F. Cascade models of synaptically stored memories. Neuron 2005, 45:599-611.
53. Gilbert P.F.C., Thach W.T. Purkinje cell activity during motor learning. Brain Res 1977, 128:309-328.
54. Kitazawa S., Kimura T., Yin P.B. Cerebellar complex spikes encode both destinations and errors in arm movements. Nature 1998, 392:494-497.
55. Soetedjo R., Kojima Y., Fuchs A. Complex spike activity signals the direction and size of dysmetric saccade errors. Prog Brain Res 2008, 171:153-159.
56. Ke M.C., Guo C.C., Raymond J.L. Elimination of climbing fiber instructive signals during motor learning. Nat Neurosci 2009, 12:1171-1179.
57. Welsh J., Lang E., Sugihara I., Llinás R. Dynamic organization of motor control within the olivocerebellar system. Nature 1995, 374:453-457.
58. Schweighofer N., Doya K., Fukai H., Chiron J., Furukawa T., Kawato M. Chaos may enhance information transmission in the inferior olive. Proc Natl Acad Sci USA 2004, 101:4655-4660.
59. Schweighofer N., Doya K., Kawato M. Electrophysiological properties of inferior olive neurons: a compartmental model. J Neurophysiol 1999, 82:804-817.
60. Tokuda I., Han C., Aihara K., Kawato M., Schweighofer N. Role of resonance in cerebellar learning. Neural Netw 2010, 23:836-842.
61. Van Der Giessen R., Koekkoek S., Van Dorp S., De Gruijl J., Cupido A., Khosrovani S., Dortland B., Wellershaus K., Degen J., Deuchars J., et al. Role of olivary electrical coupling in cerebellar motor learning. Neuron 2008, 58:599-612.
62. van Essen T.A., van der Giessen R.S., Koekkoek S.K., Vanderwerf F., Zeeuw C.I., van Genderen P.J., Overbosch D., de Jeu M.T. Anti-malaria drug mefloquine induces motor learning deficits in humans. Front Neurosci 2010, 4:191.
63. Shaikh A.G., Hong S., Liao K., Tian J., Solomon D., Zee D.S., Leigh R.J., Optican L.M. Oculopalatal tremor explained by a model of inferior olivary hypertrophy and cerebellar plasticity. Brain 2010, 133:923-940.
64. De Zeeuw C., Simpson J., Hoogenraad C., Galjart N., Koekkoek S., Ruigrok T. Microcircuitry and function of the inferior olive. Trends Neurosci 1998, 21:391-400.
65. Lang E.J., Sugihara I., Llinas R. GABAergic modulation of complex spike activity by the cerebellar nucleoolivary pathway in rat. J Neurophysiol 1996, 76:255-275.
66. Best A.R., Regehr W.G. Inhibitory regulation of electrically coupled neurons in the inferior olive is mediated by asynchronous release of GABA. Neuron 2009, 62:555-565.
67. Marshall S.P., Lang E.J. Local changes in the excitability of the cerebellar cortex produce spatially restricted changes in complex spike synchrony. J Neurosci 2009, 29:14352-14362.
68. Katori Y., Lang E., Onizuka M., Kawato M., Aihara K. Quantitative modeling of the spatio-temporal dynamics of inferior olive neurons with a simple conductance-based model. Int J Bifurcat Chaos 2010, 20:583-603.
69. Onizuka M: The effect of inhibitory synaptic input on glomeruli in the inferior olive. NAIST Master's Thesis 2009, 4318.
70. Onizuka M., Schweighofer N., Katori Y., Aihara K., Toyama K., Kawato M. Reproduction of complex spike firing patterns with modulated effective coupling conductance in inferior olive neurons. Neurosci Res 2010, 68:e435.
71. Akaike H. A new look at the statistical model identification. Jpn IEEE Trans Autom Control 1974, 19:716-723.
72. Mackay D. Probable networks and plausible predictions-a review of practical Bayesian methods for supervised neural networks. Network-Comp Neural Syst 1995, 6:469-505.
73. Geman S., Bienenstock E., Doursat R. Neural networks and the bias/variance dilemma. Neural Comput 1992, 4:1-58.
74. Sato M., Yoshioka T., Kajiwara S., Toyama K., Goda N., Doya K., Kawato M. Hierarchical Bayesian estimation for MEG inverse problem. NeuroImage 2004, 23:806-826.
75. Yamashita O., Sato M., Yoshioka T., Tong F., Kamitani Y. Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns. NeuroImage 2008, 42:1414-1429.
76. Miyawaki Y., Uchida H., Yamashita O., Sato M., Morito Y., Tanabe H.C., Sadato N., Kamitani Y. Visual image reconstruction from human brain activity using a combination of multiscale local image decoders. Neuron 2008, 60:915-929.
77. Mathy A., Ho S.S., Davie J.T., Duguid I.C., Clark B.A., Häusser M. Encoding of oscillations by axonal bursts in inferior olive neurons. Neuron 2009, 62:388-399.
78. Franklin D., Burdet E., Peng T., Osu R., Meng C., Milner T., Kawato M. CNS learns stable accurate and efficient movements using a simple algorithm. J Neurosci 2008, 28:11165-11173.
79. Kim J., Krupa D., Thompson R. Inhibitory cerebello-olivary projections and blocking effect in classical conditioning. Science 1998, 279:570-573.
80. Hoge G.J., Davidson K.G., Yasumura T., Castillo P.E., Rash J.E., Pereda A.E. The extent and strength of electrical coupling between inferior olivary neurons is heterogeneous. J Neurophysiol 2011, 105:1089-1101.
81. Perkel D.J., Hestrin S., Sah P., Nicoll R.A. Excitatory synaptic currents in Purkinje cells. Proc Biol Sci 1990, 241:116-121.
82. Renzi M., Farrant M., Cull-Candy S.G. Climbing-fibre activation of NMDA receptors in Purkinje cells of adult mice. J Physiol 2007, 585:91-101.