Cerebellarlike corrective model inference engine for manipulation tasks

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 41, Issue 5, 2011, Pages 1299-1312

  Luque, Niceto Rafael ^a   Garrido, Jesús Alberto ^a   Carrillo, Richard Rafael ^b   Coenen, Olivier J M D ^c   Ros, Eduardo ^a  

^a UNIVERSITY OF GRANADA   (Spain)

^b UNIVERSITY OF ALMERÍA   (Spain)

^c UNIVERSITY OF ULSTER   (United Kingdom)

Author keywords

Adaptive; biological control system; cerebellum; learning; plasticity; robot; simulation; spiking neuron

Indexed keywords

ADAPTIVE; BIOLOGICAL CONTROL SYSTEMS; CEREBELLUM; LEARNING; SIMULATION; SPIKING NEURON;

BIOLOGICAL SYSTEMS; CELLS; FEEDFORWARD CONTROL; FIBERS; NEURAL NETWORKS; NEURONS; PLASTICITY; RATING; ROBOTS;

ADAPTIVE CONTROL SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; CEREBELLUM; COMPUTER SIMULATION; CYBERNETICS; HUMAN; LONG TERM POTENTIATION; PHYSIOLOGY; PURKINJE CELL; REPRODUCIBILITY; ROBOTICS;

ALGORITHMS; CEREBELLUM; COMPUTER SIMULATION; CYBERNETICS; HUMANS; LONG-TERM POTENTIATION; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); PURKINJE CELLS; REPRODUCIBILITY OF RESULTS; ROBOTICS;

EID: 80052913076     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2011.2138693     Document Type: Article

References (74)

1. H. C. Leiner, A. L. Leiner, and R. S. Dow, "Cognitive and language functions of the human cerebellum," Trends Neurosci., vol. 16, no. 11, pp. 444-447, Nov. 1993.
2. P. Dean, J. Porrill, C. F. Ekerot, and H. Jörntel, "The cerebellar microcircuit as an adaptive filter: Experimental and computational evidence," Nat. Rev. Neurosci., vol. 11, no. 1, pp. 30-43, Jan. 2010.
3. E. R. Kandel, J. H. Schwartz, and T. M. Jessell, Principles of Neural Science. New York: McGraw-Hill, 2000, ch. 42.
4. D. Philipona and O. J.-M. D. Coenen, "Model of granular layer encoding in the cerebellum," Neurocomputing, vol. 58-60, pp. 575-580, Jun. 2004. (Pubitemid 38684313)
5. N. Schweighofer, K. Doya, H. Fukai, J. V. Chiron, T. Furukawa, and M. Kawato, "Chaos may enhance information transmission in the inferior olive," Proc. Nat. Acad. Sci., vol. 101, no. 13, pp. 4655-4660, Mar. 2004. (Pubitemid 38437466)
6. E. D'Angelo, S. K. Koekkoek, P. Lombardo, S. Solinas, E. Ros, J. Garrido, M. Schonewille, and C. I. De Zeeuw, "Timing in the cerebellum: Oscillations and resonance in the granular layer," Neuroscience, vol. 162, no. 3, pp. 805-815, Sep. 2009.
7. S. G. Massaquioi and J. J. E. Stoline, "The intermediate cerebellum may function as a wave-variable processor," Neurosci. Lett., vol. 215, no. 1, pp. 60-64, Aug. 1996.
8. V. Steuber, D. Willshaw, and A. Van Ooyen, "Generation of time delays. Simplified models of intracellular signaling in cerebellar Purkinje cells network," Comput. Neural Syst., vol. 17, no. 2, pp. 173-191, Jun. 2006. (Pubitemid 44024990)
9. E. Ros, R. Carrillo, E. M. Ortigosa, B. Barbour, and R. Agís, "Eventdriven simulation scheme for spiking neural networks using lookup tables to characterize neuronal dynamics," Neural Comput., vol. 18, no. 12, pp. 2959-2993, Dec. 2006. (Pubitemid 44879149)
10. J. L. Raymond and S. G. Lisberger, "Neural learning rules for the vestibulo-ocular reflex," J. Neurosci., vol. 18, no. 21, pp. 9112-9129, Nov. 1998. (Pubitemid 28491773)
11. H. Voicu and M. D. Mauk, "Parametric analysis of cerebellar LTD in eyelid conditioning," Neurocomput. Comput. Neurosci. Trends Res., vol. 69, no. 10-12, pp. 1187-1190, Jun. 2006.
12. R. R. Carrillo, E. Ros, C. Boucheny, and O.-J. M.-D. Coenen, "A real time spiking cerebellum model for learning robot control," Biosystems, vol. 94, no. 1/2, pp. 18-27, Oct.-Nov. 2008.
13. M. Kawato, "Brain controlled robots," HFSP J., vol. 2, no. 3, pp. 136-142, Jun. 2008.
14. J. C. Houk, J. T. Buckingham, and A. G. Barto, "Models of cerebellum and motor learning," Behav. Brain Sci., vol. 19, no. 3, pp. 368-383, 1996.
15. P. Van der Smagt, "Cerebellar control of robot arms," Connect. Sci., vol. 10, no. 3/4, pp. 301-320, Dec. 1998.
16. R. C. Miall, "The cerebellum, predictive control and motor coordination," in Proc. Novartis Found. Symp., 2007, vol. 218, Sensory Guidance of Movements, pp. 272-290.
17. S. Khemaissia and A. Morris, "Use of an artificial neuroadaptive robot model to describe adaptive and learning motor mechanisms in the central nervous system," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 28, no. 3, pp. 404-416, Jun. 1998. (Pubitemid 128752592)
18. D. M. Wolpert, R. C. Miall, and M. Kawato, "Internal models in the cerebellum," Trends Cognit. Sci., vol. 2, no. 9, pp. 338-347, Sep. 1998. (Pubitemid 28396569)
19. J. S. Albus, "A theory of cerebellar function," Math Biosci., vol. 10, no. 1/2, pp. 25-61, Feb. 1971.
20. M. Ito, "Cerebellar circuitry as a neuronal machine," Progr. Neurobiol., vol. 78, no. 3-5, pp. 272-303, Feb.-Apr. 2006. (Pubitemid 43850094)
21. P. Dean and J. Porril, "Adaptive filter models of the cerebellum. Computational analysis," Cerebellum, vol. 7, no. 4, pp. 567-571, 2008.
22. G. A. Jacobson, D. Rokni, and Y. Yarom, "A model of the olivo-cerebellar system as a temporal patterm generator," Trends Neurosci., vol. 31, no. 12, pp. 617-625, Dec. 2008.
23. G. A. Jacobson, I. Lev, Y. Yarom, and D. Cohen, "Invariant phase structure of olivo-cerebellar oscillations and putative role in temporal pattern generation," Proc. Nat. Acad. Sci., vol. 106, no. 9, pp. 3579-3584, Mar. 2009.
24. C. I. De Zeeuw, J. I. Simpson, C. C. Hoogenraad, N. Galjart, S. K. Koekkoek, and T. J. Ruigrok, "Microcircuitry and function of the inferior olive," Trends Neurosci., vol. 21, no. 9, pp. 391-400, Sep. 1998. (Pubitemid 28384556)
25. A. Mathy, S. S. Ho, J. T. Davie, I. C. Duguid, B. A. Clark, andM. Häusser, "Encoding of oscillations by axonal bursts in inferior olive neurons," Neuron, vol. 62, no. 3, pp. 388-399, May 2009.
26. M. Ito and M. Kano, "Long-lasting depression of parallel fiber-Purkinje cell transmission induced by conjunctive stimulation of parallel fibers and climbing fibers in the cerebellar cortex," Neurosci. Lett., vol. 33, no. 3, pp. 253-258, Dec. 1982. (Pubitemid 13119529)
27. M. Ito, "Cerebellar long-term depression: Characterizations, signal transduction and functional roles," Physiol. Rev., vol. 81, no. 3, pp. 1143-1195, 2001. (Pubitemid 32606668)
28. N. Schweighofer, J. Spoelstra, M. A. Arbib, and M. Kawato, "Role of the cerebellum in reaching movements in human. II. A neural model of the intermediate cerebellum," Eur. J. Neurosci., vol. 10, no. 1, pp. 95-105, Jan. 1998. (Pubitemid 28325430)
29. J. Simpson, D.Wylle, and C. I. De Zeeuw, "On climbing fiber signals and their consequences," Behav. Brain Sci., vol. 19, no. 3, pp. 368-383, 1996.
30. I. Raman and B. P. Bean, "Ionic currents undelying spontaneous action potentials in isolated cerebellar Purkinje neurons," J. Neurosci., vol. 19, no. 5, pp. 1663-1674, Mar. 1999. (Pubitemid 29094185)
31. E. Bauswein, F. P. Kolb, B. Leimbeck, and F. J. Rubia, "Simple and complex spike activity of cerebellar Purkinje cells during active and passive movements in the awake monkey," J. Physiol., vol. 339, pp. 379-394, Jun. 1983. (Pubitemid 13104096)
32. J. L. Gardner, S. N. Tokiyama, and S. G. Lisberger, "A population decoding framework for motion after effects on smooth pursuit eye movement," J. Neurosci., vol. 24, no. 41, pp. 9035-9048, Oct. 2004. (Pubitemid 39372248)
33. R. Soetedjo and A. F. Fuchs, "Complex spike activity of Purkinje cells in the oculomotor vermis during behavioral adaptation of monkey saccades," J. Neurosci., vol. 26, no. 29, pp. 7741-7755, Jul. 2006. (Pubitemid 44315194)
34. E. D'Angelo, T. Nieus, M. Bezzi, A. Arleo, and O. J.-M. D. Coenen, "Modeling synaptic transmission and quantifying information transfer in the granular layer of the cerebellum," Lecture Notes Comp. Sci., vol. 3512, pp. 107-114, 2005a. (Pubitemid 41348543)
35. M. Kawato and H. Gomi, "A computational model of four regions of the cerebellum based on feedback-error learning," Biol. Cybern., vol. 68, no. 2, pp. 95-103, 1992.
36. C. D. Hansel, D. J. Linden, and E. D'Angelo, "Beyond parallel fiber LTD: The diversity of synaptic and non-synaptic plasticity in the cerebellum," Nat. Neurosci., vol. 4, no. 5, pp. 467-475, May 2001. (Pubitemid 32397183)
37. D. Marr, "A theory of cerebellar cortex," J. Physiol., vol. 202, no. 2, pp. 437-470, Jun. 1969.
38. M. Ito, The Cerebellum and Neural Control. New York: Raven, 984.
39. J. Spoelstra, M. A. Arbib, and N. Schweighofer, "Cerebellar adaptive control of a biomimetic manipulator," Neurocomputing, vol. 26/27, pp. 881-889, Jun. 1999. (Pubitemid 29447400)
40. D. M. Wolpert and Z. Ghahramani, "Computational principles of movement neuroscience," Nat. Neurosci., vol. 3, no. Suppl., pp. 1212-1217, Nov. 2000.
41. S. Kuroda, K. Yammoto, H. Miyamoto, K. Doya, and M. Kawato, "Statistical characteristics of climbing fiber spikies necessary for efficient cerebellar learning," Biol. Cybern., vol. 84, no. 3, pp. 183-192, Mar. 2001. (Pubitemid 33605172)
42. E. Ros, E. M. Ortigosa, R. Agís, R. Carrillo, and M. Arnold, "Real-time computing platform for spiking neurons (RT-spike)," IEEE Trans. Neural Netw., vol. 17, no. 4, pp. 1050-1063, Jul. 2006. (Pubitemid 44207804)
43. R. Agís, J. Díaz, E. Ros, R. R. Carrillo, and E. M. Ortigosa, "Hardware event-driven simulation engine for spiking neural networks," Int. J. Electron., vol. 94, no. 5, pp. 469-480, May 2007. (Pubitemid 47157881)
44. J. Butterfaß, M. Grebenstein, H. Liu, and G. Hirzinger, "DLR hand II: Next generation of a dextrous robot hand," in Proc. IEEE Int. Conf. Robot. Automat., 2001, pp. 109-114. (Pubitemid 32815192)
45. R. E. Kettner, S. Mahamud, H.-C. Leung, N. Sitkoff, J. C. Houk, B.W. Peterson, and A. G. Barto, "Prediction of complex two-dimensional trajectories by a cerebellar model of smooth pursuit eye movement," J. Neurophysiol., vol. 77, no. 4, pp. 2115-2130, Apr. 1997. (Pubitemid 27174997)
46. A. Haith and S. Vijayakumar, "Robustness of VOR and OKR adaptation under kinematics and dynamics transformations," in Proc. 6th IEEE ICDL, London, U.K., 2007, pp. 37-42.
47. C. Boucheny, R. R. Carrillo, E. Ros, and O. J.-M. D. Coenen, "Real-time spiking neural network: An adaptive cerebellar model," LNCS, vol. 3512, pp. 136-144, 2005. (Pubitemid 41342975)
48. E. Nakano, H. Imamizu, R. Osu, Y. Uno, H. Gomi, T. Yoshioka, and M. Kawato, "Quantitative examinations of internal representations for arm trajectory planning. Minimum commanded torque change model," J. Neurophysiol., vol. 81, no. 5, pp. 2140-2155, May 1999. (Pubitemid 29262548)
49. E. J. Hwang and R. Shadmehr, "Internal models of limb dynamic and the encoding of limb state," J. Neural Eng., vol. 2, no. 3, pp. S266-S278, Sep. 2005. (Pubitemid 41225536)
50. E. Todorov, "Optimality principles in sensorimotor control (review)," Nat. Neurosci., vol. 7, no. 9, pp. 907-915, Sep. 2004. (Pubitemid 39129496)
51. M. Kawato, K. Furukawa, and R. Suzuki, "A hierarchical neural-network model for control and learning of voluntary movement," Biol. Cybern., vol. 57, no. 3, pp. 169-185, 1987.
52. J. Porrill, P. Dean, and J. V. Stone, "Recurrent cerebellar architecture solves the motor-error problem," Proc. Biol. Sci., vol. 271, no. 1541, pp. 789-796, Apr. 2004. (Pubitemid 38491264)
53. B. B. Andersen, L. Korbo, and B. Pakkenberg, "A quantitative study of the human cerebellum with unbiased stereological techniques," J. Comp. Neurol., vol. 326, no. 4, pp. 549-560, Dec. 1992. (Pubitemid 23001429)
54. C. Assad, S. Dastoor, S. Trujillo, and L. Xu, "Cerebellar dynamic state estimation for a biomorphic robot arm," in Proc. Syst., Man. Cybern., Oct. 2005, vol. 1, pp. 877-882. (Pubitemid 41679315)
55. E. D'Angelo, P. Rossi, D. Gall, F. Prestori, T. Nieus, A. Maffei, and E. Sola, "LTP of synaptic transmission at the Mossy Fiber-Granule cell relay of the cerebellum," Progress in Brain Research, vol. 128, pp. 69-80, 2005.
56. W. Gerstner and W. Kistler, Spiking Neuron Models: Singleneurons, Populations, Plasticity. Cambridge, U.K.: Cambridge Univ. Press, 2002.
57. D. Jaeger, "No parallel fiber volleys in the cerebellar cortex: Evidence from cross-correlation analysis between Purkinje cells in a computer model and in recordings from anesthetized rats," J. Comput. Neurosci., vol. 14, no. 3, pp. 311-327, May/Jun. 2003. (Pubitemid 36596482)
58. A. Roth and M. Häusser, "Compartmental models of rat cerebellar Purkinje cells based on simultaneous somatic and dendritic patch-clamp recordings," J. Physiol., vol. 535, pp. 445-472, Sep. 2001. (Pubitemid 32825682)
59. S. Solinas, R. Maex, and E. De Schutter, "Synchronization of Purkinje cell pairs along the parallel fibre fiber axis: A model," Neurocomputing, vol. 52-54, pp. 97-102, Jun. 2003. (Pubitemid 36700503)
60. D. Jaeger, E. De Schutter, and J. Bower, "The role of synaptic and voltagegated currents in the control of Purkinje cell spiking: A modeling study," J. Neurosci., vol. 17, no. 1, pp. 91-106, Jan. 1997. (Pubitemid 27008853)
61. M. Häuser and B. Clarck, "Tonic synaptic inhibition modulates neuronal output pattern and spatiotemporal synaptic integration," Neuron, vol. 19, no. 3, pp. 665-678, Sep. 1997.
62. R. S. Sutton and A. G. Barto, "Toward a modern theory of adaptive networks: Expectation and prediction," Psychol. Rev., vol. 88, no. 2, pp. 135-170, Mar. 1981.
63. A. G. Barto, R. S. Sutton, and C. W. Anderson, "Neuronlike adaptive elements that can solve difficult learning control problems," IEEE Trans. Syst., Man., Cybern., vol. SMC-13, no. 5, pp. 934-846, Sep./Oct. 1983.
64. V. Lev-Ram, S. B. Meht, D. Kleinfeld, and R. Y. Tsien, "Reversing cerebellar long term depression," Proc. Nat. Acad. Sci., vol. 100, no. 26, pp. 15 989-15 993, Dec. 2003. (Pubitemid 38021102)
65. M. Fujita, "Adaptive filter model of the cerebellum," Biol. Cybern., vol. 45, no. 3, pp. 195-206, 1982. (Pubitemid 13213497)
66. T. J. Sewjnowski, "Storing covariance with nonlinearity interacting neurons," J. Math. Biol., vol. 4, no. 4, pp. 303-321, Oct. 1977.
67. B. Widrow and S. D. Stearns, Adaptive Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1985.
68. J. G. Keating and W. T. Thach, "Nonclock behavior of inferior olive neurons. Interspike interval of Purkinje cell complex spike discharge in the awake behaving monkey is random," J. Neurophysiol., vol. 73, no. 4, pp. 1329-1340, Apr. 1995.
69. A. Linares-Barranco, M. Oster, D. Cascado, G. Jiménez, A. Civit, and B. Linares-Barranco, "Inter-spike-intervals analysis of AER Poisson-like generator hardware," Neurocomputing, vol. 70, no. 16-18, pp. 2692-2700, Oct. 2007. (Pubitemid 47308621)
70. J. Spoelstra, N. Schweighofer, and M. A. Arbib, "Cerebellar learning of accurate predictive control for fast-reaching movements," Biol. Cybern., vol. 82, no. 4, pp. 321-333, Apr. 2000.
71. J. L. Contreras-Vidal, S. Grossberg, and D. Bullock, "A neural model of cerebellar learning for arm movement control: Cortico-spino-cerebellar dynamics," Learn. Memory, vol. 3, no. 6, pp. 475-502, Mar./Apr. 1997. (Pubitemid 27258469)
72. D. Purves, G. J. Augustine, and D. Fitzpatrick, Neuroscience, 2nd ed. Sunderland, MA: Sinaver Associates Inc., 2001.
73. C. J. Willmott and K. Matsuura, "Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance," Clim. Res., vol. 30, no. 1, pp. 79-82, Dec. 2005. (Pubitemid 43072682)
74. M. Kawato and D. M. Wolpert, "Internal models for motor control," in Proc. Novartis Found. Symp., 1998, vol. 218, pp. 291-307. (Pubitemid 128685167)