Bio-inspired adaptive feedback error learning architecture for motor control

Biological Cybernetics

Volumn 106, Issue 8-9, 2012, Pages 507-522

  Tolu, Silvia ^a   Vanegas, Mauricio ^c   Luque, Niceto R ^a   Garrido, Jesús A ^b   Ros, Eduardo ^a  

^a UNIVERSITY OF GRANADA   (Spain)

^b Consorzio Interuniversitario per le Scienze Fisiche della Materia ^*  (Italy)

^c UNIVERSITY OF GENOA   (Italy)

Author keywords

Adaptive filter; Cerebellum; Feedforward scheme; Internal model; Machine learning; Motor control

Indexed keywords

ADAPTIVE CONTROL ARCHITECTURE; ADAPTIVE ERROR; ADAPTIVE FEEDBACK; ALTERNATIVE APPROACH; BIO-INSPIRED; CEREBELLUM; CONTROL SCHEMES; CONTROL TASK; FEED-FORWARD; HYBRID ARCHITECTURES; INTERNAL MODELS; LEARNING MODULES; LOCALLY WEIGHTED PROJECTION REGRESSIONS; MOTOR CONTROL; PROPOSED ARCHITECTURES; REFERENCE MODELS; REGRESSION METHOD;

COMPUTER SCIENCE; CYBERNETICS; LEARNING SYSTEMS;

ADAPTIVE FILTERS;

ARTICLE; ARTIFICIAL INTELLIGENCE; BIOLOGICAL MODEL; FEEDBACK SYSTEM; METHODOLOGY; ROBOTICS;

ARTIFICIAL INTELLIGENCE; FEEDBACK; MODELS, NEUROLOGICAL; ROBOTICS;

EID: 84867573347     PISSN: 03401200     EISSN: 14320770     Source Type: Journal    
DOI: 10.1007/s00422-012-0515-5     Document Type: Article

References (49)

1. Albus JS (1971) A theory of cerebellar function. Math Biosci 10(1-2): 25-61
2. Albus JS (1975) A new approach to manipulator control: the cerebellar model articulation controller (CMAC). J Dyn Syst Meas Control 97(3):220-227
3. Atkeson CG, Hale JG, Pollick F, Riley M, Kotosaka S, Schaul S, Shibata T, Tevatia G, Ude A, Vijayakumar S, Kawato E, Kawato M (2000) Using humanoid robots to study human behavior. IEEE Intell Syst Appl 15(4):46-56
4. Attwell P, Cooke S, Yeo C (2002) Cerebellar function in consolidation of a motor memory. Neuron 34(6):1011-1020
5. Boyden E, Katoh A, Raymond J (2004) Cerebellum-dependent learning: the role of multiple plasticity mechanisms. Neuroscience 27(1):581-609
6. Carrillo R, Ros E, Boucheny C, Coenen O (2008) A real-time spiking cerebellum model for learning robot control. Biosystems 94(1-2):18-27
7. Corke PI (1996) A robotics toolbox for matlab. IEEE Robotics Autom Mag 3(1):24-32
8. Craig JJ (2005) Introduction to robotics: mechanics and control, 3rd edn. Pearson/Prentice Hall, Upper Saddle River
9. Dean P, Porrill J, Ekerot C, Jörntell H (2010) The cerebellar microcircuit as an adaptive filter: experimental and computational evidence. Nat Rev Neurosci 11(1):30-43
10. Fujita M (1982) Adaptive filter model of the cerebellum. Biol Cybern 206(3):195-206
11. German Aerospace Center (2011) DLR Light-Weight Robot (LWR). http://www.dlr.de/rm/en/desktopdefault.aspx/tabid-3803/6175- read-8963/. Accessed 11 August 2011
12. Gomi H, Kawato M (1992) Adaptive feedback control models of the vestibulocerebellum and spinocerebellum. Biol Cybern 68(2):105-114
13. Haddadin S,Albu-SchSfferA,HirzingerG(2007) Safe physical humanrobot interaction: Measurements, analysis and new insights. In: Kaneko M, Nakamura Y (eds) ISRR, Springer, Springer Tracts in Advanced Robotics, vol 66, pp 395-407
14. Haith A, Vijayakumar S (2009) Implications of different classes of sensorimotor disturbance for cerebellar-basedmotor learning models. Biol Cybern 100(1):81-95
15. Hirzinger G, Butterfaß J, Fischer M, Grebenstein M, Hähnle M, Liu H, Schäfer I, Sporer N (2000) A mechatronics approach to the design of light-weight arms and multifingered hands. In: ICRA, pp 46-54
16. Honda T, Yamazaki T, Tanaka S, Nishino T (2010) A possible mechanism for controlling timing representation in the cerebellar cortex. In: International Symposium on Neural Networks, pp 67-76
17. Ito M (2000) Mechanisms of motor learning in the cerebellum. Brain Res 886(1-2):237-245
18. Ito M (2008) Control of mental activities by internal models in the cerebellum. Nat Rev Neurosci 9(4):304-313
19. Jordan MI (1996) Computational aspects of motor control and motor learning. In: Heuer, H and Keele, S (ed) Handbook of perception and action: Motor Skills, Academic Press, New York, vol 2, pp 71-120
20. Jordan MI, Rumelhart DE (1992) Forwardmodels: supervised learning with a distal teacher. Cognit Sci 16:307-354
21. Kawato M (1990) Feedback-error-learning neural network for supervised motor learning. In: R Eckmiller (ed) Advanced neural computers, Elsevier, North-Holland, pp 365-372
22. KawatoM (1999) Internal models formotor control and trajectory planning. Curr Opin Neurobiol 9(6):718-727
23. Lonini L, Dipietro L, ZolloL,Guglielmelli E, KrebsHI (2009) Aninternal model for acquisition and retention of motor learning during arm reaching. Neural Comput 21(7):2009-2027
24. Luque N, Garrido J, Carrillo R, Coenen O, Ros E (2011a) Cerebellarlike corrective model inference engine for manipulation tasks. IEEE Trans Syst Man Cybern B 41(5):1299-1312
25. Luque N, Garrido J, Carrillo RR, Tolu S, Ros E (2011b) Adaptive cerebellar spikingmodel embedded in the control loop: context switching and robustness against noise. Int J Neural Syst 21(5):385-401
26. Luque NR, Garrido JA, Carrillo RR, Coenen OJMD, Ros E (2011c) Cerebellar input configuration toward object model abstraction in manipulation tasks. IEEE Trans Neural Netw 22(8):1321-1328
27. Marr D (1969) A theory of cerebellar cortex. J Physiol 202:437-470
28. Masuda N, Amari S (2008) A computational study of synaptic mechanisms of partial memory transfer in cerebellar vestibulo-ocularreflex learning. J Comput Neurosci 24(2):137-156
29. Miyamura A, Kimura H (2002) Stability of feedback error learning scheme. Syst Control Lett 45(4):303-316
30. Nakanishi J, Schaal S (2004) Feedback error learning and nonlinear adaptive control. Neural Netw 17(10):1453-1465
31. Nguyen-Tuong D, Peters J (2008) Learning robot dynamics for computed torque control using local gaussian processes regression. In: Proceedings of the 2008 ECSIS Symposium on Learning and Adaptive Behaviors for Robotic Systems, IEEE Computer Society, Washington, DC, USA, pp 59-64
32. Philipona D, Coenen OJMD (2004) Model of granular layer encoding of the cerebellum. Neurocomputing 58(60):575-580
33. Porrill J, Dean P (2007) Recurrent cerebellar loops simplify adaptive control of redundant and nonlinear motor systems. Neural Comput 19(1):170-193
34. Porrill J, Dean P, Stone J (2004) Recurrent cerebellar architecture solves the motor-error problem. Proc Biol Sci 271(1541):789-796
35. Schaal S, Atkeson CG,Vijayakumar S (2002) Scalable techniques from nonparametric statistics for real time robot learning. Appl Intell 17(1):49-60
36. Schweighofer N, Spoelstra J, Arbib MA, KawatoM (1998) Role of the cerebellum in reaching movements in humans. II. A neural model of the intermediate cerebellum. Eur J Neurosci 10(1):95-105
37. Schweighofer N, Doya K, Lay F (2001) Unsupervised learning of granule cell sparse codes enhances cerebellar adaptive control. Neuroscience 103:35-50
38. Sejnowski TJ (1977) Storing covariance with nonlinearly interacting neurons. J Math Biol 4:303-321
39. Shibata T, Schaal S (2001) Biomimetic gaze stabilization based on feedback-error-learning with nonparametric regression networks. Neural Netw 14(2):201-216
40. Smola AJ, Schölkopf B (2004) A tutorial on support vector regression. Stat Comput 14(3):199-222
41. Van der Smagt P (1998) Cerebellar control of robot arms. Connect Sci 10:301-320
42. Van der Smagt P, Groen F, Schulten K (1996) Analysis and control of a rubbertuator arm. Biol Cybern 75(5):433-440
43. Vijayakumar S, Schaal S (2000) Locally weighted projection regression: Incremental real time learning in high dimensional space. In: ICML '00: Proceedings of the Seventeenth International Conference onMachine Learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, pp 1079-1086
44. Vijayakumar S, D'Souza A, Schaal S (2005) Incremental online learning in high dimensions. Neural Comput 17(12):2602-2634
45. Williams CKI, Rasmussen CE (1996) Gaussian processes for regression. In: Advances in neural information processing systems 8. MIT press, pp 514-520
46. Wolpert DM (1997) Computational approaches to motor control. Trends Cogn Sci 1(6):209-216
47. Wolpert DM, Miall RC, Kawato M (1998) Internal models in the cerebellum. Trends Cogn Sci 2(9):338-347
48. Wulff P, Schonewille M, Renzi M, Viltono L, Sassoè-Pognetto M, Badura A, Gao Z, Hoebeek FE, Dorp Svan, Wisden W, Farrant M, De ZeeuwCI (2009) Synaptic inhibition of purkinje cells mediates consolidation of vestibulo-cerebellarmotor learning. NatNeurosci 12(8):1042-1049
49. Yamazaki T, Tanaka S (2007) The cerebellum as a liquid state machine. Neural Netw 20(3):290-297