An internal model for acquisition and retention of motor learning during arm reaching

Neural Computation

Volumn 21, Issue 7, 2009, Pages 2009-2027

  Lonini, Luca ^a   Dipietro, Laura ^b   Zollo, Loredana ^a   Guglielmelli, Eugenio ^a   Krebs, Hermano Igo ^b,c,d  

^a UNIVERSITY CAMPUS BIO MEDICO   (Italy)

^b USA   (United States)

^c WEILL CORNELL MEDICAL COLLEGE   (United States)

^d UNIVERSITY OF MARYLAND SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARM; ARTICLE; ARTIFICIAL NEURAL NETWORK; HUMAN; LEARNING; MOVEMENT (PHYSIOLOGY); NONLINEAR SYSTEM; PHYSIOLOGY; PROBABILITY; PSYCHOMOTOR PERFORMANCE;

ARM; HUMANS; LEARNING; MARKOV CHAINS; MOVEMENT; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; PSYCHOMOTOR PERFORMANCE;

EID: 68349145079     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2009.03-08-721     Document Type: Letter

References (44)

1. Atkeson, C. G., Moore, A. W., & Schaal, S. (1997). Locally weighted learning. Artificial Intelligence Review, 11(1:5), 11-73.
2. Bacciu, D., Zollo, L., Guglielmelli, E., Leoni, F., & Starita, A. (2004). A RLWPR network for learning the internal model of an anthropomorphic robot arm. In Proceedings of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (Vol. 1, pp. 260-265). N.p.
3. Baillieul, J., & Martin, D. P. (1990). Resolution of kinematic redundancy. Proceedings of Symposia in Applied Mathematics, American Mathematical Society, 41, 49-89.
4. Beal, M. J., Ghahramani, Z., & Rasmussen, C. E. (2002). The infinite hidden Markov model. In T. G. Dietterich, S. Becker, & Z. Ghahramani (Eds.), Advances in neural information processing systems, 14 (pp. 577-584). Cambridge, MA: MIT Press.
5. Berniker, M. (2000). A biologically motivated paradigm for heuristic motor control in multiple contexts. Unpublished master's thesis, Massachusetts Institute of Technology.
6. Craik, K. J. W. (1943). The nature of explanation. Cambridge: Cambridge University Press.
7. Davidson, P. R., & Wolpert, D. M. (2004). Scaling down motor memories: De-adaptation after motor learning. Neuroscience Letters, 370(2-3), 102-107.
8. Dingwell, J. B., Mah, C. D., & Mussa-Ivaldi, F. A. (2002). Manipulating objects with internal degrees of freedom: Evidence for model-based control. Journal of Neurophysiology, 88(1), 222-235.
9. Doya, K., Samejima, K., Katagiri, K., & Kawato, M. (2002). Multiple model-based reinforcement learning. Neural Comput., 14(6), 1347-1369.
10. Flanagan, J. R., Vetter, P., Johansson, R. S., & Wolpert, D. M. (2003). Prediction precedes control in motor learning. Current Biology, 13(2), 146-150.
11. Flanagan, J. R., Wolpert, D. M., & Johansson, R. S. (2001). Sensorimotor prediction and memory in object manipulation. Canadian Journal of Experimental Psychology, 55(2), 89-97.
12. Flash, T., & Hogan, N. (1985). The coordination of arm movements: An experimentally confirmed mathematical model. Journal of Neuroscience, 4, 1688-1703.
13. Franklin, D. W., Osu, R., Burdet, E., Kawato, M., & Milner, T. E. (2003). Adaptation to stable and unstable dynamics achieved by combined impedance control and inverse dynamics model. Journal of Neurophysiology, 90, 3270-3282.
14. Geladi, P., & Kowalski, B. (1986). Partial least squares regression: A tutorial. Analytica Chimica Acta, 185, 1-17.
15. Gomi, H., & Kawato, M. (1993). Recognition of manipulated objects by motor learning with modular architecture networks. Neural Networks, 6, 485-497.
16. Gomi, H., & Kawato, M. (1996) Equilibrium-point control hypothesis examined by measured arm stiffness during multijoint movement. Science, 272, 117-120.
17. Haruno, M., Wolpert, D. M., & Kawato, M. (2001). MOSAIC model for sensorimotor learning and control. Neural Comput., 13, 2201-2220.
18. Hogan, N., Krebs, H. I., Rohrer, B., Palazzolo, J. J., Dipietro, L., Fasoli, S. E., et al. (2006). Motions or muscles? Some behavioral factors underlying robotic assistance of motor recovery. J. Rehabil. Res. Dev., 43(5), 605-618.
19. Huang, F. C., Gillespie, R. B., & Kuo, A. D. (2006). Human adaptation to interaction forces in visuomotor coordination. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 14(3), 390-397.
20. Imamizu, H., Kuroda, T., Miyauch, S., Yoshioka, T., & Kawato, M. (2003). Modular organization of internal models of tools in the human cerebellum. Proceedings of the National Academy of Sciences USA, 100, 5461-5466.
21. Ito, M. (1970). Neurophysiological aspects of the cerebellar motor control system. International Journal of Neurology, 7(2), 162-176.
22. Kawato, M. (1990). Feedback-error-learning neural network for supervised motor learning. In R. Eckmiller (Ed.), Advanced neural computers (pp. 365-372). Amsterdam: North-Holland.
23. Kawato, M. (1999). Internal models for motor control and trajectory planning. Current Opinion in Neurobiology, 9, 718-727.
24. Krebs, H. I., Brashers-Krug, T., Rauch, S. L., Savage, C. R., Hogan, N., Rubin, R. H., et al. (1998). Robot-aided functional imaging: Application to a motor learning study. Human Brain Mapping, 6(1), 59-72.
25. Krebs, H. I., Hogan, N., Aisen, M. L., & Volpe, B. T. (1998). Robot-aided neurorehabilitation. IEEE Transactions on Rehabilitation Engineering, 6(1), 75-87.
26. Krebs, H. I., Volpe, B. T., Williams, D., Celestino, J., Charles, S. K., Lynch, D., et al. (2007). Robot-aided neurorehabilitation: A robot for wrist rehabilitation. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 15(3), 327-335.
27. Miall, R. C., Weir, D. J., Wolpert, D. M., & Stein, J. F. (1993). Is the cerebellum a Smith predictor? Journal of Motor Behavior, 25(3), 203-216.
28. Miall, R. C., & Wolpert, D. M. (1996). Forward models for physiological motor control. Neural Networks, 9(8), 1265-1279.
29. Milner, T. E., & Franklin, D. W. (2005). Impedance control and internal model use during the initial stage of adaptation to novel dynamics in humans. Journal of Physiology, 567(2), 651-664.
30. Morasso, P. (1981). Spatial control of arm movements. Experimental Brain Research, 42, 223-227.
31. Nakanishi, J., & Schaal, S. (2004). Feedback error learning and nonlinear adaptive control. Neural Networks, 17(10), 1453-1465.
32. Narendra, K. S., & Balakrishnan, J. (1997). Adaptive control using multiple models. IEEE Transactions on Automatic Control, 42(2), 171-187.
33. Osu, R., Hirai, S., Yoshioka, T., & Kawato, M. (2004). Random presentation enables subjects to adapt to two opposing forces on the hand. Nature Neuroscience, 7(2), 111-112.
34. Petkos, G., & Vijayakumar, S. (2007). Context estimation and learning control through latent variable extraction: From discrete to continuous contexts. In Proceedings of the 2007 International Conference on Robotics and Automation (ICRA07) (pp. 2117-2123). N.p.
35. Rabiner, L. R. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2), 257-286.
36. Schaal, S., & Atkeson, C. G. (1998). Constructive incremental learning from only local information. Neural Comput., 10(8), 2047-2084.
37. Schaal, S., Atkeson, C. G., & Vijayakumar, S. (2002). Scalable techniques from non-parametric statistics for real time robot learning. Applied Intelligence, 17(1), 49-60.
38. Shadmehr, R., & Mussa-Ivaldi, F. A. (1994). Adaptive representation of dynamics during learning of a motor task. Journal of Neuroscience, 14(5), 3208-3224.
39. Shibata, T., & Schaal, S. (2001). Biomimetic gaze stabilization based on feedback-error-learning with nonparametric regression networks. Neural Networks, 14(2), 201-216.
40. Uhlenbeck, G. E., & Ornstein, L. S. (1930). On the theory of Brownian motion. Phys. Rev., 36, 823-841.
41. Vijayakumar, S., D'Souza, A., & Schaal, S. (2005). Incremental online learning in high dimensions. Neural Comput., 17, 2602-2634.
42. Wolpert, D. M., & Ghahramani, Z. (2000). Computational principles of movement neuroscience. Nature Neuroscience, 3, 1212-1217.
43. Wolpert, D. M., & Kawato, M. (1998). Multiple paired forward and inverse model for motor control. Neural Networks, 11, 1317-1329.
44. Zollo, L., Eskiizmirliler, S., Teti, G., Laschi, C., Burnod, Y., Guglielmelli, E., et al. (2008). An anthropomorphic robotic platform for progressive and adaptive sensorimotor learning. International Journal of Advanced Robotics, 22, 91-118.