Are fast/slow process in motor adaptation and forward/inverse internal model two sides of the same coin?

Medical Hypotheses

Volumn 81, Issue 4, 2013, Pages 592-600

  Yavari, Fatemeh ^a   Towhidkhah, Farzad ^a   Ahmadi Pajouh, Mohammad Ali ^a  

^a AMIRKABIR UNIVERSITY OF TECHNOLOGY   (Iran)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTATION; ARTICLE; BIOLOGICAL MODEL; BRAIN DEPTH STIMULATION; CEREBELLUM; CEREBELLUM CORTEX; CEREBELLUM NUCLEUS; DENTATE NUCLEUS; FORWARD INVERSE INTERNAL MODEL; HUMAN; HYPOTHESIS; IMAGINATION; LEARNING; MEMORY; MOTOR ADAPTATION; MOTOR CORTEX; MOTOR PERFORMANCE; NERVE CELL PLASTICITY; NONHUMAN; PRIMARY MOTOR CORTEX; SENSORY FEEDBACK; VISUAL FEEDBACK; VOLUNTARY MOVEMENT; WORKING MEMORY;

ADAPTATION, PHYSIOLOGICAL; CENTRAL NERVOUS SYSTEM; COMPUTATIONAL BIOLOGY; FEEDBACK, PHYSIOLOGICAL; HUMANS; LEARNING; MODELS, BIOLOGICAL; MOTOR ACTIVITY;

EID: 84883757376     PISSN: 03069877     EISSN: 15322777     Source Type: Journal    
DOI: 10.1016/j.mehy.2013.07.009     Document Type: Article

References (95)

1. Smith M.A., Ghazizadeh A., Shadmehr R. Interacting adaptive processes with different timescales underlie short-term motor learning. PLoS Biol 2006, 4:e179.
2. Keisler A., Shadmehr R. A shared resource between declarative memory and motor memory. J Neurosci 2010, 30:14817-14823.
3. Schaal S., Schweighofer N. Computational motor control in humans and robots. Curr Opin Neurobiol 2005, 15:675-682.
4. Lee J.Y., Schweighofer N. Dual adaptation supports a parallel architecture of motor memory. J Neurosci 2009, 29:10396-10404.
5. Scheidt R.A., Dingwell J.B., Mussa-Ivaldi F.A. Learning to move amid uncertainty. J Neurophysiol 2001, 86:971-985.
6. Baddeley R.J., Ingram H.A., Miall R.C. System identification applied to a visuomotor task: near-optimal human performance in a noisy changing task. J Neurosci 2003, 23:3066-3075.
7. Thoroughman K.A., Shadmehr R. Learning of action through adaptive combination of motor primitives. Nature 2000, 407:742-747.
8. Donchin O., Francis J.T., Shadmehr R. Quantifying generalization from trial-by-trial behavior of adaptive systems that learn with basis functions: theory and experiments in human motor control. J Neurosci 2003, 23:9032-9045.
9. Kojima Y., Iwamoto Y., Yoshida K. Memory of learning facilitates saccadic adaptation in the monkey. J Neurosci 2004, 24:7531-7539.
10. Medina J.F., Nores W.L., Mauk M.D. Inhibition of climbing fibres is a signal for the extinction of conditioned eyelid responses. Nature 2002, 416:330-333.
11. Medina J.F., Garcia K.S., Mauk M.D. A mechanism for savings in the cerebellum. J Neurosci 2001, 21:4081-4089.
12. Fusi S., Asaad W.F., Miller E.K., Wang X.J. A neural circuit model of flexible sensorimotor mapping: learning and forgetting on multiple timescales. Neuron 2007, 54:319-333.
13. Galea J.M., Vazquez A., Pasricha N., de Xivry J.J., Celnik P. Dissociating the roles of the cerebellum and motor cortex during adaptive learning: the motor cortex retains what the cerebellum learns. Cereb Cortex 2011, 21:1761-1770.
14. Reis J., Schambra H.M., Cohen L.G., Buch E.R., Fritsch B., Zarahn E., et al. Noninvasive cortical stimulation enhances motor skill acquisition over multiple days through an effect on consolidation. Proc Natl Acad Sci USA 2009, 106:1590-1595.
15. Galea J.M., Celnik P. Brain polarization enhances the formation and retention of motor memories. J Neurophysiol 2009, 102:294-301.
16. Jayaram G., Tang B., Pallegadda R., Vasudevan E.V., Celnik P., Bastian A. Modulating locomotor adaptation with cerebellar stimulation. J Neurophysiol 2012, 107:2950-2957.
17. Richardson A.G., Overduin S.A., Valero-Cabre A., Padoa-Schioppa C., Pascual-Leone A., Bizzi E., et al. Disruption of primary motor cortex before learning impairs memory of movement dynamics. J Neurosci 2006, 26:12466-12470.
18. Hadipour-Niktarash A., Lee C.K., Desmond J.E., Shadmehr R. Impairment of retention but not acquisition of a visuomotor skill through time-dependent disruption of primary motor cortex. J Neurosci 2007, 27:13413-13419.
19. Malfait N., Ostry D.J. Is interlimb transfer of force-field adaptation a cognitive response to the sudden introduction of load?. J Neurosci 2004, 24:8084-8089.
20. Schmahmann J.D. The cerebellum and cognition 1997, Academic Press Incorporated.
21. Criscimagna-Hemminger S.E., Bastian A.J., Shadmehr R. Size of error affects cerebellar contributions to motor learning. J Neurophysiol 2010, 103:2275-2284.
22. Izawa J., Criscimagna-Hemminger S.E., Shadmehr R. Cerebellar contributions to reach adaptation and learning sensory consequences of action. J Neurosci 2012, 32:4230-4239.
23. Kagerer F.A., Contreras V.J., Stelmach G.E. Adaptation to gradual as compared with sudden visuo-motor distortions. Exp Brain Res 1997, 115:557-561.
24. Huang V.S., Shadmehr R. Persistence of motor memories reflects statistics of the learning event. J Neurophysiol 2009, 102:931-940.
25. Michel C., Pisella L., Prablanc C., Rode G., Rossetti Y. Enhancing visuomotor adaptation by reducing error signals: single-step (aware) versus multiple-step (unaware) exposure to wedge prisms. J Cogn Neurosci 2007, 19:341-350.
26. Kluzik J., Diedrichsen J., Shadmehr R., Bastian A.J. Reach adaptation: what determines whether we learn an internal model of the tool or adapt the model of our arm?. J Neurophysiol 2008, 100:1455-1464.
27. Robertson E.M., Miall R.C. Visuomotor adaptation during inactivation of the dentate nucleus. Neuroreport 1999, 10:1029-1034.
28. Schlerf J.E., Galea J.M., Bastian A.J., Celnik P.A. Dynamic modulation of cerebellar excitability for abrupt, but not gradual, visuomotor adaptation. J Neurosci 2012, 32:11610-11617.
29. Tseng Y.W., Diedrichsen J., Krakauer J.W., Shadmehr R., Bastian A.J. Sensory prediction errors drive cerebellum-dependent adaptation of reaching. J Neurophysiol 2007, 98:54-62.
30. Paz R., Boraud T., Natan C., Bergman H., Vaadia E. Preparatory activity in motor cortex reflects learning of local visuomotor skills. Nat Neurosci 2003, 6:882-890.
31. Paz R., Vaadia E. Specificity of sensorimotor learning and the neural code: neuronal representations in the primary motor cortex. J Physiol Paris 2004, 98:331-348.
32. Orban de Xivry J.J., Criscimagna-Hemminger S.E., Shadmehr R. Contributions of the motor cortex to adaptive control of reaching depend on the perturbation schedule. Cereb Cortex 2011, 21:1475-1484.
33. Muellbacher W., Ziemann U., Wissel J., Dang N., Kofler M., Facchini S., et al. Early consolidation in human primary motor cortex. Nature 2002, 415:640-644.
34. Criscimagna-Hemminger S.E., Donchin O., Gazzaniga M.S., Shadmehr R. Learned dynamics of reaching movements generalize from dominant to nondominant arm. J Neurophysiol 2003, 89:168-176.
35. Wolpert D.M., Ghahramani Z., Jordan M.I. An internal model for sensorimotor integration. Science 1995, 269:1880-1882.
36. Flanagan J.R., Wing A.M. The role of internal models in motion planning and control: evidence from grip force adjustments during movements of hand-held loads. J Neurosci 1997, 17:1519-1528.
37. Jordan M.I., Rumelhart D.E. Forward models: supervised learning with a distal teacher. Cogn Sci 1992, 16:307-354.
38. Sabes P.N. The planning and control of reaching movements. Curr Opin Neurobiol 2000, 10:740-746.
39. Kawato M. Internal models for motor control and trajectory planning. Curr Opin Neurobiol 1999, 9:718-727.
40. Katayama M., Kawato M. Virtual trajectory and stiffness ellipse during multijoint arm movement predicted by neural inverse models. Biol Cybern 1993, 69:353-362.
41. Kawato M., Gomi H. A computational model of four regions of the cerebellum based on feedback-error learning. Biol Cybern 1992, 68:95-103.
42. Shidara M., Kawano K., Gomi H., Kawato M. Inverse-dynamics model eye movement control by Purkinje cells in the cerebellum. Nature 1993, 365:50-52.
43. Bhushan N., Shadmehr R. Evidence for a forward dynamics model in human adaptive motor control. Adv Neural Information Process Syst 1999, 11:3-9.
44. Sutton R.S., Barto A.G. Toward a modern theory of adaptive networks: expectation and prediction. Psychol Rev 1981, 88:135-170.
45. Itåo M. The cerebellum and neural control 1984, Raven Press, New York.
46. Miall R., Weir D., Wolpert D., Stein J. Is the cerebellum a Smith predictor?. J Motor Behav 1993, 25:203-216.
47. Wolpert D.M. Computational approaches to motor control. Trends Cogn Sci 1997, 1:209-216.
48. Mehta B., Schaal S. Forward models in visuomotor control. J Neurophysiol 2002, 88:942-953.
49. Miall R., Wolpert D.M. Forward models for physiological motor control. Neural Netw 1996, 9:1265-1279.
50. Bhushan N., Shadmehr R. Computational nature of human adaptive control during learning of reaching movements in force fields. Biol Cybern 1999, 81:39-60.
51. Wolpert D.M., Ghahramani Z. Computational principles of movement neuroscience. Nat Neurosci 2000, 3(Suppl.):1212-1217.
52. Shadmehr R., Smith M.A., Krakauer J.W. Error correction, sensory prediction, and adaptation in motor control. Annu Rev Neurosci 2010, 33:89-108.
53. Chen H. Cerebellar and cerebellar thalamic contributions to motor adaptation. Doctor of Philosophy dissertation, Johns Hopkins University; 2007. p. 120.
54. Wolpert D.M., Kawato M. Multiple paired forward and inverse models for motor control. Neural Netw 1998, 11:1317-1329.
55. Kawato M., Wolpert D. Internal models for motor control. Sens Guid Mov 1998, 218:291-307.
56. Haruno M., Wolpert D.M., Kawato M. Mosaic model for sensorimotor learning and control. Neural Comput 2001, 13:2201-2220.
57. Haruno M., Wolpert D.M., Kawato M. Multiple paired forward-inverse models for human motor learning and control. Adv Neural Information Process Syst 1999, 11:31-37.
58. Doya K., Samejima K., Katagiri K., Kawato M. Multiple model-based reinforcement learning. Neural Comput 2002, 14:1347-1369.
59. Imamizu H., Kuroda T., Yoshioka T., Kawato M. Functional magnetic resonance imaging examination of two modular architectures for switching multiple internal models. J Neurosci 2004, 24:1173-1181.
60. Gentili R., Han C.E., Schweighofer N., Papaxanthis C. Motor learning without doing: trial-by-trial improvement in motor performance during mental training. J Neurophysiol 2010, 104:774-783.
61. Flanagan J.R., Johansson R.S. Action plans used in action observation. Nature 2003, 424:769-771.
62. Kawato M., Gomi H. The cerebellum and VOR/OKR learning models. Trends Neurosci 1992, 15:445-453.
63. Kawato M., Furukawa K., Suzuki R. A hierarchical neural-network model for control and learning of voluntary movement. Biol Cybern 1987, 57:169-185.
64. Shadmehr R., Mussa-Ivaldi F.A. Adaptive representation of dynamics during learning of a motor task. J Neurosci 1994, 14:3208-3224.
65. Morton S.M., Bastian A.J. Cerebellar contributions to locomotor adaptations during splitbelt treadmill walking. J Neurosci 2006, 26:9107-9116.
66. Smith M.A., Shadmehr R. Intact ability to learn internal models of arm dynamics in Huntington's disease but not cerebellar degeneration. J Neurophysiol 2005, 93:2809-2821.
67. Gomi H., Kawato M. Adaptive feedback control models of the vestibulocerebellum and spinocerebellum. Biol Cybern 1992, 68:105-114.
68. Yavari F, Towhidkhah F. A new proposal on how motor memory is consolidated. J Neuropsych Clin N, in press.
69. Izawa J., Shadmehr R. Learning from sensory and reward prediction errors during motor adaptation. PLoS Comput Biol 2011, 7:e1002012.
70. Shadmehr R., Krakauer J.W. A computational neuroanatomy for motor control. Exp Brain Res 2008, 185:359-381.
71. Nowak D.A., Topka H., Timmann D., Boecker H., Hermsdorfer J. The role of the cerebellum for predictive control of grasping. Cerebellum 2007, 6:7-17.
72. Miall R.C., Christensen L.O., Cain O., Stanley J. Disruption of state estimation in the human lateral cerebellum. PLoS Biol 2007, 5:e316.
73. Miall R.C., Jenkinson E.W. Functional imaging of changes in cerebellar activity related to learning during a novel eye-hand tracking task. Exp Brain Res 2005, 166:170-183.
74. Nowak D.A., Timmann D., Hermsdorfer J. Dexterity in cerebellar agenesis. Neuropsychologia 2007, 45:696-703.
75. Pasalar S., Roitman A.V., Durfee W.K., Ebner T.J. Force field effects on cerebellar Purkinje cell discharge with implications for internal models. Nat Neurosci 2006, 9:1404-1411.
76. Li C.S., Padoa-Schioppa C., Bizzi E. Neuronal correlates of motor performance and motor learning in the primary motor cortex of monkeys adapting to an external force field. Neuron 2001, 30:593-607.
77. Shadmehr R. Generalization as a behavioral window to the neural mechanisms of learning internal models. Hum Mov Sci 2004, 23:543-568.
78. Vandervert L.R. Cognitive functions of the cerebellum explain how Ericsson's deliberate practice produces giftedness. High Ability Stud 2007, 18:89-92.
79. Vandervert L.R., Schimpf P.H., Liu H. How working memory and the cerebellum collaborate to produce creativity and innovation. Creativity Res J 2007, 19:1-18.
80. Koziol L.F., Budding D.E. Subcortical structures and cognition 2009, Springer.
81. Williams A., Gribble P.L. Observed effector-independent motor learning by observing. J Neurophysiol 2012, 107:1564-1570.
82. Gentili R., Papaxanthis C., Pozzo T. Improvement and generalization of arm motor performance through motor imagery practice. Neuroscience 2006, 137:761-772.
83. Wada Y., Kawato M. A neural network model for arm trajectory formation using forward and inverse dynamics models. Neural Netw 1993, 6:919-932.
84. Cressman E.K., Henriques D.Y. Reach adaptation and proprioceptive recalibration following exposure to misaligned sensory input. J Neurophysiol 2010, 103:1888-1895.
85. Synofzik M., Lindner A., Thier P. The cerebellum updates predictions about the visual consequences of one's behavior. Curr Biol 2008, 18:814-818.
86. Cressman E.K., Henriques D.Y. Sensory recalibration of hand position following visuomotor adaptation. J Neurophysiol 2009, 102:3505-3518.
87. Diedrichsen J., White O., Newman D., Lally N. Use-dependent and error-based learning of motor behaviors. J Neurosci 2010, 30:5159-5166.
88. Diedrichsen J., Verstynen T., Lehman S.L., Ivry R.B. Cerebellar involvement in anticipating the consequences of self-produced actions during bimanual movements. J Neurophysiol 2005, 93:801-812.
89. Martin T., Keating J., Goodkin H., Bastian A., Thach W. Throwing while looking through prisms. I. Focal olivocerebellar lesions impair adaptation. Brain 1996, 119:1183-1198.
90. Mazzoni P., Krakauer J.W. An implicit plan overrides an explicit strategy during visuomotor adaptation. J Neurosci 2006, 26:3642-3645.
91. Huang V.S., Haith A., Mazzoni P., Krakauer J.W. Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models. Neuron 2011, 70:787-801.
92. Verstynen T., Sabes P.N. How each movement changes the next: an experimental and theoretical study of fast adaptive priors in reaching. J Neurosci 2011, 31:10050-10059.
93. Fernandez de Bobadilla J., Sicras-Mainar A., Navarro-Artieda R., Planas-Comes A., Soto-Alvarez J., Sanchez-Maestre C., et al. Estimation of the prevalence, incidence, comorbidities and direct costs associated to stroke patients requiring care in an area of the Spanish population. Revista Neurol 2008, 46:397.
94. Young J., Forster A. Review of stroke rehabilitation. Br Med J 2007, 334:86.
95. Demiris Y, Dearden A, From motor babbling to hierarchical learning by imitation: a robot developmental pathway. Paper from Proceedings of the fifth international workshop on epigenetic robotics: modeling cognitive development in robotic systems 2005.