Learning with slight forgetting optimizes sensorimotor transformation in redundant motor systems

PLoS Computational Biology

Volumn 8, Issue 6, 2012, Pages

  Hirashima, Masaya ^a   Nozaki, Daichi ^a  

^a UNIVERSITY OF TOKYO   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ERRORS; MUSCULOSKELETAL SYSTEM; THREE DIMENSIONAL COMPUTER GRAPHICS;

CONVENTIONAL SCHEMES; ERROR INFORMATION; LEARNING PROCESS; MOTOR COMMANDS; MOTOR LEARNING; MOTOR SYSTEMS; NEURAL-NETWORKS; SENSORIMOTOR TRANSFORMATIONS; THEORETICAL STUDY; TWO-DIMENSIONAL;

NEURONS;

ANIMAL CELL; ANIMAL EXPERIMENT; ARTICLE; BACK PROPAGATION; FEEDBACK SYSTEM; HAPLORHINI; LEARNING; LEARNING ALGORITHM; MOTONEURON; MOTOR CONTROL; MOTOR SYSTEM; MUSCLE CONTRACTION; MUSCLE INNERVATION; NERVE CELL NETWORK; NEUROPHYSIOLOGICAL RECRUITMENT; NONHUMAN; PRIMARY MOTOR CORTEX; PROCESS OPTIMIZATION; RESPONSE TIME; SENSORIMOTOR FUNCTION; SIMULATION; TASK PERFORMANCE; TORQUE; BIOLOGICAL MODEL; BIOLOGY; BIOMECHANICS; COMPUTER SIMULATION; HUMAN; MEMORY; MOTOR CORTEX; MOVEMENT (PHYSIOLOGY); NERVE CELL; NONLINEAR SYSTEM; PHYSIOLOGY; PSYCHOLOGICAL MODEL; PSYCHOMOTOR PERFORMANCE; STATISTICAL MODEL; THREE DIMENSIONAL IMAGING;

BIOMECHANICS; COMPUTATIONAL BIOLOGY; COMPUTER SIMULATION; HUMANS; IMAGING, THREE-DIMENSIONAL; LEARNING; LINEAR MODELS; MEMORY; MODELS, NEUROLOGICAL; MODELS, PSYCHOLOGICAL; MOTOR CORTEX; MOVEMENT; NERVE NET; NEURONS; NONLINEAR DYNAMICS; PSYCHOMOTOR PERFORMANCE;

EID: 84864062032     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1002590     Document Type: Article

References (82)

1. Bernstein NI, (1967) The Coordination and Regulation of Movements Oxford Pergamon Press.
2. Herter TM, Kurtzer I, Cabel DW, Haunts KA, Scott SH, (2007) Characterization of torque-related activity in primary motor cortex during a multijoint postural task. J Neurophysiol 97: 2887-2899.
3. Scott SH, Gribble PL, Graham KM, Cabel DW, (2001) Dissociation between hand motion and population vectors from neural activity in motor cortex. Nature 413: 161-165.
4. Naselaris T, Merchant H, Amirikian B, Georgopoulos AP, (2006) Large-scale organization of preferred directions in the motor cortex. I. Motor cortical hyperacuity for forward reaching. J Neurophysiol 96: 3231-3236.
5. Schwartz AB, Kettner RE, Georgopoulos AP, (1988) Primate motor cortex and free arm movements to visual targets in 3-dimensional space. 1. Relations between single cell discharge and direction of movement. J Neurosci 8: 2913-2927.
6. Pruszynski JA, Kurtzer I, Nashed JY, Omrani M, Brouwer B, et al. (2011) Primary motor cortex underlies multi-joint integration for fast feedback control. Nature 478: 387-390.
7. Hoffman DS, Strick PL, (1999) Step-tracking movements of the wrist. IV. Muscle activity associated with movements in different directions. J Neurophysiol 81: 319-333.
8. Nozaki D, Nakazawa K, Akai M, (2005) Muscle activity determined by cosine tuning with a nontrivial preferred direction during isometric force exertion by lower limb. J Neurophysiol 93: 2614-2624.
9. Kurtzer I, Pruszynski JA, Herter TM, Scott SH, (2006) Primate upper limb muscles exhibit activity patterns that differ from their anatomical action during a postural task. J Neurophysiol 95: 493-504.
10. Fagg AH, Shah A, Barto AG, (2002) A computational model of muscle recruitment for wrist movements. Journal of Neurophysiology 88: 3348-3358.
11. van Bolhuis BM, Gielen C, (1999) A comparison of models explaining muscle activation patterns for isometric contractions. Biol Cybern 81: 249-261.
12. Hogan N, (1984) An organizing principle for a class of voluntary movements. J Neurosci 4: 2745-2754.
13. Uno Y, Kawato M, Suzuki R, (1989) Formation and control of optimal trajectory in human multijoint arm movement- minimum torque-change model. Biol Cybern 61: 89-101.
14. Shadmehr R, Krakauer JW, (2008) A computational neuroanatomy for motor control. Exp Brain Res 185: 359-381.
15. Todorov E, Jordan MI, (2002) Optimal feedback control as a theory of motor coordination. Nat Neurosci 5: 1226-1235.
16. Ito M, (2000) Mechanisms of motor learning in the cerebellum. Brain Res 886: 237-245.
17. Kawato M, Gomi H, (1992) A computational model of 4 regions of the cerebellum based on feedback-error learning. Biol Cybern 68: 95-103.
18. Kitazawa S, Kimura T, Yin PB, (1998) Cerebellar complex spikes encode both destinations and errors in arm movements. Nature 392: 494-497.
19. Schweighofer N, Arbib MA, Kawato M, (1998) Role of the cerebellum in reaching movements in humans. I. Distributed inverse dynamics control. Eur J Neurosci 10: 86-94.
20. Diedrichsen J, Hashambhoy Y, Rane T, Shadmehr R, (2005) Neural correlates of reach errors. J Neurosci 25: 9919-9931.
21. Roitman AV, Pasalar S, Ebner TJ, (2009) Single trial coupling of Purkinje cell activity to speed and error signals during circular manual tracking. Exp Brain Res 192: 241-251.
22. Engelbrecht SE, (2001) Minimum principles in motor control. J Math Psychol 45: 497-542.
23. Harris CM, Wolpert DM, (1998) Signal-dependent noise determines motor planning. Nature 394: 780-784.
24. Haruno M, Wolpert DM, (2005) Optimal control of redundant muscles in step-tracking wrist movements. J Neurophysiol 94: 4244-4255.
25. Wolpert DM, (2007) Probabilistic models in human sensorimotor control. Hum Movement Sci 26: 511-524.
26. Kitazawa S, (2002) Optimization of goal-directed movements in the cerebellum: a random walk hypothesis. Neurosci Res 43: 289-294.
27. Guigon E, Baraduc P, Desmurget M, (2007) Coding of movement- and force-related information in primate primary motor cortex: a computational approach. Eur J Neurosci 26: 250-260.
28. Todorov E, (2002) Cosine tuning minimizes motor errors. Neural Comput 14: 1233-1260.
29. Burdet E, Franklin DW, Osu R, Tee KP, Kawato M, et al. (2004) How are internal models of unstable tasks formed? Proceedings of the 26th Annual International Conference of the IEEE EMBS; 1-5 September 2004; San Francisco, CA, USA pp. 4491-4494.
30. Reinkensmeyer D, Aoyagi D, Emken J, Galvez J, Ichinose W, et al. (2004) Robotic Gait Training: Toward More Natural Movements and Optimal Training Algorithms. Proceedings of the 26th Annual International Conference of the IEEE EMBS; 1-5 September 2004; San Francisco, CA, USA pp. 4818-4821.
31. Reinkensmeyer DJ, Akoner OM, Ferris DP, Gordon KE, (2009) Slacking by the Human Motor System: Computational Models and Implications for Robotic Orthoses. Proceedings of the 31st Annual International Conference of the IEEE EMBS; 2-6 September 2009; Minneapolis, Minnesota, USA pp. 2129-2132.
32. Emken JL, Benitez R, Sideris A, Bobrow JE, Reinkensmeyer DJ, (2007) Motor adaptation as a greedy optimization of error and effort. J Neurophysiol 97: 3997-4006.
33. Emken JL, Benitez R, Reinkensmeyer DJ, (2007) Human-robot cooperative movement training: Learning a novel sensory motor transformation during walking with robotic assistance-as-needed. J Neuroeng Rehab 4: 8.
34. Franklin DW, Burdet E, Tee KP, Osu R, Chew CM, et al. (2008) CNS Learns Stable, Accurate, and Efficient Movements Using a Simple Algorithm. J Neurosci 28: 11165-11173.
35. Tee KP, Franklin DW, Kawato M, Milner TE, Burdet E, (2010) Concurrent adaptation of force and impedance in the redundant muscle system. Biol Cybern 102: 31-44.
36. Reed R, (1993) Pruning algorithms- A survey. IEEE Trans Neural Networks 4: 740-747.
37. Le Cun Y, Denker JS, Solla SA, (1990) Optimal brain damage. In: Touretzky DS, editors. Advances in neural information processing systems San Mateo Mogan Kaufmann pp. 598-605.
38. Krogh A, Hertz JA, (1992) A simple weight decay can improve generalization. In: Moody JE, Hanson SJ, Lippmann RP, editors. Advances in neural information processing systems San Mateo Mogan Kaufmann pp. 950-957.
39. Hinton GE, (1987) Learning translation invariant recognition in a massively parallel networks. In: Goos G, Hartmanis J, editors. PARLE: Parallel Architectures and Languages Europe Lecture Notes in Computer Science Berlin Springer pp. 1-13.
40. Ganesh G, Albu-Schaeffer A, Haruno M, Kawato M, Burdet E, (2010) Biomimetic motor behavior for simultaneous adaptation of force, impedance and trajectory in interaction tasks. Proceedings of the IEEE International Conference on Robotics and Automation; 3-8 May 2010; Anchorage, Alaska, USA pp. 2705-2711.
41. Yang C, Ganesh G, Haddadin S, Parusel S, Albu-Schaeffer A, et al. (2011) Human-Like Adaptation of Force and Impedance in Stable and Unstable Interactions. IEEE T Robot 27: 918-930.
42. Rumelhart DE, Hinton GE, Williams RJ, (1986) Learning representations by back-propagating errors. Nature 323: 533-536.
43. Rokni U, Richardson AG, Bizzi E, Seung HS, (2007) Motor learning with unstable neural representations. Neuron 54: 653-666.
44. Georgopoulos AP, Kalaska JF, Caminiti R, Massey JT, (1982) On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex. J Neurosci 2: 1527-1537.
45. Shinoda Y, Yokota JI, Futami T, (1981) Divergent projection of individual corticospinal axons to moto-neurons of multiple muscles in the monkey. Neurosci Lett 23: 7-12.
46. Fetz EE, Cheney PD, (1980) Postspike facilitation of forelimb muscle-activity by primate corticomotoneuronal cells. J Neurophysiol 44: 751-772.
47. Griffin DM, Hudson HM, Belhaj-Saif A, McKiernan BJ, Cheney PD, (2008) Do corticomotoneuronal cells predict target muscle EMG activity? J Neurophysiol 99: 1169-1186.
48. McKiernan BJ, Marcario JK, Karrer JH, Cheney PD, (1998) Corticomotoneuronal postspike effects in shoulder, elbow, wrist, digit, and intrinsic hand muscles during a reach and prehension task. J Neurophysiol 80: 1961-1980.
49. Rathelot JA, Strick PL, (2009) Subdivisions of primary motor cortex based on cortico-motoneuronal cells. Proc Natl Acad Sci U S A 106: 918-923.
50. Griffin DM, Hudson HM, Belhaj-Saif A, Cheney PD, (2009) Stability of Output Effects from Motor Cortex to Forelimb Muscles in Primates. J Neurosci 29: 1915-1927.
51. Davidson AG, Chan V, O'Dell R, Schieber MH, (2007) Rapid changes in throughput from single motor cortex neurons to muscle activity. Science 318: 1934-1937.
52. Cheng EJ, Scott SH, (2000) Morphometry of Macaca mulatta forelimb. I. Shoulder and elbow muscles and segment inertial parameters. J Morphol 245: 206-224.
53. Nakamura Y, Yamane K, Fujita Y, Suzuki I, (2005) Somatosensory computation for man-machine interface from motion-capture data and musculoskeletal human model. IEEE Trans Robot 21: 58-66.
54. Nozaki D, Nakazawa K, Akai M, (2005) Uncertainty of knee joint, muscle activity during knee joint torque exertion: the significance of controlling adjacent joint torque. J Appl Physiol 99: 1093-1103.
55. Kakei S, Hoffman DS, Strick PL, (2001) Direction of action is represented in the ventral premotor cortex. Nat Neurosci 4: 1020-1025.
56. Thoroughman KA, Shadmehr R, (1999) Electromyographic correlates of learning an internal model of reaching movements. J Neurosci 19: 8573-8588.
57. Franklin DW, Osu R, Burdet E, Kawato M, Milner TE, (2003) Adaptation to stable and unstable dynamics achieved by combined impedance control and inverse dynamics model. J Neurophysiol 90: 3270-3282.
58. Abraham WC, (2003) How long will long-term potentiation last? Philos Trans R Soc Lond Ser B-Biol Sci 358: 735-744.
59. Kurtzer IL, Herter TM, (2007) Contrasting interpretations of the nonuniform distribution of preferred directions within primary motor cortex. J Neurophysiol 97: 4390.
60. Georgopoulos AP, Naselaris T, Merchant H, Amirikian B, (2007) Contrasting interpretations of the nonuniform distribution of preferred directions within primary motor cortex- Reply to Kurtzer and Herter. J Neurophysiol 97: 4391-4392.
61. Kurtzer I, Herter TM, Scott SH, (2006) Nonuniform distribution of reach-related and torque-related activity in upper arm muscles and neurons of primary motor cortex. J Neurophysiol 96: 3220-3230.
62. Chestek CA, Batista AP, Santhanam G, Yu BM, Afshar A, et al. (2007) Single-neuron stability during repeated reaching in macaque premotor cortex. J Neurosci 27: 10742-10750.
63. Osu R, Franklin DW, Kato H, Gomi H, Domen K, et al. (2002) Short- and long-term changes in joint co-contraction associated with motor learning as revealed from surface EMG. J Neurophysiol 88: 991-1004.
64. Joiner WM, Smith MA, (2008) Long-Term Retention Explained by a Model of Short-Term Learning in the Adaptive Control of Reaching. J Neurophysiol 100: 2948-2955.
65. Kalaska JF, Cohen DAD, Hyde ML, Prudhomme M, (1989) A comparison of movement direction-related versus load direction-related activity in primate motor cortex, using a two-dimensional reaching task. J Neurosci 9: 2080-2102.
66. Kaufman MT, Churchland MM, Santhanam G, Yu BM, Afshar A, et al. (2010) Roles of Monkey Premotor Neuron Classes in Movement Preparation and Execution. J Neurophysiol 104: 799-810.
67. Bartho P, Hirase H, Monconduit L, Zugaro M, Harris KD, et al. (2004) Characterization of neocortical principal cells and Interneurons by network interactions and extracellular features. J Neurophysiol 92: 600-608.
68. Zajac FE, Gordon ME, (1989) Determining muscles force and action in multi-articular movement. Exerc Sport Sci Rev 17: 187-230.
69. Hirashima M, (2011) Induced acceleration analysis of three-dimensional multi-joint movements and its application to sports movements. In: Klika V, editors. Theoretical Biomechanics Reijka, Croatia InTech pp. 303-318.
70. Hoff B, Arbib MA, (1993) Models of trajectory formation and temporal interaction of reach and grasp. J Mot Behav 25: 175-192.
71. Desmurget M, Epstein CM, Turner RS, Prablanc C, Alexander GE, et al. (1999) Role of the posterior parietal cortex in updating reaching movements to a visual target. Nat Neurosci 2: 563-567.
72. Johnson PB, Ferraina S, Bianchi L, Caminiti R, (1996) Cortical networks for visual reaching: Physiological and anatomical organization of frontal and parietal lobe arm regions. Cereb Cortex 6: 102-119.
73. Shen LM, Alexander GE, (1997) Neural correlates of a spatial sensory-to-motor transformation in primary motor cortex. J Neurophysiol 77: 1171-1194.
74. Zhang J, Riehle A, Requin J, Kornblum S, (1997) Dynamics of single neuron activity in monkey primary motor cortex related to sensorimotor transformation. J Neurosci 17: 2227-2246.
75. Tanaka H, Krakauer JW, Qian N, (2006) An optimization principle for determining movement duration. J Neurophysiol 95: 3875-3886.
76. Trainin E, Meir R, Karniel A, (2007) Explaining patterns of neural activity in the primary motor cortex using spinal cord and limb biomechanics models. J Neurophysiol 97: 3736-3750.
77. Rickert J, Riehle A, Aertsen A, Rotter S, Nawrot MP, (2009) Dynamic Encoding of Movement Direction in Motor Cortical Neurons. J Neurosci 29: 13870-13882.
78. Cisek P, (2006) Integrated neural processes for defining potential actions and deciding between them: A computational model. J Neurosci 26: 9761-9770.
79. Smith MA, Ghazizadeh A, Shadmehr R, (2006) Interacting adaptive processes with different timescales underlie short-term motor learning. PLoS Biol 4: 1035-1043.
80. Hirashima M, Yamane K, Nakamura Y, Ohtsuki T, (2008) Kinetic chain of overarm throwing in terms of joint rotations revealed by induced acceleration analysis. J Biomech 41: 2874-2883.
81. Berens P, (2009) CircStat: A MATLAB Toolbox for Circular Statistics. J Stat Soft 31: 1-21.
82. de Leva P, (1996) Adjustments to Zatsiorsky-Seluyanov's segment inertia parameters. J Biomech 29: 1223-1230.