Neural primitives for motion control

IEEE Journal of Oceanic Engineering

Volumn 29, Issue 3, 2004, Pages 640-650

  Mussa Ivaldi, Ferdinando A ^a,b   Solla, Sara A ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

^b REHABILITATION INSTITUTE OF CHICAGO   (United States)

Author keywords

Adaptive control; Central pattern generators; Coordination; Force fields; Primitives

Indexed keywords

ACTUATORS; ADAPTIVE CONTROL SYSTEMS; INTELLIGENT CONTROL; MARINE BIOLOGY; MOTION CONTROL; MUSCULOSKELETAL SYSTEM; NEURAL NETWORKS; ROBOTICS;

ACTUATOR COORDINATES; BIOROBOTIC AUTONOMOUS UNDERSEA VEHICLES; CENTRAL PATTERN GENERATORS; FORCE FIELDS; MUSCLE SYNERGIES; NEURAL CONTROL; PRIMITIVES;

REMOTELY OPERATED VEHICLES;

EID: 9244251068     PISSN: 03649059     EISSN: None     Source Type: Journal    
DOI: 10.1109/JOE.2004.833102     Document Type: Article

References (89)

1. R. Llinas, I of the Vortex: From Neurons to Self. Cambridge, MA: MIT Press, 2001.
2. M. Brady, J. Hollerbach, T. Johnson, T. Lozano-Perez, and M. Mason, Robot Motion: Planning and Control. Cambridge, MA: MIT Press, 1982.
3. G. Nicolis and I. Prigogine, Exploring Complexity. New York: Freeman, 1989.
4. P. Cvitanovic, "Chaotic field theory: a sketch," Phys. A, vol. 288, pp. 61-89, 2000.
5. J. E. Colgate and K. M. Lynch, "Control problems solved by a fish's body and brain: A review," IEEE J. Oceanic Eng., vol. 29, pp. 660-673, July 2004.
6. T. V. P. Bliss and T. Lomo, "Long-lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path," J. Physiol., vol. 232, pp. 331-356, 1973.
7. T. V. P. Bliss and G. L. Collingridge, "A synaptic model of memory: long-term potentiation in the hippocampus," Nature, vol. 361, pp. 31-39, 1993.
8. M. Ito, "Long-term depression," Annu. Rev. Neurosci., vol. 12, pp. 85-102, 1989.
9. M. S. Rioult-Pedotti, D. Friedman, and J. P. Donoghue, " Learning-induced LTP in neocortex," Science, pp. 553-556, 2000.
10. R. Shadmehr and F. A. Mussa-Ivaldi, "Adaptive representation of dynamics during learning of a motor task," J. Neurosci., vol. 14, pp. 3208-3224, 1994.
11. E. Marder, "Modifiability of pattern generation," Current Opinion Neurobiol., vol. 1, pp. 571-576, 1991.
12. D. Parker and S. Grillner, "Neuronal mechanisms of synaptic and network plasticity in the lamprey spinal cord," Progress Brain Res., vol. 125, pp. 381-398, 2000.
13. M. C. Dorris, M. Pare, and D. P. Munoz, "Immediate neural plasticity shapes motor performance," J. Neurosci., vol. 20, p. RC52, 2000.
14. J. F. Houde and M. I. Jordan, "Sensorimotor adaptation in speech production," Science, vol. 279, pp. 1213-1216, 1998.
15. T. R. Nichols, "The contributions of muscles and reflexes to the regulation of joint and limb mechanics," Clinical Ortho. Rel. Res., vol. 403 Suppl, pp. S43-S50, 2002.
16. L. Jami, "Golgi tendon organs in mammalian skeletal muscle: functional properties and central actions," Physiol. Rev., vol. 72, pp. 623-666, 1992.
17. F. A. Mussa-Ivaldi, "Geometrical principles in motor control," in Handbook of Brain Theory, 2nd ed, M. A. Arbib, Ed. Cambridge, MA: MIT Press, 2002.
18. P. Morasso, "Spatial control of arm movements," Exp. Brain Res., vol. 42, pp. 223-227, 1981.
19. T. Flash and N. Hogan, "The coordination of arm movements: an experimentally confirmed mathematical model," J. Neurosci., vol. 5, pp. 1688-1703, 1985.
20. Y. Gutfreund, T. Flash, G. Fiorito, and B. Hochner, "Patterns of arm muscle activation involved in octopus reaching movements," J. Neurosci., vol. 18, pp. 5976-5987, 1998.
21. P. Bandyopadhyay, "Maneuvering hydrodynamics of fish and small underwater vehicles," Integ. Comp. Biol., vol. 42, pp. 102-117, 2002.
22. R. N. Holdefer and L. E. Miller, "Primary motor cortical neurons encode functional muscle synergies," Exp. Brain Res., vol. 146, pp. 233-243, 2002.
23. H. Goldstein, Classical Mechanics, 2nd ed. Reading, MA: Addison-Wesley, 1980.
24. J. V. Jose and E. J. Saletan, Classical Dynamics: A Contemporary Approach. Cambridge, U.K.: Cambridge Univ. Press, 1998.
25. L. Sciavicco and B. Siciliano, Modeling and Control of Robot Manipulators. New York: Springer-Verlag, 2000.
26. N. Bernstein, The Coordination and Regulation of Movement. Oxford: Pergamon, 1967.
27. F. A. Mussa-Ivaldi and N. Hogan, "Integrable solutions of kinematic redundancy via impedance control," Int. J. Robot. Res., vol. 10, pp. 481-491, 1991.
28. K. Leeser and W. T. Townsend, "Control and exploitation of kinematic redundancy in torque controllable manipulators via multiple-Jacobian superposition," presented at the 1st Int. Conf. Field and Service Robotics, Canberra, Australia, 1997.
29. N. Hogan, "The mechanics of multi-joint posture and movement control," Biol. Cybern., vol. 52, pp. 315-331, 1985.
30. P. M. H. Rack and D. R. Westbury, "The effects of length and stimulus rate on tension in the isometric cat soleus muscle," J. Physiol., vol. 204, pp. 443-460, 1969.
31. A. V. Hill, "Heat shortening and the dynamic constants of muscle," in Proc. Royal Soc. B, vol. 126, 1938, pp. 136-195.
32. A. F. Huxley, "Muscle structure and theories of contraction," Progress Biophys. Biophys. Chem., vol. 7, pp. 257-318, 1957.
33. F. Mussa-Ivaldi, N. Hogan, and E. Bizzi, "Neural, mechanical and geometrical factors subserving arm posture in humans," J. Neurosci., vol. 5, pp. 2732-2743, 1985.
34. N. Hogan, "Impedance control: an approach to manipulation. Parts I, II, III," ASME J. Dyn. Syst., Meas. Contr., vol. 107, pp. 1-24, 1985.
35. F. A. Mussa-Ivaldi, "Nonlinear force fields: a distributed system of control primitives for representing and learning movements," presented at the Proc. 1997 IEEE Int. Symp. Computational Intelligence in Robotics and Automation, 1997.
36. F. A. Mussa-Ivaldi and E. Bizzi, "Motor learning through the combination of primitives," Phil. Trans. Royal Soc. London B, vol. 355, pp. 1755-1769, 2000.
37. R. Sutton and A. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
38. R. J. van Beers, P. Baraduc, and D. M. Wolpert, "Role of uncertainty in sensorimotor control," Phil. Trans. Royal Soc. London B, vol. 357, pp. 1137-1145, 2002.
39. P. B. Matthews, "Relationship of firing intervals of human motor units to the trajectory of post-spike after-hyperpolarization and synaptic noise," J. Physiol., vol. 492, pp. 597-682, 1996.
40. C. M. Harris and D. M. Wolpert, "Signal-dependent noise determines motor planning," Nature, vol. 394, pp. 780-784, 1998.
41. E. Todorov and M. I. Jordan, "Optimal feedback control as a theory of motor coordination," Nature Neurosci., vol. 5, pp. 1226-1235, 2002.
42. F. Mussa-Ivaldi, S. Giszter, and E. Bizzi, "Motor-space coding in the central nervous system," in Cold Spring Harbor Symp. Quantitative Biology: The Brain, vol. 55, 1990, pp. 827-835.
43. E. Bizzi, F. Mussa-Ivaldi, and S. Giszter, "Computations underlying the execution of movement: a biological perspective," Science, vol. 253, pp. 287-291, 1991.
44. S. F. Giszter, F. A. Mussa-Ivaldi, and E. Bizzi, "Convergent force fields organized in the frog's spinal cord," J. Neurosci., vol. 13, pp. 467-491, 1993.
45. M. Lemay and W. Grill, "Endpoint forces evoked by microstimulation of the cat spinal cord," presented at the Annu. Int. Conf. IEEE Engineering in Medicine and Biology, 1999.
46. M. C. Tresch and E. Bizzi, "Responses to spinal microstimulation in the chronically spinalized rat and their relationship to spinal systems activated by low threshold cutaneous stimulation," Exp. Brain Res., vol. 129, pp. 401-416, 1999.
47. F. A. Mussa-Ivaldi, S. F. Giszter, and E. Bizzi, "Linear combinations of primitives in vertebrate motor control," Proc. Nat. Academy Sci. USA, vol. 91, pp. 7534-7538, 1994.
48. R. Llinás, E. Leznik, and V. Makarenko, "The olivo-cerebellar circuit as universal motor control system," IEEE J. Oceanic Eng., vol. 29, no. 3, pp. 631-639, 2004.
49. W. Lohmiller and J.-J. E. Slotine, "On contraction analysis for nonlinear systems," Automatica, vol. 34, pp. 683-696, 1998.
50. M. W. Westneat, D. H. Thorsen, J. A. Walker, and M. A. Hale, " Structure, function and neural control of pectoral fins in fishes," IEEE J. Oceanic Eng., vol. 29, no. 3, pp. 674-683, 2004.
51. A. Lansner, J. H. Kotaleski, and S. Grillner, "Modeling of the spinal neuronal circuitry underlying locomotion in a lower vertebrate," Ann. New York Acad. Sci., vol. 860, pp. 239-249, 1998.
52. T. G. Brown, "On the nature of the fundamental activity of the nervous centres; together with an analysis of the conditioning of rhythmic activity in progression, and a theory of the evolution of function in the nervous system," J. Physiol., vol. 48, pp. 18-46, 1914.
53. S. Grillner, "Control of locomotion in bipeds, tetrapods and fish," in Handbook of Physiology. The Nervous System, Motor Control, V. B. Brookds, Ed. Bethesda, MD: American Physiological Society, 1981, pp. 1179-1236.
54. E. Marder and R. L. Calabrese, "Principles of rhythmic motor pattern generation," Physiol. Rev., vol. 76, pp. 687-717, 1996.
55. E. Marder and D. Bucher, "Central pattern generators and the control of rhythmic movements," Current Biol., vol. 11, pp. R986-R996, 2001.
56. O. Kiehn and T. Eken, "Functional role of plateau potentials in vertebrate motor neurons," Current Opinion Neurobiol., vol. 8, pp. 746-752, 1998.
57. J. C. Rekling and J. L. Feldman, "PreBotzinger complex and pacemaker neurons: hypothesized site and kernel for respiratory rhythm generation," Annu. Rev. Physil., vol. 60, pp. 385-405, 1998.
58. X.-J. Wang and J. Rinzel, "Alternating and synchronous rhythms in reciprocally inhibitory model neurons," Neural Comput., vol. 4, pp. 84-97, 1992.
59. J. A. White, C. C. Chow, J. Ritt, C. Soto-Trevino, and N. Kopell, " Synchronization and oscillatory dynamics in heterogeneous, mutually inhibited neurons," J. Comput. Neurosci., vol. 5, pp. 5-16, 1998.
60. S. Alford, I. Zompa, and R. Dubuc, "Long-term potentiation of glutamatergic pathways in the lamprey brainstem," J. Neurosci., vol. 15, pp. 7528-7538, 1995.
61. T. Deliagina and E. Pavlova, "Modifications of vestibular responses of individual reticulospinal neurons in lamprey caused by unilateral labyrinthectomy," J. Neurophysil., vol. 87, pp. 1-14, 2002.
62. G. V. DiPrisco, P. Wallen, and S. Grillner, "Synaptic effects of intraspinal stretch receptor neurons mediating movement-related feedback during locomotion," Brain Res., vol. 530, pp. 161-166, 1990.
63. S. Grillner, T. Williams, and P. Lagerback, "The edge cell, a possible intraspinal mechanoreceptor," Science, vol. 233, pp. 500-503, 1984.
64. A. H. Cohen, G. B. Ermentrout, T. Kiernel, N. Kopell, K. A. Sigvardt, and T. L. Williams, "Modeling of intersegmental coordination in the lamprey central pattern generation for locomotion," Trends Neurosci., vol. 15, pp. 434-438, 1992.
65. J. Albus, "The theory of cerebellar function," Math. Biosci., vol. 10, pp. 25-61, 1971.
66. D. Marr, "A theory of cerebellar cortex," J. Physiol., vol. 202, pp. 437-470, 1969.
67. E. Bizzi and F. Mussa-Ivaldi, "The acquisition of motor behavior," Daedalus, vol. 127, pp. 217-232, 1998.
68. C. Atkeson and S. Schaal, "Robot learning from demonstration," presented at the Machine Learning: Proc. 14th Int. Conf. (ICML '97), 1997.
69. S. Schaal, "Is imitation learning the route to humanoid robots?," Trends Cognitive Sci., vol. 3, pp. 233-242, 1999.
70. A. Whiten, "Imitation of the sequential structure of actions by chimpanzees (Pan troglodytes)," J. Compar. Psychol., vol. 112, pp. 270-281, 1998.
71. R. Byrne and A. Russon, "Learning by imitation: a hierarchical approach," Behav. Brain Sci., vol. 21, pp. 667-684, 1998.
72. M. I. Jordan and D. E. Rumelhart, "Forward models: supervised learning with a distal teacher," Cognitive Sci., vol. 16, pp. 307-354, 1992.
73. M. Kawato and D. Wolpert, "Internal models for motor control," in Novartis Foundation Symp., vol. 218, 1998, pp. 291-304.
74. J. McIntyre, A. Berthoz, and F. Lacquaniti, "Reference frames and internal models," Brain Res. Brain Res. Rev., vol. 28, pp. 143-154, 1998.
75. J. Flanagan and A. Wing, "The role of internal models in motion planning and control: evidence from grip force adjustments during movements of hand-held loads," J. Neurosci., vol. 17, pp. 1519-1528, 1997.
76. R. Miall and D. Wolpert, "Forward models for physiological motor control," Neural Networks, vol. 9, pp. 1265-1279, 1996.
77. N. Hogan, E. Bizzi, F. A. Mussa-Ivaldi, and T. Flash, "Controlling multi-joint motor behavior," Exercise Sport Sci. Rev., vol. 15, pp. 153-190, 1987.
78. D. Wolpert and M. Kawato, "Multiple paired forward and inverse models for motor control," Neural Networks, vol. 11, pp. 1317-1329, 1998.
79. D. Wolpert, R. Miall, and M. Kawato, "Internal models in the cerebellum," Trends Cognitive Sci., vol. 2, pp. 338-347, 1998.
80. P. N. Sabes, M. I. Jordan, and D. M. Wolpert, "The role of inertial sensitivity in motor planning," J. Neurosci., vol. 18, pp. 5948-5957, 1998.
81. J. Hore, R. Ritchi, and S. Watts, "Finger opening in an overarm throw is not triggered by proprioceptive feedback from elbow extension or wrist flexion," Exp. Brain Res., vol. 125, pp. 301-312, 1999.
82. M. A. Conditt, F. Gandolfo, and F. A. Mussa-Ivaldi, "The motor system does not learn the dynamics of the arm by rote memorization of past experience," J. Neurophysiol., vol. 78, pp. 554-560, 1997.
83. M. A. Conditt and F. A. Mussa-Ivaldi, "Central representation of time during motor learning," Proc. Nat. Acad. Sci. USA, vol. 96, pp. 11 625-11 630, 1999.
84. T. Brashers-Krug, R. Shadmehr, and E. Bizzi, "Consolidation in human motor memory," Nature, vol. 382, pp. 252-255, 1996.
85. N. Bhushan and R. Shadmehr, "Computational nature of human adaptive control during learning of reaching movements in force fields," Biol. Cybern., vol. 81, pp. 39-60, 1999.
86. D. Amit, Modeling Brain Function: The World of Attractor Neural Networks. Cambridge, U.K.: Cambridge Univ. Press, 1989.
87. R. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton, "Adaptive mixtures of local experts," Neural Comput., vol. 3, pp. 79-87, 1988.
88. C. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Oxford Univ. Press, 1996.
89. M. I. Jordan and D. A. Rosenbaum, "Action," in Foundations of Cognitive Science, M. I. Posner, Ed. Cambridge, MA: MIT Press, 1989, pp. 727-767.