Learning to push and learning to move: The adaptive control of contact forces

Frontiers in Computational Neuroscience

Volumn 9, Issue November, 2015, Pages 1-17

  Casadio, Maura ^a,b,c   Pressman, Assaf ^d,e   Mussa Ivaldi, Ferdinando A ^b,e  

^a UNIVERSITY OF GENOA   (Italy)

^b NORTHWESTERN UNIVERSITY   (United States)

^c ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^d BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^e REHABILITATION INSTITUTE OF CHICAGO   (United States)

Author keywords

Dynamics of manual skill; Force control; Impedance; Kinematics; Modularity; Motor learning

Indexed keywords

COMPUTATION THEORY; CONCURRENCY CONTROL; CONTROL SYSTEMS; CONTROL THEORY; DYNAMICS; ELECTRIC IMPEDANCE; FORCE CONTROL; KINEMATICS; MOTION CONTROL;

CO-ORDINATED CONTROL; COMPUTATIONAL THEORIES; CONCURRENT OPERATIONS; INTERACTIVE BEHAVIOR; MECHANICAL IMPEDANCES; MODULARITY; MOTOR LEARNING; MOVEMENT TRAJECTORIES;

PROCESS CONTROL;

BRAIN; CONTROL SYSTEM; EXPERIMENTAL MODEL; HUMAN; IMPEDANCE; LEARNING; MOTION;

EID: 84948761276     PISSN: None     EISSN: 16625188     Source Type: Journal    
DOI: 10.3389/fncom.2015.00118     Document Type: Article

References (67)

1. Bizzi, E., Accornero, N., Chapple, W., and Hogan, N. (1984). Posture control and trajectory formation during arm movement. J. Neurosci. 4, 2738-2744.
2. Buneo, C. A., and Andersen, R. A. (2006). The posterior parietal cortex: sensorimotor interface for the planning and online control of visually guided movements. Neuropsychologia 44, 2594-2606. doi: 10.1016/j.neuropsychologia.2005.10.011
3. Delhi; Agra: Springer).
4. Chiaverini, S., and Sciavicco, L. (1993). The parallel approach to force/position control ofrobotic manipulators. Rob. Autom. IEEETrans. 9, 361-373.
5. Chib, V. S., Krutky, M. A., Lynch, K. M., and Mussa-Ivaldi, F. A. (2009). The separate neural control of hand movements and contact forces. J. Neurosci. 29, 3939-3947. doi: 10.1523/JNEUROSCI.5856-08.2009
6. Conditt, M. A., Gandolfo, F., and Mussa-Ivaldi, F. A. (1997). The motor system does not learn the dynamics of the arm by rote memorization of past experience. J. Neurophysiol 78, 554-560.
7. Criscimagna-Hemminger, S. E., Donchin, O., Gazzaniga, M. S., and Shadmehr, R. (2003). Learned dynamics ofreachingmovements generalize fromdominant to nondominant arm. J. Neurophysiol. 89, 168-176. doi: 10.1152/jn.00622.2002
8. Damm, L., and McIntyre, J. (2008). Physiological basis of limb-impedance modulation during free and constrained movements. J. Neurophysiol. 100, 2577-2588. doi: 10.1152/jn.90471.2008
9. onchin, O., Francis, J. T., and Shadmehr, R. (2003). Quantifying generalization from trial-by-trial behavior of adaptive systems that learn with basis functions: theory and experiments in human motor control. J. Neurosci. 23, 9032-9045.
10. Emken, J. L., and Reinkensmeyer, D. J. (2005). Robot-enhanced motor learning: accelerating internal model formation during locomotion by transient dynamic amplification. IEEE Trans. Neural Syst. Rehabil. Eng. 13, 33-39. doi:10.1109/TNSRE.2004.843173
11. eldman, A. (1966). Functional tuning of the nervous system during control of movement or maintenance of a steady posture. II. Controllable parameters of the muscles. III. Mechanographic analysis of the execution by man of the simplest motor task. Biophysics 11, 565-578, 766-755.
12. Feldman, A. G. (1986). Once more on the equilibrium-point hypothesis (lambda model) for motor control. J. Mot. Behav. 18, 17-54.
13. Flash, T., and Gurevich, I. (1992). Arm stiffness and movement adaptation to external loads. Proc. Annu. Conf. Eng. Med. 13, 885-886.
14. Foley, J. M., and Meyer, R. A. (1993). Energycostoftwitchand tetanic contractions ofrat muscle estimated in situ bygated 31P NMR. NMR Biomed. 6, 32-38.
15. Franklin, D. W., Liaw, G., Milner, T. E., Osu, R., Burdet, E., and Kawato, M. (2007). Endpoint stiffness of the arm is directionally tuned to instability in the environment. J. Neurosci. 27, 7705-7716. doi: 10.1523/JNEUROSCI.0968-07.2007
16. Franklin, D. W., Osu, R., Burdet, E., Kawato, M., and Milner, T. E. (2003). Adaptation to stable and unstable dynamics achieved by combined impedance control and inverse dynamics model. J. Neurophysiol. 90, 3270-3282. doi:10.1152/jn.01112.2002
17. Franklin, D. W., So, U., Kawato, M., and Milner, T. E. (2004). Impedance control balances stability with metabolically costly muscle activation. J. Neurophysiol. 92, 3097-3105. doi: 10.1152/jn.00364.2004
18. Gandolfo, F., Mussa-Ivaldi, F. A., and Bizzi, E. (1996). Motor learning by field approximation. Proc. Natl.Acad. Sci. U.S.A. 93, 3483-3486.
19. Ganesh, G., Albu-Schaffer, A., Haruno, M., Kawato, M., and Burdet, E. (2010). "Biomimetic motor behavior for simultaneous adaptation of force, impedance and trajectory in interaction tasks,, in Robotics and Automation (ICRA), 2010 IEEE International Conference (Anchorage, AK), 2705-2711.
20. Ganesh, G., Jarrasse, N., Haddadin, S., Albu-Schaeffer, A., and Burdet, E. (2012). "A versatile biomimetic controller for contact tooling and haptic exploration,, in Robotics and Automation (ICRA), 2012 IEEEInternational Conference (Saint Paul, MN), 3329-3334.
21. Gomi, H., and A Kawato (1996). Equilibrium-point control hypothesis examined by measured arm stiffness during multijoint movement. Science 272, 117-120.
22. Gomi, H., and Osu, R. (1998). Task-dependent viscoelasticity of human multijoint arm and its spatial characteristics for interaction with environments. J. Neurosci. 18, 8965-8978.
23. Hamel-Paquet, K., Sergio, L. F., and Kalaska, J. F. (2006). Parietal area 5 activity does not reflect the differential time-course of motor output kinetics during arm-reaching and isometric-force tasks. J. Neurophysiol. 95, 3353-3370. doi:10.1152/jn.00789.2005
24. Hoffer, J. A., and Andreassen, S. (1981). Regulation of soleus muscle stiffness in premammillary cats: intrinsic and reflex components. J. Neurophysiol. 45, 267-285.
25. Hogan, M. C., Ingham, E., and Kurdak, S. S. (1998). Contraction duration affects metabolic energy cost and fatigue in skeletal muscle. Am. J. Physiol. 274, E397-E402.
26. Hogan, N. (1985a). The mechanics of multi-joint posture and movement control. Biol. Cybern. 52, 315-331.
27. Hogan, N. (1985b). Impedance control: an approach to manipulation. Parts I, II, III. ASMEJ. Dyn. Sys. Meas. Control 107, 1-24.
28. Hogan, N., Bizzi, E., Mussa-Ivaldi, F. A., and Flash, T. (1987). Controlling multijoint motor behavior. Exerc. Sport Sci. Rev. 15, 153-190.
29. Jones, L. A. (1986). Perception of force and weight: theory and research. Psychol. Bull. 100, 29-42.
30. relative force effect. Brain Res. 244, 186-189.
31. Judkins, T., and Scheidt, R. A. (2014). Visuo-proprioceptive interactions during adaptation of the human reach. J. Neurophysiol. 111, 868-887. doi:10.1152/jn.00314.2012
32. Kawato, M., and Wolpert, D. (1998). Internal models for motor control. Novartis Found. Symp. 218, 291-304.
33. Kirsch, R. F., Boskov, D., and Rymer, W. Z. (1994). Muscle stiffness during transient and continuous movements of cat muscle: perturbation characteristics and physiological relevance. IEEE Trans. Biomed. Eng. 41, 758-770.
34. Kurtzer, I., Herter, T. M., and Scott, S. H. (2005). Random change in cortical load representation suggests distinct control of posture and movement. Nat. Neurosci. 8, 498-504. doi:10.1038/nn1420
35. ackner, J. R., and Dizio, P. (1994). Rapid adaptation to Coriolis force perturbations of arm trajectory. J. Neurophysiol. 72, 299-313.
36. Lacquaniti, F., and Maioli, C. (1994). Independent control of limb position and contact forces in cat posture. J. Neurophysiol. 72, 1476-1495.
37. Maluf, K. S., Barry, B. K., Riley, Z. A., and Enoka, R. M. (2007). Reflex responsiveness of a human hand muscle when controlling isometric force and joint position. Clin. Neurophysiol. 118, 2063-2071. doi:10.1016/j.clinph.2007.06.009
38. McIntyre, J., and Bizzi, E. (1993). Servo Hypotheses for the Biological Control of Movement. J. Mot. Behav. 25, 193-202.
39. Melendez-Calderon, A., Masia, L., Gassert, R., Sandini, G., and Burdet, E. (2011). Force field adaptation can be learned using vision in the absence of proprioceptive error. IEEE Trans. Neural Syst. Rehabil. Eng. 19, 298-306. doi:10.1109/TNSRE.2011.2125990
40. Morris, D., Hong, T., Barbagli, F., Chang, T., and Salisbury, K. (2007). "Haptic feedback enhances force skill learning," in EuroHaptics Conference, 2007 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics 2007. Second Joint (Tsukuba), 21-26.
41. Mugge, W., Abbink, D. A., Schouten, A. C., Dewald, J. P., and van der Helm, F. C. (2010). A rigorous model of reflex function indicates that position and force feedback are flexibly tuned to position and force tasks. Exp. Brain Res. 200, 325-340. doi:10.1007/s00221-009-1985-0
42. Mugge, W., Schuurmans, J., Schouten, A. C., and van der Helm, F. C. (2009). Sensory weighting of force and position feedback in human motor control tasks. J. Neurosci. 29, 5476-5482. doi:10.1523/JNEUROSCI.0116-09.2009
43. Mussa-Ivaldi, F. A., Hogan, N., and Bizzi, E. (1985). Neural, mechanical, and geometric factors subserving arm posture in humans. J. Neurosci. 5, 2732-2743.
44. Perreault, E. J., Kirsch, R. F., and Crago, P. E. (2004). Multijoint dynamics and postural stability of the human arm. Exp. Brain Res. 157, 507-517. doi:10.1007/s00221-004-1864-7
45. Raibert, M. H., and Craig, J. J. (1981). Hybrid Position/Force Control of Manipulators. J. Dyn. Syst. Meas. Control 103, 126-133.
46. Russell, D., and Hogan, N. (1989). "Dealing with constraints: a biomechanical approach," in Engineering in Medicine and Biology Society, 1989. Images of the Twenty-First Century, Proceedings ofthe Annual International Conference of the IEEE Engineering(Seattle, WA), 892-893.
47. amid uncertainty. J. Neurophysiol. 86, 971-985.
48. Scheidt, R. A., and Stoeckmann, T. (2007). Reach adaptation and final position control amid environmental uncertainty after stroke. J. Neurophysiol. 97, 2824-2836. doi:10.1152/jn.00870.2006
49. Schoner, G., Zanone, P. G., and Kelso, J. A. (1992). Learning as change of coordination dynamics: theoryand experiment. J. Mot. Behav. 24, 29-48.
50. Selen, L. P., Franklin, D. W., and Wolpert, D. M. (2009). Impedance control reduces instability that arises from motor noise. J. Neurosci. 29, 12606-12616. doi:10.1523/JNEUROSCI.2826-09.2009
51. Sergio, L. E., Hamel-Paquet, C., and Kalaska, J. F. (2005). Motor Cortex Neural Correlates of Output Kinematics and Kinetics During Isometric-Force and Arm-Reaching Tasks. J. Neurophysiol. 94, 2353-2378. doi:10.1152/jn.00989.2004
52. Sergio, L. E., and Kalaska, J. F. (1998). Changes in the temporal pattern ofprimary motor cortex activity in a directional isometric force versus limb movement task. J. Neurophysiol. 80, 1577-1583.
53. hadmehr, R., and Mussa-Ivaldi, F. A. (1994). Adaptive representation ofdynamics during learning of a motor task. J. Neurosci. 14, 3208-3224.
54. Siciliano, B. (1996). "Parallel force/position control of robot manipulators," in Robotics Research, eds G. Giralt and G. Hirzinger (London: Springer), 78-89.
55. Sih, B. L., and Stuhmiller, J. H. (2003). The metabolic cost offorce generation. Med. Sci. Sports Exerc. 35, 623-629. doi: 10.1249/01.MSS.0000058435.67376.49
56. Smith, M. A., Ghazizadeh, A., and Shadmehr, R. (2006). Interacting adaptive processes with different timescales underlie short-term motor learning. PLoS Biol. 4:e179. doi:10.1371/journal.pbio.0040179
57. posterior parietal cortex. Nature 386, 167-170.
58. Spong, M. W., and Vidyasagar, M. (1989). Robot Dynamics and Control. NewYork, NY: Wiley & Sons.
59. Srimathveeravalli, G., and Thenkurussi, K. (2005). "Motor skill training assistance using haptic attributes," in Eurohaptics Conference, 2005 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2005. World Haptics 2005. First Joint (Pisa), 452-457.
60. Thoroughman, K. A., and Shadmehr, R. (2000). Learning of action through adaptive combination of motor primitives. Nature 407, 742-747. doi:10.1038/35037588
61. Toffin, D., McIntyre, J., Droulez, J., Kemeny, A., and Berthoz, A. (2003). Perception and reproduction offorce direction in the horizontal plane. J. Neurophysiol. 90, 3040-3053. doi:10.1152/jn.00271.2003
62. Torres, E., and Andersen, R. (2006). Space-time separation during obstacle-avoidance learning in m nkeys. J. Neurophysiol. 96, 2613-2632. doi:10.1152/jn.00188.2006
63. Van Donkelaar, P., Lee, J. H., and Drew, A. S. (2000). Transcranial magnetic stimulation disrupts eye-hand interactions in the posterior parietal cortex. J. Neurophysiol. 84, 1677-1680.
64. Venkadesan, M., and Valero-Cuevas, F. J. (2008). Neural control of motion-to-force transitions with the fingertip. J. Neurosci. 28, 1366-1373. doi:10.1523/JNEUROSCI.4993-07.2008
65. Won, J., and Hogan, N. (1995). Stabilityproperties ofhuman reaching movements. Exp. Brain Res. 107, 125-136.
66. ong, J., Wilson, E. T., Malfait, N., and Gribble, P. L. (2009). The influence of visual perturbations on the neural control of limb stiffness. J. Neurophysiol. 101, 246-257. doi:10.1152/jn.90371.2008
67. Yoshikawa, T. (1990). Foundation ofRobotics, Analysis and Control. Cambridge, MA: The MIT Press.