Control strategies in object manipulation tasks

Current Opinion in Neurobiology

Volumn 16, Issue 6, 2006, Pages 650-659

  Flanagan, J Randall ^a   Bowman, Miles C ^a   Johansson, Roland S ^b  

^a QUEEN S UNIVERSITY   (Canada)

^b UMEÅ UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

GAZE; HUMAN; NERVOUS SYSTEM; PREDICTION; PRIORITY JOURNAL; REVIEW; SENSORIMOTOR FUNCTION; SENSORY SYSTEM; TASK PERFORMANCE; VISUOMOTOR COORDINATION;

ANIMALS; CENTRAL NERVOUS SYSTEM; FEEDBACK; FIXATION, OCULAR; HAND; HAND STRENGTH; HUMANS; MOVEMENT; PERIPHERAL NERVOUS SYSTEM; PSYCHOMOTOR PERFORMANCE; SENSATION;

EID: 33751225937     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.conb.2006.10.005     Document Type: Review

References (84)

1. Wolpert D.M., and Flanagan J.R. Motor prediction. Curr Biol 11 (2001) R729-R732
2. Wolpert D.M., Ghahramani Z., and Flanagan J.R. Perspectives and problems in motor learning. Trends Cogn Sci 5 (2001) 487-494
3. Wolpert D.M., and Ghahramani Z. Computational principles of movement neuroscience. Nat Neurosci 3 (2000) 1212-1217
4. Jenmalm P., and Johansson R.S. Visual and somatosensory information about object shape control manipulative fingertip forces. J Neurosci 17 (1997) 4486-4499
5. Jenmalm P., Dahlstedt S., and Johansson R.S. Visual and tactile information about object-curvature control fingertip forces and grasp kinematics in human dexterous manipulation. J Neurophysiol 84 (2000) 2984-2997
6. Nowak D.A., Glasauer S., and Hermsdorfer J. How predictive is grip force control in the complete absence of somatosensory feedback?. Brain 127 (2004) 182-192
7. Nowak D.A., and Hermsdorfer J. Predictive and reactive control of grasping forces: on the role of the basal ganglia and sensory feedback. Exp Brain Res 173 (2006) 650-660. The authors examined reactive and predictive control of grip forces in patients with basal ganglia disorders (including Parkinson's disease) and in deafferented patients lacking all tactile and proprioceptive sensory feedback. In the predictive control task, participants used one hand to drop a ball into a receptacle held in a precision grip by the other hand. In the reactive task, the experimenter dropped the ball and the participant was blindfolded. The basal ganglia dysfunction patients exhibited adequate predictive and reactive control of grip forces. As expected, reactive control was absent in the deafferented patient. However, these patients also exhibited poor predictive control. This supports the notion that the ability to monitor sensory events is important in maintaining predictive control mechanisms.
8. Johansson R.S., and Westling G. Roles of glabrous skin receptors and sensorimotor memory in automatic-control of precision grip when lifting rougher or more slippery objects. Exp Brain Res 56 (1984) 550-564
9. Westling G., and Johansson R.S. Responses in glabrous skin mechanoreceptors during precision grip in humans. Exp Brain Res 66 (1987) 128-140
10. Johansson R.S., and Westling G. Signals in tactile afferents from the fingers eliciting adaptive motor-responses during precision grip. Exp Brain Res 66 (1987) 141-154
11. Johansson R.S., and Cole K.J. Sensory-motor coordination during grasping and manipulative actions. Curr Opin Neurobiol 2 (1992) 815-823
12. Johansson R.S., Westling G., Backstrom A., and Flanagan J.R. Eye-hand coordination in object manipulation. J Neurosci 21 (2001) 6917-6932
13. Johansson R.S., and Westling G. Coordinated isometric muscle commands adequately and erroneously programmed for the weight during lifting task with precision grip. Exp Brain Res 71 (1988) 59-71
14. Gordon A.M., Forssberg H., Johansson R.S., and Westling G. Visual size cues in the programming of manipulative forces during precision grip. Exp Brain Res 83 (1991) 477-482
15. Gordon A.M., Forssberg H., Johansson R.S., and Westling G. The integration of haptically acquired size information in the programming of precision grip. Exp Brain Res 83 (1991) 483-488
16. Mon-Williams M., and Murray A.H. The size of the visual size cue used for programming manipulative forces during precision grip. Exp Brain Res 135 (2000) 405-410
17. Gordon A.M., Westling G., Cole K.J., and Johansson R.S. Memory representations underlying motor commands used during manipulation of common and novel objects. J Neurophysiol 69 (1993) 1789-1796
18. Wing A.M., and Lederman S.J. Anticipating load torques produced by voluntary movements. J Exp Psychol Hum Percept Perform 24 (1998) 1571-1581
19. Salimi I., Frazier W., Reilmann R., and Gordon A.M. Selective use of visual information signaling objects' center of mass for anticipatory control of manipulative fingertip forces. Exp Brain Res 150 (2003) 9-18
20. Johansson R.S., Backlin J.L., and Burstedt M.K. Control of grasp stability during pronation and supination movements. Exp Brain Res 128 (1999) 20-30
21. Goodwin A.W., Jenmalm P., and Johansson R.S. Control of grip force when tilting objects: effect of curvature of grasped surfaces and applied tangential torque. J Neurosci 18 (1998) 10724-10734
22. Jenmalm P., Goodwin A.W., and Johansson R.S. Control of grasp stability when humans lift objects with different surface curvatures. J Neurophysiol 79 (1998) 1643-1652
23. Johansson R.S., and Westling G. Programmed and triggered actions to rapid load changes during precision grip. Exp Brain Res 71 (1988) 72-86
24. Salimi I., Hollender I., Frazier W., and Gordon A.M. Specificity of internal representations underlying grasping. J Neurophysiol 84 (2000) 2390-2397
25. Gordon A.M., Forssberg H., Johansson R.S., and Westling G. Integration of sensory information during the programming of precision grip: Comments on the contributions of size cues. Exp Brain Res 85 (1991) 226-229
26. Flanagan J.R., and Beltzner M.A. Independence of perceptual and sensorimotor predictions in the size-weight illusion. Nat Neurosci 3 (2000) 737-741
27. Flanagan J.R., Vetter P., Johansson R.S., and Wolpert D.M. Prediction precedes control in motor learning. Curr Biol 13 (2003) 146-150
28. Flanagan J.R., and Wing A.M. The role of internal models in motion planning and control: evidence from grip force adjustments during movements of hand-held loads. J Neurosci 17 (1997) 1519-1528
29. Jenmalm P., Birznieks I., Goodwin A.W., and Johansson R.S. Influence of object shape on responses of human tactile afferents under conditions characteristic of manipulation. Eur J Neurosci 18 (2003) 164-176
30. Birznieks I., Jenmalm P., Goodwin A.W., and Johansson R.S. Encoding of direction of fingertip forces by human tactile afferents. J Neurosci 21 (2001) 8222-8237
31. Johansson R.S., and Birznieks I. First spikes in ensembles of human tactile afferents code complex spatial fingertip events. Nat Neurosci 7 (2004) 170-177
32. Desmurget M., Pelisson D., Rossetti Y., and Prablanc C. From eye to hand: planning goal-directed movements. Neurosci Biobehav Rev 22 (1998) 761-788
33. Crawford J.D., Medendorp W.P., and Marotta J.J. Spatial transformations for eye-hand coordination. J Neurophysiol 92 (2004) 10-19
34. Prablanc C., Echallier J.E., Jeannerod M., and Komilis E. Optimal response of eye and hand motor systems in pointing at a visual target. II. Static and dynamic visual cues in the control of hand movement. Biol Cybern 35 (1979) 183-187
35. Prablanc C., Pelisson D., and Goodale M.A. Visual control of reaching movements without vision of the limb.1. role of retinal feedback of target position in guiding the hand. Exp Brain Res 62 (1986) 293-302
36. Jeannerod M: The Neural and Behavioural Organization of Goal-Directed Movements. Oxford: OUP Psychology Series No 5; 1988.
37. Desmurget M., Gaveau V., Vindras P., Turner R.S., Broussolle E., and Thobois S. On-line motor control in patients with Parkinson's disease. Brain 127 (2004) 1755-1773
38. Ballard D.H., Hayhoe M.M., Li F., and Whitehead S.D. Hand-eye coordination during sequential tasks. Philos Trans R Soc Lond B Biol Sci 337 (1992) 331-338
39. Smeets J.B., Hayhoe M.M., and Ballard D.H. Goal-directed arm movements change eye-head coordination. Exp Brain Res 109 (1996) 434-440
40. Land M., Mennie N., and Rusted J. The roles of vision and eye movements in the control of activities of daily living. Perception 28 (1999) 1311-1328
41. Land M.F., and Hayhoe M. In what ways do eye movements contribute to everyday activities?. Vision Res 41 (2001) 3559-3565
42. Flanagan J.R., and Johansson R.S. Action plans used in action observation. Nature 424 (2003) 769-771
43. Hayhoe M., and Ballard D. Eye movements in natural behavior. Trends Cogn Sci 9 (2005) 188-194. The authors provide an excellent review of saccadic eye movement organization in natural tasks. The review focuses on recent advances that have greatly expanded our understanding of the role of eye movements in natural behaviour. These advances include findings showing the importance of both the task and internal reward in specifying eye movements in addition to limb movements.
44. Rizzolatti G., Fogassi L., and Gallese V. Neurophysiological mechanisms underlying the understanding and imitation of action. Nat Rev Neurosci 2 (2001) 661-670
45. Rizzolatti G., and Craighero L. The mirror-neuron system. Annu Rev Neurosci 27 (2004) 169-192
46. Liberman A.M., and Whalen D.H. On the relation of speech to language. Trends Cogn Sci 4 (2000) 187-196
47. Iacoboni M., Woods R.P., Brass M., Bekkering H., Mazziotta J.C., and Rizzolatti G. Cortical mechanisms of human imitation. Science 286 (1999) 2526-2528
48. Land M.F., and Furneaux S. The knowledge base of the oculomotor system. Philos Trans R Soc Lond B Biol Sci 352 (1997) 1231-1239
49. Falck-Ytter T., Gredeback G., and von Hofsten C. Infants predict other people's action goals. Nat Neurosci 9 (2006) 878-879. The authors show that the generation of proactive and action-like eye movements during observation of a manipulation task emerges in infants between 6 months and 12 months of age. The fact that the ability to perform manipulation tasks also emerges during this period supports the idea that action observation engages action systems.
50. Rotman G., Troje N.F., Johansson R.S., and Flanagan J.R. Eye movements when observing predictable and unpredictable actions. J Neurophysiol 96 (2006) 1358-1369. This paper shows that when participants watch an actor grasp one of two possible blocks and do not know in advance which block will be grasped, they nevertheless directed their gaze to the target block ahead of the actor's hand and maintain fixation at the block until it is grasped. The authors suggest that these proactive eye movements are driven by sensorimotor representations of the task (activated in the observer's brain) and enable the observer to monitor the task in much the same way that actors do.
51. de C Hamilton AF Joyce DW, Flanagan JR, Frith CD, Wolpert DM: Kinematic cues in perceptual weight judgement and their origins in box lifting. Psychol Res 2005, in press.
52. Kawato M. Internal models for motor control and trajectory planning. Curr Opin Neurobiol 9 (1999) 718-727
53. Krakauer J.W., Pine Z.M., Ghilardi M.F., and Ghez C. Learning of visuomotor transformations for vectorial planning of reaching trajectories. J Neurosci 20 (2000) 8916-8924
54. Wigmore V., Tong C., and Flanagan J.R. Visuomotor rotations of varying size and direction compete for a single internal model in motor working memory. J Exp Psychol Hum Percept Perform 28 (2002) 447-457
55. Cunningham H.A. Aiming error under transformed spatial maps suggest a structure for visual-motor maps. J Exp Psychol 15 3 (1989) 493-506
56. Martin T.A., Keating J.G., Goodkin H.P., Bastian A.J., and Thach W.T. Throwing while looking through prisms. II. Specificity and storage of multiple gaze-throw calibrations. Brain 119 (1996) 1199-1211
57. Fernandez-Ruiz J., Diaz R., Aguilar C., and Hall-Haro C. Decay of prism aftereffects under passive and active conditions. Brain Res Cogn Brain Res 20 (2004) 92-97
58. Wang J., and Sainburg R.L. Adaptation to visuomotor rotations remaps movement vectors, not final positions. J Neurosci 25 (2005) 4024-4030
59. Lackner J.R., and DiZio P. Motor control and learning in altered dynamic environments. Curr Opin Neurobiol 15 (2005) 653-659. The authors review research on load adaptation in the context of reaching movements and emphasize differences between active self-recalibration and adaptive tool use. They also show that the internal models of hand-held objects are rapidly recruited and de-recruited when grasped and released.
60. Sailer U., Flanagan J.R., and Johansson R.S. Eye-hand coordination during learning of a novel visuomotor task. J Neurosci 25 (2005) 8833-8842. This is the first study examining gaze behavior during the acquisition of a novel visuomotor transformation. Participants were required to learn a complex mapping between hand actions and cursor motion to move the cursor to targets. During early learning, gaze chased the uncontrolled cursor. Once control over the cursor began to emerge, proactive gaze behavior, with gaze leading the cursor towards the target, started to develop.
61. Land M.F., and McLeod P. From eye movements to actions: how batsmen hit the ball. Nat Neurosci 3 (2000) 1340-1345
62. Brooks V., Hilperath F., Brooks M., Ross H.G., and Freund H.J. Learning "what" and "how" in a human motor task. Learn Mem 2 (1995) 225-242
63. Willingham D.B. A neuropsychological theory of motor skill learning. Psychol Rev 105 (1998) 558-584
64. Andersen R.A., and Buneo C.A. Intentional maps in posterior parietal cortex. Annu Rev Neurosci 25 (2002) 189-220
65. Engel K.C., Flanders M., and Soechting J.F. Oculocentric frames of reference for limb movement. Arch Ital Biol 140 (2002) 211-219
66. Sperry R.W. Neural basis of the spontaneous optokinetic response produced by visual inversion. J Comp Physiol Psychol 43 (1950) 482-489
67. Weiskrantz L., Elliott J., and Darlington C. Preliminary observations on tickling oneself. Nature 230 (1971) 598-599
68. Shergill S.S., Bays P.M., Frith C.D., and Wolpert D.M. Two eyes for an eye: The neuroscience of force escalation. Science 301 (2003) 187
69. Bays P.M., Wolpert D.M., and Flanagan J.R. Perception of the consequences of self-action is temporally tuned and event driven. Curr Biol 15 (2005) 1125-1128
70. Flanagan J.R., and Lolley S. The inertial anisotropy of the arm is accurately predicted during movement planning. J Neurosci 21 (2001) 1361-1369
71. Flanagan J.R., and Tresilian J. Grip-load force coupling: a general control strategy for transporting objects. J. Exp. Psychol. Hum Percept Perform 20 (1994) 944-957
72. Flanagan J.R., and Wing A.M. Modulation of grip force with load force during point-to-point arm movements. Exp Brain Res 95 (1993) 131-143
73. Flanagan J.R., and Wing A.M. The stability of precision grip forces during cyclic arm movements with a hand-held load. Exp Brain Res 105 (1995) 455-464
74. Danion F. How dependent are grip force and arm actions during holding an object?. Exp Brain Res 158 (2004) 109-119
75. Descoins M., Danion F., and Bootsma R.J. Predictive control of grip force when moving object with an elastic load applied on the arm. Exp Brain Res 172 (2006) 331-342. The authors show that people are able to distinguish loads applied to the arm and loads applied to an object in hand in order to adjust grip forces predictively for object loads. They compared grip forces applied to a hand-held object during arm movement under three conditions: when an elastic band was attached to the forearm, when the elastic band was attached to the object, and when there was no elastic band. They found that, relative to the no elastic band condition, grip forces increased when the band was attached to the object but not the forearm.
76. Cothros N., Wong J.D., and Gribble P.L. Are there distinct neural representations of object and limb dynamics?. Exp Brain Res 173 (2006) 689-697
77. Quaney B.M., Rotella D.L., Peterson C., and Cole K.J. Sensorimotor memory for fingertip forces: evidence for a task-independent motor memory. J Neurosci 23 (2003) 1981-1986
78. Quaney B.M., Nudo R.J., and Cole K.J. Can internal models of objects be utilized for different prehension tasks?. J Neurophysiol 93 (2005) 2021-2027
79. Shadmehr R., and Mussa-Ivaldi F.A. Adaptive representation of dynamics during learning of a motor task. J Neurosci 14 (1994) 3208-3224
80. Malfait N., Shiller D.M., and Ostry D.J. Transfer of motor learning across arm configurations. J Neurosci 22 (2002) 9656-9660
81. Mah C.D., and Mussa-Ivaldi F.A. Generalization of object manipulation skills learned without limb motion. J Neurosci 23 (2003) 4821-4825
82. Edin B.B., Westling G., and Johansson R.S. Independent control of human finger-tip forces at individual digits during precision lifting. J Physiol-London 450 (1992) 547-564
83. Quaney B.M., and Cole K.J. Distributing vertical forces between the digits during gripping and lifting: the effects of rotating the hand versus rotating the object. Exp Brain Res 155 (2004) 145-155
84. Grandy M.S., and Westwood D.A. Opposite perceptual and sensorimotor responses to a size-weight illusion. J Neurophysiol 95 (2006) 3887-3892