Grasping at 'thin air': Multimodal contact cues for reaching and grasping

Experimental Brain Research

Volumn 180, Issue 1, 2007, Pages 69-84

  Zahariev, Mihaela A ^a   MacKenzie, Christine L ^a  

^a SIMON FRASER UNIVERSITY   (Canada)

Author keywords

Haptics auditory; Kinematics; Prehension; Sensorimotor integration

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; AUDITORY STIMULATION; CONTROLLED STUDY; HAND FUNCTION; HAND GRIP; HAND MOVEMENT; HUMAN; HUMAN EXPERIMENT; MOTOR CONTROL; PRIORITY JOURNAL; VISUAL INFORMATION;

ACOUSTIC STIMULATION; ADULT; BIOMECHANICS; CUES; FEMALE; HAND STRENGTH; HUMANS; MALE; MOVEMENT; PSYCHOMOTOR PERFORMANCE; REACTION TIME; TIME FACTORS; TOUCH; VISUAL PERCEPTION;

EID: 34249902482     PISSN: 00144819     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00221-006-0845-4     Document Type: Article

References (49)

1. Arbib MA (1985) Schemas for the temporal control of behavior. Hum Neurobiol 4(2):63-72
2. Bresciani JP, Ernst MO, Drewing K, Bouyer G, Maury V, Kheddar A (2005) Feeling what you hear: auditory signals can modulate tactile tap perception. Exp Brain Res 162:172-180
3. Calvert GA (2001) Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex 11(12):1110-1123
4. DiFranco DW, Beauregard GL, Srinivasan MA (1997) The effect of auditory cues on the haptic perception of stiffness in virtual environments. In: Rizzoni G (ed) Proceedings of the ASME dynamic systems and control division, DSC, vol 61, pp 17-22
5. Durlach NI, Mavor AS (eds) (1995) Virtual reality: scientific and technological challenges. National Academy Press, Washington
6. Fitts PM (1954) The information capacity of the human motor system in controlling the amplitude of movement. J Exp Psychol 47:381-391
7. Fitts PM, Peterson JP (1964) Information capacity of discrete motor response. J Exp Psychol 67(2):103-112
8. Gentilucci M, Daprati E, Gangitano M (1998) Haptic information differentially interferes with visual analysis in reaching-grasping control and in perceptual processes. NeuroReport 9:887-891
9. Giard MH, Peronnet F (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11:473-490
10. Goodale MA, Jakobson LS, Keillor JM (1994) Differences in the visual control of pantomimed and natural grasping movements. Neuropsychologia 32:1159-1178
11. Graham ED, MacKenzie CL (1996) Physical versus virtual pointing. In: Proceedings of the conference on human factors in computing systems CHI'96. ACM Press, New York, pp 292-299
12. Guest S, Catmur C, Lloyd D, Spence C (2002) Audiotactile interactions in roughness perception. Exp Brain Res 146:161-171
13. Howell DC (1997) Statistical methods for pshychology. Duxbury Press, London
14. Jeannerod M (1981) Intersegmental coordination during reaching at natural visual objects. In: Long J, Baddeley A (eds) Attention and performance IX. Erlbaum, Hillsdale, pp 153-169
15. Jeannerod M (1984) The timing of natural prehension movements. J Motor Behav 16(3):235-254
16. Jeannerod M, Decety J (1990) The accuracy of visuomotor transformation. An investigation into the mechanisms of visual recognition of objects. In: Goodale M (ed) Vision and action: the control of grasping. Ablex, USA, pp 33-48
17. Johansson RS, Westling G (1984) Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects. Exp Brain Res 56:550-564
18. Jousmaki V, Hari R (1998) Parchment-skin illusion: sound-biased touch. Curr Biol 8:190
19. Klatzky RL, Lederman SJ (1987a) The intelligent hand. In: Bower GH (ed) The psychology of learning and motivation, vol 21. Academic, San Diego, pp 121-151
20. Klatsky RL, Lederman SJ, Reed C (1987b) There's more to touch than meets the eye: the salience of object attributes for haptics with and without vision. J Exp Psychol General 116(4):356-369
21. Klatzky RL, Pai DK, Krotkov EP (2000) Perception of material from contact sounds. Presence Teleoperators Virtual Environ 9:399-410
22. Lederman SJ (1979) Auditory texture perception. Perception 8:93-103
23. Lederman SJ, Klatzky RL (2004) Multisensory texture perception. In: Calvert G, Spence C, Stein B (eds). Handbook of multisensory processes. MIT Press, Cambridge, pp 107-122
24. Lederman SJ, Summers C, Klatzky RL (1996) Cognitive salience of haptic object properties: role of modality-encoding bias. Perception 25(8):983-998
25. Lederman SJ, Klatzky RL, Morgan T, Hamilton C (2002) Integrating multimodal information about surface texture via a probe: relative contributions of haptic and touch-produced sounds. In: Proceedings of the 10th annual symposium on haptic interfaces for virtual environment and teleoperator systems, IEEE VR'02, pp 97-104
26. Lederman SJ, Martin AM, Tong C, Klatzky RL (2003) Relative performance using haptic and/or touch-produced auditory cues in a remote absolute texture identification task. In: Proceedings, haptic interfaces for virtual environment and teleoperator systems, pp 151-158
27. MacKenzie CL, Iberall T (1994) The grasping hand. Elsevier/North Holland, Amsterdam
28. MacKenzie CL, Marteniuk RG, Dugas C, Liske D, Eickmeier B (1987) Three-dimensional movement trajectories in Fitts' task: implications for control. Q J Exp Psychol-A 39:629-647
29. Mason AH, Walji MA, Lee EJ, Mackenzie CL (2001) Reaching movements to augmented and graphic objects in virtual environments. In: Proceedings of the conference on human factors in computing systems, CHI 2001. ACM Press, New York, pp 426-433
30. Marteniuk RG, MacKenzie CL, Jeannerod M, Athenes S, Dugas C (1987) Constraints on human arm movement trajectories. Can J Psychol 41:365-378
31. Marteniuk RG, Leavitt JL, MacKenzie CL, Athènes S (1990) Functional relationships between grasp and transport components in a prehension task. Hum Movement Sci 9:149-176
32. Meulenbroek RGJ, Rosenbaum DA, Jansen C, Vaughan J, Vogt S (2001) Multijoint grasping movements: simulated and observed effects of object location, object size and initial aperture. Exp Brain Res 138(2):219-234
33. Morein-Zamir S, Soto-Faraco S, Kingstone A (2003) Auditory capture of vision: examining temporal ventriloquism. Cogn Brain Res 17(1):154-163
34. Paillard J (1982) The contribution of peripheral and central vision to visually guided reaching. In: Ingle DJ, Goodale MA, Mansfield RJW (eds) Visually oriented behavior. MIT Press, Cambridge, pp 367-385
35. Patchay S, Castiello U, Haggard P (2003) A cross-modal interference effect in grasping objects. Psychon B Rev 10(4):924-931
36. Posner MI, Nissen MJ, Klein RM (1976) Visual dominance: an information-processing account of its origins and significance. Psychol Rev 83(2):157-171
37. Prablanc C, Echallier JF, Jeannerod M, Komilis E (1979) Optimal response of eye and hand motor systems in pointing at a visual target. II: Static and dynamic visual cues in the control of hand movement. Biol Cybern 35:183-187
38. Rosenbaum DA, Meulenbroek RGJ, Vaughan J, Jansen C (1999) Coordination of reaching and grasping by capitalizing on obstacle avoidance and other constraints. Exp Brain Res 128(1):92-100
39. Sekuler R, Sekuler AB, Lau R (1997) Sound alters visual motion perception. Nature 385(6614):308
40. Shams L, Kamitani Y, Shimojo S (2000) Illusions: what you see is what you hear. Nature 408(6814):788
41. Stein BE, Meredith MA (1990) Multisensory integration-neural and behavioral solutions for dealing with stimuli from different sensory modalities. Ann NY Acad Sci 608:51-70
42. Stein BE, Wallace MT, Meredith MA (1995) Neural mechanisms mediating attention and orientation to multisensory cues. In: Gazzaniga MS (ed) The cognitive neurosciences. Bradford Books, MIT Press, Cambridge
43. van Beers RJ, Baraduc P, Wolpert DM (2002) Role of uncertainty in sensorimotor control. Philos T Roy Soc B 357:1137-1145
44. Welch RB, Warren DH (1986) Intersensory interactions. In: Boff KR, Kaufman L, Thomas JP (eds) Handbook of perception and performance, vol 1. Sensory processes and perception. Wiley, New York, pp 25-1-25-36
45. Westling G, Johansson RS (1984) Factors influencing the force control during precision grip. Exp Brain Res 53:277-284
46. Wing AM, Haggard P, Flannagan JR (1996) Hand and brain. Academic, New York
47. Wolpert DM, Flanagan JR (2001) Motor prediction. Curr Biol 11(8):R720-R732
48. Woodworth RS (1899) The accuracy of voluntary movement. Psychol Rev 3:1-106
49. Zahariev MA, MacKenzie CL (2003) Auditory, graphical and haptic contact cues for a reach grasp and place task in an augmented environment. In: Proceedings of the fifth international conference on multimodal interfaces, ICMI '03. ACM Press, New York, pp 273-276