Integration of visual and auditory information for hand actions: Preliminary evidence for the contribution of natural sounds to grasping

Experimental Brain Research

Volumn 209, Issue 3, 2011, Pages 365-374

  Sedda, Anna ^a   Monaco, Simona ^b   Bottini, Gabriella ^a   Goodale, Melvyn A ^c  

^a UNIVERSITY OF PAVIA   (Italy)

^b YORK UNIVERSITY   (Canada)

^c UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

Audition; Grasping; Multisensory integration; Natural sounds; Size

Indexed keywords

ADULT; ARTICLE; AUDITORY DISCRIMINATION; HAND GRIP; HAND MOVEMENT; HUMAN; HUMAN EXPERIMENT; KINEMATICS; MOTOR CONTROL; NORMAL HUMAN; PRIORITY JOURNAL; PSYCHOPHYSIOLOGY; RIGHT HANDEDNESS; SENSORIMOTOR INTEGRATION; TASK PERFORMANCE; VISUAL INFORMATION;

ADOLESCENT; BIOMECHANICS; FEMALE; HAND; HAND STRENGTH; HEARING; HUMANS; MALE; MOVEMENT; PSYCHOMOTOR PERFORMANCE; REACTION TIME; SIZE PERCEPTION; SOUND; VISION, OCULAR; WRIST; YOUNG ADULT;

EID: 79952448622     PISSN: 00144819     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00221-011-2559-5     Document Type: Article

References (30)

1. SR Arnott MA Binns CL Grady C Alain 2004 Assessing the auditory dual-pathway model in humans Neuroimage 22 401 408 15110033 10.1016/j. neuroimage.2004.01.014 (Pubitemid 38515849)
2. P Binda A Bruno DC Burr MC Morrone 2007 Fusion of visual and auditory stimuli during saccades: a Bayesian explanation for perisaccadic distortions J Neurosci 27 8525 8532 17687030 10.1523/JNEUROSCI.0737-07.2007 1:CAS:528:DC%2BD2sXptlSns78%3D (Pubitemid 47254263)
3. GA Calvert 2001 Crossmodal processing in the human brain: insights from functional neuroimaging studies Cereb Cortex 11 1110 1123 11709482 10.1093/cercor/11.12.1110 1:STN:280:DC%2BD3MnmtlKhug%3D%3D (Pubitemid 33108238)
4. C Carello KL Anderson AJ Kunkler-Peck 1998 Perception of object length by sound Psychol Sci 9 211 214 10.1111/1467-9280.00040 (Pubitemid 128088980)
5. S Fagioli B Hommel RI Schubotz 2007 Intentional control of attention: action planning primes action-related stimulus dimensions Psychol Res 71 22 29 16317565 10.1007/s00426-005-0033-3
6. Gibson JJ (1966) The senses considered as perceptual systems. Houghton Mifflin, Boston
7. BL Giordano D Rocchesso S McAdams 2010 Integration of acoustical information in the perception of impacted sound sources: the role of information accuracy and exploitability J Exp Psychol Hum Percept Perform 36 462 476 20364930 10.1037/a0018388
8. MA Goodale GK Humphrey 1998 The objects of action and perception Cognition 67 181 207 9735540 10.1016/S0010-0277(98)00017-1 1:STN:280: DyaK1cvgs1Gjsw%3D%3D (Pubitemid 128431121)
9. M Grassi 2005 Do we hear size or sound? Balls dropped on plates Percept Psychophys 67 274 284 15971691 10.3758/BF03206491 (Pubitemid 40900520)
10. Green DM (1987) Profile analysis. Auditory intensity discrimination. Oxford University Press, Oxford
11. T Green D McKeown 2007 The role of auditory memory traces in attention to frequency Percept Psychophys 69 942 951 18018975 10.3758/BF03193931
12. B Hommel 2004 Event files: feature binding in and across perception and action Trends Cogn Sci 8 494 500 15491903 10.1016/j.tics.2004.08.007 (Pubitemid 39387844)
13. Y Hu R Eagleson MA Goodale 1999 The effects of delay on the kinematics of grasping Exp Brain Res 126 109 116 10333011 10.1007/s002210050720 1:STN:280:DyaK1M3mtlyjtA%3D%3D (Pubitemid 29192219)
14. M Jeannerod 1984 The timing of natural prehension movements J Mot Behav 16 235 254 15151851 1:STN:280:DC%2BD2c3ltlagsQ%3D%3D
15. FA Kagerer JL Contreras-Vidal 2009 Adaptation of sound localization induced by rotated visual feedback in reaching movements Exp Brain Res 193 315 321 19048242 10.1007/s00221-008-1630-3
16. JK Kim RJ Zatorre 2010 Can you hear shapes you touch? Exp Brain Res 202 747 754 20165840 10.1007/s00221-010-2178-6
17. BR King FA Kagerer JL Contreras-Vidal JE Clark 2009 Evidence for multisensory spatial-to-motor transformations in aiming movements of children J Neurophysiol 101 315 322 18987123 10.1152/jn.90781.2008
18. RL Klatzky DK Pai EP Krotkov 2000 Perception of material from contact sounds PRESENCE: Teleoperators Virtual Environ 9 399 410 10.1162/105474600566907
19. AJ Kunkler-Peck MT Turvey 2000 Hearing shape J Exp Psychol Hum Percept Perform 26 279 294 10696618 10.1037/0096-1523.26.1.279 1:STN:280: DC%2BD3c7mtFKjug%3D%3D
20. S Lakatos S McAdams R Causse 1997 The representation of auditory source characteristics: simple geometric form Percept Psychophys 59 1180 1190 9401453 10.3758/BF03214206 1:STN:280:DyaK1c%2FmsVyhtQ%3D%3D (Pubitemid 127459257)
21. DJ Lewkowicz 2000 The development of intersensory temporal perception: an epigenetic systems/limitations view Psychol Bull 126 281 308 10748644 10.1037/0033-2909.126.2.281 1:STN:280:DC%2BD3c3ht1WgsA%3D%3D
22. JC Middlebrooks DM Green 1991 Sound localization by human listeners Annu Rev Psychol 42 135 159 2018391 10.1146/annurev.ps.42.020191.001031 1:STN:280:DyaK3M3gslSjsA%3D%3D
23. RC Oldfield 1971 The assessment and analysis of handedness: the Edinburgh inventory Neuropsychologia 9 97 113 5146491 10.1016/0028-3932(71)90067-4 1:STN:280:DyaE387msVSqsQ%3D%3D
24. S Patchay U Castiello P Haggard 2003 A cross-modal interference effect in grasping objects Psychon Bull Rev 10 924 931 15000540 10.3758/BF03196553 (Pubitemid 38483388)
25. CE Pettypiece MA Goodale JC Culham 2010 Integration of haptic and visual size cues in perception and action revealed through cross-modal conflict Exp Brain Res 201 863 873 19949777 10.1007/s00221-009-2101-1
26. L Ren AZ Khan G Blohm DY Henriques LE Sergio JD Crawford 2006 Proprioceptive guidance of saccades in eye-hand coordination J Neurophysiol 96 1464 1477 16707717 10.1152/jn.01012.2005 1:STN:280:DC%2BD28vnsF2kuw%3D%3D (Pubitemid 44376260)
27. SJ Sober PN Sabes 2003 Multisensory integration during motor planning J Neurosci 23 6982 6992 12904459 1:CAS:528:DC%2BD3sXmtlyhsLs%3D (Pubitemid 36975864)
28. F Tubaldi C Ansuini R Tirindelli U Castiello 2008 The grasping side of odours PLoS One 3 e1795 18350137 10.1371/journal.pone.0001795 (Pubitemid 351917371)
29. DA Westwood MA Goodale 2003 A haptic size-contrast illusion affects size perception but not grasping Exp Brain Res 153 253 259 12898086 10.1007/s00221-003-1599-x (Pubitemid 37445318)
30. S Zmigrod B Hommel 2009 Auditory event files: integrating auditory perception and action planning Atten Percept Psychophys 71 352 362 19304624 10.3758/APP.71.2.352