Interaction of sound and sight during action perception: Evidence for shared modality-dependent action representations

Neuropsychologia

Volumn 47, Issue 12, 2009, Pages 2593-2599

  Alaerts, Kaat ^a   Swinnen, Stephan P ^a   Wenderoth, Nicole ^a  

^a Research Center for Motor Control and Neuroplasticity   (Belgium)

Author keywords

Action observation; Action sound listening; Mirror neurons; Primary motor cortex; Transcranial magnetic stimulation

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; CONTROLLED STUDY; FEMALE; HAND MOVEMENT; HEARING; HUMAN; HUMAN EXPERIMENT; MALE; MOTOR CORTEX; MOTOR SYSTEM; MOVEMENT PERCEPTION; NERVE EXCITABILITY; NORMAL HUMAN; STIMULUS RESPONSE; TRANSCRANIAL MAGNETIC STIMULATION; VISION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; BRAIN MAPPING; ELECTROMYOGRAPHY; EVOKED POTENTIALS, MOTOR; FEMALE; HUMANS; MALE; MOTOR CORTEX; MUSCLE, SKELETAL; PHOTIC STIMULATION; REACTION TIME; SOUND; TRANSCRANIAL MAGNETIC STIMULATION; VISION, OCULAR; VISUAL PERCEPTION; YOUNG ADULT;

EID: 67650214700     PISSN: 00283932     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2009.05.006     Document Type: Article

References (42)

1. Allison T., Puce A., and McCarthy G. Social perception from visual cues: Role of the STS region. Trends in Cognitive Sciences 4 (2000) 267-278
2. Aziz-Zadeh L., Iacoboni M., Zaidel E., Wilson S., and Mazziotta J. Left hemisphere motor facilitation in response to manual action sounds. European Journal of Neuroscience 19 (2004) 2609-2612
3. Barraclough N.E., Xiao D., Baker C.I., Oram M.W., and Perrett D.I. Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. Journal of Cognitive Neuroscience 17 (2005) 377-391
4. Calvert G.A., Campbell R., and Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology 10 (2000) 649-657
5. Calvert G.A., Hansen P.C., Iversen S.D., and Brammer M.J. Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. Neuroimage 14 (2001) 427-438
6. Colavita F.B. Human Sensory Dominance. Perception & Psychophysics 16 (1974) 409-412
7. Colavita F.B., Tomko R., and Weisberg D. Visual pre-potency and eye orientation. Bulletin of the Psychonomic Society 8 (1976) 25-26
8. Colavita F.B., and Weisberg D. Further investigation of visual dominance. Perception & Psychophysics 25 (1979) 345-347
9. Di Pellegrino G., Fadiga L., Fogassi L., Gallese V., and Rizzolatti G. Understanding motor events: A neurophysiological study. Experimental Brain Research 91 (1992) 176-180
10. Dum R.P., and Strick P.L. Frontal lobe inputs to the digit representations of the motor areas on the lateral surface of the hemisphere. Journal of Neuroscience 25 (2005) 1375-1386
11. Elsner B., and Hommel B. Contiguity and contingency in action-effect learning. Psychological Research 68 (2004) 138-154
12. Fadiga L., Fogassi L., Pavesi G., and Rizzolatti G. Motor facilitation during action observation: A magnetic stimulation study. Journal of Neurophysiology 73 (1995) 2608-2611
13. Flach R., Osman M., Dickinson A., and Heyes C. The interaction between response effects during the acquisition of response priming. ACTA Psychologica (Amsterdam) 122 (2006) 11-26
14. Gazzola V., Aziz-Zadeh L., and Keysers C. Empathy and the somatotopic auditory mirror system in humans. Current Biology 16 (2006) 1824-1829
15. Grant K.W., and Seitz P.F. The use of visible speech cues for improving auditory detection of spoken sentences. The Journal of the Acoustical Society of America 108 (2000) 1197-1208
16. Heyes C. Four routes of cognitive evolution. Psychological Review 110 (2003) 713-727
17. Heyes C., Bird G., Johnson H., and Haggard P. Experience modulates automatic imitation. Brain Research: Cognitive Brain Research 22 (2005) 233-240
18. Hikosaka K., Iwai E., Saito H., and Tanaka K. Polysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. Journal of Neurophysiology 60 (1988) 1615-1637
19. Hommel, and Elsner B. Acquisition, representation and control of action. In: Morsella E., Bargh J.A., and Gollwitzer P.M. (Eds). Oxford handbook of human action (2009), Oxford University Press, New York 371-398
20. Iacoboni M. Neural mechanisms of imitation. Current Opinion in Neurobiology 15 (2005) 632-637
21. James. The principles of psychology (1890), Dover Publications, New York
22. Jeannerod M. Neural simulation of action: A unifying mechanism for motor cognition. Neuroimage 14 (2001) S103-S109
23. Kaplan J.T., and Iacoboni M. Multimodal action representation in human left ventral premotor cortex. Cognitive Processing 8 (2007) 103-113
24. Keysers C., Kohler E., Umilta M.A., Nanetti L., Fogassi L., and Gallese V. Audiovisual mirror neurons and action recognition. Experimental Brain Research 153 (2003) 628-636
25. Kohler E., Keysers C., Umilta M.A., Fogassi L., Gallese V., and Rizzolatti G. Hearing sounds, understanding actions: Action representation in mirror neurons. Science 297 (2002) 846-848
26. Macaluso E., George N., Dolan R., Spence C., and Driver J. Spatial and temporal factors during processing of audiovisual speech: A PET study. Neuroimage 21 (2004) 725-732
27. McGurk H., and MacDonald J. Hearing lips and seeing voices. Nature 264 (1976) 746-748
28. Meister I.G., Wilson S.M., Deblieck C., Wu A.D., and Iacoboni M. The essential role of premotor cortex in speech perception. Current Biology 17 (2007) 1692-1696
29. Meredith M.A., and Stein B.E. Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. Journal of Neurophysiology 56 (1986) 640-662
30. Oldfield R.C. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 9 (1971) 97-113
31. Pazzaglia M., Pizzamiglio L., Pes E., and Aglioti S.M. The sound of actions in apraxia. Current Biology 18 (2008) 1766-1772
32. Pobric G., and Hamilton A.F. Action understanding requires the left inferior frontal cortex. Current Biology 16 (2006) 524-529
33. Rickham P.P. Human experimentation. Code of Ethics of the World Medical Association. Declaration of Helsinki. British Medical Journal 2 (1964) 177
34. Rizzolatti G., and Craighero L. The mirror-neuron system. Annual Review of Neuroscience 27 (2004) 169-192
35. Rossini P.M., Barker A.T., Berardelli A., Caramia M.D., Caruso G., Cracco R.Q., et al. Noninvasive electrical and magnetic stimulation of the brain, spinal-cord and roots-Basic principles and procedures for routine clinical-application-Report of an Ifcn Committee. Electroencephalography and Clinical Neurophysiology 91 (1994) 79-92
36. Scheiber M.H. How might the motor cortex individuate movements. Trends in Neurosciences 13 (1990) 440-445
37. Seltzer B., and Pandya D.N. Parietal, temporal, and occipital projections to cortex of the superior temporal sulcus in the rhesus monkey: A retrograde tracer study. Journal of Comparative Neurology 343 (1994) 445-463
38. Shimazu H., Maier M.A., Cerri G., Kirkwood P.A., and Lemon R.N. Macaque ventral premotor cortex exerts powerful facilitation of motor cortex outputs to upper limb motoneurons. Journal of Neuroscience 24 (2004) 1200-1211
39. Skipper J.I., Nusbaum H.C., and Small S.L. Listening to talking faces: Motor cortical activation during speech perception. Neuroimage 25 (2005) 76-89
40. Stein B.E., and Stanford T.R. Multisensory integration: Current issues from the perspective of the single neuron. Nature Reviews Neuroscience 9 (2008) 255-266
41. Sumby W., and Pollack I. Visual contribution to speech intelligibility in noise. The Journal of the Acoustical Society of America 26 (1954) 212-215
42. Summerfield Q. Lipreading and audio-visual speech perception. Philosophical Transactions of the Royal Society B: Biological Sciences 335 (1992) 71-78