Neural correlates of audiovisual motion capture

Experimental Brain Research

Volumn 198, Issue 2-3, 2009, Pages 383-390

  Stekelenburg, Jeroen J ^a   Vroomen, Jean ^a  

^a TILBURG UNIVERSITY   (Netherlands)

Author keywords

Audiovisual motion capture; ERP; MMN; Multisensory integration

Indexed keywords

ADULT; ARTICLE; AUDIOVISUAL EQUIPMENT; AUDITORY STIMULATION; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; EVENT RELATED POTENTIAL; FEMALE; HUMAN; MALE; MISMATCH NEGATIVITY; NERVE CELL NETWORK; NORMAL HUMAN; PRIORITY JOURNAL; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; AUDITORY PERCEPTION; BRAIN; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; MOTION PERCEPTION; MULTIVARIATE ANALYSIS; NEUROPSYCHOLOGICAL TESTS; PHOTIC STIMULATION; PSYCHOPHYSICS; SPACE PERCEPTION; TIME FACTORS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 69549095937     PISSN: 00144819     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00221-009-1763-z     Document Type: Article

References (48)

1. D Alais D Burr 2004 No direction-specific bimodal facilitation for audiovisual motion detection Brain Res Cogn Brain Res 19 185 194
2. A Alink W Singer L Muckli 2008 Capture of auditory motion by vision is represented by an activation shift from auditory to visual motion cortex J Neurosci 28 2690 2697
3. JA Altman SP Vaitulevich LB Shestopalova AL Varfolomeev 2005 Mismatch negativity evoked by stationary and moving auditory images of different azimuthal positions Neurosci Lett 384 330 335
4. O Baumann MW Greenlee 2007 Neural correlates of coherent audiovisual motion perception Cereb Cortex 17 1433 1443
5. SJ Bensmaïa JH Killebrew JC Craig 2006 Influence of visual motion on tactile motion perception J Neurophysiol 96 1625 1637
6. Bertelson P (1999) Ventriloquism: a case of crossmodal perceptual grouping. In: Aschersleben G, Bachmann T, Müsseler J (eds) Cognitive contributions to the perception of spatial and temporal events. Elsevier, Amsterdam, pp 347-362
7. J Besle A Fort C Delpuech MH Giard 2004 Bimodal speech: early suppressive visual effects in human auditory cortex Eur J Neurosci 20 2225 2234
8. B Bonath T Noesselt A Martinez J Mishra K Schwiecker HJ Heinze SA Hillyard 2007 Neural basis of the ventriloquist illusion Curr Biol 17 1697 1703
9. C Colin M Radeau A Soquet B Dachy P Deltenre 2002 Electrophysiology of spatial scene analysis: the mismatch negativity (MMN) is sensitive to the ventriloquism illusion Clin Neurophysiol 113 507 518
10. C Colin M Radeau A Soquet D Demolin F Colin P Deltenre 2002 Mismatch negativity evoked by the McGurk-MacDonald effect: a phonetic representation within short-term memory Clin Neurophysiol 113 495 506
11. JC Craig 2006 Visual motion interferes with tactile motion perception Perception 35 351 367
12. B de Gelder P Bertelson 2003 Multisensory integration, perception and ecological validity Trends Cogn Sci 7 460 467
13. A Falchier S Clavagnier P Barone H Kennedy 2002 Anatomical evidence of multimodal integration in primate striate cortex J Neurosci 22 5749 5759
14. JJ Foxe CE Schroeder 2005 The case for feedforward multisensory convergence during early cortical processing Neuroreport 16 419 423
15. MH Giard F Peronnet 1999 Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study J Cogn Neurosci 11 473 490
16. M Gondan B Niederhaus F Rösler B Röder 2005 Multisensory processing in the redundant-target effect: a behavioral and event-related potential study Percept Psychophys 67 713 726
17. G Gratton MG Coles E Donchin 1983 A new method for off-line removal of ocular artifact Electroencephalogr Clin Neurophysiol 55 468 484
18. D Guthrie JS Buchwald 1991 Significance testing of difference potentials Psychophysiology 28 240 244
19. Kislyuk DS, Mottonen R, Sams M (2008) Visual processing affects the neural basis of auditory discrimination. J Cogn Neurosci
20. N Kitagawa S Ichihara 2002 Hearing visual motion in depth Nature 416 172 174
21. N Kitajima Y Yamashita 1999 Dynamic capture of sound motion by light stimuli moving in three-dimensional space Percept Mot Skills 89 1139 1158
22. JW Lewis MS Beauchamp EA DeYoe 2000 A comparison of visual and auditory motion processing in human cerebral cortex Cereb Cortex 10 873 888
23. S Mateeff J Hohnsbein T Noack 1985 Dynamic visual capture: apparent auditory motion induced by a moving visual target Perception 14 721 727
24. GF Meyer SM Wuerger 2001 Cross-modal integration of auditory and visual motion signals Neuroreport 12 2557 2560
25. GF Meyer SM Wuerger F Rohrbein C Zetzsche 2005 Low-level integration of auditory and visual motion signals requires spatial co-localisation Exp Brain Res 166 538 547
26. S Molholm W Ritter MM Murray DC Javitt CE Schroeder JJ Foxe 2002 Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study Brain Res Cogn Brain Res 14 115 128
27. R Möttönen CM Krause K Tiippana M Sams 2002 Processing of changes in visual speech in the human auditory cortex Brain Res Cogn Brain Res 13 417 425
28. A Muller-Gass RM Stelmack KB Campbell 2005 ".and were instructed to read a self-selected book while ignoring the auditory stimuli": the effects of task demands on the mismatch negativity Clin Neurophysiol 116 2142 2152
29. Näätänen R (1992) Attention and brain function. Erlbaum, Hillsdale
30. R Näätänen AW Gaillard S Mantysalo 1978 Early selective-attention effect on evoked potential reinterpreted Acta Psychol 42 313 329
31. R Näätänen P Paavilainen T Rinne K Alho 2007 The mismatch negativity (MMN) in basic research of central auditory processing: a review Clin Neurophysiol 118 2544 2590
32. D Saint-Amour P De Sanctis S Molholm W Ritter JJ Foxe 2007 Seeing voices: high-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion Neuropsychologia 45 587 597
33. M Sams R Aulanko M Hämäläinen R Hari OV Lounasmaa ST Lu J Simola 1991 Seeing speech: visual information from lip movements modifies activity in the human auditory cortex Neurosci Lett 127 141 145
34. D Sanabria C Spence S Soto-Faraco 2007 Perceptual and decisional contributions to audiovisual interactions in the perception of apparent motion: a signal detection study Cognition 102 299 310
35. JF Smiley TA Hackett I Ulbert G Karmas P Lakatos DC Javitt CE Schroeder 2007 Multisensory convergence in auditory cortex, I. Cortical connections of the caudal superior temporal plane in macaque monkeys J Comp Neurol 502 894 923 (Pubitemid 46806627)
36. S Soto-Faraco J Lyons M Gazzaniga C Spence A Kingstone 2002 The ventriloquist in motion: illusory capture of dynamic information across sensory modalities Brain Res Cogn Brain Res 14 139 146
37. S Soto-Faraco C Spence A Kingstone 2004 Congruency effects between auditory and tactile motion: extending the phenomenon of cross-modal dynamic capture Cogn Affect Behav Neurosci 4 208 217 (Pubitemid 39167163)
38. S Soto-Faraco C Spence A Kingstone 2004 Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities J Exp Psychol Hum Percept Perform 30 330 345 (Pubitemid 38422589)
39. S Soto-Faraco C Spence A Kingstone 2005 Assessing automaticity in the audiovisual integration of motion Acta Psychol 118 71 92
40. JJ Stekelenburg J Vroomen B de Gelder 2004 Illusory sound shifts induced by the ventriloquist illusion evoke the mismatch negativity Neurosci Lett 357 163 166
41. WA Teder-Salejarvi F Di Russo JJ McDonald SA Hillyard 2005 Effects of spatial congruity on audio-visual multimodal integration J Cogn Neurosci 17 1396 1409
42. J Vroomen B de Gelder 2003 Visual motion influences the contingent auditory motion aftereffect Psychol Sci 14 357 361 (Pubitemid 37282834)
43. J Vroomen P Bertelson B de Gelder 2001 Directing spatial attention towards the illusory location of a ventriloquized sound Acta Psychol 108 21 33
44. MG Woldorff SA Hillyard 1991 Modulation of early auditory processing during selective listening to rapidly presented tones Electroencephalogr Clin Neurophysiol 79 170 191
45. MG Woldorff SA Hackley SA Hillyard 1991 The effects of channel-selective attention on the mismatch negativity wave elicited by deviant tones Psychophysiology 28 30 42
46. SM Wuerger M Hofbauer GF Meyer 2003 The integration of auditory and visual motion signals at threshold Percept Psychophys 65 1188 1196
47. G Yucel C Petty G McCarthy A Belger 2005 Graded visual attention modulates brain responses evoked by task-irrelevant auditory pitch changes J Cogn Neurosci 17 1819 1828
48. P Zhang X Chen P Yuan D Zhang S He 2006 The effect of visuospatial attentional load on the processing of irrelevant acoustic distractors Neuroimage 33 715 724