Intermodal attention affects the processing of the temporal alignment of audiovisual stimuli

Experimental Brain Research

Volumn 198, Issue 2-3, 2009, Pages 313-328

  Talsma, Durk ^a,b   Senkowski, Daniel ^c   Woldorff, Marty G ^d  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

^b UNIVERSITY OF TWENTE   (Netherlands)

^c UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

^d DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

EEG; Electrophysiology; ERP; Multisensory; SOA

Indexed keywords

ADULT; ARTICLE; ATTENTION; AUDITORY STIMULATION; CONTROLLED STUDY; ELECTRIC POTENTIAL; ELECTROENCEPHALOGRAM; EVENT RELATED POTENTIAL; FEMALE; HEART FUNCTION TEST; HUMAN; HUMAN EXPERIMENT; INTEGRATION; LATENT PERIOD; MALE; NORMAL HUMAN; PRIORITY JOURNAL; RIGHT HEMISPHERE; SIGNAL PROCESSING; STIMULUS RESPONSE; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; ATTENTION; AUDITORY PERCEPTION; BRAIN; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; MULTIVARIATE ANALYSIS; NEUROPSYCHOLOGICAL TESTS; PHOTIC STIMULATION; REACTION TIME; SIGNAL PROCESSING, COMPUTER-ASSISTED; TASK PERFORMANCE AND ANALYSIS; TIME FACTORS; VISUAL PERCEPTION;

EID: 69549111051     PISSN: 00144819     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00221-009-1858-6     Document Type: Article

References (53)

1. K Alho DL Woods A Algazi R Näätänen 1992 Intermodal selective attention II: effects of attentional load on processing auditory and visual stimuli in central space Electroencephalogr Clin Neurophysiol 82 356 368
2. TS Andersen P Mamassian 2008 Audiovisual integration of stimulus transients Vis Res 48 2537 2544
3. MA Burock RL Buckner MG Woldorff BR Rosen AM Dale 1998 Randomized event-related experimental designs allow for extremely rapid presentation rates using functional MRI NeuroReport 9 3735 3739
4. L Busse MG Woldorff 2003 Implications of the ERP omitted stimulus response to "no-stim" events in fast-rate event-related fMRI designs Neuroimage 18 856 864
5. L Busse KC Roberts RE Crist DH Weissman MG Woldorff 2005 The spread of attention across modalities and space in a multisensory object Proc Natl Acad Sci USA 102 18751 18756
6. A Correa AC Nobre 2008 Spatial and temporal acuity of visual perception can be enhanced selectively by attentional set Exp Brain Res 189 339 344
7. MB De Ruiter A Kok M Van der Schoot 1998 Effects of inter- and intramodal selective attention to non-spatial stimuli: an event-related potential analysis Biol Psychol 49 269 294
8. DiLuca M, Machulla T-K, Ernst MO (2009) Recalibration of multisensory simultaneity: crosmodal transfer coincides with a change in perpeptual latency. J Vis (submitted)
9. C Escera K Alho E Schröger I Winkler 2000 Involuntary attention and distractibility as evaluated with event-related brain potentials Audiol Neurootol 5 151 166
10. R Fendrich PM Corballis 2001 The temporal cross-capture of audition and vision Percept Psychophys 63 719 725
11. A Fort C Delpuech J Pemier MH Giard 2002 Early auditory-visual interactions in human cortex during nonredundant target identification Cogn Brain Res 14 20 30
12. MH Giard F Peronnét 1999 Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study J Cogn Neurosci 11 473 490
13. M Gondan B Röder 2006 A new method for detecting interactions between the senses in event-related potentials Brain Res 1073 389 397
14. M Gondan B Niederhaus F Rösler B Röder 2005 Multisensory processing in the redundant-target effect: a behavioral and event-related potential study Percept Psychophys 67 713 726
15. G Iarocci JJ McDonald 2006 Sensory integration and the perceptual experience of persons with autism J Autism Dev Disord 36 77 90
16. M Keetels J Vroomen 2005 The role of spatial disparity and hemifields in audio-visual temporal order judgments Exp Brain Res 167 635 640
17. Kenemans JL, Molenaar PCM, Verbaten MN (1991) Models for estimation and removal of artifacts in biological signals. In: Weitkunat R (ed) Digital biosignal processing. Elsevier, New York
18. JL Kenemans A Kok FTY Smulders 1993 Event-related potentials to conjunctions of spatial-frequency and orientation as a function of stimulus parameters and response requirements Electroencephalogr Clin Neurophysiol 88 51 63
19. AJ King 2005 Multisensory integration: strategies for synchronization Curr Biol 15 R339 R341
20. J Lewald R Guski 2003 Cross-modal perceptual integration of spatially and temporary disparate auditory and visual stimuli Cogn Brain Res 16 468 478
21. J Lewald R Guski 2004 Auditory-visual temporal integration as a function of distance: no compensation for sound-transmission time in human perception Neurosci Lett 357 119 122
22. J Lewald WH Ehrenstein R Guski 2001 Spatio-temporal constraints for auditory-visual integration Behav Brain Res 121 69 79
23. MJCM Magnée B de Gelder H van Engeland C Kemner 2008 Audiovisual speech integration in pervasive development disorder: evidence from event-related potentials J Child Psychol Psychiatry 49 995 1000
24. MJCM Magnée B de Gelder H van Engeland C Kemner 2008 Atypical processing of fearful face-voice pairs in pervasive developmental disorder: an ERP study Clin Neurophysiol 119 2004 2010
25. JJ McDonald WA Teder-Sälejärvi F Di Russo SA Hillyard 2005 Neural basis of auditory-induced shifts in visual time-order perception Nat Neurosci 8 1197 1202
26. MA Meredith 2002 On the neuronal basis for multisensory convergence: a brief overview Brain Res Cogn Brain Res 14 31 40
27. MA Meredith JW Nemitz BE Stein 1987 Determinants of multisensory integration in superior colliculus neurons. 1. Temporal factors J Neurosci 7 3215 3229
28. S Molholm W Ritter MM Murray DC Javitt CE Schroeder JJ Foxe 2002 Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study Cogn Brain Res 14 115 128
29. S Morein-Zamir S Soto-Faraço A Kingstone 2003 Auditory capture of vision: examining temporal ventriloquism Cogn Brain Res 17 154 163
30. Näätänen R (1992) Attention and brain function. Lawrence Erlbaum, Hillsdale, NJ
31. J Navarra A Vatakis M Zampini S Soto-Faraço W Humphreys C Spence 2005 Exposure to asynchronous audiovisual speech extends the temporal window for audiovisual integration Cogn Brain Res 25 499 507
32. LA Ross D Saint-Amour VM Leavitt S Molholm DC Javitt JJ Foxe 2007 Impaired multisensory processing in schizophrenia: deficits in the visual enhancement of speech comprehension under noisy environmental conditions Schizophr Res 97 173 183
33. D Senkowski D Talsma CS Herrmann MG Woldorff 2005 Multisensory processing and oscillatory gamma responses: effects of spatial selective attention Exp Brain Res 166 411 426
34. D Senkowski S Molholm M Gomez-Ramirez JJ Foxe 2006 Oscillatory beta activity predicts response speed during a multisensory audiovisual reaction time task: a high-density electrical mapping study Cereb Cortex 16 1556 1565
35. D Senkowski D Talsma M Grigutsch CS Herrmann MG Woldorff 2007 Good times for multisensory integration: effects of the precision of temporal synchrony as revealed by gamma-band oscillations Neuropsychologia 45 3 561 571
36. D Senkowski D Saint-Amour SP Kelly JJ Foxe 2007 Multisensory processing of naturalistic objects in motion: a high-density electrical mapping and source estimation study Neuroimage 36 877 888
37. L Shams Y Kamitani S Thompson S Shimojo 2001 Sound alters visual evoked potentials in humans NeuroReport 12 3849 3852 (Pubitemid 33105184)
38. L Shams Y Kamitani S Shimojo 2002 Visual illusion induced by sound Cogn Brain Res 14 147 152
39. HGOM Smid A Jakob HJ Heinze 1999 An event-related brain potential study of visual selective attention to conjunctions of color and shape Psychophysiology 36 264 279
40. C Spence S Squire 2003 Multisensory integration: maintaining the perception of synchrony Curr Biol 12 R519 R521
41. Stein BE, Meredith MA (1993) The merging of the senses. MIT press, Cambridge, MA
42. JJ Stekelenburg J Vroomen 2005 An event-related potential investigation of the time-course of temporal ventriloquism NeuroReport 16 641 644
43. D Talsma 2008 Auto-adaptive averaging: detecting artifacts in event-related potential data using a fully automated procedure Psychophysiology 45 216 228
44. D Talsma A Kok 2001 Nonspatial intermodal selective attention is mediated by sensory brain areas: evidence from event-related potentials Psychophysiology 38 736 751
45. D Talsma MG Woldorff 2005 Attention and multisensory integration: multiple phases of effects on the evoked brain activity J Cogn Neurosci 17 1098 1114
46. Talsma D, Woldorff MG (2005b) Methods for the estimation and removal of artifacts and overlap in ERP waveforms. In: Handy TC (ed) Event-related potentials: a methods handbook. MIT Press, Cambridge, MA, pp 115-148
47. D Talsma TJ Doty MG Woldorff 2007 Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? Cereb Cortex 17 691 701
48. WA Teder-Sälejärvi JJ McDonald F Di Russo SA Hillyard 2002 An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings Cogn Brain Res 14 106 114
49. J Vroomen B De Gelder 2004 Temporal ventriloquism: sound modulates the flash-lag effect J Exp Psychol Hum Percept Perform 30 513 518
50. J Vroomen M Keetels 2006 The spatial constraint in intersensory pairing: no role in temporal ventriloquism J Exp Psychol Hum Percept Perform 32 1063 1071
51. MT Wallace MA Meredith BE Stein 1993 Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus J Neurophysiol 69 1797 1809
52. MG Woldorff 1993 Distortion of ERP averages due to overlap from temporally adjacent ERP: analysis and correction Psychophysiology 30 98 119
53. DL Woods K Alho A Algazi 1992 Intermodal selective attention I: effects of event-related potentials to lateralized auditory and visual stimuli Electroencephalogr Clin Neurophysiol 82 341 355