On perceived synchrony-neural dynamics of audiovisual illusions and suppressions

Brain Research

Volumn 1220, Issue , 2008, Pages 132-141

  Noesselt, Toemme ^a,b   Bonath, Bjoern ^a   Boehler, Carsten Nicolas ^c   Schoenfeld, Mircea Ariel ^a,c   Heinze, Hans Jochen ^a,c  

^a Department of Neurology II ^*  (Germany)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c LEIBNIZ INSTITUTE FOR NEUROBIOLOGY   (Germany)

Author keywords

Audiovisual; Auditory driving; ERP; Multisensory; Synchrony perception; Temporal integration; Visual illusion; Visual suppression

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; BRAIN ELECTROPHYSIOLOGY; BRAIN REGION; CORTICAL SYNCHRONIZATION; EVENT RELATED POTENTIAL; FEMALE; FRONTAL CORTEX; HUMAN; HUMAN EXPERIMENT; MALE; NERVE PROJECTION; NORMAL HUMAN; OCCIPITAL CORTEX; PARIETAL LOBE; PERCEPTIVE DISCRIMINATION; PRIORITY JOURNAL; VISUAL ILLUSION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; BRAIN MAPPING; CEREBRAL CORTEX; EVOKED POTENTIALS; FEMALE; HUMANS; ILLUSIONS; MALE; NONLINEAR DYNAMICS; PHOTIC STIMULATION; PSYCHOPHYSICS; REACTION TIME; REPRESSION; TIME FACTORS; VISUAL PERCEPTION;

EID: 48949119354     PISSN: 00068993     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.brainres.2007.09.045     Document Type: Article

References (47)

1. Andersen T.S., Tiippana K., and Sams M. Factors influencing audiovisual fission and fusion illusions. Brain Res. Cogn. Brain Res. 21 (2004) 301-308
2. Arden G.B., Wolf J.E., and Messiter C. Electrical activity in visual cortex associated with combined auditory and visual stimulation in temporal sequences known to be associated with a visual illusion. Vis. Res. 43 (2003) 2469-2478
3. Beauchamp M.S., Argall B.D., Bodurka J., Duyn J.H., and Martin A. Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat. Neurosci. 7 (2004) 1190-1192
4. Berger T.D., Martelli M., and Pelli D.G. Flicker flutter: is an illusory event as good as the real thing?. J. Vis. 3 (2003) 406-412
5. Bonath, B., Noesselt, T., Martinez, A., Mishra, J., Schwiecker, K., Heinze, H.J., Hillyard, S.A., in press. Neural basis of the ventriloquist illusion. Curr. Biol. doi:10.1016/j.cub.2007.08.050.
6. Busse L., Roberts K.C., Crist R.E., Weissman D.H., and Woldorff M.G. The spread of attention across modalities and space in a multisensory object. Proc. Natl. Acad. Sci. U. S. A. 102 (2005) 18751-18756
7. Cheatham P.G., and White C.T. Temporal numerosity: III. Auditory perception of number. J. Exp. Psychol. 47 (1954) 425-428
8. Falchier A., Clavagnier S., Barone P., and Kennedy H. Anatomical evidence of multimodal integration in primate striate cortex. J. Neurosci. 22 (2002) 5749-5759
9. Fendrich R., and Corballis P.M. The temporal cross-capture of audition and vision. Percept. Psychophys. 63 (2001) 719-725
10. Foxe J.J., and Schroeder C.E. The case for feedforward multisensory convergence during early cortical processing. NeuroReport 16 (2005) 419-423
11. Gebhard J.W., and Mowbray G.H. On discriminating the rate of visual flicker and auditory flutter. AOP 72 (1959) 521-528
12. Ghazanfar A.A., and Schroeder C.E. Is neocortex essentially multisensory?. Trends Cogn. Sci. 10 (2006) 278-285
13. Gondan M., Niederhaus B., Rosler F., and Roder B. Multisensory processing in the redundant-target effect: a behavioral and event-related potential study. Percept. Psychophys. 67 (2005) 713-726
14. Guideline thirteen: guidelines for standard electrode position nomenclature. American Electroencephalographic Society. J. Clin. Neurophysiol. 11 (1994) 111-113
15. Kaas J.H., and Collins C.E. The resurrection of multisensory cortex in primates. In: Calvert G.A., Spence C., and Stein B.E. (Eds). The Handbook of Multisensory Processes (2004), Bradford, Cambridge, MA 285-294
16. McDonald J.J., Teder-Salejarvi W.A., Di Russo F., and Hillyard S.A. Neural substrates of perceptual enhancement by cross-modal spatial attention. J. Cogn. Neurosci. 15 (2003) 10-19
17. McDonald J.J., Teder-Salejarvi W.A., Di Russo F., and Hillyard S.A. Neural basis of auditory-induced shifts in visual time-order perception. Nat. Neurosci. 8 (2005) 1197-1202
18. Mishra J., Martinez A., Sejnowski T.J., and Hillyard S.A. Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J. Neurosci. 27 (2007) 4120-4131
19. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., and Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res. 14 (2002) 115-128
20. Myers A.K., Cotton B., and Hilp H.A. Matching the rate of concurrent tone bursts and light flashes as a function of flash surround luminance. Percept. Psychophys. 30 (1981) 33-38
21. Noesselt T., Fendrich R., Bonath B., Tyll S., and Heinze H.J. Closer in time when farther in space-spatial factors in audiovisual temporal integration. Brain Res. Cogn. Brain Res. 25 (2005) 443-458
22. Noesselt T., Rieger J., Schoenfeld A., Kanowski M., Hinrichs H., Heinze H.J., and Driver J. Audiovisual temporal correspondence modulates human superior temporal sulcus plus primary sensory cortices. J. Neurosci. 27 (2007) 11431-11441
23. Ogilvie J.C. Effect of auditory flutter on the visual critical flicker frequency. Can. J. Psychol. 10 (1956) 61-68
24. Paavilainen P., Karlsson M.L., Reinikainen K., and Naatanen R. Mismatch negativity to change in spatial location of an auditory stimulus. Electroencephalogr. Clin. Neurophysiol. 73 (1989) 129-141
25. Padberg J., Seltzer B., and Cusick C.G. Architectonics and cortical connections of the upper bank of the superior temporal sulcus in the rhesus monkey: an analysis in the tangential plane. J. Comp. Neurol. 467 (2003) 418-434
26. Recanzone G.H. Auditory influences on visual temporal rate perception. J. Neurophysiol. 89 (2003) 1078-1093
27. Regan D., and Spekreijse H. Auditory-visual interactions and the correspondence between perceived auditory space and perceived visual space. Perception 6 (1977) 133-138
28. Saberi K., and Perrott D.R. Lateralization thresholds obtained under conditions in which the precedence effect is assumed to operate. J. Acoust. Soc. Am. 87 (1990) 1732-1737
29. Schroeder C.E., and Foxe J.J. The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res. Cogn. Brain Res. 14 (2002) 187-198
30. Schroeder C.E., and Foxe J. Multisensory contributions to low-level, 'unisensory' processing. Curr. Opin. Neurobiol. 15 (2005) 454-458
31. Shams L., Kamitani Y., and Shimojo S. Illusions. What you see is what you hear. Nature 408 (2000) 788
32. Shams L., Kamitani Y., Thompson S., and Shimojo S. Sound alters visual evoked potentials in humans. NeuroReport 12 (2001) 3849-3852
33. Shams L., Kamitani Y., and Shimojo S. Visual illusion induced by sound. Brain Res. Cogn. Brain Res. 14 (2002) 147-152
34. Shams L., Iwaki S., Chawla A., and Bhattacharya J. Early modulation of visual cortex by sound: an MEG study. Neurosci. Lett. 378 (2005) 76-81
35. Shipley T. Auditory flutter-driving of visual flicker. Science 145 (1964) 1328-1330
36. Spence C., and Driver J. Crossmodal Space and Crossmodal Attention (2004), Oxford University Press
37. Stein B.E., Meredith M.A., and Wallace M.T. The visually responsive neuron and beyond: multisensory integration in cat and monkey. Prog. Brain Res. 95 (1993) 79-90
38. Talsma D., Slagter H.A., Nieuwenhuis S., Hage J., and Kok A. The orienting of visuospatial attention: an event-related brain potential study. Brain Res. Cogn. Brain Res. 25 (2005) 117-129
39. Talsma D., Doty T.J., and Woldorff M.G. Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration?. Cereb. Cortex 17 (2007) 679-690
40. Teder-Sälejärvi W.A., McDonald J.J., Di Russo F., and Hillyard S.A. An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Cogn. Brain Res. 14 (2002) 106-114
41. Teder-Salejarvi W.A., Di Russo F., McDonald J.J., and Hillyard S.A. Effects of spatial congruity on audio-visual multimodal integration. J. Cogn. Neurosci. 17 (2005) 1396-1409
42. van Wassenhove V., Grant K.W., and Poeppel D. Visual speech speeds up the neural processing of auditory speech. Proc. Natl. Acad. Sci. U. S. A. 102 (2005) 1181-1186
43. Vogel E.K., and Machizawa M.G. Neural activity predicts individual differences in visual working memory capacity. Nature 428 (2004) 748-751
44. Wada Y., Kitagawa N., and Noguchi K. Audio-visual integration in temporal perception. Int. J. Psychophysiol. 50 (2003) 117-124
45. Watkins S., Shams L., Tanaka S., Haynes J.D., and Rees G. Sound alters activity in human V1 in association with illusory visual perception. NeuroImage 31 (2006) 1247-1256
46. Welch R.B., and Warren D.H. Intersensory interactions. In: Kaufman L., Boff K.R., and Thomas J.P. (Eds). Handbook of Perception and Human Performance (1986), Wiley, New York chapter 25
47. Welch R.B., DuttonHurt L.D., and Warren D.H. Contributions of audition and vision to temporal rate perception. Percept. Psychophys. 39 (1986) 294-300