Cortical processes underlying sound-induced flash fusion

Brain Research

Volumn 1242, Issue , 2008, Pages 102-115

  Mishra, Jyoti ^a   Martinez, Antigona ^a,b   Hillyard, Steven A ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b NATHAN S KLINE INSTITUTE FOR PSYCHIATRIC RESEARCH   (United States)

Author keywords

Cross modal interaction; ERPs; Flash fusion; Multisensory; Polymodal cortex; Visual illusion

Indexed keywords

ADULT; ARTICLE; AUDITORY CORTEX; AUDITORY STIMULATION; CONTROLLED STUDY; EVENT RELATED POTENTIAL; EVOKED CORTICAL RESPONSE; EVOKED VISUAL RESPONSE; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; OUTCOME ASSESSMENT; PRIORITY JOURNAL; TEMPORAL CORTEX; VISUAL CORTEX; VISUAL ILLUSION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; BRAIN; BRAIN MAPPING; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; PHOTIC STIMULATION; VISUAL PERCEPTION;

EID: 55549147146     PISSN: 00068993     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.brainres.2008.05.023     Document Type: Article

References (44)

1. Andersen T.S., Tiippana K., and Sams M. Factors influencing audiovisual fission and fusion illusions. Brain Res. Cogn. Brain Res. 21 (2004) 301-308
2. Arden G.B., Wolf J.E., and Messiter C. Electrical activity in visual cortex associated with combined auditory and visual stimulation in temporal sequences known to be associated with a visual illusion. Vis. Res. 43 (2003) 2469-2478
3. Bavelier D., and Neville H.J. Cross-modal plasticity: where and how?. Nat. Rev., Neurosci. 3 (2002) 443-452
4. Calvert G.A., Stein B.E., and Spence C. The handbook of multisensory processing (2004), MIT, Cambridge, MA
5. Clark V.P., and Hillyard S.A. Spatial selective attention affects early extrastriate but not striate components of the visual evoked potential. J. Cogn. Neurosci. 8 (1996) 387-402
6. Coles M.G.H., Smid H.G.O.M., Scheffers M.K., and Otten L.J. Mental chronometry and the study of human information processing. In: Rugg M.D., and Coles M.G.H. (Eds). Electrophysiology of mind (1995), Oxford University Press, New York 86-131
7. Cox R.W. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 29 (1996) 162-173
8. Di Russo F., Martinez A., Sereno M.I., Pitzalis S., and Hillyard S.A. Cortical sources of the early components of the visual evoked potential. Hum. Brain Mapp. 15 (2002) 95-111
9. Di Russo F., Martinez A., and Hillyard S.A. Source analysis of event-related cortical activity during visuo-spatial attention. Cereb. Cortex 13 (2003) 486-499
10. Fendrich R., and Corballis P.M. The temporal cross-capture of audition and vision. Percept. Psychophys. 63 (2001) 719-725
11. Fort A., Delpuech C., Pernier J., and Giard M.H. Early auditory-visual interactions in human cortex during nonredundant target identification. Brain Res. Cogn. Brain Res. 14 (2002) 20-30
12. Ghazanfar A.A., and Schroeder C.E. Is neocortex essentially multisensory?. Trends Cogn. Sci. 10 (2006) 278-285
13. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci. 11 (1999) 473-490
14. Gondan M., and Roder B. A new method for detecting interactions between the senses in event-related potentials. Brain Res. (2006) 1073-1074 389-397
15. Hillyard S.A., and Picton T.W. Electrophysiology of cognition. In: Plum F. (Ed). Handbook of Physiology Section 1: The Nervous System. Higher Functions of the Brain, Part 2, Vol. V (1987), American Physiological Society, Bethesda, Maryland 519-584
16. Macaluso E., and Driver J. Multisensory spatial interactions: a window onto functional integration in the human brain. Trends Neurosci. 28 (2005) 264-271
17. Macmillan N.A., and Creelman C.D. Detection theory: A user's guide (1991), Cambridge University Press, New York
18. McCarthy G., and Wood C.C. Scalp distributions of event-related potentials: an ambiguity associated with analysis of variance models. Electroencephalogr. Clin. Neurophysiol. 62 (1985) 203-208
19. McDonald J.J., Teder-Salejarvi W.A., Di Russo F., and Hillyard S.A. Neural substrates of perceptual enhancement by cross-modal spatial attention. J. Cogn. Neurosci. 15 (2003) 10-19
20. McDonald J.J., Teder-Salejarvi W.A., Di Russo F., and Hillyard S.A. Neural basis of auditory-induced shifts in visual time-order perception. Nat. Neurosci. 8 (2005) 1197-1202
21. Meylan R.V., and Murray M.M. Auditory-visual multisensory interactions attenuate subsequent visual responses in humans. Neuroimage 35 (2007) 244-254
22. Mishra J., Martinez A., Sejnowski T.J., and Hillyard S.A. Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J. Neurosci. 27 (2007) 4120-4131
23. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., and Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res. 14 (2002) 115-128
24. Noesselt T., Bonath B., Boehler C.N., Schoenfeld M.A., and Heinze H.J. On perceived synchrony-neural dynamics of audiovisual illusions and suppressions. Brain Res. (2007) 10.1016/j.brainres.2007.09.045
25. Noesselt T., Rieger J.W., Schoenfeld M.A., Kanowski M., Hinrichs H., Heinze H.J., and Driver J. Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. J. Neurosci. 27 (2007) 11431-11441
26. Recanzone G.H. Auditory influences on visual temporal rate perception. J. Neurophysiol. 89 (2003) 1078-1093
27. Rorden C., and Brett M. Stereotaxic display of brain lesions. Behav. Neurol. 12 (2000) 191-200
28. Scherg M. Fundamentals of dipole source analysis. In: Grandori F., Hoke M., and Roman G.L. (Eds). Auditory evoked magnetic fields and electric potentials (1990) 40-69
29. Schroeder C.E., and Foxe J. Multisensory contributions to low-level, 'unisensory' processing. Curr. Opin. Neurobiol. 15 (2005) 454-458
30. Sekuler R., Sekuler A.B., and Lau R. Sound alters visual motion perception. Nature 385 (1997) 308
31. Shams L., Kamitani Y., and Shimojo S. Illusions. What you see is what you hear. Nature 408 (2000) 788
32. Shams L., Kamitani Y., Thompson S., and Shimojo S. Sound alters visual evoked potentials in humans. Neuroreport 12 (2001) 3849-3852
33. Shams L., Kamitani Y., and Shimojo S. Visual illusion induced by sound. Brain Res. Cogn. Brain Res. 14 (2002) 147-152
34. Shams L., Iwaki S., Chawla A., and Bhattacharya J. Early modulation of visual cortex by sound: an MEG study. Neurosci. Lett. 378 (2005) 76-81
35. Shams L., Ma W.J., and Beierholm U. Sound-induced flash illusion as an optimal percept. Neuroreport 16 (2005) 1923-1927
36. Stein B.E., London R., Wilkinson L.K., and Price D.D. Enhancement of perceived visual intensity by auditory stimuli: a psychophysical analysis. J. Cogn. Neurosci. 8 (1996) 497-506
37. Stein B.E., and Meredith M.A. The merging of the senses (1993), MIT, Cambridge, MA
38. Talairach J., and Tournoux P. Co-planar stereotaxic atlas of the human brain (1988), Thieme, New York
39. Talsma D., and Woldorff M.G. Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J. Cogn. Neurosci. 17 (2005) 1098-1114
40. Teder-Salejarvi W.A., McDonald J.J., Di Russo F., and Hillyard S.A. An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Brain Res. Cogn. Brain Res. 14 (2002) 106-114
41. Teder-Salejarvi W.A., Di Russo F., McDonald J.J., and Hillyard S.A. Effects of spatial congruity on audio-visual multimodal integration. J. Cogn. Neurosci. 17 (2005) 1396-1409
42. Vroomen J., and de Gelder B. Sound enhances visual perception: cross-modal effects of auditory organization on vision. J. Exp. Psychol. Hum. Percept. Perform. 26 (2000) 1583-1590
43. Watkins S., Shams L., Josephs O., and Rees G. Activity in human V1 follows multisensory perception. Neuroimage 37 (2007) 572-578
44. Watkins S., Shams L., Tanaka S., Haynes J.D., and Rees G. Sound alters activity in human V1 in association with illusory visual perception. Neuroimage 31 (2006) 1247-1256