On the variability of the McGurk effect: Audiovisual integration depends on prestimulus brain states

Cerebral Cortex

Volumn 22, Issue 1, 2012, Pages 221-231

  Keil, Julian ^a   Müller, Nadia ^a   Ihssen, Niklas ^b   Weisz, Nathan ^a  

^a UNIVERSITY OF KONSTANZ   (Germany)

^b CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

illusion; MEG; multisensory; perception

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; AUDIOVISUAL INTEGRATION; AUDITORY STIMULATION; BETA RHYTHM; BRAIN FUNCTION; CORTICAL SYNCHRONIZATION; CUNEUS; FEMALE; FRONTAL CORTEX; HUMAN; HUMAN EXPERIMENT; ILLUSION; MALE; MCGURK EFFECT; MIDDLE TEMPORAL GYRUS; NERVE CELL EXCITABILITY; NERVE CELL NETWORK; NERVE PROJECTION; NORMAL HUMAN; PARIETAL CORTEX; PRECUNEUS; PRIORITY JOURNAL; SPEECH PERCEPTION; SUPERIOR FRONTAL GYRUS; SUPERIOR TEMPORAL GYRUS; TEMPORAL CORTEX; THETA RHYTHM; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADAPTATION, PHYSIOLOGICAL; ADULT; AUDITORY PERCEPTION; BIOLOGICAL CLOCKS; BRAIN; BRAIN MAPPING; CUES; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LINEAR MODELS; MAGNETIC RESONANCE IMAGING; MAGNETOENCEPHALOGRAPHY; MALE; PHOTIC STIMULATION; PSYCHOPHYSICS; REACTION TIME; STATISTICS, NONPARAMETRIC; TIME FACTORS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84055199396     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhr125     Document Type: Article

References (51)

1. Arnal L, Morillon B, Kell C, Giraud A- L. 2009. Dual neural routing of visual facilitation in speech processing. J Neurosci. 29(43): 13445-13453.
2. Barraclough N, Xiao D, Baker C, Oram M, Perrett D. 2005. Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. J Cogn Neurosci. 17(3): 377-391. (Pubitemid 40364527)
3. Beauchamp M, Lee K, Argall B, Martin A. 2004. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron. 41(5):809-823. (Pubitemid 38326842)
4. Beauchamp M, Nath A, Pasalar S. 2010. fMRI-guided transcranial magnetic stimulation reveals that the superior temporal sulcus is a cortical locus of the McGurk effect. J Neurosci. 30(7): 2414-2417.
5. Besle J, Fischer C, Bidet-Caulet A, Lecaignard F, Bertrand O, Giard M- H. 2008. Visual activation and audiovisual interactions in the auditory cortex during speech perception: intracranial recordings in humans. J Neurosci. 28(52):14301-14310.
6. Bizley J, Nodal F, Bajo V, Nelken I, King A. 2007. Physiological and anatomical evidence for multisensory interactions in auditory cortex. Cereb Cortex. 17(9):2172-2189. (Pubitemid 47283692)
7. Busch N, Vanrullen R. 2010. Spontaneous EEG oscillations reveal periodic sampling of visual attention. Proc Natl Acad Sci U S A. 107(37):16048-16053.
8. Buzsáki G. 2006. Rhythms of the brain. New York: Oxford University Press.
9. Calvert G, Campbell R, Brammer M. 2000. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol. 10(11):649-657. (Pubitemid 30354700)
10. Calvert G, Spence C, Stein B. 2004. The handbook of multisensory processes. Cambridge (MA): MIT Press.
11. Cappe C, Thut G, Romei V, Murray M. 2010. Auditory-visual multisensory interactions in humans: timing, topography, directionality, and sources. J Neurosci. 30(38):12572-12580.
12. Dahl C, Logothetis N, Kayser C. 2010. Modulation of visual responses in the superior temporal sulcus by audio-visual congruency. Front Integr Neurosci. 4:10.
13. Dehaene S, Changeux J-P, Naccache L, Sackur J, Sergent C. 2006. Conscious, preconscious, and subliminal processing: a testable taxonomy. Trends Cogn Sci. 10(5):204-211. (Pubitemid 43674496)
14. Fries P. 2005. A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends Cogn Sci. 9(10): 474-480. (Pubitemid 41338822)
15. Ghazanfar A, Chandrasekaran C, Logothetis N. 2008. Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys. J Neurosci. 28(17):4457-4469.
16. Gross J, Kujala J, Hamalainen M, Timmermann L, Schnitzler A, Salmelin R. 2001. Dynamic imaging of coherent sources: studying neural interactions in the human brain. Proc Natl Acad Sci U S A. 98(2):694-699. (Pubitemid 32105105)
17. Gross J, Schmitz F, Schnitzler I, Kessler K, Shapiro K, Hommel B. 2004. Modulation of long-range neural synchrony reflects temporal limitations of visual attention in humans. Proc Natl Acad Sci U S A. 101(35):13050-13055. (Pubitemid 39167581)
18. Hanslmayr S, Aslan A, Staudigl T, Klimesch W, Herrmann C, Bauml K- H. 2007. Prestimulus oscillations predict visual perception performance between and within subjects. Neuroimage. 37(4):1465-1473. (Pubitemid 47385295)
19. Hein G, Knight R. 2008. Superior temporal sulcus-it's my area: or is it J Cogn Neurosci. 20(12):2125-2136.
20. Hipp J, Engel A, Siegel M. 2011. Oscillatory synchronization in largescale cortical networks predicts perception. Neuron. 69(2): 387-396.
21. Kanwisher N. 2000. Domain specificity in face perception. Nat Neurosci. 3:759-763. (Pubitemid 30485699)
22. Kayser C, Logothetis N. 2007. Do early sensory cortices integrate crossmodal information Brain Struct Funct. 212(2):121-132. (Pubitemid 47394498)
23. Kayser C, Logothetis N, Panzeri S. 2010. Visual enhancement of the information representation in auditory cortex. Curr Biol. 20(1): 19-24.
24. Kayser C, Petkov C, Augath M, Logothetis N. 2007. Functional imaging reveals visual modulation of specific fields in auditory cortex. J Neurosci. 27(8):1824-1835.
25. Keil J, Weisz N, Paul-Jordanov I, Wienbruch C. 2010. Localization of the magnetic equivalent of the ERN and induced oscillatory brain activity. Neuroimage. 51:404-411.
26. Klimesch W. 1999. EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res Rev. 29(2-3):169-195. (Pubitemid 29191338)
27. Koch C. 2004. The quest for consciousness: a neurobiological approach. Englewood (CO): Roberts & Co Publishers.
28. Kranczioch C, Debener S, Maye A, Engel A. 2007. Temporal dynamics of access to consciousness in the attentional blink. Neuroimage. 37(3):947-955. (Pubitemid 47248319)
29. Lachaux J, Rodriguez E, Martinerie J, Varela F. 1999. Measuring phase synchrony in brain signals. Hum Brain Mapp. 8(4):194-208.
30. Maris E, Oostenveld R. 2007. Nonparametric statistical testing of EEGand MEG-data. J Neurosci Methods. 164(1):177-190. (Pubitemid 46950991)
31. Mathewson K, Gratton G, Fabiani M, Beck D, Ro T. 2009. To see or not to see: prestimulus alpha phase predicts visual awareness. J Neurosci. 29(9):2725-2732.
32. McGurk H, MacDonald J. 1976. Hearing lips and seeing voices. Nature. 264(5588):746-748.
33. Melloni L, Molina C, Pena M, Torres D, Singer W, Rodriguez E. 2007. Synchronization of neural activity across cortical areas correlates with conscious perception. J Neurosci. 27(11):2858-2865. (Pubitemid 46438979)
34. Möttönen R, Krause C, Tiippana K, Sams M. 2002. Processing of changes in visual speech in the human auditory cortex. Brain Res Cogn Brain Res. 13(3):417-425. (Pubitemid 34252971)
35. Oostenveld R, Fries P, Maris E, Schoffelen J- M. 2011. FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Comput Int Neurosci. 2011:1-9.
36. Pessoa L, De Weerd P. 2003. Filling-in: from perceptual completion to cortical reorganization. New York: Oxford University Press.
37. Romei V, Gross J, Thut G. 2010. On the role of prestimulus alpha rhythms over occipito-parietal areas in visual input regulation: correlation or causation J Neurosci. 30(25):8692-8697.
38. Saint-Amour D, De Sanctis P, Molholm S, Ritter W, Foxe J. 2007. Seeing voices: high-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion. Neuropsychologia. 45(3):587-597. (Pubitemid 44894464)
39. Schoffelen J-M, Gross J. 2009. Source connectivity analysis with MEG and EEG. Hum Brain Mapp. 30(6):1857-1865.
40. Senkowski D, Schneider T, Foxe J, Engel A. 2008. Crossmodal binding through neural coherence: implications for multisensory processing. Trends Neurosci. 31(8):401-409.
41. Stein B. 1998. Neural mechanisms for synthesizing sensory information and producing adaptive behaviors. Exp Brain Res. 123(1-2): 124-135. (Pubitemid 28495305)
42. Stein B, London N, Wilkinson L. 1996. Enhancement of perceived visual intensity by auditory stimuli: a psychophysical analysis. J Cogn Neurosci. 8(6):497-506. (Pubitemid 27075432)
43. Stein B, Meredith A. 1993 . The merging of the senses. Cambridge (MA): MIT Press.
44. Stevenson R, James T. 2009. Audiovisual integration in human superior temporal sulcus: inverse effectiveness and the neural processing of speech and object recognition. Neuroimage. 44(3):1210-1223.
45. Tass P, Rosenblum M, Weule J, Kurths J. 1998. Detection of n: m phase locking from noisy data: application to magnetoencephalography. Phys Rev Lett. 81(15):3291-3294. (Pubitemid 128629556)
46. Van Veen B, van Drongelen W, Yuchtman M, Suzuki A. 1997. Localization of brain electrical activity via linearly constrained minimum variance spatial filtering. IEEE Trans Bio-Med Eng. 44(9): 867-880. (Pubitemid 27357681)
47. Van Wassenhove V, Grant K, Poeppel D. 2005. Visual speech speeds up the neural processing of auditory speech. Proc Natl Acad Sci U S A. 102(4):1181-1186. (Pubitemid 40170746)
48. Varela F, Lachaux J, Rodriguez E, Martinerie J. 2001. The brainweb: phase synchronization and large-scale integration. Nat Rev Neurosci. 2(4):229-239. (Pubitemid 33673064)
49. Weisz N, Dohrmann K, Elbert T. 2007. The relevance of spontaneous activity for the coding of the tinnitus sensation. Prog Brain Res. 166:61-70. (Pubitemid 47595305)
50. Zeki S. 2003. The disunity of consciousness. Trends Cogn Sci. 7(5): 214-218. (Pubitemid 36561633)
51. Zeki S, Bartels A. 1998. The asynchrony of consciousness. Proc R Soc Lond B Biol Sci. 265(1405):1583-1585. (Pubitemid 28421132)