Examining the McGurk illusion using high-field 7 tesla functional MRI

Frontiers in Human Neuroscience

Volumn , Issue APRIL 2012, 2012, Pages

  Szycik, Gregor R ^a   Stadler, Jörg ^b   Tempelmann, Claus ^c   Münte, Thomas F ^d  

^a HANNOVER MEDICAL SCHOOL   (Germany)

^b LEIBNIZ INSTITUTE FOR NEUROBIOLOGY   (Germany)

^c OTTO VON GUERICKE UNIVERSITY   (Germany)

^d UNIVERSITY OF LÜBECK   (Germany)

Author keywords

7 Tesla; Audio visual integration; Functional magnetic resonance imaging; Mcgurk illusion

Indexed keywords

ADULT; ARTICLE; AUDITORY DISCRIMINATION; BRAIN FUNCTION; BRAIN REGION; CONTROLLED STUDY; EVENT RELATED POTENTIAL; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; HUMAN EXPERIMENT; INFERIOR FRONTAL GYRUS; MALE; NORMAL HUMAN; SPEECH PERCEPTION; SUPERIOR TEMPORAL SULCUS; VISUAL INFORMATION;

EID: 84933672627     PISSN: 16625161     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2012.00095     Document Type: Article

References (44)

1. Amunts, K., Schleicher, A., Bürgel, U., Mohlberg, H., Uylings, H. B. M., and Zilles, K. (1999). Broca's region revisited: cytoarchitecture and intersubject variability. J. Comp. Neurol. 412, 319-341.
2. Barraclough, N. E., Xiao, D., Baker, C. I., Oram, M. W., and Perrett, D. I. (2005). Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. J. Cogn. Neurosci. 17, 377-391.
3. Baumgart, F., Kaulisch, T., Tempelmann, C., Gaschler-Markefski, B., Tegeler, C., Schindler, F., Stiller, D., and Scheich, H. (1998). Electrodynamic headphones and woofers for application in magnetic resonance imaging scanners. Med. Phys. 25, 2068-2070.
4. Beauchamp, M. S. (2005). See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex. Curr. Opin. Neurobiol. 15, 145-153.
5. Bernstein, L. E., Auer, E. T., Wagner, M., and Ponton, C. W. (2008). Spatiotemporal dynamics of audiovisual speech processing. Neuro-image 39, 423-435.
6. Bookheimuer, S. Y. (2002). Functional MRI of Language: new approaches to understanding the cortical organization of semantic processing. Annu. Rev. Neurosci. 25, 151-188.
7. Boynton, G. M., Engel, S. A., Glover, G. H., and Heeger, D. J. (1996). Linear systems analysis of functional magnetic resonance imaging in human V1. J. Neurosci. 16, 4207-4221.
8. Brefczynski-Lewis, J., Lowitszch, S., Parsons, M., Lemieux, S., and Puce, A. (2009). Audiovisual non-verbal dynamic faces elicit converging fMRI and ERP responses. Brain Topogr. 21, 193-206.
9. Calvert, G. A. (2001). Crossmodal processing in the human brain: insights from functional neu-roimaging studies. Cereb. Cortex 11, 1110-1123.
10. Calvert, G. A., Campbell, R., and Brammer, M. J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 10, 649-657.
11. Cusick, C. G. (1997). "The superior temporal polysensory region in monkeys," in Cerebral Cortex: Extrastriate Cortex in Primates, eds K. S. Rockland, J. H. Kaas, and A. Peters (New York, NY: Springer), 435-468.
12. Driver, J. (1996). Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature 381, 66-68.
13. Driver, J., and Noesselt, T. (2008). Multisensory interplay reveals crossmodal influences on "sensory-specific" brain regions, neural responses, and judgments. Neuron 57, 11-23.
14. Hagoort, P. (2005). On Broca, brain, and binding: a new framework. Trens Cogn. Sci. 9, 416-423.
15. Hein, G., and Knight, R. T. (2008). Superior temporal sulcus-It's my area: or is it? J. Cogn. Neurosci. 20, 2125-2136.
16. Jäncke, L., and Shah, N. J. (2004). Hearing syllables by seeing visual stimuli. Eur. J. Neurosci. 19, 2603-2608.
17. Koelsch, S., Gunter, T. C., Cramon, D. Y., Zysset, S., Lohmann, G., and Friederici, A. D. (2002). Bach speaks: a cortical "language-network" serves the processing of music. Neuroimage 17, 956-966.
18. Krämer, U. M., Mohammadi, B., Doñamayor, N., Samii, A., and Münte, T. F. (2010). Emotional and cognitive aspects of empathy and their relation to social cognition- an fMRI-study. Brain Res. 1311, 110-120.
19. Lancaster, J. L., Woldorff, M. G., Parsons, L. M., Liotti, M., Freitas, C. S., Rainey, L., Kochunov, P. V., Nickerson, D., Mikiten, S. A., and Fox, P. T. (2000). Automated Talairach atlas labels for functional brain mapping. Hum. Brain Mapp. 10, 120-131.
20. Lee, H., and Noppeney, U. (2011). Physical and perceptual factors shape the neural mechanisms that integrate audiovisual signals in speech comprehension. J. Neurosci. 31, 11338-11350.
21. Liberman, A. M., and Mattingly, I. G. (1985). The motor theory of speech perception revised. Cognition 21, 1-36.
22. Liberman, A. M., and Mattingly, I. G. (1989). A specialization for speech perception. Science 243, 489-494.
23. Macaluso, E., Frith, C. D., and Driver, J. (2000). Modulation of human visual cortex by crossmodal spatial attention. Science 289, 1206-1208.
24. McGurk, H., and MacDonald, J. (1976). Hearing lips and seeing voices. Nature 264, 746-748.
25. Miller, L. M., and D'Esposito, M. (2005). Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J. Neurosci. 25, 5884-5893.
26. Nath, A. R., and Beauchamp, M. S. (2011). Dynamic changes in superior temporal sulcus connectivity during perception of noisy audiovisual speech. J. Neurosci. 31, 1704-1714.
27. Nath, A. R., and Beauchamp, M. S. (2012). A neural basis for interindi-vidual differences in the McGurk effect, a multisensory speech illusion. Neuroimage 59, 781-787.
28. Nath, A. R., Fava, E. E., and Beauchamp, M. S. (2011). Neural correlates of interindividual differences in children's audiovisual speech perception. J. Neurosci. 31, 13963-13971.
29. Noesselt, T., Rieger, J. W., Schoenfeld, M. A., Kanowski, M., Hinrichs, H., Heinze, H. J., and Driver, J. (2007). Audiovisual temporal correspondence modulates human mul-tisensory superior temporal sulcus plus primary sensory cortices. J. Neurosci. 27, 11431-11441.
30. Ojanen, V., Möttönen, R., Pekkola, J., Jääskeläinen, I. P., Joensuu, R., Autti, T., and Sams, M. (2005). Processing of audiovisual speech in Broca's area. Neuroimage 25, 333-338.
31. Pekkola, J., Laasonen, M., Ojanen, V., Autti, T., Jääskeläinen, I. P., Kujala, T., and Sams, M. (2005). Perception of matching and conflicting audiovisual speech in dyslexic and fluent readers: an fMRI study at 3 T. Neuroimage 29, 797-807.
32. Pekkola, J., Ojanen, V., Autti, T., Jääskeläinen, I. P., Möttönen, R., and Sams, M. (2006). Attention to visual speech gestures enhances hemodynamic activity in the left planum temporale. Hum. Brain Mapp. 27, 471-477.
33. Ross, L. A., Saint-Amour, D., Leavitt, V. M., Javitt, D. C., and Foxe, J. J. (2007). Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb. Cortex 17, 1147-1153.
34. Schwartz, J. L., Berthommier, F., and Savariaux, C. (2004). Seeing to hear better: evidence for early audio-visual interactions in speech identification. Cognition 93, B69-B78.
35. Sekiyama, K., Kanno, I., Miura, S., and Sugita, Y. (2003). Auditory-visual speech perception examined by fMRI and PET. Neurosci. Res. 47, 277-287.
36. Skipper, J. I., Nusbaum, H. C., and Small, S. L. (2005). Listening to talking faces: motor cortical activation during speech perception. Neuroimage 25, 76-89.
37. Skipper, J. I., van Wassenhove, V., Nusbaum, H. C., and Small, S. L. (2007). Hearing lips and seeing voices: how cortical areas supporting speech production mediate audiovisual speech perception. Cereb. Cortex 17, 2387-2399.
38. Stevenson, R. A., van Der Klok, R. M., Pisoni, D. B., and James, T. W. (2011). Discrete neural substrates underlie complementary audiovisual speech integration processes. Neuroimage 55, 1339-1345.
39. Sumby, W. H., and Pollack, I. (1954). Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26, 212-215.
40. Szycik, G. R., Jansma, H., and Münte, T. F. (2008a). Audiovisual integration during speech comprehension: an fMRI study comparing ROI-based and whole brain analyses. Hum. Brain Mapp. 30, 1990-1999.
41. Szycik, G. R., Tausche, P., and Münte, T. F. (2008b). A novel approach to study audiovisual integration in speech perception: localizer fMRI and sparse sampling. Brain Res. 1220, 142-149.
42. Szycik, G. R., Münte, T. F., Dillo, W., Mohammadi, B., Samii, A., Emrich, H. M., and Dietrich, D. E. (2009). Audiovisual integration of speech is disturbed in schizophrenia: an fMRI study. Schizophr. Res. 110, 111-118.
43. von Kriegstein, K., Dogan, O., Grüter, M., Giraud, A. L., Kell, C. A., Grüter, T., Kleinschmidt, A., and Kiebel, S. J. (2008). Simulation of talking faces in the human brain improves auditory speech recognition. Proc. Nat. Acad. Sci. U.S.A. 105, 6747-6752.
44. Wright, T. M., Pelphrey, K. A., Allison, T., McKeown, M. J., and McCarthy, G. (2003). Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cereb. Cortex 13, 1034-1043.