Gaze-direction-based MEG averaging during audiovisual speech perception

Frontiers in Human Neuroscience

Volumn 4, Issue MAR, 2010, Pages

  Hirvenkari, Lotta ^a   Jousmäki, Veikko ^a   Lamminmäki, Satu ^a   Saarinen, Veli Matti ^a   Sams, Mikko E ^a   Hari, Riitta ^a,b  

^a AALTO UNIVERSITY   (Finland)

^b HELSINKI UNIVERSITY CENTRAL HOSPITAL   (Finland)

Author keywords

Auditory cortex; Eye tracking; Human; Magnetoencephalography; McGurk illusion

Indexed keywords

EID: 79953003492     PISSN: 16625161     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnhum.2010.00017     Document Type: Article

References (30)

1. Antervo, A., Hari, R., Katila, T., Ryhänen, T., and Seppänen, M. (1985). Magnetic fields produced by eye blinking. Electroencephalogr. Clin. Neurophysiol. 61, 247-253
2. Besle, J., Fort, A., Delpuech, C., and Giard, M. H. (2004). Bimodal speech: early suppressive visual effects in human auditory cortex. Eur. J. Neurosci. 20, 2225-2234
3. Bulkin, D. A., and Groh, J. M. (2006). Seeing sounds: visual and auditory interactions in the brain. Curr. Opin. Neurobiol. 16, 415-419
4. Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C., McGuire, P. K., Woodruff, P. W., Iversen, S. D., and David, A. S. (1997). Activation of auditory cortex during silent lipreading. Science 276, 593-596
5. Colin, C., Radeau, M., Soquet, A., and Deltenre, P. (2004). Generalization of the generation of an MMN by illusory McGurk percepts: voiceless consonants. Clin. Neurophysiol. 115, 1989-2000
6. Colin, C., Radeau, M., Soquet, A., Demolin, D., Colin, F., and Deltenre, P. (2002). Mismatch negativity evoked by the McGurk-MacDonald effect: a phonetic representation within short-term memory. Clin. Neurophysiol. 113, 495-506
7. Evdokimidis, I., Smyrnis, N., Constantinidis, T. S., Gourtzelidis, P., and Papageorgiou, C. (2001). Frontal-parietal activation differences observed before the execution of remembered saccades: an event-related potentials study. Brain Res. Cogn. Brain Res. 12, 89-99
8. Graupner, S. T., Velichkovsky, B. M., Pannasch, S., and Marx, J. (2007). Surprise, surprise: two distinct components in the visually evoked distractor effect. Psychophysiology 44, 251-261
9. Hämäläinen, M., Hari, R., Ilmoniemi, R. J., Knuutila, J., and Lounasmaa, O. V. (1993). Magnetoencephalography-theory, instrumentation, and applications to noninvasive studies of the working human brain. Rev Mod. Phys. 65, 413-497
10. Hari, R. (2004). Magnetoencephalography in clinical neurophysiological assessment of human cortical functions. In Electroencephalography. Basic Principles, Clinical Applications and Related Fields, E. Niedermeyer and F. Lopes da Silva, eds. (Philadelphia, Lippincott Williams & Wilkins), pp. 1165-1197
11. Hasson, U., Nir, Y., Levy, I., Fuhrmann, G., and Malach, R. (2004). Intersubject synchronization of cortical activity during natural vision. Science 303, 1634-1640
12. Heinen, S. J., Rowland, J., Lee, B. T., and Wade, A. R. (2006). An oculomotor decision process revealed by functional magnetic resonance imaging. J. Neurosci. 26, 13515-13522
13. Jonides, J., Irwin, D. E., and Yantis, S. (1982). Integrating visual information from successive fi xations. Science 215, 192-194
14. Jousmäki, V., Hämäläinen, M., and Hari, R. (1996). Magnetic source imaging during a visually guided task. Neuroreport 7, 2961-2964
15. Klucharev, V., Möttönen, R., and Sams, M. (2003). Electrophysiological indicators of phonetic and nonphonetic multisensory interactions during audiovisual speech perception. Brain Res. Cogn. Brain Res. 18, 65-75
16. Lebib, R., Papo, D., de Bode, S., and Baudonniere, P. M. (2003). Evidence of a visual-to-auditory cross-modal sensory gating phenomenon as refl ected by the human P50 event-related brain potential modulation. Neurosci. Lett. 341, 185-188
17. Malinen, S., Hlushchuk, Y., and Hari, R. (2007). Towards natural stimulation in fMRI-issues of data analysis. Neuroimage 35, 131-139
18. Manoach, D. S., Thakkar, K. N., Cain, M. S., Polli, F. E., Edelman, J. A., Fischl, B., and Barton, J. J. (2007). Neural activity is modulated by trial history: a functional magnetic resonance imaging study of the effects of a previous antisaccade. J. Neurosci. 27, 1791-1798
19. McGurk, H., and MacDonald, J. (1976). Hearing lips and seeing voices. Nature 264, 746-748
20. Motter, B. C., and Poggio, G. F. (1990). Dynamic stabilization of receptive fi elds of cortical neurons (VI) during fi xation of gaze in the macaque. Exp. Brain Res. 83, 37-43
21. Oldfi eld, R. C. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9, 97-113
22. Pekkola, J., Ojanen, V., Autti, T., Jääskeläinen, I. P., Möttönen, R., Tarkiainen, A., and Sams, M. (2005). Primary auditory cortex activation by visual speech: an fMRI study at 3 T. Neuroreport 16, 125-128
23. Saint-Amour, D., De Sanctis, P., Molholm, S., Ritter, W., and Foxe, J. J. (2007). Seeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion. Neuropsychologia 45, 587-597
24. Sams, M., Aulanko, R., Hämäläinen, M., Hari, R., Lounasmaa, O. V., Lu, S. T., and Simola, J. (1991). Seeing speech: visual information from lip movements modifi es activity in the human auditory cortex. Neurosci. Lett. 127, 141-145
25. Stekelenburg, J. J., and Vroomen, J. (2007). Neural correlates of multisensory integration of ecologically valid audiovisual events. J. Cogn. Neurosci. 19, 1964-1973
26. Sterpenich, V., D'Argembeau, A., Desseilles, M., Balteau, E., Albouy, G., Vandewalle, G., Degueldre, C., Luxen, A., Collette, F., and Maquet, P. (2006). The locus ceruleus is involved in the successful retrieval of emotional memories in humans. J. Neurosci. 26, 7416-7423
27. Sumby, W. H., and Pollack, I. (1954). Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26, 212-215
28. Taulu, S., and Simola, J. (2006). Spatiotemporal signal space separation method for rejecting nearby interference in MEG measurements. Phys. Med. Biol. 51, 1759-1768.
29. van Wassenhove, V., Grant, K. W., and Poeppel, D. (2005). Visual speech speeds up the neural processing of auditory speech. Proc. Natl. Acad. Sci. U.S.A. 102, 1181-1186
30. Werner-Reiss, U., Kelly, K. A., Trause, A. S., Underhill, A. M., and Groh, J. M. (2003). Eye position affects activity in primary auditory cortex of primates. Curr. Biol. 13, 554-562.