Hearing lips: Gamma-band activity during audiovisual speech perception

Cerebral Cortex

Volumn 15, Issue 5, 2005, Pages 646-653

  Kaiser, Jochen ^a   Hertrich, Ingo ^a   Ackermann, Hermann ^a   Mathiak, Klaus ^a   Lutzenberger, Werner ^a  

^a UNIVERSITY OF TÜBINGEN   (Germany)

Author keywords

Auditory ventral stream; Inferior frontal cortex; Magnetoencephalography; McGurk; Oscillatory activity

Indexed keywords

ADULT; ARTICLE; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; FEMALE; FRONTAL CORTEX; GAMMA BAND ACTIVITY; HEARING; HUMAN; LIP; MAGNETOENCEPHALOGRAPHY; MALE; NORMAL HUMAN; OSCILLATION; PARIETAL LOBE; PRIORITY JOURNAL; SPEECH PERCEPTION; VISION; VISUAL CORTEX;

EID: 17744392863     PISSN: 10473211     EISSN: None     Source Type: Journal    
DOI: 10.1093/cercor/bhh166     Document Type: Article

References (59)

1. Alain C, Arnott SR, Hevenor S, Graham S, Grady CL (2001) 'What' and 'where' in the human auditory system. Proc Natl Acad Sci USA 98:12301-12306.
2. Beauchamp MS, Lee KE, Argall BD, Martin A (2004) Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41:809-823.
3. Bernstein LE, Auer ET, Jr., Moore JK, Ponton CW, Don M, Singh M (2002) Visual speech perception without primary auditory cortex activation. Neuroreport 13:311-315.
4. Binder JR, Frost JA, Hammeke TA, Cox RW, Rao SM, Prieto T (1997) Human brain language areas identified by functional magnetic resonance imaging. J Neurosci 17:353-362.
5. Blair RC, Karniski W (1993) An alternative method for significance testing of waveform difference potentials. Psychophysiology 30:518-524.
6. Bremmer F, Schlack A, Shah NJ, Zafiris O, Kubischik M, Hoffmann K, Zilles K, Fink GR (2001) Polymodal motion processing in posterior parietal and premotor cortex: a human fMRI study strongly implies equivalencies between humans and monkeys. Neuron 29:287-296.
7. Burton MW, Small SL, Blumstein SE (2000) The role of segmentation in phonological processing: an fMRI investigation. J Cogn Neurosci 12:679-690.
8. Calvert GA, Campbell R (2003) Reading speech from still and moving faces: the neural substrates of visible speech. J Cogn Neurosci 15:57-70.
9. Calvert GA, Bullmore ET, Brammer MJ, Campbell R, Williams SC, McGuire PK, Woodruff PW, Iversen SD, David AS (1997) Activation of auditory cortex during silent lipreading. Science 276:593-596.
10. Clochon P, Fontbonne J, Lebrun N, Etevenon P (1996) A new method for quantifying EEG event-related desynchronization:amplitude envelope analysis. Electroencephalogr Clin Neurophysiol 98:126-129.
11. Colin C, Radeau M, Soquet A, Demolin D, Colin F, Deltenre P (2002) Mismatch negativity evoked by the McGurk-MacDonald effect: a phonetic representation within short-term memory. Clin Neurophysiol 113:495-506.
12. Di Russo F, Martinez A, Hillyard SA (2003) Source analysis of event-related cortical activity during visuo-spatial attention. Cereb Cortex 13:486-499.
13. Downar J, Crawley AP, Mikulis DJ, Davis KD (2000) A multimodal cortical network for the detection of changes in the sensory environment. Nat Neurosci 3:277-283.
14. Gobbelé R, Waberski TD, Schmitz S, Sturm W, Buchner H (2002) Spatial direction of attention enhances right hemispheric event-related gamma-band synchronization in humans. Neurosci Lett 327:57-60.
15. Gruber T, Müller MM, Keil A, Elbert T (1999) Selective visual-spatial attention alters induced gamma band responses in the human EEG. Clin Neurophysiol 110:2074-2085.
16. Gruber T, Keil A, Müller MM (2001) Modulation of induced gamma band responses and phase synchrony in a paired associate learning task in the human EEG. Neurosci Lett 316:29-32.
17. Gruber T, Müller MM, Keil A (2002) Modulation of induced gamma band responses in a perceptual learning task in the human EEG. J Cogn Neurosci 14:732-744.
18. Jäncke L, Shah NJ (2002) Does dichotic listening probe temporal lobe functions? Neurology 58:736-743.
19. Jones JA, Callan DE (2003) Brain activity during audiovisual speech perception: an fMRI study of the McGurk effect. Neuroreport 14:1129-1133.
20. Kaiser J, Lutzenberger W (2001) Parietal gamma-band activity during auditory spatial precueing of motor responses. Neuroreport 12:3479-3482.
21. Kaiser J, Lutzenberger W (2003) Induced gamma-band activity and human brain function. Neuroscientist 9:475-484.
22. Kaiser J, Lutzenberger W, Preissl H, Ackermann H, Birbaumer N (2000a) Right-hemisphere dominance for the processing of sound-source lateralization. J Neurosci 20:6631-6639.
23. Kaiser J, Lutzenberger W, Preissl H, Mosshammer D, Birbaumer N (2000b) Statistical probability mapping reveals high-frequency magnetoencephalographic activity in supplementary motor area during self-paced finger movements. Neurosci Lett 283:81-84.
24. Kaiser J, Birbaumer N, Lutzenberger W (2002a) Magnetic oscillatory responses to lateralization changes of natural and artificial sounds in humans. Eur J Neurosci 15:345-354.
25. Kaiser J, Lutzenberger W, Ackermann H, Birbaumer N (2002b) Dynamics of gamma-band activity induced by auditory pattern changes in humans. Cereb Cortex 12:212-221.
26. Kaiser J, Ripper B, Birbaumer N, Lutzenberger W (2003) Dynamics of gamma-band activity in human magnetoencephalogram during auditory pattern working memory. Neuroimage 20:816-827.
27. Keil A, Müller MM, Ray WJ, Gruber T, Elbert T (1999) Human gamma band activity and perception of a gestalt. J Neurosci 19:7152-7161.
28. Keil A, Gruber T, Müller MM (2001) Functional correlates of macroscopic high-frequency brain activity in the human visual system. Neurosci Biobehav Rev 25:527-534.
29. Lewis JW, Beauchamp MS, DeYoe EA (2000) A comparison of visual and auditory motion processing in human cerebral cortex. Cereb Cortex 10:873-888.
30. Lutzenberger W, Pulvermüller F, Birbaumer N (1994) Words and pseudowords elicit distinct patterns of 30-Hz EEG responses in humans. Neurosci Lett 176:115-118.
31. Lutzenberger W, Pulvermüller F, Elbert T, Birbaumer N (1995) Visual stimulation alters local 40-Hz responses in humans: an EEG-study. Neurosci Lett 183:39-42.
32. Lutzenberger W, Ripper B, Busse L, Birbaumer N, Kaiser J (2002) Dynamics of gamma-band activity during an audiospatial working memory task in humans. J Neurosci 22:5630-5638.
33. Maeder PP, Meuli RA, Adriani M, Bellmann A, Fornari E, Thiran JP, Pittet A, Clarke S (2001) Distinct pathways involved in sound recognition and localization: a human fMRI study. Neuroimage 14:802-816.
34. Martinez A, Anllo-Vento L, Sereno MI, Frank LR, Buxton RB, Dubowitz DJ, Wong EC, Hinrichs H, Heinze HJ, Hillyard SA (1999) Involvement of striate and extrastriate visual cortical areas in spatial attention. Nat Neurosci 2:364-369.
35. McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264:746-748.
36. Miltner WH, Braun C, Arnold M, Witte H, Taub E (1999) Coherence of gamma-band EEG activity as a basis for associative learning. Nature 397:434-436.
37. Möttönen R, Krause CM, Tiippana K, Sams M (2002) Processing of changes in visual speech in the human auditory cortex. Cogn Brain Res 13:417-425.
38. Müller MM, Bosch J, Elbert T, Kreiter A, Sosa MV, Sosa PV, Rockstroh B (1996) Visually induced gamma-band responses in human electroencephalographic activity - a link to animal studies. Exp Brain Res 112:96-102.
39. Müller MM, Gruber T, Keil A (2000) Modulation of induced gamma band activity in the human EEG by attention and visual information processing. Int J Psychophysiol 38:283-299.
40. Näätänen R (1992) Attention and brain function. Hillsdale, NJ: Erlbaum.
41. Nichols TE, Holmes AP (2002) Nonparametric permutation tests for functional neuroimaging: a primer with examples. Hum Brain Mapp 15:1-25.
42. Nishitani N, Hari R (2002) Viewing lip forms: cortical dynamics. Neuron 36:1211-1220.
43. Noesselt T, Shah NJ, Jäncke L (2003) Top-down and bottom-up modulation of language related areas - an fMRI Study. BMC Neurosci 4:13.
44. Noesselt T, Hillyard SA, Woldorff MG, Schoenfeld A, Hagner T, Jäncke L, Tempelmann C, Hinrichs H, Heinze HJ (2002) Delayed striate cortical activation during spatial attention. Neuron 35:575-587.
45. Noreen EW (1989) Computer intensive methods for testing hypotheses: an introduction. New York: Wiley & Sons.
46. Palva S, Palva JM, Shtyrov Y, Kujala T, Ilmoniemi RJ, Kaila K, Näätänen R (2002) Distinct gamma-band evoked responses to speech and non-speech sounds in humans. J Neurosci 22:RC211.
47. Poremba A, Saunders RC, Crane AM, Cook M, Sokoloff L, Mishkin M (2003) Functional mapping of the primate auditory system. Science 299:568-572.
48. Puce A, Allison T, Bentin S, Gore JC, McCarthy G (1998) Temporal cortex activation in humans viewing eye and mouth movements. J Neurosci 18:2188-2199.
49. Pulvermüller F, Birbaumer N, Lutzenberger W, Mohr B (1997) High-frequency brain activity: its possible role in attention, perception and language processing. Prog Neurobiol 52:427-445.
50. Pulvermüller F, Shtyrov Y, Ilmoniemi R (2003) Spatiotemporal dynamics of neural language processing: an MEG study using minimum-norm current estimates. Neuroimage 20:1020-1025.
51. Rauschecker JP (1998) Cortical processing of complex sounds. Curr Opin Neurobiol 8:516-521.
52. Romanski LM, Goldman-Rakic PS (2002) An auditory domain in primate prefrontal cortex. Nat Neurosci 5:15-16.
53. Sams M, Aulanko R, Hamalainen M, Hari R, Lounasmaa OV, Lu ST, Simola J (1991) Seeing speech: visual information from lip movements modifies activity in the human auditory cortex. Neurosci Lett 127:141-145.
54. Sekiyama K, Kanno I, Miura S, Sugita Y (2003) Auditory-visual speech perception examined by fMRI and PET. Neurosci Res 47:277-287.
55. Stevens AA (2004) Dissociating the cortical basis of memory for voices, words and tones. Cogn Brain Res 18:162-171.
56. Sumby WH, Pollack I (1954) Visual contribution to speech intelligibility in noise. J Acoust Soc Am 26:212-215.
57. Tallon-Baudry C, Bertrand O (1999) Oscillatory gamma activity in humans and its role in object representation. Trends Cogn Sci 3:151-162.
58. Tallon-Baudry C, Bertrand O, Delpuech C, Pernier J (1996) Stimulus specificity of phase-locked and non-phase-locked 40 Hz visual responses in human. J Neurosci 16:4240-4249.
59. Tallon-Baudry C, Bertrand O, Peronnet F, Pernier J (1998) Induced gamma-band activity during the delay of a visual short-term memory task in humans. J Neurosci 18:4244-4254.