Electrophysiology of Auditory-Visual Speech Integration

AVSP 2003 - International Conference on Audio-Visual Speech Processing

Volumn , Issue , 2003, Pages 37-42

  van Wassenhove, Virginie ^a   Grant, Ken W ^b   Poeppel, David ^a  

^a UNIVERSITY OF MARYLAND   (United States)

^b WALTER REED ARMY MEDICAL CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIORAL RESEARCH; ELECTROPHYSIOLOGY; SPEECH PROCESSING;

% REDUCTIONS; AUDITORY-VISUAL; AUDITORY-VISUAL STIMULUS; EARLY EFFECTS; SPEECH INPUT; UNIMODAL; VISUAL ATTENTION; VISUAL CONDITION; VISUAL SPEECH; VISUAL STIMULUS;

ELECTROENCEPHALOGRAPHY;

EID: 84919874632     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. McGurk, H., and McDonald, J., “Hearing lips and seeing voices”, Nature, 264, 746-747, 1976.
2. Sumby, W.H., and Pollack, I., “Visual contribution to speech intelligibility in noise”, J. Acoust. Soc. Am., 26, 212-215, 1954.
3. MacLeod, A., and Summerfield, Q., “A procedure for measuring auditory and audio-visual speech-reception thresholds for sentences in noise: rationale, evaluation, and recommendation for use”, British Journal of Audiology, 24, 29-43, 1990.
4. Helfer, K.S., “Auditory and audio-visual perception of clear and conversational speech”, Journal of Speech, Language and Hearing Research1, 40, 432-43. 1997
5. Grant, K.W., Walden, B.E., Seitz P.F., “Auditory-visual speech recognition by hearing-impaired subjects: consonant recognition, sentence recognition and auditory-visual integration”, J. Acoust. Soc. Am., 103, 2677-2690, 1998
6. Massaro, D.W. (1987) Perceiving Talking Faces: From Speech perception to a Behavioral principle. Cambridge, MA: MIT Press, 1987.
7. Massaro, D.W., Cohen, M.M., Smeele, P.M. (1996). “Perception of asynchronous and conflicting visual and auditory speech”, J. Acous. Soc. Am, 100, 1777-1786, 1996.
8. Munhall, K., Gribble, P., Sacco, L., Ward, M., “Temporal constraints on the McGurk effect”, Perception and Psychophysics, 58, 351-362, 1996.
9. van Wassenhove, V., Grant, K.W., Poeppel, D., “Temporal window of Integration in bimodal speech” (submitted)
10. Celesia, G.G., “Organization of auditory cortical areas in man”, Brain, 99, 410:414, 1976.
11. Yvert, B., Fischer, C., Guénot, M., Krolak-Salmon, P., Isnard, J., Pernier, J., “Simultaneous intracerebral recordings of early auditory thalamic and cortical activity in human”, European Journal of Neuroscience, 16, 1146-1150, 2002.
12. Ffytche, D.H., Guy, C.N., Zeki, S., “The parallel visual motion inputs into areas V1 and V5 of human cerebral cortex”, Brain, 118, 1375-1394, 1995.
13. Arai, T., and Greenberg, S., “The temporal properties of spoken Japanese are similar to those of English” Proceedings of Eurospeech, Rhodes, Greece, 1011-1014, 1997.
14. Summerfield, Q., “Lipreading and audio-visual speech perception”, Phil. Trans. R. Soc. Lond. B, 335, 71-7, 1992.
15. Grant, K. and Greenberg, S., (2001), “Speech intelligibility derived from asynchronous processing of auditory-visual information”, Proceedings of the workshop on Auditory-Visual speech processing (AVSP), 2001.
16. Rosen, S., “Temporal information in speech: acoustic, auditory and linguistic aspects”, Phil. Trans. R. Soc. Lond. B, 336, 367-373, 1992.
17. Poeppel, D., “The analysis of speech in different temporal integration windows: cerebral lateralization as 'asymmetric sampling time'”, Speech Communication.(in press)
18. Stein, B.E., and Meredith, A.M., The merging of the senses. Cambridge, MA: MIT Press, 1993.
19. Giard, M.-H., and Peronnet, F., “Auditroy-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study”, Journal of Cognitive Neuroscience, 11(5), 473-490, 1999.
20. Molhom, S., Ritter, W., Murray, M.M., Javitt, D.C., Schroeder, C.E., Foxe, J.J., “Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study”, Cognitive Brain Research, 14, 115-128, 2002.
21. Fort, A., Delpuech, C., Pernier, J., Giard, M.-H., “Dynamics of cortico-subcortical cross-modal operations involved in auditory-visual object detection in humans”, Cerebral Cortex, 12, 1031-1039, 2002.
22. Calvert, G.A., Campbell, R., Brammer, M.J., “Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex”, Current Biology, 10 (11) 649-656, 2000.
23. Calvert, G.A., Bullmore, E.T., Brammer, M.J., Campbell, R., Williams, S.C., McGuire, P.K., Woodruff, P.W., Iversen, S.D., David, A., “Activation of auditory cortex during silent lipreading”, Science, 2776, 593-596, 1997.
24. Efron, B., “Bootstrap methods: another look at the jackknife”, Annals of Statistics, 7, 1-26, 1979.
25. Watanabe, J., and, Iwai, E., “Neuronal Activity in visual, auditory and polysensory areas in the monkey temporal cortex during visual fixation task”, Brain Research Bulletin, 26, 583-592, 1991.
26. Falchier, A., Clavagnier, B., Kennedy, H., “Evidence of multimodal integration in primate striate cortex”, Journal of Neuroscience, 22(13), 5749-5759, 2002.
27. Lebib, R.,Papo, D., de Bode, S., Baudonnière P.-M, “Evidence of a visual-to-auditory cross-modal sensory gating phenomenon as reflected by the human P50 event-related brain potential modulation”, Neuroscience Letters, 341, 185-188, 2003.
28. Yabe, H., Winkler, I., Czigler, I., Koyama, S., Kakigi R., Sutoh, T., Hiruma, T., Kaneko, S., “Organizing sound sequences in the human brain: the interplay of auditory streaming and temporal integration”, Brain Research, 897, 222-227, 2001.
29. Näätänen, R., Attention and Brain Function. Hillsdale, NJ: Lawrence Erlbaum Associates.1992.
30. Sams, M., Aulanko, R., Hämäläinen, M., Hari, R., Louassmaa, O.V., Lu, S.T., Simola, J., “Seeing speech: visual information from lip movement modifies activity in the auditory cortex.” Neuroscience Letters, 127, 141:145, 1991.
31. Colin, C., Radeau, M., Soquet, A., Demolin, D., Colin, F., Deltenre, P., “Mismatch negativity evoked by the McGurk-MacDonald effect: a phonetic representation within short-term memory.” Clinical Neurophysiology, 113, 495-506, 2002.