Auditory event-related potentials (ERPs) in audiovisual speech perception

Journal of Speech, Language, and Hearing Research

Volumn 52, Issue 4, 2009, Pages 1073-1081

  Pilling, Michael ^a  

^a MRC INSTITUTE OF HEARING RESEARCH   (United Kingdom)

Author keywords

Audiovisual integration; Event related potential (ERP); Speech

Indexed keywords

ADULT; ARTICLE; EVOKED AUDITORY RESPONSE; EVOKED VISUAL RESPONSE; FEMALE; HUMAN; HUMAN EXPERIMENT; INTERMETHOD COMPARISON; MALE; SPEECH PERCEPTION; TASK PERFORMANCE; VIDEORECORDING;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; BRAIN; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, AUDITORY; EVOKED POTENTIALS, VISUAL; HUMANS; PHOTIC STIMULATION; SIGNAL DETECTION, PSYCHOLOGICAL; SPEECH; SPEECH PERCEPTION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 68149110397     PISSN: 10924388     EISSN: None     Source Type: Journal    
DOI: 10.1044/1092-4388(2009/07-0276)     Document Type: Article

References (30)

1. Bernstein, L. E., Takayanagi, S., & Auer, E. T., Jr. (2004). Auditory speech detection in noise enhanced by lipreading. Speech Communication, 44, 5-18.
2. Besle, J., Fort, A., Delpuech, C., & Giard, M. H. (2004). Bimodal speech: Early suppressive visual effects in the human auditory cortex. European Journal of Neuroscience, 20, 2225-2234. (Pubitemid 39331143)
3. Braida, L. D. (1991). Crossmodal integration in the identification of consonant segments. Quarterly Journal of Experimental Psychology (A), 43, 647-677.
4. Dixon, N. F., & Spitz, L. (1980). The detection of auditory visual desynchrony. Perception, 9, 719-721.
5. Erber, N. P. (1975). Auditory-visual perception of speech. Journal of Speech and Hearing Disorders, 40, 481-492.
6. Giarda, M. H., & Peronnet, F. (1999). Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience, 11, 473-490.
7. Grant, K. W., & Greenberg, S. (2001, September). Speech intelligibility derived from asynchronous processing of auditory-visual information. Proceedings of Auditory-Visual Speech Processing 2001, Scheelsminde, Denmark.
8. Grant, K. W., & Walden, P. F. (1996). Evaluating the articulation index for auditory-visual consonant recognition. The Journal of the Acoustical Society of America, 100, 2415-2424. (Pubitemid 26340009)
9. Gratton, G., Coles, M. G. H., & Donchin, E. (1983). A new method for off-line removal of ocular artifacts. Electroencephalography and Clinical Neurophysiology, 55, 468-484.
10. Green, K. P. (1998). The use of auditory and visual information during phonetic processing: Implications for theories of speech perception. In R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech (pp. 85-108). Hove, England: Psychology Press.
11. Hansen, J., & Hillyard, S. J. (1980). Endogenous brain potentials associated with selective auditory attention. Electroencephalography and Clinical Neurophysiology, 49, 277-290. (Pubitemid 10044179)
12. Macaluso, E., Dolan, R. C., Spence, D., & Driver, J. (2004). Spatial and temporal factors during processing of audiovisual speech: A PET study. NeuroImage, 21, 725-732. (Pubitemid 38229935)
13. Massaro, D. M. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Erlbaum.
14. Massaro, D. M. (1998). Perceiving talking faces: From speech perception to behavioral principle. Cambridge, MA: MIT Press.
15. McGurk, H., & MacDonald, J. (1976, December 23). Hearing lips and seeing voices. Nature, 264, 746-748.
16. McPherson, D. L., & Starr, A. (1993). Binaural interaction in auditory evoked potentials: Brainstem, middle-, and long-latency components. Hearing Research, 66, 91-98.
17. Munhall, K. G., Gribble, P., Sacco, L., & Ward, M. (1996). Temporal constraints on the McGurk effect. Perception & Psychophysics, 58, 351-362.
18. Näätänen, R., & Picton,T. (1987). The N1 wave of the human electric and magnetic response to sound: A review and an analysis of the component structure. Psychophysiology, 24, 375-426. (Pubitemid 17114207)
19. Näätänen, R., & Winkler, I. (1999). The concept of auditory stimulus representation in cognitive neuroscience. Psychological Bulletin, 6, 826-859.
20. Rosenblum, L. D., & Saldapa, H. M. (1996). An audiovisual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 22, 318-331.
21. Scherg, M., & Von Cramon, D. (1986). Evoked dipole source potentials of the human auditory cortex. Electroencephalography and Clinical Neurology, 65, 344-360. (Pubitemid 16048434)
22. Schwartz, J. L., Robert-Ribes, J., & Escudier, P. (1998). Ten years after Summerfield: A taxonomy of models for audio-visual fusion in speech perception. In R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech (pp. 85-108). Hove, England: Psychology Press.
23. Sekiyama, K., Kannoc, I., Miurac, S., & Sugit, Y. (2003). Auditory-visual speech perception examined by fMRI and PET. Neuroscience Research, 47, 277-287. (Pubitemid 37267963)
24. Shulman, G. L., Corbetta, M., Buckner, R. L., Raichle, M. E., Fiezi, J. A., Miezini, F. M., & Petersen, S. E. (1997). Top-down modulation of early sensory cortex. Cerebral Cortex, 7, 193-206. (Pubitemid 27184481)
25. Spence, C. (2007). Audiovisual multisensory integration. Acoustic Science and Technology, 28, 61-70.
26. Stekelenburg, J. J., & Vroomen, J. (2007). Neural correlates of multisensory integration of ecologically valid audiovisual events. Journal of Cognitive Neuroscience, 19, 1964-1973.
27. Summerfield, Q. (1987). Some preliminaries to a comprehensive account of audio-visual speech perception. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lipreading (pp. 3-51). London: Erlbaum.
28. van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005). Visual speech speeds up the neural processing of auditory speech. Proceedings of the National Academy of Science, 102, 1181-1186. (Pubitemid 40170746)
29. Vitkovitch, M., & Barber, P. J. (1994). Effect of video frame rate on subjects' ability to shadow one of two competing verbal passages. Journal of Speech and Hearing Research, 37, 1204-1210. (Pubitemid 24307885)
30. Vitkovitch, M., & Barber, P. J. (1996). Visible speech as a function of image quality: Effects of display parameters on lip reading ability. Applied Cognitive Psychology, 39, 121-140. (Pubitemid 126482118)