Degradation of labial information modifies audiovisual speech perception in cochlear-implanted children

Ear and Hearing

Volumn 34, Issue 1, 2013, Pages 110-121

  Huyse, Aurélie ^a   Berthommier, Frédéric ^b   Leybaert, Jacqueline ^a  

^a UNIVERSITÉ LIBRE DE BRUXELLES   (Belgium)

^b UNIV GRENOBLE ALPES   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ARTICLE; ASSOCIATION; AUDITORY STIMULATION; CASE CONTROL STUDY; CHILD; COCHLEA PROSTHESIS; FEMALE; HEARING; HEARING IMPAIRMENT; HUMAN; IMPLANTATION; LIP READING; MALE; PHOTOSTIMULATION; PHYSIOLOGY; SPEECH PERCEPTION; VISION;

ACOUSTIC STIMULATION; ADOLESCENT; AUDITORY PERCEPTION; CASE-CONTROL STUDIES; CHILD; COCHLEAR IMPLANTATION; COCHLEAR IMPLANTS; CUES; DEAFNESS; FEMALE; HUMANS; LIPREADING; MALE; PHOTIC STIMULATION; SPEECH PERCEPTION; VISUAL PERCEPTION;

EID: 84872201695     PISSN: 01960202     EISSN: None     Source Type: Journal    
DOI: 10.1097/AUD.0b013e3182670993     Document Type: Article

References (47)

1. Bergeson, T. R., Pisoni, D. B., Davis, R. A. (2005). Development of audiovisual comprehension skills in prelingually deaf children with cochlear implants. Ear Hear, 26, 149-164 (Pubitemid 40489326)
2. Berthommier, F. (2001). Audio-visual recognition of spectrally reduced speech. Dans AVSP 2001-International Conference on Auditory-Visual Speech Processing Aalborg, Denmark
3. Champoux, F., Lepore, F., Gagné, J. P., et al. (2009). Visual stimuli can impair auditory processing in cochlear implant users. Neuropsychologia, 47, 17-22
4. Desai, S., Stickney, G., Zeng, F. G. (2008). Auditory-visual speech perception in normal-hearing and cochlear-implant listeners. J Acoust Soc Am, 123, 428-440
5. Dowell, R. C., Martin, L. F., Tong, Y. C., et al. (1982). A 12-consonant confusion study on a multiple-channel cochlear implant patient. J Speech Hear Res, 25, 509-516 (Pubitemid 13106509)
6. Erber, N. P. (1969). Interaction of audition and vision in the recognition of oral speech stimuli. J Speech Hear Res, 12, 423-425
7. Fetterman, B. L., & Domico, E. H. (2002). Speech recognition in background noise of cochlear implant patients. Otolaryngol Head Neck Surg, 126, 257-263 (Pubitemid 41123587)
8. Fixmer, E., & Hawkins, S. (1998). The influence of the quality of information on the McGurk effect. Paper presented at the international conference on audio-visual speech processing, Terrigal, Australia December 4-6, 1998
9. Fu, Q. J., Shannon, R. V., Wang, X. (1998). Effects of noise and spectral resolution on vowel and consonant recognition: Acoustic and electric hearing. J Acoust Soc Am, 104, 3586-3596 (Pubitemid 29006021)
10. Füllgrabe, C., Berthommier, F., Lorenzi, C. (2006). Masking release for consonant features in temporally fluctuating background noise. Hear Res, 211, 74-84 (Pubitemid 43112413)
11. Geers, A. E., Nicholas, J. G., Sedey, A. L. (2003). Language skills of children with early cochlear implantation. Ear Hear, 24(1 Suppl), 46S-58S. (Pubitemid 36262690)
12. Giraud, A. L., Price, C. J., Graham, J. M., et al. (2001). Cross-modal plasticity underpins language recovery after cochlear implantation. Neuron, 30, 657-663 (Pubitemid 32607331)
13. Grant, K. W. (2002). Measures of auditory-visual integration for speech understanding: A theoretical perspective. J Acoust Soc Am, 112, 30-33 (Pubitemid 34747734)
14. Grant, K. W., & Seitz, P. F. (1998). Measures of auditory-visual integration in nonsense syllables and sentences. J Acoust Soc Am, 104, 2438-2450 (Pubitemid 28463139)
15. Grant, K. W., & Seitz, P. F. (2000). The use of visible speech cues for improving auditory detection of spoken sentences. J Acoust Soc Am, 108(3 Pt 1), 1197-1208
16. Kaiser, A. R., Kirk, K. I., Lachs, L., et al. (2003). Talker and lexical effects on audiovisual word recognition by adults with cochlear implants. J Speech Lang Hear Res, 46, 390-404
17. Kiefer, J., Hohl, S., Stürzebecher, E., et al. (2001). Comparison of speech recognition with different speech coding strategies (SPEAK, CIS, and ACE) and their relationship to telemetric measures of compound action potentials in the nucleus CI 24M cochlear implant system. Audiology, 40, 32-42 (Pubitemid 32229208)
18. Lachs, L., Pisoni, D. B., Kirk, K. I. (2001). Use of audiovisual information in speech perception by prelingually deaf children with cochlear implants: A first report. Ear Hear, 22, 236-251 (Pubitemid 32531965)
19. Leybaert, J., & Colin, C. (2007). Le rôle des informations visuelles dans le développement du langage de l'enfant sourd muni d'un implant aire [The role of visual information in the language development of deaf children with cochlear implants]. Enfance, 59, 245-253
20. Liberman, A. M., & Mattingly, I. G. (1985). The motor theory of speech perception revised. Cognition, 21, 1-36
21. MacDonald, J., Andersen, S., Bachmann, T. (2000). Hearing by eye: How much spatial degradation can be tolerated? Perception, 29, 1155-1168
22. MacLeod, A. & Summerfield, Q. (1987). Quantifying the contribution of vision to speech perception in noise. Br J Audiol, 21(2), 131-141
23. Manuel, S. Y., Repp, B. H., Studdert K. M., Liberman, A. M. (1983). Exploring the "McGurk effect." J Acoust Soc Am, 74, S66
24. Massaro, D. W. (1987). Speech Perception by Ear and Eye: A Paradigm for Psychological Inquiry. Hillsdale, NJ: Erlbaum
25. Massaro, D. W. (1998). Perceiving Talking Faces: From Speech Perception to a Behavioral Principle. Cambridge, MA: MIT Press
26. Massaro, D. W., Thompson, L. A., Barron, B., Laren, E. (1986). Developmental changes in visual and auditory contributions to speech perception. J Exp Child Psychol, 41, 93-113
27. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748
28. Mohammed, T., Campbell, R., MacSweeney, M., et al. (2005). Speechreading skill and visual movement sensitivity are related in deaf speechreaders. Perception, 34, 205-216 (Pubitemid 40482630)
29. Moody-Antonio, S., Takayanagi, S., Masuda, A., et al. (2005). Improved speech perception in adult congenitally deafened cochlear implant recipients. Otol Neurotol, 26, 649-654 (Pubitemid 41026090)
30. Munson, B., & Nelson, P. B. (2005). Phonetic identification in quiet and in noise by listeners with cochlear implants. J Acoust Soc Am, 118, 2607-2617 (Pubitemid 41463971)
31. Rosenblum, L. D., & Saldaña, H. M. (1996). An audiovisual test of kinematic primitives for visual speech perception. J Exp Psychol Hum Percept Perform, 22, 318-331 (Pubitemid 126418397)
32. Rouger, J., Fraysse, B., Deguine, O., et al. (2008). McGurk effects in cochlear-implanted deaf subjects. Brain Res, 1188, 87-99 (Pubitemid 350296053)
33. Rouger, J., Lagleyre, S., Fraysse, B., et al. (2007). Evidence that cochlear-implanted deaf patients are better multisensory integrators. Proc Natl Acad Sci USA, 104, 7295-7300 (Pubitemid 47186048)
34. Schorr, E. A., Fox, N. A., van Wassenhove, V., et al. (2005). Auditory-visual fusion in speech perception in children with cochlear implants. Proc Natl Acad Sci USA, 102, 18748-18750 (Pubitemid 43011297)
35. Schwartz, J. L. (2010). A reanalysis of McGurk data suggests that audiovisual fusion in speech perception is subject-dependent. J Acoust Soc Am, 127, 1584-1594
36. Schwartz, J. L., Tiippana, K., Andersen, T. (2010). Disentangling unisensory from fusion effects in the attentional modulation of McGurk effects: A Bayesian modeling study suggests that fusion is attention-dependent. AVSP, Japan 23-27
37. Sekiyama, K., Burnham, D., Tam, H., Erdener, D. (2003). Auditory-visual speech perception development in Japanese and English speakers. AVSP 2003-International Conference on Audio-Visual Speech Processing, ISCA September 4-7, France
38. Sekiyama, K., & Tohkura, Y. (1993). Inter-language differences in the influence of visual cues in speech perception. J Phon, 21, 427-444
39. Shannon, R. V., Zeng, F. G., Kamath, V., et al. (1995). Speech recognition with primarily temporal cues. Science, 270, 303-304
40. Skinner, M. W., Fourakis, M. S., Holden, T. A., et al. (1999). Identification of speech by cochlear implant recipients with the multipeak (MPEAK) and spectral peak (SPEAK) speech coding strategies II. Consonants. Ear Hear, 20, 443-460 (Pubitemid 30007543)
41. Sommers, M. S., Tye-Murray, N., Spehar, B. (2005). Auditory-visual speech perception and auditory-visual enhancement in normal-hearing younger and older adults. Ear Hear, 26, 263-275 (Pubitemid 40917424)
42. Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. J Acoust Soc Am, 26, 212-215
43. Tremblay, C., Champoux, F., Lepore, F., et al. (2010). Audiovisual fusion and cochlear implant proficiency. Restor Neurol Neurosci, 28, 283-291
44. Tremblay, C., Champoux, F., Voss, P., et al. (2007). Speech and non-speech audio-visual illusions: A developmental study. PLoS ONE, 2, e742
45. Tyler, R. S., Parkinson, A. J., Woodworth, G. G., et al. (1997). Performance over time of adult patients using the Ineraid or nucleus cochlear implant. J Acoust Soc Am, 102, 508-522 (Pubitemid 27300531)
46. Walden, B. E., Prosek, R. A., Montgomery, A. A., et al. (1977). Effects of training on the visual recognition of consonants. J Speech Hear Res, 20, 130-145 (Pubitemid 8066301)
47. Zeng, F. G. (2004). Trends in cochlear implants. Trends Amplif, 8, 1-34