Audiovisual fusion and cochlear implant proficiency

Restorative Neurology and Neuroscience

Volumn 28, Issue 2, 2010, Pages 283-291

  Tremblay, Corinne ^a,b   Champoux, François ^a   Lepore, Franco ^a,b   Théoret, Hugo ^a,b  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b UNIVERSITY OF MONTREAL   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AGED; ARTICLE; AUDIOVISUAL EQUIPMENT; AUDITORY STIMULATION; CLINICAL ARTICLE; COCHLEA PROSTHESIS; CONTROLLED STUDY; FEMALE; HEARING; HEARING IMPAIRMENT; HUMAN; MALE; PRIORITY JOURNAL; SENSORY ANALYSIS; STIMULUS RESPONSE; VISION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; AGED; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; COCHLEAR IMPLANTATION; COCHLEAR IMPLANTS; DEAFNESS; FEMALE; HUMANS; MALE; MIDDLE AGED; PHOTIC STIMULATION; REACTION TIME; VISUAL PERCEPTION; YOUNG ADULT;

EID: 77952350803     PISSN: 09226028     EISSN: None     Source Type: Journal    
DOI: 10.3233/RNN-2010-0498     Document Type: Article

References (66)

1. Alegria, J. & Lechat, J. (2005). Phonological processing in deaf children: when lipreading and cues are incongruent. J Deaf Stud Deaf Educ, 10, 122-133.
2. Alsius, A., Navarra, J., Campbell, R. & Soto-Faraco, S. (2005). Audiovisual integration of speech falters under high attention demands. Curr Biol, 15, 839-843.
3. Armstrong, B.A., Neville, H.J., Hillyard, S.A. & Mitchell, T.V. (2002). Auditory deprivation affects processing of motion, but not color. Brain Res Cogn Brain Res, 14, 422-434.
4. Bavelier, D., Dye, M.W. & Hauser, P.C. (2006). Do deaf individuals see better? Trends Cogn Sci, 10, 512-518.
5. Bolognini, N., Frassinetti, F., Serino, A. & Làdavas, E. (2005). "Acoustical vision" of below threshold stimuli: interaction among spatially converging audiovisual inputs. Exp Brain Res, 160, 273-282.
6. Brozinsky, C.J. & Bavelier, D. (2004). Motion velocity thresholds in deaf signers: changes in lateralization but not in overall sensitivity. Brain Res Cogn Brain Res, 21, 1-10.
7. Burnham, D. & Dodd, B. (2004). Auditory-visual speech integration by prelinguistic infants: perception of an emergent consonant in the McGurk effect. Dev Psychobiol, 45, 204-220.
8. Calvert, G.A., Campbell, R. & Brammer, M.J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol, 10, 649-657.
9. Champoux, F., Tremblay, C., Mercier, C., Lassonde, M., Lepore, F., Gagné, J.P. & Théoret, H. (2006). A role for the inferior colliculus in multisensory speech integration. Neuroreport, 17, 1607-1610.
10. Champoux, F., Gagné, J.P., Lepore, F. & Théoret, H. (2008). Visual stimuli can impair auditory processing in cochlear implant users. Neuropsychologia, In press. doi:10.1016/j.neuropsychologia.2008.08.028
11. Desai, S., Stickney, G. & Zeng, F.G. (2008). Auditory-visual speech perception in normal-hearing and cochlear-implant listeners. J Acoust Soc Am, 123, 428-440.
12. Desjardins, R.N. & Werker, J.F. (2004). Is the integration of heard and seen speech mandatory for infants? Dev Psychobiol, 45, 187-203.
13. Doucet, M.E., Bergeron, F., Lassonde, M., Ferron, P. & Lepore, F. (2006). Cross-modal reorganization and speech perception in cochlear implant users. Brain, 129, 3376-3383.
14. Finney, E.M., Fine, I. & Dobkins, K.R. (2001). Visual stimuli activate auditory cortex in the deaf. Nat Neurosci, 4, 1171-1173.
15. Fishman, K.E., Shannon, R.V. & Slattery, W.H. (1997). Speech recognition as a function of the number of electrodes used in the SPEAK cochlear implant speech processor, J Speech Lang Hear Res, 40, 1201-1215.
16. Frassinetti, F., Bolognini, N. & Làdavas, E. (2002). Enhancement of visual perception by crossmodal visuo-auditory interaction. Exp Brain Res, 147, 332-343.
17. Frens, M.A., Van Opstal, A.J. & Van der Willigen, R.F. (1995). Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements. Percept Psychophys, 57, 802-816.
18. Fryauf-Bertschy, H., Tyler, R.S., Kelsay, D.M., Gantz, B.J. & Woodworth, G.G. (1997). Cochlear implant use by prelingually deafened children: the influences of age at implant and length of device use. J Speech Lang Hear Res, 40, 183-199.
19. Fu, Q.J., Shannon, R.V. & Wang, X. (1998). Effects of noise and spectral resolution on vowel and consonant recognition: acoustic and electric hearing. J Acoust Soc Am, 104, 3586-3596.
20. Geers, A.E. (2004). Speech, language, and reading skills after early cochlear implantation. Arch Otolaryngol Head Neck Surg, 130, 634-638.
21. Giraud, A.L., Price, C.J., Graham, J.M. & Frackowiak, R.S. (2001). Functional plasticity of language-related brain areas after cochlear implantation. Brain, 124, 1307-1316.
22. Giraud, A.L., Truy, E., Frackowiak, R.S., Grégoire, M.C., Pujol, J.F. & Collet, L. (2000). Differential recruitment of the speech processing system in healthy subjects and rehabilitated cochlear implant patients. Brain, 123, 1391-1402.
23. Goh, W.D., Pisoni, D.B., Kirk, K.I. & Remez, R.E. (2001). Audio-visual perception of sinewave speech in an adult cochlear implant user: a case study. Ear Hear, 22, 412-419.
24. Grant, K.W., Walden, B.E. & Seitz, P.F. (1998). Auditory-visual speech recognition by hearing-impaired subjects: consonant recognition, sentence recognition, and auditory-visual integration. J Acoust Soc Am, 103, 2677-2690.
25. Hirano, S., Naito, Y., Kojima, H., Honjo, I., Inoue, M., Shoji, K., Tateya, I., Fujiki, N., Nishizawa, S. & Konishi, J. (2000). Functional differentiation of the auditory association area in prelingually deaf subjects. Auris Nasus Larynx, 27, 303-310.
26. Hughes, H.C., Reuter-Lorenz, P.A., Nozawa, G. & Fendrich, R. (1994). Visual-auditory interactions in sensorimotor processing: saccades versus manual responses. J Exp Psychol Hum Percept Perform, 20, 131-153.
27. Kaiser, A.R., Kirk, K.I., Lachs, L. & Pisoni, D.B. (2003). Talker and lexical effects on audiovisual word recognition by adults with cochlear implants. J Speech Lang Hear Res, 46, 390-404.
28. Kang, E., Lee, D.S., Kang, H., Hwang, C.H., Oh, S.H., Kim, C.S., Chung, J.K. & Lee, M.C. (2006). The neural correlates of cross-modal interaction in speech perception during a semantic decision task on sentences: a PET study. Neuroimage, 32, 423-431.
29. Kral, A., Hartmann, R., Tillein, J., Heid, S. & Klinke, R. (2002). Hearing after congenital deafness: central auditory plasticity and sensory deprivation. Cereb Cortex, 12, 797-807.
30. Kral, A. & Eggermont, J.J. (2007) What's to lose and what's to learn: development under auditory deprivation, cochlear implants and limits of cortical plasticity. Brain Res Rev, 56, 259-269.
31. Lee, D.S., Lee, J.S., Oh, S.H., Kim, S.K., Kim, J.W., Chung, J.K., Lee, M.C. & Kim, C.S. (2001) Cross-modal plasticity and cochlear implants. Nature, 409, 149-150.
32. Lee, H.J., Giraud, A.L., Kang, E., Oh, S.H., Kang, H., Kim, C.S. & Lee, D.S. (2007). Cortical activity at rest predicts cochlear implantation outcome. Cereb Cortex, 17, 909-917.
33. Macaluso, E., George, N., Dolan, R., Spence, C. & Driver, J. (2004). Spatial and temporal factors during processing of audiovisual speech: a PET study. Neuroimage, 21, 725-732.
34. MacDonald, J., Andersen, S. & Bachmann, T. (2000). Hearing by eye: how much spatial degradation can be tolerated? Perception, 29, 1155-68.
35. MacSweeney, M., Calvert, G.A., Campbell, R., McGuire, P.K., David, A.S., Williams, S.C., Woll, B. & Brammer, M.J. (2002). Speechreading circuits in people born deaf. Neuropsychologia, 40, 801-807.
36. Massaro, D.W., Thompson, L.A., Barron, B. & Laren, E. (1986). Developmental changes in visual and auditory contributions to speech perception. J Exp Child Psychol, 1, 93-113.
37. McGurk, H. & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
38. Meredith, M.A. & Stein, B.E. (1986). Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Research Cognitive Brain Research, 369, 350-354.
39. Moody-Antonio, S., Takayanagi, S., Masuda, A., Auer, E.T. Jr, Fisher, L. & Bernstein, L.E. (2005). Improved speech perception in adult congenitally deafened cochlear implant recipients. Otol Neurotol, 26, 649-654.
40. Munson, B. & Nelson, P.B. (2005). Phonetic identification in quiet and in noise by listeners with cochlear implants. J Acoust Soc Am, 118, 2607-2617.
41. Musacchia, G., Sams, M., Nicol, T. & Kraus, N. (2006). Seeing speech affects acoustic information processing in the human brainstem. Exp Brain Res, 168, 1-10.
42. Naito, Y., Hirano, S., Honjo, I., Okazawa, H., Ishizu, K., Takahashi, H., Fujiki, N., Shiomi, Y., Yonekura, Y. & Konishi, J. (1997). Sound-induced activation of auditory cortices in cochlear implant users with post- and prelingual deafness demonstrated by positron emission tomography. Acta Otolaryngol, 117, 490-496.
43. Naito, Y., Okazawa, H., Honjo, I., Hirano, S., Takahashi, H., Shiomi, Y., Hoji, W., Kawano, M., Ishizu, K. & Yonekura, Y. (1995). Cortical activation with sound stimulation in cochlear implant users demonstrated by positron emission tomography. Brain Res Cogn Brain Res, 2, 207-214.
44. Neville, H.J. & Lawson, D. (1987). Attention to central and peripheral visual space in a movement detection task: an event-related potential and behavioral study. II. Congenitally deaf adults. Brain Res, 405, 268-283. (Pubitemid 17042819)
45. Okazawa, H., Naito, Y., Yonekura, Y., Sadato, N., Hirano, S., Nishizawa, S., Magata, Y., Ishizu, K., Tamaki, N., Honjo, I. & Konishi, J. (1996). Cochlear implant efficiency in pre- and postlingually deaf subjects. A study with H2(15)O and PET. Brain, 119, 1297-1306.
46. Perrott, D.R., Saberi, K., Brown, K. & Strybel, T.Z. (1990). Auditory psychomotor coordination and visual search performance. Percept Psychophys, 48, 214-226.
47. Petitto, L.A., Zatorre, R.J., Gauna, K., Nikelski, E.J., Dostie, D. & Evans, A.C. (2000). Speech-like cerebral activity in profoundly deaf people processing signed languages: implications for the neural basis of human language. Proc Natl Acad Sci USA, 97, 13961-13966.
48. Proksch, J. & Bavelier, D. (2002). Changes in the spatial distribution of visual attention after early deafness. J Cogn Neurosci, 14, 687-701.
49. Rosenblum, L.D. & Saldana, H.M. (1996). An audiovisual test of kinematic primitives for visual speech perception. J Exp Psychol Hum Percept Perform, 22, 318-331.
50. Ross, L.A., Saint-Amour, D., Leavitt, V.M., Javitt, D.C. & Foxe, J.J. (2007). Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cerebral Cortex, 17, 1147-1153.
51. Rouger, J., Fraysse, B., Deguine, O. & Barone, P. (2008). McGurk effects in cochlear-implanted deaf subjects. Brain Res, 1188, 87-99.
52. Rouger, J., Lagleyre, S., Fraysse, B., Deneve, S., Deguine, O. & Barone, P. (2007). Evidence that cochlear-implanted deaf patients are better multisensory integrators. Proc Natl Acad Sci USA, 104, 7295-7300.
53. Sadato, N., Okada, T., Honda, M., Matsuki, K., Yoshida, M., Kashikura, K., Takei, W., Sato, T., Kochiyama, T. & Yonekura, Y. (2005). Cross-modal integration and plastic changes revealed by lip movement, random-dot motion and sign languages in the hearing and deaf. Cereb Cortex, 15, 1113-1122.
54. Saito, D.N., Yoshimura, K., Kochiyama, T., Okada, T., Honda, M. & Sadato, N. (2005). Cross-modal binding and activated attentional networks during audio-visual speech integration: a functional MRI study. Cereb Cortex, 15, 1750-1760.
55. Schorr, E.A., Fox, N.A., van Wassenhove, V. & Knudsen, E.I. (2005). Auditory-visual fusion in speech perception in children with cochlear implants. Proc Natl Acad Sci USA, 102, 18748-18750.
56. Sekiyama, K., Kanno, I., Miura, S. & Sugita, Y. (2003). Auditory-visual speech perception examined by fMRI and PET. Neurosci Res, 47, 277-287.
57. Shannon, R.V. (2007). Understanding hearing through deafness. Proc Natl Acad Sci USA, 104, 6883-6884.
58. Skipper, J.I., Nusbaum, H.C. & Small, S.L. (2005). Listening to talking faces: motor cortical activation during speech perception. Neuroimage, 25, 76-89.
59. Strelnikov K., Rouger J., Lagleyre S., Fraysse B., Deguine O. & Barone P., Improvement in speech-reading by auditory training: Evidence from gender differences in normally hearing, deaf and cochlear implanted subjects. Neuropsychologia, 47, 972-979.
60. Teder-Sälejärvi, W.A., McDonald, J.J., Di Russo, F. & Hillyard, S.A. (2002). An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Brain Res Cogn Brain Res, 14, 106-114.
61. Tremblay, C., Champoux, F., Voss, P., Bacon, B.A., Lepore, F. & Théoret, H. (2007). Speech and non-speech audio-visual illusions: a developmental study. PLoS ONE, 15, e742.
62. Tyler, R., Parkinson, A.J., Fryauf-Bertchy, H., Lowder, M.W., Parkinson, W.S., Gantz, B.J. & Kelsay, D.M. (1997). Speech perception by prelingually deaf children and postlingually deaf adults with cochlear implant. Scand Audiol Suppl, 46, 65-71.
63. Tyler, R.S., Parkinson, A.J., Woodworth, G.G., Lowder, M.W. & Gantz, B.J. (1997). Performance over time of adult patients using the Ineraid or nucleus cochlear implant. J Acoust Soc Am, 102, 508-522.
64. van Wassenhove, V., Grant, K.W. & Poeppel, D. (2005). Visual speech speeds up the neural processing of auditory speech. Proc Natl Acad Sci USA, 102, 1181-1186.
65. Wong, D., Miyamoto, R.T., Pisoni, D.B., Sehgal, M. & Hutchins, G.D. (1999). PET imaging of cochlear-implant and normal-hearing subjects listening to speech and nonspeech. Hear Res, 132, 34-42.
66. Zekveld, A.A., Kramer, S.E., Vlaming, M.S. & Houtgast, T. (2008). Audiovisual perception of speech in noise and masked written text. Ear Hear, 29, 99-111.