Internet Video Telephony Allows Speech Reading by Deaf Individuals and Improves Speech Perception by Cochlear Implant Users

PLoS ONE

Volumn 8, Issue 1, 2013, Pages

  Mantokoudis, Georgios ^a   Dähler, Claudia ^a   Dubach, Patrick ^a   Kompis, Martin ^a   Caversaccio, Marco D ^a   Senn, Pascal ^a  

^a UNIVERSITY OF BERN   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AGED; ARTICLE; CAMERA; CLINICAL ARTICLE; CLINICAL ASSESSMENT; COCHLEA PROSTHESIS; COMMUNICATION SOFTWARE; FEMALE; HEARING IMPAIRMENT; HUMAN; IMAGE DISPLAY; IMAGE QUALITY; INFORMATION TECHNOLOGY; INTERNET; LIP READING; MALE; SOUND TRANSMISSION; SPEECH DISCRIMINATION; SPEECH PERCEPTION; TELECOMMUNICATION; VIDEORECORDING; VISUAL STIMULATION;

ADOLESCENT; ADULT; CHILD; CHILD, PRESCHOOL; COCHLEAR IMPLANTS; DEAFNESS; FEMALE; HUMANS; INTERNET; MALE; MIDDLE AGED; READING; SPEECH; TELEPHONE;

EID: 84872833019     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0054770     Document Type: Article

References (38)

1. Hellstrom Delevert Revelius (1997) Quality requirements on Videotelephony for Sign Language; Stockholm, Sweden.
2. Bowe FG, (2002) Deaf and hard of hearing Americans' instant messaging and e-mail use: a national survey. Am Ann Deaf 147: 6-10.
3. Dalton DS, Cruickshanks KJ, Klein BE, Klein R, Wiley TL, et al. (2003) The impact of hearing loss on quality of life in older adults. Gerontologist 43: 661-668.
4. Barnett S, Franks P, (1999) Deafness and mortality: analyses of linked data from the National Health Interview Survey and National Death Index. Public Health Rep 114: 330-336.
5. Mantokoudis G, Kompis M, Dubach P, Caversaccio M, Senn P, (2010) How internet telephony could improve communication for hearing-impaired individuals. Otol Neurotol 31: 1014-1021.
6. Mantokoudis G, Dubach P, Pfiffner F, Kompis M, Caversaccio M, et al. (2012) Speech perception benefits of internet versus conventional telephony for hearing-impaired individuals. J Med Internet Res 14: e102.
7. Bergeson TR, Pisoni DB, Davis RA, (2005) Development of audiovisual comprehension skills in prelingually deaf children with cochlear implants. Ear Hear 26: 149-164.
8. Strelnikov K, Rouger J, Barone P, Deguine O, (2009) Role of speechreading in audiovisual interactions during the recovery of speech comprehension in deaf adults with cochlear implants. Scand J Psychol 50: 437-444.
9. Rouger J, Lagleyre S, Fraysse B, Deneve S, Deguine O, et al. (2007) Evidence that cochlear-implanted deaf patients are better multisensory integrators. Proc Natl Acad Sci U S A 104: 7295-7300.
10. Rouger J, Fraysse B, Deguine O, Barone P, (2008) McGurk effects in cochlear-implanted deaf subjects. Brain Res 1188: 87-99.
11. Tremblay C, Champoux F, Lepore F, Theoret H, (2010) Audiovisual fusion and cochlear implant proficiency. Restor Neurol Neurosci 28: 283-291.
12. Farrera MP, Fleury M, Guild K, Ghanbari M, (2010) Measurement and analysis Study of Congestion Detection for Internet Video Streaming. Journal of Communications 5: 169-177.
13. Baskent D, Bazo D, (2011) Audiovisual Asynchrony Detection and Speech Intelligibility in Noise With Moderate to Severe Sensorineural Hearing Impairment. Ear Hear 32: 582-592.
14. Pavel M, Sperling G, Riedl T, Vanderbeek A, (1987) Limits of visual communication: the effect of signal-to-noise ratio on the intelligibility of American Sign Language. J Opt Soc Am A 4: 2355-2365.
15. Hochmair-Desoyer I, Schulz E, Moser L, Schmidt M, (1997) The HSM sentence test as a tool for evaluating the speech understanding in noise of cochlear implant users. Am J Otol 18: S83.
16. ITU-T Handbook on Telephonometry (1992). Geneva: International Telecommunication Union.
17. Lenarz M, Sonmez H, Joseph G, Buchner A, Lenarz T, (2012) Effect of gender on the hearing performance of adult cochlear implant patients. Laryngoscope 122: 1126-1129.
18. Lenarz M, Sonmez H, Joseph G, Buchner A, Lenarz T, (2012) Long-term performance of cochlear implants in postlingually deafened adults. Otolaryngol Head Neck Surg 147: 112-118.
19. Wu YH, Bentler RA, (2010) Impact of visual cues on directional benefit and preference: Part I-laboratory tests. Ear Hear 31: 22-34.
20. Wu YH, Bentler RA, (2010) Impact of visual cues on directional benefit and preference: Part II-field tests. Ear Hear 31: 35-46.
21. Erber NP, (1969) Interaction of audition and vision in the recognition of oral speech stimuli. J Speech Hear Res 12: 423-425.
22. Frowein HW, Smorrenburg GF, Pyters L, Schinkel D, (1991) Improved speech recognition through videotelephony: experiments with the hard of hearing. IEEE Journal on Selected Areas in Communications 9: 611-616.
23. Ross LA, Saint-Amour D, Leavitt VM, Javitt DC, Foxe JJ, (2007) Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb Cortex 17: 1147-1153.
24. Alegria J, Lechat J, (2005) Phonological processing in deaf children: when lipreading and cues are incongruent. J Deaf Stud Deaf Educ 10: 122-133.
25. Luettin J. Towards Speaker Independent Continuous Speechreading; 1997 22-25 September; Rhodes, Greece. EUROSPEECH. 1991-1994.
26. Bavelier D, Dye MW, Hauser PC, (2006) Do deaf individuals see better? Trends Cogn Sci 10: 512-518.
27. Foulds RA, (2004) Biomechanical and perceptual constraints on the bandwidth requirements of sign language. IEEE Trans Neural Syst Rehabil Eng 12: 65-72.
28. ITU-T Recommendations (1999) H-Series: Application profile- Sign language and lip-reading real-time conversation using low bit rate video communication. International Telecommunication Union.
29. De Cicco L, Mascolo S, Palmisano V. Skype Video Responsiveness to Bandwidth Variations; 2008 28/05/2008; Braunschweig, Germany.
30. Cavender A, Vanam R, Barney DK, Ladner RE, Riskin EA, (2008) MobileASL: intelligibility of sign language video over mobile phones. Disabil Rehabil Assist Technol 3: 93-105.
31. Ciaramello F, Hemami S, (2011) A computational intelligibility model for assessment and compression of American Sign Language video. IEEE Trans Image Process 20: 3014-3027.
32. Saxe DM, Foulds RA, (2002) Robust region of interest coding for improved sign language telecommunication. IEEE Trans Inf Technol Biomed 6: 310-316.
33. Skoglund J, Kozica E, Linden J, Hagen R, Kleijn WB (2008) Voice over IP: Speech Transmission over Packet Networks. Handbook of Speech processing. Heidelberg: Springer. 307-330.
34. ITU-T Recommendations (2009) H-Series: Packet-based multimedia communications systems. International Telecommunication Union.
35. Tye-Murray N, Sommers MS, Spehar B, (2007) Audiovisual integration and lipreading abilities of older adults with normal and impaired hearing. Ear Hear 28: 656-668.
36. Champoux F, Lepore F, Gagne JP, Theoret H, (2009) Visual stimuli can impair auditory processing in cochlear implant users. Neuropsychologia 47: 17-22.
37. Summerfield Q, (1992) Lipreading and audio-visual speech perception. Philos Trans R Soc Lond B Biol Sci 335: 71-78.
38. Colonius H, Diederich A (2011) Computing an optimal time window of audiovisual integration in focused attention tasks: illustrated by studies on effect of age and prior knowledge. Exp Brain Res.