The benefit obtained from visually displayed text from an automatic speech recognizer during listening to speech presented in noise

Ear and Hearing

Volumn 29, Issue 6, 2008, Pages 838-852

  Zekveld, Adriana A ^a   Kramer, Sophia E ^a   Kessens, Judith M ^b   Vlaming, Marcel S M G ^a   Houtgast, Tammo ^a  

^a VU UNIVERSITY MEDICAL CENTER   (Netherlands)

^b TNO   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ADULT; ARTICLE; AUDIOVISUAL EQUIPMENT; AUDITORY STIMULATION; AUDITORY THRESHOLD; AUTOMATIC SPEECH RECOGNITION; CONTROLLED STUDY; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MEDICAL TECHNOLOGY; NOISE; NORMAL HUMAN; SCORING SYSTEM; SIGNAL NOISE RATIO; SPEECH AUDIOMETRY; SPEECH DISCRIMINATION; VISUAL STIMULATION; ADOLESCENT; COMMUNICATION AID; HEARING IMPAIRMENT; MIDDLE AGED; PHONETICS; PHOTOSTIMULATION; READING; SPEECH; SPEECH PERCEPTION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; COMMUNICATION AIDS FOR DISABLED; DEAFNESS; FEMALE; HUMANS; MALE; MIDDLE AGED; NOISE; PHONETICS; PHOTIC STIMULATION; READING; SPEECH; SPEECH PERCEPTION; SPEECH RECEPTION THRESHOLD TEST; SPEECH RECOGNITION SOFTWARE; YOUNG ADULT;

EID: 59149105727     PISSN: 01960202     EISSN: None     Source Type: Journal    
DOI: 10.1097/AUD.0b013e31818005bd     Document Type: Article

References (41)

1. Burnham, D., Robert-Ribes, J., & Ellison, R. (1998). Why captions have to be on time. International Conference in Audiovisual Speech Processing. (pp. 153-156). ISBN 0-643-063951.
2. Bratakos, M. S., Duchnowski, P., & Braida, L. D. (1998). Toward the automatic generation of Cued Speech. Cued Speech J, 6, 1-37.
3. Duchnowski, P., Lum, D. S., Krause, J. C., et al. (2000). Development of speechreading supplements based on automatic speech recognition. IEEE Trans Biomed Eng, 47, 487-496. (Pubitemid 30187518)
4. d'Ydewalle, G., Praet, C., Verfaille, K., et al. (1991). Watching subtitled television. Automatic reading behavior. Commun Res, 18, 650-666.
5. Elliot, L., Foster, S., & Stinson, M. (2002). Student study habits using notes from a speech-to-text support service. Exceptional Children, 69, 25-40.
6. Feng, J., & Sears, A. (2004). Using confidence scores to improve hands-free speech based navigation in continuous dictation systems. ACM Trans Comput Hum Interact, 11, 329-356. (Pubitemid 40006197)
7. Fiscus, J., Garofolo, J., Lee, A., et al. (2004). Results of the fall 2004 SST and MDE Evaluation. In DARPA Rich Transcription Workshop. Palisades, NY.
8. Hacioglu, K., & Ward, W. (2002). A concept graph based confidence measure. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing. (pp. I225-I228). Orlando, FL. (Pubitemid 34710271)
9. Huggins, A., Houde, R., & Colwell, E. (1986). Vidvox human factors investigation (technical report 6187). Cambridge, MA: BBN Laboratories.
10. Hygge, S., Rönnberg, J., Larsby, B., et al. (1992). Normal-hearing and hearing-impaired subjects' ability to just follow conversation in competing speech, reversed speech, and noise backgrounds. J Speech Hearing Res, 35, 208-215.
11. International Organization for Standardization. (1991). Acoustics - standard reference zero for the calibration of puretone air conduction audiometers. Geneva, Switzerland: International Organization for Standardization.
12. Kingsbury, B., Mangu, L., Saon, G., et al. (2003). Toward domain-independent conversational speech recognition. In Proceedings of the 8th European Conference on Speech Communication and Technology (Eurospeech). (pp. 1881-1884). Geneva, Switzerland.
13. Kramer, S. E., Kapteyn, D. S., Festen, J. M., et al. (1997). Assessing aspects of auditory handicap by means of pupil dilatation. Audiology, 36, 155-164. (Pubitemid 27254859)
14. Kurzweil, R. (1999). The age of the spiritual machine. New York, NY: Viking.
15. Lamel, L., & Gauvain, J. L. (1993). High performance speaker-independent phone recognition using CDHMM. Proc Eurospeech, 93, 121-124.
16. Larsby, B., Hällgren, M., Lyxell, B., et al. (2005). Cognitive performance and perceived effort in speech processing tasks: effects of different noise backgrounds in normal-hearing and hearing-impaired subjects. Int J Audiol, 44, 131-143.
17. Leitch, D., & MacMillan, T. (2003). Innovative technology and inclusion: current issues and future directions for Liberated Learning Research. Year IV Research Report on the Liberated Learning Initiative, Liberated Learning Project, Saint Mary's University, Halifax, Nova Scotia, Canada.
18. Levitt, H. (1995). Processing of speech signals for physical and sensory disabilities. Proc Natl Acad Sci, 99, 9999-10006.
19. MacLeod, A., & Summerfield, Q. (1987). Quantifying the contribution of vision to speech perception in noise. Br J Audiol, 21, 131-141. (Pubitemid 17120189)
20. Maruyama, I., Abe, Y., Sawamura, E., et al. (1999). Cognitive experiments on timing lag for superimposing closed captions. Proceedings of the Sixth European Conference on Speech Communication and Technology (EUROSPEECH'99), 575-578.
21. Massaro, D. W., & Light, J. (2004). Using visible speech to train perception and production of speech for individuals with hearing loss. J Speech Lang Hear Res, 47, 304-320.
22. Middelweerd, M. J., & Plomp, R. (1987). The effect of speechreading on the speech-reception threshold of sentences in noise. J Acoust Soc Am, 82, 2145-2147.
23. Ordelman, R. J. F. (2003). Dutch speech recognition in multimedia information retrieval. Ph.D. thesis, University of Twente, Centre for Telematics and Information Technology.
24. Pallett, D. S. (2003). A look at NIST's benchmark ASR tests: past, present, and future. In Proceedings of the Workshop Automatic Speech Recognition and Understanding. St. Thomas, Virgin Islands, USA. (pp. 483-488).
25. Pellom, B., & Hacioglu, K. (2003). Recent improvements in the CU SONIC ASR system for noisy speech: the SPINE task. In Proceedings of ICASSP'03. Hong Kong.
26. Pellom, B. (2001). SONIC: The University of Colorado Continuous Speech Recognizer, Technical Report TR-CSLR-2001-2101 University of Colorado.
27. Pichora-Fuller, M. K., Schneider, B. A., & Daneman, M. (1995). How young and old adults listen to and remember speech in noise. J Acoust Soc Am, 97, 593-608.
28. Plomp, R., & Mimpen, A. M. (1979). Improving the reliability of testing the speech reception threshold for sentences. Audiology, 18, 43-52. (Pubitemid 9111887)
29. Riccardi, G., & Hakkani-Tür, D. (2003). Active and unsupervised learning for automatic speech recognition. In Proceedings of the 7th European Conference on Speech Communication and Technology (Eurospeech). (pp. 1825-1828). Geneva, Switzerland.
30. Ross, L. A., Saint-Amour, D., Leavitt, V. M., et al. (2006). Do you see what I amsaying? Exploring visual enhancement of speech comprehension in noisy environments. Cerebr Cortex, 17, 1147-1153. (Pubitemid 46598855)
31. Shum, B., Myers, B., & Waibel, A. (2001). Multimodal error correction for speech user interfaces. ACM Trans Comput Hum Interact, 8, 60-98.
32. Siciliano, C., Faulkner, A., & Williams, G. (2003). Lipreadability of a synthetic talking face in normal hearing and hearing-impaired listeners. In Proceedings of the Auditory-Visual Speech Processing Workshop (pp. 205-208). St Jorioz, France.
33. Stinson, M., Eisenberg, S., Horn, C., et al. (1999). Real-time speech-to-text services: a report of the National Task Force on Quality of Services in the Postsecondary Education of Deaf and Hard of Hearing Students. Rochester, NY: Northeast Technical Assistance center, Rochester Institute of Technology. (ERIC Document Reproduction Service No. ED 441 296).
34. Strik, H., Cucchiarini, C., & Kessens, J. M. (2001). Comparing the performance of two CSRs: how to determine the significance level of the differences. Proceedings of Eurospeech, 3. (pp. 2091-2094). Aalborg, Denmark.
35. Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. J Acoust Soc Am, 25, 212-215.
36. Tye-Murray, N., Sommers, M. S., & Spehar, B. (2007). Audiovisual integration and lipreading abilities of older adults with normal and impaired hearing. Ear Hear, 28, 656-668. (Pubitemid 47360999)
37. Versfeld, N. J., Daalder, L., Festen, J. M., et al. (2000). Method for the selection of sentence materials for efficient measurement of the speech reception threshold. J Acoust Soc Am, 107, 1671-1684. (Pubitemid 30141708)
38. Wells, J. C., (1997). SAMPA computer readable phonetic alphabet. In D. Gibbon, R. Moore, & R. Winski, R. (Eds.), Handbook of standards and resources for spoken language systems (Part IV, section B). Berlin and New York: Mouton de Gruyter.
39. Whittaker, S., Hirschberg, J., Amento, B., et al. (2002). SCANMail: a voicemail interface that makes speech browsable, readable and searchable. Proceedings of ACM Conference on Human Factors in Computing. (pp. 275-282) New York, NY: ACM Press.
40. Woodcock, K. (1997). Ergonomics and automatic speech recognition applications for deaf and hard-of-hearing users. Technol Disabil, 7, 147-164.
41. Zekveld, A. A., Kramer, S. E., Vlaming, S. M. G., et al. (2008). Audiovisual perception of speech in noise and masked written text. Ear Hear, 29, 99-111.