Audiovisual perception of speech in noise and masked written text

Ear and Hearing

Volumn 29, Issue 1, 2008, Pages 99-111

  Zekveld, Adriana A ^a   Kramer, Sophia E ^a   Vlaming, Marcel S M G ^a   Houtgast, Tammo ^a  

^a VU UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; CLINICAL ARTICLE; COMPREHENSION; FEMALE; HUMAN; MALE; MASKING; NOISE; SPEECH AUDIOMETRY; SPEECH PERCEPTION; VISUAL INFORMATION; VISUAL STIMULATION;

ADULT; AUDITORY PERCEPTION; AUDITORY THRESHOLD; FEMALE; HUMANS; MALE; NOISE; PERCEPTUAL MASKING; READING; SPEECH PERCEPTION; VISUAL PERCEPTION;

EID: 37649011154     PISSN: 01960202     EISSN: None     Source Type: Journal    
DOI: 10.1097/AUD.0b013e31815d6d8d     Document Type: Article

References (36)

1. Becker, C. A., & Killion, T. H. (1977). Interaction of visual and cognitive effects in word recognition. Journal of Experimental Psychology: Human Perception and Performance, 3, 389-401.
2. Beskow, J., Karlsson, I., Kewley, J., & Salvi, G. (2004). SYNFACE - a talking head telephone for the hearing-impaired. In K. Miesenberger, J. Klaus, W. Zagler, & D. Burger (Eds.), Computers helping people with special needs, 8th International Conference, ICCHP, 2002 (pp. 1178-1186). Berlin: Springer.
3. Blamey, P. J., Cowan, R. S. C., Alcantara, J. I., Whitford, L. A., & Clark, G. M. (1989). Speech perception using combinations of auditory, visual, and tactile information. Journal of Rehabilitation Research, 26, 15-24.
4. Danan, M. (1992). Reversed subtitling and dual coding theory: new directions for foreign language instruction. Language Learning, 42, 497-527.
5. Duchnowski, P., Braida, L., Lum, D., Sexton, M., Krause, J., & Banthia, S. (1998). Automatic generation of cued speech for the deaf: status and outlook. In Proceedings of the international conference on auditory-visual speech processing. Australia: Terrigal.
6. Duchnowski, P., Lum, D. S., Krause, J. C., Sexton, M. G., Bratakos, M. S., & Braida, L. D. (2000). Development of speechreading supplements based on automatic speech recognition. IEEE Transactions on Biomedical Engineering, 47, 487-496.
7. Frost, R., & Katz, L. (1989). Orthographic depth and the interaction of visual and auditory processing in word recognition. Memory and Cognition, 17, 302-310.
8. Frost, R., Repp, B. H., & Katz, L. (1988). Can speech detection be influenced by the simultaneous presentation of print? Journal of Memory and Language, 27, 741-755.
9. Gordon, P. C. (2000). Masking protection in the perception of auditory objects. Speech Communication, 30, 197-206.
10. Grant, K. W., & Seitz, P. -F. (1998). Measures of auditory-visual integration in nonsense syllables and sentences. The Journal of the Acoustical Society of America, 104, 2438-2450.
11. Grant, K. W., & Seitz, P.-F. (2000). The use of visible speech cues for improving auditory detection of spoken sentences. The Journal of the Acoustical Society of America, 108, 1197-1208.
12. Grant, K. W., Walden, B. E., & Seitz, P.-F. (1998). Auditory-visual speech recognition by hearing-impaired subjects: consonant recognition, sentence recognition, and auditory-visual integration. The Journal of the Acoustical Society of America, 103, 2677-2690.
13. Hagerman, B. (2002). Speech recognition threshold in slightly and fully modulated noise for hearing-impaired subjects. International Journal of Audiology, 41, 321-329.
14. Humes, L. E. (2005). Do 'auditory processing' tests measure auditory processing in the elderly? Ear and Hearing, 26, 109-119.
15. International Organization for Standardization. (1991). Acoustics - standard reference zero for the calibration of puretone air conduction audiometers. Geneva, Switzerland: International Organization for Standardization.
16. Ishihara, S. (1989). The series of plates designed as a test for colour deficiency. Tokyo: Kanehara.
17. Larsby, B., Hällgren, M., Lyxell, B., & Arlinger, S. (2005). Cognitive performance and perceived effort in speech processing tasks: effects of different noise backgrounds in normalhearing and hearing-impaired subjects. International Journal of Audiology, 44, 131-143.
18. Leitch, D., & MacMillan, T. (2003). Liberated Learning Initiative. Innovative technology and inclusion: current issues and future directions for Liberated Learning Research. Year IV Research Report on the Liberated Learning Initiative.
19. Levitt, H. (1995). Processing of speech signals for physical and sensory disabilities. Proceedings of the National Academy of Sciences of the United States of America, 92, 9999-10006.
20. Lunner, T. (2003). Cognitive function in relation to hearing aid use. International Journal of Audiology, 42, S49-S58.
21. Mangold, H. (1988). Principles of automatic processing of speech signals and their application in medical technology and for aids for handicapped. Medical Progress through Technology, 14, 39-56.
22. Massaro, D. W., & Light, J. (2004). Using visible speech to train perception and production of speech for individuals with hearing loss. Journal of Speech, Language, and Hearing Research, 47, 304-320.
23. Meyer, D. E., Schvaneveldt, R. W., & Ruddy, M. G. (1975). Loci of contextual effects on visual word-recognition. In P. M. A. Rabbitt & S. Dornid (Eds.), Attention and performance V (pp. 98-118). London: Academic Press.
24. Pallett, D. S. (2003). A look at NIST's benchmark ASR tests: past, present, and future. In Proceedings of the workshop automatic speech recognition and understanding (pp. 483-488).
25. Pichora-Fuller, M. K., Schneider, B. A., & Daneman, M. (1995). How young and old adults listen to and remember speech in noise. The Journal of the Acoustical Society of America, 97, 593-608.
26. Plomp, R., & Mimpen, A. M. (1979). Improving the reliability of testing the speech reception threshold for sentences, Audiology, 18, 43-52.
27. Ross, L. A., Saint-Amour, D., Leavitt, V. M., Javitt, D. C., & Foxe, J. J. (2006). Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cerebral Cortex, 17, 1147-1153.
28. Siciliano, C., Faulkner, A., & Williams, G. (2003). Lipreadability of a synthetic talking face in normal hearing and hearing-impaired listeners. In Proceedings of the auditory-visual speech processing workshop (pp. 205-208). St Jorioz, France.
29. Sommers, M. S., Tye-Murray, N., & Spehar, B. (2005). Auditory-visual speech perception and auditory-visual enhancement in normal-hearing younger and older adults. Ear and Heraing, 26, 263-275.
30. Van Diepen, P. M. J., & d'Ydewalle, G. (1997). Bewegende vensters en maskeringen tijdens scèneperceptie. Nederlands Tijdschrift voor de Psychologie, 52, 1-9.
31. Versfeld, N. J., Daalder, L., Festen, J. M., & Houtgast, T. (2000). Method for the selection of sentence materials for efficient measurement of the speech reception threshold. The Journal of the Acoustical Society of America, 107, 1671-1684.
32. Wagenaar, W. A., Varey, C. A. & Hudson, P. T. (1984). Do audiovisuals aid? A study of bisensory presentation on the recall of information. In H. Bouma & D. G. Bouwhuis (Eds.), Attention and performance: X (pp. 379-391). Lawrence Erlbaum Associates.
33. Watsin, C. S., & Kidd, G. R. (2002). On the lack of association between basic auditory abilities, speech processing, and other cognitive skills. Seminars in Hearing, 23, 83-93.
34. Watson, C. S., Qiu, W. W., Chamberlain, M. M., & Li, X. (1996). Auditory and visual perception: Confirmation of a modality-independent source of individual differences in speech recognition. The Journal of the Acoustical Society of America, 100, 1153-1162.
35. Woodcock, K. (1997). Ergonomics and automatic speech recognition applications for deaf and hard-of-hearing users. Technology and Disability, 7, 147-164.
36. Zekveld, A. A., George, E. L. J., Kramer, S. E., Goverts, S. T., & Houtgast, T. (2007). The development of the Text Reception Threshold test: A visual analogue of the Speech Reception Threshold test. Journal of Speech, Language, and Hearing Research, 50, 576-584.