The effects of auditory-visual vowel identification training on speech recognition under difficult listening conditions

Journal of Speech, Language, and Hearing Research

Volumn 51, Issue 6, 2008, Pages 1607-1619

  Richie, Carolyn ^a,b   Kewley Port, Diane ^a  

^a INDIANA UNIVERSITY   (United States)

^b BUTLER UNIVERSITY   (United States)

Author keywords

Auditory visual; Speech perception; Vowels

Indexed keywords

ADULT; ARTICLE; AUDITORY DISCRIMINATION; CLINICAL ARTICLE; COMPUTER SYSTEM; CONTROLLED STUDY; FEMALE; HEARING LOSS; HUMAN; MALE; NOISE; SPEECH DISCRIMINATION; SPEECH PERCEPTION; TRAINING; VISUAL DISCRIMINATION; VOWEL; WORD RECOGNITION;

ADULT; AUDITORY PERCEPTION; DISCRIMINATION (PSYCHOLOGY); FEMALE; HUMANS; MALE; NOISE; PHONETICS; RECOGNITION (PSYCHOLOGY); SPEECH PERCEPTION; TEACHING; VISUAL PERCEPTION;

EID: 56849134311     PISSN: 10924388     EISSN: None     Source Type: Journal    
DOI: 10.1044/1092-4388(2008/07-0069)     Document Type: Article

References (55)

1. Ades, A. E. (1977). Theoretical notes: Vowels, consonants, speech, and nonspeech. Psychological Review, 84, 524-530.
2. Andersson, U., & Lidestam, B. (2005). Bottom-up driving speechreading in a speechreading expert: The case of AA (JK023). Ear and Hearing, 26, 214-224.
3. Berger, K. (1970). Vowel confusions in auditory-visual speech perception. The Ohio Journal of Speech and Hearing, 5, 123-128.
4. Bernstein, L. E., Demorest, M. E., Coulter, D. C., & O'Connell, M. P. (1991). Lipreading sentences with vibrotactile vocoders: Performance of normal-hearing and hearing-impaired subjects. The Journal of the Acoustical Society of America, 90, 2971-2984.
5. Bernstein, L. E., Demorest, M. E., & Tucker, P. E. (2000). Speech perception without hearing. Perception & Psychophysics, 62, 233-252.
6. Bernstein, L., & Eberhardt, S. (1986). Johns Hopkins Lipreading Corpus I-II [Videodisc]. Baltimore: Johns Hopkins University.
7. Binnie, C. (1977). Attitude changes following auditory-visual speech perception training. Scandinavian Audiology, 6, 13-19.
8. Black, J., O'Reilly, P., & Peck, L. (1963). Self-administered training in lipreading. Journal of Speech and Hearing Disorders, 28, 183-186.
9. Burkle, Z., Kewley-Port, D., Humes, L., & Lee, J. (2004). Contribution of consonant versus vowel information to sentence intelligibility by normal and hearing-impaired listeners. The Journal of the Acoustical Society of America, 115, 2601.
10. Cole, R., Yan, Y., Mak, B., Fanty, M., & Bailey, T. (1996). The contribution of consonants versus vowels to word recognition in fluent speech. In Proceedings of the 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing (Vol. 2, pp. 853-856), Atlanta, GA.
11. Davis, H., & Silverman, S. (1970). Hearing and deafness (3rd ed.). New York: Holt, Rinehart, and Winston.
12. De Filippo, C. L. (1984). Laboratory projects in tactile aids to lipreading. Ear and Hearing, 5, 211-227.
13. Diehl, R. L., Kluender, K. R., Foss, D. J., Parker, E. M., & Gernsbacher, M. A. (1987). Vowels as islands of reliability. Journal of Memory and Language, 26, 564-573.
14. Eberhardt, S. P., Bernstein, L. E., Demorest, M. E., & Goldstein, M. H. (1990). Speechreading sentences with single-channel vibrotactile presentation of voice fundamental frequency. The Journal of the Acoustical Society of America, 88, 1274-1285.
15. Erber, N. (1969). Interaction of audition and vision in the recognition of oral speech stimuli. Journal of Speech and Hearing Research, 12, 423-425.
16. Fisher, C. (1968). Confusions among visually perceived consonants. Journal of Speech and Hearing Research, 11, 796-800.
17. Gagné, J. (1994). Visual and audiovisual speech perception training: Basic and applied research needs. Journal of the Academy of Rehabilitative Audiology, XXVII(Suppl. 1), 133-159.
18. Garofolo, J., Lamel, L., Fisher, W., Fiscus, J., Pallett, D., & Dahlgren, N. (1990). DARPA TIMIT acoustic-phonetic continuous speech corpus [CD-ROM]. Gaithersburg, MD: National Institute of Standards and Technology.
19. Gesi, A., Massaro, D., & Cohen, M. (1992). Discovery and expository method in teaching visual consonant and word identification. Journal of Speech and Hearing Research, 35, 1180-1188.
20. Grant, K., &Walden, B. (1995, August). Predicting auditory-visual speech recognition in hearing-impaired listeners. Paper presented at the 13th International Congress of Phonetic Sciences, Stockholm, Sweden.
21. Grant, K., Walden, B., & Seitz, P. (1998). Auditory-visual speech recognition by hearing-impaired subjects: Consonant recognition, sentence recognition, and auditory-visual integration. The Journal of the Acoustical Society of America, 103, 2677-2690.
22. Hack, Z., & Erber, N. (1982). Auditory, visual, and auditory-visual perception of vowels by hearing-impaired children. Journal of Speech and Hearing Research, 25, 100-107.
23. Heider, F., & Heider, G. (1940). An experimental investigation of lipreading. Psychological Monographs, 52, 124-153.
24. Humes, L., Dirks, D., Bell, T., & Kincaid, G. (1987). Recognition of nonsense syllables by hearing-impaired listeners and by noise-masked normal hearers. The Journal of the Acoustical Society of America, 81, 765-773.
25. Hutton, C. (1959). Combining auditory and visual stimuli in aural rehabilitation. The Volta Review, 61, 316-319.
26. Jackson, P., Montgomery, A., & Binnie, C. (1976). Perceptual dimensions underlying vowel lipreading performance. Journal of Speech and Hearing Research, 19, 796-812.
27. Kewley-Port, D., Burkle, T., & Lee, J. (2007). Contribution of consonant versus vowel information to sentence intelligibility for young normal-hearing and elderly hearingimpaired listeners. The Journal of the Acoustical Society of America, 122, 2365-2375.
28. 0. The Journal of the Acoustical Society of America, 100, 593-602.
29. Lee, H., Rayner, K., & Pollatsek, A. (2001). The relative contribution of consonants and vowels to word recognition during reading. Journal of Memory and Language, 44, 189-205.
30. Lesner, S., Sandridge, S., & Kricos, P. (1987). Training influences on visual consonant and sentence recognition. Ear and Hearing, 8, 283-287.
31. Liberman, A., Cooper, F., Shankweiler, D., & Studdert-Kennedy, M. (1967). Perception of the speech code. Psychological Review, 74, 431-461.
32. MacLeod, A., & Summerfield, Q. (1987). Quantifying the contribution of vision to speech perception in noise. British Journal of Audiology, 21, 131-141.
33. Mansfield, J. S., Legge, G. E., Luebker, A., & Cunningham, K. (1994). The MNRead Acuity Charts. New York: Light-house Low Vision Products.
34. Massaro, D., Cohen, M., & Gesi, A. (1993). Long-term training, transfer and retention in learning to lipread. Perception and Psychophysics, 53, 549-562.
35. McGrath, M., Summerfield, Q., & Brooke, M. (1984). Roles of lips and teeth in lipreading vowels. Proceedings of the Institute of Acoustics, 6, 401-408.
36. Mohammed, T., Campbell, R., MacSweeney, M., Milne, E., Hansen, P., & Coleman, M. (2005). Speechreading skill and visual movement sensitivity are related in deaf speech-readers. Perception, 34, 205-216.
37. Montgomery, A., Walden, B., Schwartz, D., & Prosek, R. (1984). Training auditory-visual speech reception in adults with sensorineural hearing loss. Ear and Hearing, 5, 30-36.
38. O'Neill, J. (1954). Contributions of the visual components of oral symbols to speech comprehension. Journal of Speech and Hearing Disorders, 19, 429-439.
39. Prall, J. (1957). Lipreading and hearing aids combine for better comprehension. The Volta Review, 59, 64-65.
40. Richie, C., & Kewley-Port, D. (2003). The effects of auditory and visual vowel training on auditory-visual speech perception performance. The Journal of the Acoustical Society of America, 114, 2337.
41. Richie, C., & Kewley-Port, D. (2005). The effects of auditory-visual vowel and consonant training on auditory-visual speech perception performance. The Journal of the Acoustical Society of America, 117, 2570.
42. Richie, C., Kewley-Port, D., & Coughlin, M. (2003). Discrimination and identification of vowels by young, hearing-impaired adults. The Journal of the Acoustical Society of America, 114, 2923-2933.
43. Robert-Ribes, J., Schwartz, J., Lallouache, T.,&Escudier, P. (1998). Complementarity and synergy in bimodal speech: Auditory, visual, and audio-visual identification of French oral vowels in noise. The Journal of the Acoustical Society of America, 103, 3677-3689.
44. Sanders, D. (1993). Management of hearing handicap: Infants to elderly (3rd ed.). Mahwah, NJ: Prentice-Hall.
45. Sensimetrics Corporation. (2001). Seeing and hearing speech: Lessons in lipreading and listening [CD-ROM]. Somerville, MA: Author.
46. Squires, S. C., & Dancer, J. E. (1986). Auditory versus visual practice effects in the intelligibility of words in everyday sentences. The Journal of Auditory Research, 26, 5-10.
47. Studebaker, G. A. (1985). A "rationalized" arcsine transform. Journal of Speech and Hearing Research, 28, 455-462.
48. Sumby, W., & Pollack, I. (1954). Visual contributions to speech intelligibility in noise. The Journal of the Acoustical Society of America, 26, 212-215.
49. Tillberg, I., Rönnberg, J., Svärd, I., & Ahlner, B. (1996). Audio-visual speechreading in a group of hearing aid users: The effects of onset age, handicap age, and degree of hearing loss. Scandinavian Audiology, 25, 267-272.
50. Tye-Murray, N. (2004). Foundations of aural rehabilitation: Adults, children and their families (2nd ed.). San Diego, CA: Dellmar Publishing.
51. Van Tasell, D., & Hawkins, D. (1981). Effects of guessing strategy on auditory-visual speech perception test scores. American Annals of the Deaf, 126, 840-844.
52. Walden, B., Erdman, S., Montgomery, A., Schwartz, D., & Prosek, R. (1981). Some effects of training on speech recognition by hearing-impaired adults. Journal of Speech and Hearing Research, 24, 207-216.
53. Walden, B., Prosek, R., Montgomery, A., Scherr, C., & Jones, C. (1977). Effects of training on the visual recognition of consonants. Journal of Speech and Hearing Research, 20, 130-145.
54. Warren, Y., Dancer, J., Monfils, B., & Pittenger, J. (1989). The practice effect in speechreading distributed over five days: Same versus different CID sentence lists. The Volta Review, 91, 321-325.
55. White, S., Dancer, J., & Burl, N. (1996). Auditory-visual speech perception and auditory-visual speech perception tests: A survey of rehabilitative audiologists. American Annals of the Deaf, 141, 236-239.