Talker and lexical effects on audiovisual word recognition by adults with cochlear implants

Journal of Speech, Language, and Hearing Research

Volumn 46, Issue 2, 2003, Pages 390-404

  Kaiser, Adam R ^a   Kirk, Karen Iler ^a   Lachs, Lorin ^b   Pisoni, David B ^b  

^a INDIANA UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b INDIANA UNIVERSITY   (United States)

Author keywords

Audiovisual; Cochlear implants; Hearing impairment; Speech perception

Indexed keywords

ADULT; AGED; ARTICLE; ASSOCIATION; AUDITORY RESPONSE; AUDITORY STIMULATION; CLINICAL ARTICLE; CONTROLLED STUDY; CONVERSATION; HEARING IMPAIRMENT; HUMAN; HUMAN EXPERIMENT; IMPLANTATION; LIP READING; SPEECH PERCEPTION; STIMULUS RESPONSE; TASK PERFORMANCE; VISUAL STIMULATION; WORD RECOGNITION;

ADULT; AGED; ANALYSIS OF VARIANCE; CASE-CONTROL STUDIES; COCHLEAR IMPLANTS; CUES; DEAFNESS; FEMALE; HEARING IMPAIRED PERSONS; HUMANS; MALE; MIDDLE AGED; SPEECH PERCEPTION;

EID: 0037390684     PISSN: 10924388     EISSN: None     Source Type: Journal    
DOI: 10.1044/1092-4388(2003/032)     Document Type: Article

References (53)

1. Bernstein, L. E., Demorest, M. E., & Tucker, P. E. (2000). Speech perception without hearing. Perception & Psychophysics, 62, 233-252.
2. Bernstein, L. E., Edward T., Auer, J., & Tucker, P. E. (2001). Enhanced speechreading in deaf adults: Can short-term training/practice close the gap for hearing adults? Journal of Speech, Language, and Hearing Research, 44, 5-18.
3. Bradlow, A. R., Akahne-Yamada, R., Pisoni, D. B., & Tohkura, Y. (1999). Training Japanese listeners to identify English/r/and/l/: Long-term retention of learning perception and production. Perception & Psychophysics, 61, 977-985.
4. Bradlow, A. R., & Pisoni, D. B. (1999). Recognition of spoken words by native and non-native listeners: Talker-, listener-, and item-related factors. Journal of the Acoustical Society of America, 106, 2074-2085.
5. Creelman, C. D. (1957). Case of the unknown talker [Abstract]. Journal of the Acoustical Society of America, 29, 655.
6. Demorest, M. E., & Bernstein, L. E. (1992). Sources of variability on speechreading sentences: A generalizability analysis. Journal of Speech and Hearing Research, 35, 876-891.
7. Dorman, M. F., Dankowski, K., McCandless, G., Parkin, J. L., & Smith, L. B. (1991). Vowel and consonant recognition with the aid of a multichannel cochlear implant. Quarterly Journal of Experimental Psychology, 43, 585-601.
8. Dorman, M. F., Loizou, P. C., Fitzke, J., & Tu, Z. (1998). The recognition of sentences in noise by normal-hearing listeners using simulations of cochlear-implant signal processors with 6-20 channels. Journal of the Acoustical Society of America, 104, 3583-3596.
9. Dorman, M. F., Loizou, P. C., Kemp, L. L., & Kirk, K. I. (2000). Word recognition by children listening to speech processed into a small number of channels: Data from normal-hearing children and children with cochlear implants. Ear and Hearing, 21, 590-596.
10. Erber, N. P. (1972). Auditory, visual and auditory-visual recognition of consonants by children with normal and impaired hearing. Journal of Speech and Hearing Research, 15, 413-422.
11. Erber, N. P. (1975). Auditory-visual perception of speech. Journal of Speech and Hearing Disorders, 40, 481-492.
12. Fowler, C. A. (1986). An event approach to the study of speech perception from a direct-realist perspective. Journal of Phonetics, 14, 3-28.
13. Fowler, C. A., & Dekle, D. J. (1991). Listening with eye and hand: Cross-modal contributions to speech perception. Journal of Experimental Psychology: Human Perception and Performance, 17, 816-828.
14. Fryauf-Bertschy, H., Tyler, R. S., Kelsay, D. M. R., Gantz, B., & Woodworth, G. (1997). Cochlear implant use by prelingually deafened children: The influences of age at implant and length of device use. Journal of Speech, Language, and Hearing Research, 40, 183-199.
15. Gaver, W. W. (1993). What in the world do we hear?: An ecological approach to auditory event perception. Ecological Psychology, 5(1), 1-29.
16. Grant, K. W., & Seitz, P. F. (1998). Measures of auditory-visual integration in nonsense syllables and sentences. Journal of the Acoustical Society of America, 104, 2438-2450.
17. Grant, K. W., Walden, B. E., & Seitz, P. F. (1998). Auditory-visual speech recognition by hearing-impaired subjects: Consonant recognition, sentence recognition, and auditory-visual integration. Journal of the Acoustical Society of America, 103, 2677-2690.
18. Kirk, K. I. (2000). Challenges in the clinical investigation of cochlear implant outcomes. In J. K. Niparko, K. I. Kirk, N. K. Mellon, A. M. Robbins, D. L. Tucci, & B. S. Wilson (Eds.), Cochlear implants: Principles and practices (pp. 225-259). Philadelphia: Lippincott Williams & Wilkins.
19. Kirk, K. I., Pisoni, D. B., & Miyamoto, R. C. (1997). Effects of stimulus variability on speech perception in listeners with hearing impairment. Journal of Speech and Hearing Research, 40, 1395-1405.
20. Kucera, F., & Francis, W. (1967). Computational analysis of present day American English. Providence, RI: Brown University Press.
21. Lachs, L. (1996). Static vs. dynamic faces as retrieval cues in recognition of spoken words. In Research on spoken language processing (Progress Report No. 22, pp. 141-177). Bloomington: Indiana University, Department of Psychology, Speech Research Laboratory.
22. Lachs, L. (1999). A voice is a face is a voice. In Research on spoken language processing (Progress Report No. 23, pp. 81-118). Bloomington: Indiana University, Department of Psychology, Speech Research Laboratory.
23. Lachs, L., & Hernández, L. R. (1998). Update: The Hoosier Audiovisual Multitalker Database. In Research on spoken language processing (Progress Report No. 22, pp. 377-388). Bloomington: Indiana University, Department of Psychology, Speech Research Laboratory.
24. Lachs, L., Pisoni, D. B., & Kirk, K. I. (2001). Use of audiovisual information in speech perception by prelingually deaf children with cochlear implants: A first report. Ear and Hearing, 22(2), 236-251.
25. Liberman, A. M., Cooper, F. S., Shankweiler, D. P., & Studdert-Kennedy, M. (1967). Perception of the speech code. Psychological Review, 74, 431-461.
26. Luce, P. A., & Pisoni, D. B. (1998). Recognizing spoken words: The neighborhood activation model. Ear and Hearing, 19, 1-36.
27. Massaro, D. W., & Cohen, M. M. (1995). Perceiving talking faces. Current Directions in Psychological Science, 4(4), 104-109.
28. Massaro, D. W., & Cohen, M. M. (1999). Speech perception in perceivers with hearing loss: Synergy of multiple modalities. Journal of Speech, Language, and Hearing Research, 42, 21-41.
29. Massaro, D. W., & Cohen, M. M. (2000). Tests of auditory-visual integration efficiency within the framework of the fuzzy logical model of perception. Journal of the Acoustical Society of America, 108, 784-789.
30. McGurk, H., & MacDonald, J. W. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
31. Mullennix, J. W., & Pisoni, D. B. (1990). Stimulus variability and processing dependencies in speech perception. Perception & Psychophysics, 47, 379-390.
32. Mullennix, J. W., Pisoni, D. B., & Martin, C. S. (1989). Some effects of talker variability on spoken word recognition. Journal of the Acoustical Society of America, 85, 365-378.
33. Nusbaum, H. C., Pisoni, D. B., & Davis, C. K. (1984). Sizing up the Hoosier mental lexicon: Measuring the familiarity of 20,000 words. In Research on speech perception (Progress Report No. 10, pp. 357-376). Bloomington: Indiana University, Department of Psychology, Speech Research Laboratory.
34. Nygaard, L. C., & Pisoni, D. B. (1995). Talker- and task-specific perceptual learning in speech perception. International Congress on Phonetic Sciences, 95, 1(Section 9.5), 194-197.
35. Nygaard, L. C., & Pisoni, D. B. (1998). Talker-specific learning in speech perception. Perception & Psychophysics, 60, 355-376.
36. Nygaard, L. C., Sommers, M. S., & Pisoni, D. B. (1994). Speech perception as a talker-contingent process. Psychological Science, 5(1), 42-46.
37. Nygaard, L. C., Sommers, M. S., & Pisoni, D. B. (1995). Effects of stimulus variability on perception and representation of spoken words in memory. Perception & Psychophysics, 57, 989-1001.
38. Pisoni, D. B. (1993). Long-term memory in speech perception: Some new findings on talker variability, speaking rate, and perceptual learning. Speech Communication, 13, 109-125.
39. Pisoni, D. B. (1996). Some thoughts on "normalization" in speech perception. In K. Johnson & W. Mullenix (Eds.), Talker variability in speech processing (pp. 9-32). San Diego, CA: Academic Press.
40. Remez, R. E., Fellowes, J. M., Pisoni, D. B., Goh, W. D., & Rubin, P. (1998). Multimodal perceptual organization of speech: Evidence from tone analogs of spoken utterances. Speech Communication, 26, 65-73.
41. Remez, R. E., Rubin, P., Pisoni, D. B., & Carrell, T. D. (1981). Speech perception without traditional speech cues. Science, 212, 947-950.
42. Remez, R. E., Rubin, P. E., Berns, S. M., Pardo, J. S., & Lang, J. M. (1994). On the perceptual organization of speech. Psychological Review, 101, 129-156.
43. Rosenblum, L. D., & Saldaña, H. M. (1996). An audiovisual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 22, 318-331.
44. Shannon, R. V., Zeng, F. G., Kamath, V., Wygonski, J., & Ekelid, M. (1995). Speech recognition with primarily temporal cues. Science, 270, 303-304.
45. Sheffert, S. M., Lachs, L., & Hernández, L. R. (1996). The Hoosier Audiovisual Multitalker Database. In Research on spoken language processing (Progress Report No. 21, pp. 578-583). Bloomington: Indiana University, Department of Psychology, Speech Research Laboratory.
46. Sommers, M. S., Kirk, K. I., & Pisoni, D. B. (1997). Some considerations in evaluating spoken word recognition by normal-hearing, noise masked normal hearing and cochlear implant listeners. I: The effects of response format. Ear and Hearing, 18, 89-99.
47. Sommers, M. S., Nygaard, L. C., & Pisoni, D. B. (1994). Stimulus variability and spoken word recognition. I: Effects of variability in speaking rate and overall amplitude. Journal of the Acoustical Society of America, 96, 1314-1324.
48. Stein, B. E., & Meredith, M. A. (1993). The merging of the senses. Cambridge, MA: MIT Press.
49. Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of Acoustical Society of America, 26, 212-215.
50. Summerfield, Q. (1987). Some preliminaries to a comprehensive account of audio-visual speech perception. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip-reading (pp. 3-51). Hillsdale, NJ: Erlbaum.
51. Tyler, R. S., Fryauf-Bertschy, H., Kelsay, D. M., Gantz, B., Woodworth, G., & Parkinson, A. (1997). Speech perception by prelingually deaf children using cochlear implants. Otolaryngology Head and Neck Surgery, 117(3, Part 1), 180-187.
52. Tyler, R. S., Parkinson, A. J., Woodworth, G. G., Lowder, M. W., & Gantz, B. J. (1997). Performance over time of adult patients using the Ineraid or nucleus cochlear implant. Journal of the Acoustical Society of America, 102, 508-522.
53. Watson, C. S., Qiu, W. W., Chamberlain, M. M., & Li, X. (1996). Auditory and visual speech perception: Confirmation of a modality-independent source of individual differences in speech recognition. Journal of the Acoustical Society of America, 100, 1153-1162.