Speech perception without hearing

Perception and Psychophysics

Volumn 62, Issue 2, 2000, Pages 233-252

  Bernstein, Lynne E ^a   Demorest, Marilyn E ^b   Tucker, Paula E ^a  

^a HOUSE EAR INSTITUTE   (United States)

^b UNIVERSITY OF MARYLAND BALTIMORE COUNTY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; ATTENTION; FEMALE; HEARING IMPAIRMENT; HUMAN; INDIVIDUALITY; LIP READING; MALE; MIDDLE AGED; PHONETICS; PSYCHOLOGICAL ASPECT;

ADOLESCENT; ADULT; ATTENTION; DEAFNESS; FEMALE; HUMANS; INDIVIDUALITY; LIPREADING; MALE; MIDDLE AGED; PHONETICS;

EID: 0034132106     PISSN: 00315117     EISSN: None     Source Type: Journal    
DOI: 10.3758/BF03205546     Document Type: Article

References (97)

1. AUER, E. T., JR., & BERNSTEIN, L. E. (1997). Speechreading and the structure of the lexicon: Computationally modeling the effects of reduced phonetic distinctiveness on lexical uniqueness. Journal of the Acoustical Society of America, 102, 3704-3710.
2. AUER, E. T., JR., BERNSTEIN, L. E., WALDSTEIN, R. S., & TUCKER, P. E. (1997). Effects of phonetic variation and the structure of the lexicon on the uniqueness of words. In C. Benoît & R. Campbell (Eds.), Proceedings of the ESCA/ESCOP Workshop on Audio-Visual Speech Processing (pp. 21-24). Rhodes, Greece, September 26-27.
3. AUER, E. T., JR., WALDSTEIN, R. S., TUCKER, P. E., & BERNSTEIN, L. E. (1996). Relationships between word knowledge and visual speech perception: I. Subjective estimates of word age-of-acquisition. Journal of the Acoustical Society of America, 100, 2569.
4. BENGUEREL, A. P., & PICHORA-FULLER, M. K. (1982). Coarticulation effects in lipreading. Journal of Speech & Hearing Research, 25, 600-607.
5. BERNSTEIN, L. E., COULTER, D. C., O'CONNELL, M. P., EBERHARDT, S. P., & DEMOREST, M. E. (1993). Vibrotactile and haptic speech codes. In A. Risberg, S. Felicetti, G. Plant, & K.-E. Spens (Eds.), Proceedings of the Second International Conference on Tactile Aids, Hearing Aids, and Cochlear Implants (pp. 57-70). Stockholm, June 7-11, 1992.
6. BERNSTEIN, L. E., DEMOREST, M. E., COULTER, D. C., & O'CONNELL, M. P. (1991). Lipreading sentences with vibrotactile vocoders: Performance of normal-hearing and hearing-impaired subjects. Journal of the Acoustical Society of America, 90, 2971-2984.
7. BERNSTEIN, L. E., DEMOREST, M. E., & EBERHARDT, S. P. (1994). A computational approach to analyzing sentential speech perception: Phoneme-to-phoneme stimulus-response alignment. Journal of the Acoustical Society of America, 95, 3617-3622.
8. BERNSTEIN, L. E., DEMOREST, M. E., & TUCKER, P. E. (1998). What makes a good speechreader? First you have to find one. In R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by eye: II. The psychology of speechreading and auditory-visual speech (pp. 211-228). East Sussex, U.K.: Psychology Press.
9. BERNSTEIN, L. E., & EBERHARDT, S. P. (1986a). Johns Hopkins Lipreading Corpus I-II: Disc 1 [videodisc]. Baltimore: Johns Hopkins University.
10. BERNSTEIN, L. E., & EBERHARDT, S. P. (1986b). Johns Hopkins Lipreading Corpus III-IV: Disc 2 [videodisc]. Baltimore: Johns Hopkins University.
11. BERNSTEIN, L. E., IVERSON, P., & AUER, E. T., JR. (1997). Elucidating the complex relationships between phonetic perception and word recognition in audiovisual speech perception. In C. Benoît & R. Campbell (Eds.), Proceedings of the ESCA/ESCOP Workshop on Audio-Visual Speech Processing (pp. 89-92). Rhodes, Greece, September 26-27.
12. BOOTHROYD, A., & CAWKWELL, S. (1970). Vibrotactile thresholds in pure tone audiometry. Acta Otolaryngologica, 69, 381-387.
13. BREEUWER, M., & PLOMP, R. (1986). Speechreading supplemented with auditorily presented speech parameters. Journal of the Acoustical Society of America, 79, 481-499.
14. CATFORD, J. C. (1977). Fundamental problems in phonetics. Bloomington: Indiana University Press.
15. CHOMSKY, N., & HALLE, M. (1968). The sound pattern of English. New York: Harper & Row.
16. CLOUSER, R. A. (1977). Relative phoneme visibility and lipreading performance. Volta Review, 79, 27-34.
17. CONKLIN, E. S. (1917). A method for the determination of relative skill in lip-reading. Volta Review, 19, 216-219.
18. CONRAD, R. (1977). Lipreading by deaf and hearing children. British Journal of Educational Psychology, 47, 60-65.
19. DAVIS, H., & SILVERMAN, S. R. (EDS.) (1970). Hearing and deafness. New York: Holt, Rinehart & Winston.
20. DEKLE, D. J., FOWLER, C. A., & FUNNELL, M. G. (1992). Audiovisual integration in perception of real words. Perception & Psychophysics, 51, 355-362.
21. DEMOREST, M. E., & BERNSTEIN, L. E. (1992). Sources of variability in speechreading sentences: A generalizability analysis. Journal of Speech & Hearing Research, 35, 876-891.
22. DEMOREST, M. E., & BERNSTEIN, L. E. (1997). Relationships between subjective ratings and objective measures of performance in speech-reading sentences. Journal of Speech, Language. & Hearing Research, 40, 900-911.
23. DEMOREST, M. E., BERNSTEIN, L. E., & DEHAVEN, G. P. (1996). Generalizablity of speechreading performance on nonsense syllables, words, and sentences: Subjects with normal hearing. Journal of Speech & Hearing Research, 39, 697-713.
24. DUFFY, S. A., & PISONI, D. B. (1992). Comprehension of synthetic speech produced by rule: A review and theoretical interpretation. Language & Speech, 35, 351-389.
25. DUNN, L. M., & DUNN, L. M. (1981). Peabody picture vocabulary test -revised. Circle Pines, MN: American Guidance Service.
26. FEINGOLD, A. (1995). The additive effects of differences in central tendency and variability are important in comparisons between groups. American Psychologist, 50, 5-13.
27. FISHER, C. G. (1968). Confusions among visually perceived consonants. Journal of Speech & Hearing Research, 11, 796-804.
28. GEERS, A., & MOOG, J. (1989). Factors predictive of the development of literacy in profoundly hearing-impaired adolescents. Volta Review, 91, 69-86.
29. GREEN, K. [P.] (1998). The use of auditory and visual information during phonetic processing: Implications for theories of speech perception. In R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by eye: II. Advances in the psychology of speechreading and auditory-visual speech (pp. 3-25). East Sussex, U.K.: Psychology Press.
30. GREEN, K. P., & KUHL, P. K. (1989). The role of visual information in the processing of place and manner features in speech perception. Perception & Psychophysics, 45, 34-42.
31. HEIDER, F., & HEIDHR, G. M. (1940). An experimental investigation of lipreading. Psychological Monographs, 52 (Whole No. 232), 124-153.
32. HOTCHKISS, D. (1989). Demographic aspects of hearing impairment: Questions and answers. (Available from Center for Assessment and Demographic Studies, Gallaudet Research Institute, 800 Florida Avenue, N.E., Washington, DC 20002)
33. HOUSE, A. S., WILLIAMS, C. E., HECKER, M. H., & KRYTER, K. D. (1965). Articulation-testing methods: Consonantal differentiation with a closed-response set. Journal of the Acoustical Society of America, 37, 158-166.
34. JEFFERS, J., & BARLEY, M. (1971). Speechreading (lipreading). Springfield, IL: Charles C. Thomas.
35. KEATING, P. A. (1988). A survey of phonological features. Bloomington: Indiana University Linguistics Club.
36. KREUL, E. J., NIXON, J. C., KRYTER, K. D., BELL, D. W., & LAMB, J. S. (1968). A proposed clinical test of speech discrimination. Journal of Speech & Hearing Research, 11, 536-552.
37. KUHL, P. K., & MELTZOFF, A. N. (1988). Speech as an intermodal object of perception. In A. Yonas (Ed.), Perceptual development in infancy (Vol. 20, pp. 235-266). Hillsdale, NJ: Erlbaum.
38. LESNER, S. A., & KRICOS, P. B. (1981). Visual vowel and diphthong perception across speakers. Journal of the Academy of Rehabilitative Audiohgy, 14, 252-258.
39. LEWELLEN, M. J., GOLDINGER, S. D., PISONI, D. B., & GREENE, B. G. (1993). Lexical familiarity and processing efficiency: Individual differences in naming, lexical decision, and semantic categorization. Journal of Experimental Psychology: General, 122, 316-330.
40. LISKER, L., & ABRAMSON, A. S. (1964). A cross-language study of voicing in initial stops: Acoustical measurements. Word, 20, 384-422.
41. LUCE, P. A., & PISONI, D. B. (1998). Recognizing spoken words: The neighborhood activation model. Ear & Hearing, 19, 1-36.
42. LYXELL, B., & RÖNNBERG, J. (1987). Guessing and speechreading. British Journal of Audiology, 21, 13-20.
43. LYXELL, B., & RÖNNBERG, J. (1989). Information-processing skill and speech-reading. British Journal of Audiology, 23, 339-347.
44. LYXELL, B., & RÖNNBERG, J. (1991a). Visual speech processing: Word-decoding and word-discrimination related to sentence-based speechreading and hearing-impairment. Scandinavian Journal of Psychology, 32, 9-17.
45. LYXELL, B., & RÖNNBERG, J. (1991b). Word discrimination and chronological age related to sentence-based speechreading skill. British Journal of Audiology, 25, 3-10.
46. LYXELL, B., & RÖNNBERG, J. (1992). The relationship between verbal ability and sentence-based speechreading. Scandinavian Audiology, 21, 67-72.
47. LYXELL, B., RÖNNBERG, J., ANDERSSON, J., & LINDEROTH, E. (1993). Vibrotactile support: Initial effects on visual speech perception. Scandinavian Audiology, 22, 179-183.
48. MACLEOD, A., & SUMMERFIELD, Q. (1990). A procedure for measuring auditory and audiovisual speech-reception thresholds for sentences in noise: Rationale, evaluation, and recommendations for use. British Journal of Audiology, 24, 29-43.
49. MARSLEN-WILSON, W. (1990). Activation, competition, and frequency in lexical access. In G. T. M. Altmann (Ed.), Cognitive models of speech processing: Psycholinguistic and computational perspectives (pp. 148-172). Cambridge, MA: MIT Press.
50. MASSARO, D. W. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Erlbaum.
51. MASSARO, D. W. (1998). Perceiving talking faces: From speech perception to a behavioral principle. Cambridge, MA: MIT Press, Bradford Books.
52. MASSARO, D. W., COHEN, M. M., & GESI, A. T. (1993). Long-term training, transfer, and retention in learning to lipread. Perception & Psychophysics, 53, 549-562.
53. MCCLELLAND, J. L., & ELMAN, J. (1986). The TRACE model of speech perception. Cognitive Psychology, 18, 1-86.
54. MCGURK, H., & MACDONALD, J. (1976). Hearing lips and seeing voices: A new illusion. Nature, 264, 746-748.
55. MIDDLEWEERD, M. J., & PLOMP, R. (1987). The effect of speechreading on the speech-reception threshold of sentences in noise. Journal of the Acoustical Society of America, 82, 2145-2147.
56. MILLER, G. A., HEISE, G. A., & LICHTEN, W. (1951). The intelligibility of speech as a function of the context of the test materials. Journal of Experimental Psychology, 41, 329-335.
57. MILLER, J. L. (1991). Comment: Bimodal speech perception and the motor theory. In I. G. Mattingly & M. Studdert-Kennedy (Eds.), Modularity and the motor theory of speech perception (pp. 139-143). Hillsdale, NJ: Erlbaum.
58. MOGFORD, K. (1987). Lip-reading in the prelingually deaf. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip-reading (pp. 191-211). Hillsdale, NJ: Erlbaum.
59. MONTGOMERY, A. A., & JACKSON, P. L. (1983). Physical characteristics of the lips underlying vowel lipreading performance. Journal of the Acoustical Society of America, 73, 2134-2144.
60. MONTGOMERY, A. A., WALDEN, B. E., & PROSEK, R. A. (1987). Effects of consonantal context on vowel lipreading. Journal of Speech & Hearing Research, 30, 50-59.
61. MOORES, D. F., & SWEET, C. (1991). Factors predictive of school achievement. In D. F. Moores & K. P. Meadow-Orlans (Eds.). Educational and developmental aspects of deafness (pp. 154-201). Washington, DC: Gallaudet University Press.
62. NEVILLE, H. J. (1995). Developmental specificity in neurocognitive development in humans. In M. Gazzaniga (Ed.), The cognitive neurosciences (pp. 219-231). Cambridge, MA: MIT Press.
63. NEWMAN, R. S., SAWUSCH, J. R., & LUCE, P. A. (1997). Lexical neighborhood effects in phonetic processing. Journal of Experimental Psychology: Human Perception & Performance, 23, 873-889.
64. NOBER, E. H. (1967). Vibrotactile sensitivity of deaf children to high intensity sound. Laryngoscope, 78, 2128-2146.
65. OWENS, E., & BLAZEK, B. (1985). Visemes observed by hearing impaired and normal hearing adult viewers. Journal of Speech & Hearing Research, 28, 381-393.
66. PELSON, R. O., & PRATHER, W. F. (1974). Effects of visual message-related cues, age, and hearing impairment on speechreading performance. Journal of Speech & Hearing Research, 17, 518-525.
67. PERFETTI, C. A. (1994). Psycholinguistics and reading ability. In M. A. Gernsbacher (Ed.), Handbook of psycholinguistics (pp. 849-894). New York: Academic Press.
68. RABINOWITZ, W. M., EDDINGTON, D. K., DELHORNE, L. A., & CUNEO, P. A. (1992). Relations among different measures of speech reception in subjects using a cochlear implant. Journal of the Acoustical Society of America, 92, 1869-1881.
69. RAPHAEL, L. J. (1972). Preceding vowel duration as a cue to the perception of the voicing characteristic of word final consonants in American English. Journal of the Acoustical Society of America, 51, 1296-1303.
70. RÖNNBERG, J. (1995). Perceptual compensation in the deaf and blind: Myth or reality? In R. A. Dixon & L. Bäckman (Eds.), Compensating for psychological deficits and declines (pp. 251-274). Mahwah, NJ: Erlbaum.
71. RÖNNBERG, J., ÖHNGREN, G., & NILSSON, L.-G. (1982). Hearing deficiency, speechreading and memory functions. Scandinavian Audiology, 11, 261-268.
72. RÖNNBERG, J., SAMUELSSON, S., & LYXELL, B. (1998). Conceptual constraints in sentence-based lipreading in the hearing-impaired. In R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by eye: II. The psychology of speechreading and auditory-visual speech (pp. 143-153). East Sussex, U.K.: Psychology Press.
73. ROSEN, S., & CORCORAN, T. (1982). A video-recorded test of lipreading for British English. British Journal of Audiology, 16, 245-254.
74. ROSENBLUM, L. D., & FOWLER, C. A. (1991). Audiovisual investigation of the loudness-effort effect for speech and nonspeech events. Journal of Experimental Psychology: Human Perception & Performance, 17, 976-985.
75. SANKOFF, D., & KRUSKAL, J. B. (EDS.) (1983). Time warps, string edits, and macromolecules: The theory and practice of sequence comparison. Reading, MA: Addison-Wesley.
76. SCHEINBERG, J. C. S. (1988). An analysis of /p/, /b/ and /m/ in the speechreading signal. Unpublished doctoral dissertation, The City University of New York, New York.
77. SCHILDROTH, A. N., & KARCHMER, M. A. (1986). Deaf children in America. San Diego: College-Hill.
78. SCHWANTES, F. M. (1981). Locus of the context effect in children's word recognition. Child Development, 52, 895-903.
79. SEKIYAMA, K., & TOHKURA, Y. (1991). McGurk effect in non-English listeners: Visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility. Journal of the Acoustical Society of America, 90, 1797-1805.
80. . (1996). Chicago, IL: SPSS Inc.
81. STANOVICH, K. E. (1980). Toward an interactive-compensatory model of individual differences in the development of reading fluency. Reading Research Quarterly, 1, 32-71.
82. SUMBY, W. H., & POLLACK, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.
83. SUMMERFIELD, Q. (1987). Some preliminaries to a comprehensive account of audio-visual speech perception. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lipreading (pp. 3-52). London: Erlbaum.
84. SUMMERFIELD, Q. (1991). Visual perception of phonetic gestures. In I. G. Mattingly & M. Studdert-Kennedy (Eds.), Modularity and the motor theory of speech perception (pp. 117-137). Hillsdale, NJ: Erlbaum.
85. SUMMERFIELD, Q., & MCGRATH, M. (1984). Detection and resolution of audio-visual incompatibility in the perception of vowels. Quarterly Journal of Experimental Psychology, 36A, 51-74.
86. TILLBERG, I., RÖNNBERG, J., SVÄRD, I., & AHLNER, B. (1996). Audio-visual speechreading in a group of hearing aid users: The effects of onset age, handicap age, and degree of hearing loss. Scandinavian Audiology, 25, 267-272.
87. TYLER, L. K., COBB, H., & GRAHAM, N. (EDS.) (1992). Spoken language comprehension: An experimental approach to disordered and normal processing. Cambridge, MA: MIT Press.
88. UTLEY, J. (1946). A test of lip reading ability. Journal of Speech & Hearing Disorders, 11, 109-116.
89. VATIKIOTIS-BATESON, E., MUNHALL, K. G., KASAHARA, Y., GARCIA, F., & YEHIA, H. (1996). Characterizing audiovisual information during speech. In H.T. Bunnell & W. Idsardi (Eds.), Proceedings ICSLP 96: Fourth International Conference on Spoken Language Processing (pp. 1485-1488). New Castle, DE: Citation Delaware.
90. WALDEN, B. E., ERDMAN, S. A., MONTGOMERY, A. A., SCHWARTZ, D. M., & PROSEK, R. A. (1981). Some effects of training on speech recognition by hearing-impaired adults. Journal of Speech & Hearing Research, 24, 207-216.
91. WALDEN, B. E., MONTGOMERY, A. A., PROSEK, R. A., & SCHWARTZ, D. M. (1980). Consonant similarity judgments by normal and hearing-impaired listeners. Journal of Speech & Hearing Research, 23, 162-184.
92. WALDEN, B. E., PROSEK, R. A., MONTGOMERY, A. A., SCHERR, C. K., & JONES, C. J. (1977). Effects of training on the visual recognition of consonants. Journal of Speech & Hearing Research, 20, 130-145.
93. WALDSTEIN, R. S., AUER, E. T., JR., TUCKER, P. E. & BERNSTEIN, L. E. (1996). Relationships between word knowledge and visual speech perception: II. Subjective ratings of word familiarity. Journal of the Acoustical Society of America, 100, 2569.
94. WANG, M. D. (1976). SINFA: Multivariate uncertainty analysis for confusion matrices. Behavior Research Methods & Instrumentation, 8, 471-472.
95. WANG, M. D., & BILGER, R. C. (1973). Consonant confusions in noise: A study of perceptual features. Journal of the Acoustical Society of America, 54, 1248-1266.
96. WOZNIAK, V. D., & JACKSON, P. L. (1979). Visual vowel and diphthong perception from two horizontal viewing angles. Journal of Speech & Hearing Research, 22, 355-365.
97. YEHIA, H., RUBIN, P., & VATIKIOTIS-BATESON, E. (1997). Quantitative association of orofacial and vocal-tract shapes. In C. Benoît & R. Campbell (Eds.), Proceedings of the ESCA/ESCOP Workshop on Audio-Visual Speech Processing (pp. 41-44). Rhodes, Greece, September 26-27.