Point-light facial displays enhance comprehension of speech in noise

Journal of Speech, Language, and Hearing Research

Volumn 39, Issue 6, 1996, Pages 1159-1170

  Rosenblum, Lawrence D ^a   Johnson, Jennifer A ^a   Saldaña, Helena M ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b HOUSE EAR INSTITUTE   (United States)

Author keywords

Lipreading; Point lights; Speech in noise; Speechreading; Telecommunication

Indexed keywords

ARTICLE; AUDITORY STIMULATION; FACE; FEMALE; HEARING; HUMAN; HUMAN EXPERIMENT; LIGHT; MALE; NOISE; SIGNAL NOISE RATIO; SPEECH; SPEECH PERCEPTION; TELECOMMUNICATION; VISUAL STIMULATION;

ADOLESCENT; ADULT; FACE; FEMALE; HUMANS; LEARNING; LIGHT; LIPREADING; MALE; NOISE; SPEECH PERCEPTION; TELECOMMUNICATIONS;

EID: 0029853869     PISSN: 10924388     EISSN: None     Source Type: Journal    
DOI: 10.1044/jshr.3906.1159     Document Type: Article

References (42)

1. American National Standards Institute (1989). Specification for audiometers. (ANSI S3.6-1989). New York: ANSI.
2. Bassili, J. N. (1978). Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology: Human Perception and Performance, 4, 373-379.
3. Bench, J., & Bamford, J. (1979). Speech-hearing tests and the spoken language of hearing impaired children. London: Academic Press.
4. Berry, D. S. (1990). What can a moving face tell us? Journal of Personality and Social Psychology, 58, 1004-1014.
5. Bingham, G. P. (1987). Scaling and kinematic form: Further investigations on the visual perception of lifted weight. Journal of Experimental Psychology: Human Perception and Performance, 13, 155-177.
6. Bingham, G. P., Rosenblum, L. D., & Schmidt, R. C. (1995). Dynamics and the orientation of kinematic forms in visual event recognition. Journal of Experimental Psychology: Human Perception and Performance, 21, 1473-1493.
7. Brooke, N. M., & Summerfield, A. Q. (1983). Analysis, synthesis and perception of visible articulatory movements. Journal of Phonetics, 11, 63-76.
8. Campbell, R. (1989). Lipreading. In A. W. Young & H. D. Ellis (Eds.), Handbook of research on face processing (pp. 187-205). North-Holland: Elsevier.
9. Danz, A. D., & Binnie, C. A. (1983). Quantification of the effects of training the auditory-visual recognition of connected speech. Ear and Hearing, 4, 146-151.
10. Erber, N. P. (1969). Interaction of audition and vision in the recognition of oral speech stimuli. Journal of Speech and Hearing Research, 12, 423-425.
11. Erber, N. P. (1980). Central Institute for the Deaf Research Department, Periodic Progress Report, 23.
12. Greenberg, H. J., & Bode, D. L. (1968). Visual discrimination of consonants. Journal of Speech and Hearing Research, 11, 869-874.
13. Hinkle, R. R. (1979). An investigation of list equivalency for auditory, visual and audiovisual performance using revised CID sentences, Unpublished doctoral dissertation, Purdue University, West Lafayette, IN.
14. Usselddijk, F. J. (1992). Speechreading performance under different conditions of video image, repetition, and speech rate. Journal of Speech and Hearing Research, 35, 466-471.
15. Jackson, P. L., Montgomery, A. A., & Binnie, C. A. (1976). Perceptual dimensions underlying vowel lipreading performance. Journal of Speech and Hearing Research, 19, 796-812.
16. Johansson, G. (1973). Visual perception of biological motion and a model for its analysis. Perception and Psychophysics, 14, 201-211.
17. Kozlowski, L. T., & Cutting, J. E. (1977). Recognizing the sex of a walker from a dynamic point light display. Perception and Psychophysics, 21, 575-580.
18. Larr, A. L. (1959). Speechreading through closed-circuit television. Volta Review, 61, 19-21.
19. MacLeod, A., & Summerfield, Q. (1987). Quantifying the contribution of vision to speech perception in noise. British Journal of Audiology, 21, 131-141.
20. MacLeod, A., & Summerfield, Q. (1990). A procedure for measuring auditory and audio-visual speech reception thresholds for sentences in noise: Rationale, evaluation, and recommendations for use. British Journal of Audiology, 24, 29-43.
21. Massaro, D. W. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Erlbaum.
22. Massaro, D. W., Cohen, M. M., & Gesi, A. T. (1993). Long-term training, transfer and retention in learning to lipread. Perception and Psychophysics, 53, 549-562.
23. McGrath, M. (1985). An examination of cues for visual and audio-visual speech perception using natural and computer-generated faces. Unpublished doctoral dissertation, University of Nottingham, Nottingham, U.K.
24. McGrath, M., Summerfield, Q., & Brooke, N. M. (1984). Roles of lips and teeth in lipreading vowels. Proceedings of the Institute of Acoustics, 6, 401-408.
25. Middleweerd, M. J., & Plomp, R. (1987). The effect of speechreading on the speech reception threshold of sentences in noise. Journal of the Acoustical Society of America, 82, 2145-2146.
26. Montgomery, A. A., & Jackson, P. L. (1983). Physical characteristics of the lips underlying vowel lipreading performance. Journal of the Acoustical Society of America, 73, 2134-2144.
27. Montgomery, A. A., Walden, B. E., Schwartz, D. M., & Prosek, R. A. (1984). Training auditory-visual speech reception in adults with moderate sensorineural hearing loss. Ear and Hearing, 5, 30-36.
28. Nilsson, M. J., Soli, S. D., & Sullivan, J. (1994). Development of the hearing in noise test for the measurement of speech reception thresholds in quiet and in noise. Journal of the Acoustical Society of America, 95, 1085-1099.
29. Pearson, D. (1981). Visual communication systems for the deaf. IEEE Transactions on Communications, COM-29, 1986-1992.
30. Petajan, E. D. (1984). Automatic lipreading to enhance speech recognition. Proceedings of the Global Communications Conference (pp. 265-272). Atlanta, GA: IEEE Communications Society.
31. Reisberg, D., McLean, J., & Goldfield, A. (1987). Easy to hear but hard to understand: A lip-reading advantage with intact auditory stimuli. In B. Dodd & R. Campbell (Eds), Hearing by eye: The psychology of lip reading. Hillsdale, NJ: Erlbaum.
32. Rosenblum, L. D., Johnson, J. A., & Saldaña, H. M. (1995 May). Determining the kinematic features for visual speech perception. Colloquium presented at the University of California, Riverside.
33. Rosenblum, L. D., & Saldaña, H. M. (1996). An audiovisual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 22(2), 318-331.
34. Runeson, S. (1977). On the visual perception of dynamic events. Acta Universitatis Upsaliensis: Studia Psychologica Upsaliensia. (Series No. 9). Uppsala, Sweden: Offsetcenter AB.
35. Runeson, S., & Frykholm, G. (1981). Visual perception of lifted weight. Journal of Experimental Psychology: Human Perception and Performance, 7, 733-740.
36. Stone, L. (1957). Facial clues of context in lip reading. John Tracy Clinic, Los Angeles Research Papers, 5 (pp. 36-45). Los Angeles: John Tracy Clinic.
37. Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.
38. Summerfield, Q., MacLeod, P., McGrath, M., & Brooke, N. M. (1989). Lips, teeth, and the benefits of lipreading. In A. W. Young and H. D. Ellis (Eds.), Handbook of research on face processing (pp. 223-233.) New Holland: Elsevier.
39. Summerfield, Q. & McGrath, M. (1984). Detection and resolution of audio-visual incompatibility in the perception of vowels. Quarterly Journal of Experimental Psychology, 36, 51-74.
40. Summerfield, Q. A. (1979). Use of visual information for phonetic perception. Phonetics, 36, 314-331.
41. Tartter, V. C., & Knowlton, K. C. (1981). Perception of sign language from an array of 27 moving spots. Nature, 289, 676-678.
42. Verfaillie, K., De Troy, A., & Van Rensbergen, J. (1994). Transsaccadic integration of biological motion. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20, 649-670.