Attention to facial regions in segmental and prosodic visual speech perception tasks

Journal of Speech, Language, and Hearing Research

Volumn 42, Issue 3, 1999, Pages 526-539

  Lansing, Charissa R ^a   McConkie, George W ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Eye gaze eyetracking eye movements; Lipreading speechreading; Visual speech perception

Indexed keywords

ADULT; ARTICLE; EYE MOVEMENT; EYE TRACKING; FACE PROFILE; FEMALE; GAZE; HUMAN; HUMAN EXPERIMENT; LIP READING; MALE; NORMAL HUMAN; SPEECH DISCRIMINATION; SPEECH PERCEPTION; VISUAL INFORMATION; WORD RECOGNITION;

EID: 0033062198     PISSN: 10924388     EISSN: None     Source Type: Journal    
DOI: 10.1044/jslhr.4203.526     Document Type: Article

References (35)

1. American National Standards Institute. (1996). Specifications for audiometers (ANSI S3.6-1996). New York: Author.
2. Bernstein, L. E. (1991). Gallaudet Lipreading Corpus VII-VIII, Disc 4 Videodisc. Washington, DC: Gallaudet University.
3. Bernstein, L. E., Demorest, M. E., Coulter, D. C., & O'Connell, M. P. (1991). Lipreading sentences with vibrotactile vocoders: Performance of normal-hearing and hearing-impaired subjects. Journal of the Acoustical Society of America, 90, 2971-2984.
4. Bernstein, L. E., Demorest, M. E., & Tucker, P. E. (1998). What makes a good speechreader? First you have to find one. In R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by eye II: Advances in the psychology of speech-reading and audiovisual speech (pp. 221-227). London: Erlbaum & Associates.
5. Bernstein, L. E., Eberhardt, S. P., & Demorest, M. E. (1989). Single-channel vibrotactile supplements to visual perception of intonation and stress. Journal of the Acoustical Society of America, 85, 397-405.
6. Benôit, C., Guiard-Marigny, T., Le Goff, B., & Adjoudani, A. (1996). Which components of the face do humans and machines best speechread? In D. G. Stork & M. E. Hennecke (Eds.), Speechreading by humans and machines: Models, systems, and applications (pp. 315-328; NATO ASI Series, Vol. 150, Series F: Computer and Systems Sciences). Berlin: Springer-Verlag.
7. Boothroyd, A. (1988). Perception of speech pattern contrasts from auditory presentation of voice fundamental frequency. Ear and Hearing, 9, 313-321.
8. Cohen, M. M., Walker, R. L., & Massaro, D. W. (1996). Perception of visual speech. In D. G. Stork & M. E. Hennecke (Eds.), Speechreading by humans and machines: Models, systems, and applications (pp. 153-168; NATO ASI Series, Vol. 150, Series F: Computer and Systems Sciences). Berlin: Springer-Verlag.
9. Demorest, M. E., & Bernstein, L. E. (1992). Sources of variability in speechreading sentences. A generalizability analysis. Journal of Speech and Hearing Research, 35, 876-891.
10. Eberhardt, S. P., Bernstein, L. E., Demorest, M. E., & Goldstein, M. H. (1990). Speechreading sentences with single-channel vibrotactile presentation of fundamental frequency. Journal of the Acoustical Society of America, 88, 1274-1285.
11. Ekman, P. (1979). About brows: Emotional and conversational signals. In J. Aschoff, M. von Carnack, K. Foppa, W. Lepenies, & D. Plog (Eds.), Human ethology (pp. 169-202). Cambridge, U.K.: Cambridge University Press.
12. Fisher, C. G. (1969). The visibility of terminal pitch contour. Journal of Speech and Hearing Research, 12, 379-82.
13. Grant, K. W. (1980). Investigating a tactile speechreading aid: The transmission of prosodic information in connected discourse and sentences. Unpublished masters thesis, University of Washington, Seattle.
14. Grant, K. W., Ardell, L. A., Kuhl, P. K., & Sparks, D. W. (1986). The transmission of prosodic information via an electrotactile speechreading aid. Ear and Hearing, 7, 328-335.
15. Grant, K. W., & Walden, B. E. (1996). Spectral distribution of prosodic information. Journal of Speech and Hearing Research, 39, 228-238.
16. Greenberg, H. J., & Bode, D. L. (1968). Visual discrimination of consonants. Journal of Speech and Hearing Research, 35, 466-471.
17. Hallet, P. E. (1986). Eye movements. In K. B. Boff, L. Kaufman, & J. P. Thomas (Eds.), Handbook of perception and human performance I: Sensory processes and perception (pp. 10-1-10-102). New York: Wiley.
18. Hnath-Chisolm, T., & Kishon-Rabin, L. (1988). Tactile presentation of voice fundamental frequency as an aid to the perception of speech pattern contrasts. Ear and Hearing, 9, 329-334.
19. Kent, R. D., & Netsell, R. (1971). Effects of stress contrast on certain articulatory parameters. Phonetica, 24, 23-44.
20. Lansing, C. R., & McConkie, G. W. (1994). A new method for speechreading research: Eyetracking observers' eye movements. Journal of the Academy of Rehabilitative Audiology, 27, 25-43.
21. Marassa, L. K., & Lansing, C. R. (1995). Visual word recognition in two facial motion conditions: Full-face versus lips-plus-mandible. Journal of Speech and Hearing Research, 38, 1387-1394.
22. Massaro, D. W. (1998). Perceiving talking faces: From speech perception to a behavioral principal (pp. 415-443). Cambridge, MA: MIT Press.
23. McConkie, G. W., Scouten, C. W., Bryant, P. K., & Wilson, J. (1988). A microcomputer-based software package for eye monitoring research. Behavior Research Methods, Instruments, and Computers, 20, 142-149.
24. Posner, M. I. (1980). Orienting attention. Quarterly Journal of Experimental Psychology, 32, 3-25.
25. Preminger, J. E., Lin, H.-B., Payen, M., Levitt, H. (1998). Selective masking in speechreading. Journal of Speech, Language, and Hearing Research, 41, 564-575.
26. Risberg, A., & Lubker, J. (1978). Prosody and speechreading. Speech Transmission Laboratory Quarterly Progress Report Status Report, 4, 1-16.
27. Rönnberg, J. (1995). What makes a good speechreader? In G. Plant & K. Spens (Eds.), Profound deafness and speech communication (pp. 393-417). London: Whurr.
28. Rosenblum, L. D., Johnson, J. A., & Saldaña, H. M. (1996). Point-light facial displays enhance comprehension of speech in noise. Journal of Speech and Hearing Research, 39, 1159-1170.
29. Storke, D. G., & Hennecke, M. E. (1996). Panel discussions: Human Speechreading: Psychology and Cognition. In D. G. Stork & M. E. Hennecke (Eds.), Speechreading by humans and machines: Models, systems, and applications (p. 525; NATO ASI Series, Vol. 150, Series F: Computer and Systems Sciences). Berlin: Springer-Verlag.
30. Summerfield, Q., MacLeod, A., McGrath, M., & Brooke, M. (1989). Lips, teeth, and the benefits of lipreading. In A. W. Young & H. D. Ellis (Eds.), Handbook of research on face processing (pp. 223-233). North-Holland: Elsevier Sciences Publishers, B.V.
31. Thompson, D. M. (1934). On the detection of emphasis in spoken sentences by means of visual, tactual, and visual-tactual cues. Journal of General Psychology 11, 160-172.
32. Vatikiotis-Bateson, E., Eigsti, I.-M., Yano, S., & Munhall, K. (1998). Eye movements of perceivers during audiovisual speech perception. Perception and Psychophysics, 60(6), 926-940.
33. Vatikiotis-Bateson, E., Munhall, K. G., Hirayama, M., Lee, Y. V., & Terzopoulos, D. (1996). The dynamics of audiovisual behavior in speech. In D. G. Stork & M. E. Hennecke (Eds.), Speechreading by humans and machines: Models, systems, and applications (pp. 221-232; NATO ASI Series, Vol. 150, Series F: Computer and Systems Sciences). Berlin: Springer-Verlag.
34. Yarbus, A. L. (1967). Eye movements and vision. New York: Plenum Press.
35. Weiner, B. J. (1962). Statistical principles in experimental design (pp. 221-222). New York: McGraw-Hill.