Bimodal displays improve speech comprehension in environments with multiple speakers

Human Factors

Volumn 45, Issue 2, 2003, Pages 329-336

  Rudmann, Darrell S ^a   McCarley, Jason S ^a   Kramer, Arthur F ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AIR TRAFFIC CONTROL; DISPLAY DEVICES; ENVIRONMENTAL CHAMBERS; SPEECH RECOGNITION;

SPEECH COMPREHENSION;

SPEECH PROCESSING;

ARTICLE; BIMODAL DISPLAY; COMPREHENSION; DISPLAY SYSTEM; ENVIRONMENTAL FACTOR; MILITARY PHENOMENA; MULTIPLE SPEAKER; SIGNAL DETECTION; SPEECH INTELLIGIBILITY; STIMULUS RESPONSE; TASK PERFORMANCE; TRAFFIC NOISE; VENTRILOQUISM; VIDEORECORDING; VOICE; WORD RECOGNITION;

ADOLESCENT; ADULT; AVIATION; COMPREHENSION; COMPUTER TERMINALS; EYE MOVEMENTS; FEMALE; HUMANS; ILLINOIS; MALE; MILITARY PERSONNEL; SPEECH; TASK PERFORMANCE AND ANALYSIS;

EID: 0041733737     PISSN: 00187208     EISSN: None     Source Type: Journal    
DOI: 10.1518/hfes.45.2.329.27237     Document Type: Article

References (21)

1. Bertelson, P., & Radeau, M. (1976). Ventriloquism, sensory interaction, and response bias: Remarks on the paper by Choe, Welch, Gilford and Juola. Perception and Psychophysics, 19, 531-535.
2. Blauert, J. (1997). Spatial hearing: The psychophysics of human sound localization (rev. ed.). Cambridge: MIT Press.
3. Campbell, C. S., & Massaro, D. W. (1997). Perception of visible speech: Influence of spatial quantization. Perception, 26, 626-644.
4. Driver, J. (1996). Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature, 381, 66-68.
5. Handel, S. (1989). Listening: An introduction to the perception of auditory events. Cambridge: MIT Press.
6. Jack, C. E., & Thurlow, W. R. (1973). Effects of degree of visual association and angle of displacement on the "ventriloquism" effect. Perceptual and Motor Skills, 37, 967-979.
7. Kryter, K. D. (1972). Speech communications. In H. P. Van Cott & R. G. Kinkade (Eds.), Human engineering guide to system design (pp. 161-226). Washington, DC: U.S. Government Printing Office.
8. Lansing, C. R., & McConkie, G. (1994). A new method for speech-reading research: Tracking observer's eye movements. Journal of the Academy of Rehabilitative Audiology, 27, 25-43.
9. Lee, M. D. (2001). Multichannel auditory search: Toward understanding control processes in polychotic auditory listening. Human Factors, 43, 328-342.
10. MacDonald, J., Andersen, S., & Bachmann, T. (2000). Hearing by eye: How much spatial degradation can be tolerated? Perception, 29, 1155-1168.
11. MacLeod, A., & Summerfield, Q. (1987). A procedure for measuring auditory and audiovisual speech-reception thresholds for sentences in noise: Rationale, evaluation, and recommendations for use. British Journal of Audiology, 24, 29-43.
12. Massaro, D. W. (1998). Perceiving talking faces: From speech perception to a behavioral principle. Cambridge: MIT Press.
13. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 747-748.
14. Middlebrooks, J. C., & Green, D. M. (1991). Sound localization by human listeners. Annual Review of Psychology, 42, 135-159.
15. Proctor, R. W., & Van Zandt, T. (1994). Human factors in simple and complex systems. Boston: Allyn & Bacon.
16. Rosenblum. L. D. & Saldaña, H. M. (1996). An audiovisual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 22, 318-331.
17. Thurlow, W. R., & Jack. C. E. (1973). Certain determinants of the "ventriloquism effect." Perceptual and Motor Skills, 36, 1171-1184.
18. Vatikiotis-Bateson, E., Eigsti, I.-M., Yano, S., & Munhall, K. G. (1998). Eye movement of perceivers during audiovisual speech perception. Perception and Psychophysics, 60, 926-940.
19. Viktovitch, M., & Barber, P. (1994). Effect of video frame rate on subjects' ability to shadow one of two competing verbal passages. Journal of Speech & Hearing Research, 37, 1204-1210.
20. Wickens, T. D. (2002). Elementary signal detection theory. Oxford, England: Oxford University Press.
21. Yost, W. A. (1997). The cocktail party problem: Forty years later, In R. H. Gilkey & T. R. Anderson (Eds.), Binaural and spatial hearing in real and virtual environments (pp. 329-348). Mahwah, NJ: Erlbaum.