The role of visual speech cues in reducing energetic and informational masking

Journal of the Acoustical Society of America

Volumn 117, Issue 2, 2005, Pages 842-849

  Heifer, Karen S ^a   Freyman, Richard L ^a  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SPATIAL VARIABLES MEASUREMENT; SPEECH ANALYSIS; SPEECH INTELLIGIBILITY;

LIPREADING CUES; PHONETIC INFORMATION; SPATIAL SEPARATION; VISUAL CUES;

SPEECH;

ARTICLE; ASSOCIATION; AUDITORY MASKING; AUDITORY STIMULATION; CONTROLLED STUDY; ENERGY TRANSFER; HUMAN; HUMAN EXPERIMENT; INFORMATIONAL MASKING; MASKING; NOISE; NORMAL HUMAN; PHONETICS; PRIORITY JOURNAL; SPEECH INTELLIGIBILITY; STEADY STATE; VISION; VISUAL STIMULATION; VOICE;

ADULT; CUES; HUMANS; LIPREADING; NOISE; PERCEPTUAL MASKING; PHONETICS; SPEECH ACOUSTICS; SPEECH PERCEPTION;

EID: 13544256368     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.1836832     Document Type: Article

References (34)

1. ANSI (1996). ANSI 3.6-1996, "Specifications for Audiometers" (American National Standards Institute, New York).
2. Arbogast, A. L., Mason, C. R., and Kidd, G. (2002). "The effect of spatial separation on informational and energetic masking of speech," J. Acoust. Soc. Am. 112, 2086-2098.
3. Bench, J., Doyle, J., Daly, N., and Lind, C. (1995). "Audiovisual, auditory, and visual perception of BKB/A sentence lists (speechreading version) by normally hearing subjects: Practice effects across presentation modes," Aust. J. Audiol. 17, 115-121.
4. Bronkhorst, A. W., and Plomp, R. (1992). "Effect of multiple speech-like maskers on binaural speech recognition in normal and impaired hearing," J. Acoust. Soc. Am. 92, 3132-3139.
5. Brungart, D. S. (2001). "Informational and energetic masking effects in the perception of two simultaneous talkers," J. Acoust. Soc. Am. 109, 1101-1109.
6. Carhart, R., Tillman, T., and Greetis, R. (1969). "Perceptual masking in multiple sound backgrounds," J. Acoust. Soc. Am. 45, 694-703.
7. Darwin, C. J., and Carlyon, R. P. (1995). "Auditory Grouping," in The Handbook of Perception and Cognition (Hearing), edited by B. C. J. Moore (Academic, London), pp. 387-424.
8. Freyman, R. L., Heifer, K. S., McCall, D. D., and Clifton, R. K. (1999). "The role of perceived spatial separation in the unmasking of speech," J. Acoust. Soc. Am. 106, 3578-3588.
9. Freyman, R. L., Balakrishnan, U., and Heifer, K. S. (2001). "Spatial release from informational masking in speech recognition," J. Acoust. Soc. Am. 109, 2112-2122.
10. Freyman, R. L., Balakrishnan, U., and Heifer, K. S. (2004). "Effect of number of masking talkers and auditory priming on informational masking in speech recognition," J. Acoust. Soc. Am. 115, 2246-2256.
11. Gagne, J. P., Rochette, A. J., and Charest, M. (2002). "Auditory, visual and audiovisual clear speech," Speech Commun. 37, 213-230.
12. Grant, K. W. (2001). "The effect of speechreading on masked detection thresholds for filtered speech," J. Acoust. Soc. Am. 109, 2272-2275.
13. Grant, K. W., and Seitz, P. F. (2000a). "The recognition of isolated words and words in sentences: Individual variability in the use of sentence context," J. Acoust. Soc. Am. 107, 1000-1011.
14. Grant, K. W., and Seitz, P. F. (2000b). "The use of visible speech cues for improving auditory detection of spoken sentences," J. Acoust. Soc. Am. 108, 1197-1208.
15. Helfer, K. S. (1997). "Auditory and auditory-visual perception of clear and conversational speech," J. Speech Lang. Hear. Res. 40, 432-443.
16. Hirsch, I. J. (1950). "Relation between localization and intelligibility," J. Acoust. Soc. Am. 22, 196-200.
17. Kidd, G., Jr., Mason, C. R., Brughera, A., and Hartmann, W. M., "The role of reverberation in release from masking due to spatial separation of sources for speech identification," Acust. Acta Acust. (submitted).
18. Kidd, G., Jr., Mason, C. R., Rohtla, T. L., and Deliwala, P. S. (1998). "Release from masking due to spatial separation of sources in the identification of nonspeech auditory patterns," J. Acoust. Soc. Am. 104, 422-431.
19. Levitt, H. (1971). "Transformed up-down methods in psychoacoustics," J. Acoust. Soc. Am. 49, 467-477.
20. MacKeith, N. W., and Coles, R. R. (1971). "Binaural advantages in the hearing of speech," J. Laryngol. Otol. 85, 213-232.
21. Noble, W., and Perrett, S. (2002). "Hearing speech against spatially separate competing speech versus competing noise," Percept. Psychophys. 64, 1325-1336.
22. Plomp, R. (1976). "Binaural and monaural speech intelligibility of connected discourse in reverberation as a function of azimuth of a single competing sound source (speech or noise)," Acustica 34, 200-211.
23. Reisberg, D. (1978). "Looking where you listen: Visual cues and auditory attention," Acta Psychol. 42, 331-341.
24. Reisberg, D., Scheiber, R., and Potemken, L. (1981). "Eye position and the control of auditory attention," J. Exp. Psychol. Hum. Percept. Perform. 7, 318-323.
25. Repp, B. H., Frost, R., and Zsiga, E. (1992). "Lexical mediation between sight and sound in speechreading," Q. J. Exp. Psychol. A 45, 1-20.
26. Rudmann, D. S., McCarley, J. S., and Kramer, A. F. (2003). "Bimodal displays improve speech comprehension in environments with multiple speakers," Hum. Factors 45, 329-336.
27. Spence, C., Ranson, J., and Driver, J. (2000). "Cross-modal selective attention: On the difficulty of ignoring sounds at the locus of visual attention," Percept. Psychophys. 62, 410-424.
28. Sumby, W. H., and Pollack, I. (1954). "Visual contribution to speech intelligibility in noise," J. Acoust. Soc. Am. 26, 212-215.
29. Summerfield, Q. (1979). "Use of visual information for phonetic perception," Phonetica 36, 314-331.
30. Summerfield, Q. (1987). "Some preliminaries to a comprehensive account of audio-visual speech perception," in Hearing by Eye: The Psychology of Lipreading, 1st ed., edited by B. Dodd and R. Campbell (Erlbaum, London), pp. 3-51.
31. Takahashi, G. A., and Bacon, S. P. (1992). "Modulation detection, modulation masking, and speech understanding in noise in the elderly," J. Speech Hear. Res. 35, 1410-1421.
32. Vitkovitch, M., and Barber, P. (1994). "Effects of video frame rate on subjects' ability to shadow one of two competing verbal passages," J. Speech Hear. Res. 37, 1204-1210.
33. Vroomen, J., and de Gelder, B. (2000). "Sound enhances visual perception: Cross-modal effects of auditory organization on vision," J. Exp. Psychol. Hum. Percept. Perform. 26, 1583-1590.
34. Zurek, P. M. (1993). "Binaural advantages and directional effects in speech intelligibility," in Acoustical Factors Affecting Hearing Aid Performance, edited by G. A. Studebaker and I. Hockberg (Allyn and Bacon, Boston), pp. 255-276.