Informational masking of speech in children: Auditory-visual integration

Journal of the Acoustical Society of America

Volumn 119, Issue 6, 2006, Pages 3940-3949

  Wightman, Frederic ^a   Kistler, Doris ^a   Brungart, Douglas ^b  

^a UNIVERSITY OF LOUISVILLE   (United States)

^b AIR FORCE RESEARCH LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO SYSTEMS; DATA PROCESSING; SPEECH SYNTHESIS; SYNCHRONIZATION; VIDEO SIGNAL PROCESSING;

AUDIOVISUAL PRESENTATION; INFORMATIONAL MASKING; SPEECHREADING ABILITY; TARGET/DISTRACTER RATIOS;

SPEECH RECOGNITION;

ADOLESCENT; ARTICLE; ATTENTION; AUDIOMETRY; CONTROLLED STUDY; DISTRACTIBILITY; HEARING; HUMAN; PRESCHOOL CHILD; PRIORITY JOURNAL; SCHOOL CHILD; SPEECH; SPEECH AUDIOMETRY; TASK PERFORMANCE; VISUAL MASKING;

ADOLESCENT; ADULT; AGE FACTORS; AUDITORY CORTEX; CHILD; FEMALE; HUMANS; MALE; PERCEPTUAL MASKING; PSYCHOACOUSTICS; SPEECH PERCEPTION; VISION; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 33745137835     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.2195121     Document Type: Article

References (79)

1. Allen, P., and Wightman, F. (1994). " Psychometric functions for children's detection of tones in noise., " J. Speech Hear. Res. 37, 205-215.
2. Allen, P., and Wightman, F. (1995). " Effects of signal and masker uncertainty on children's detection., " J. Speech Hear. Res. 38, 503-511.
3. Allen, P., Wightman, F., Kistler, D., and Dolan, T. (1989). " Frequency resolution in children., " J. Speech Hear. Res. 32, 317-322.
4. Arbogast, T. L., Mason, C. R., and Kidd, G., Jr. (2002). " The effect of spatial separation on informational and energetic masking of speech., " J. Acoust. Soc. Am. 112, 2086-2098.
5. Arbogast, T. L., Mason, C. R., and Kidd, G., Jr. (2005). " The effect of spatial separation on informational masking of speech in normal-hearing and hearing-impaired listeners., " J. Acoust. Soc. Am. 117, 2169-2180.
6. Aylward, E. H., Park, J. E., Field, K. M., Parsons, A. C., Richards, T. L., Cramer, S. C., and Meltzoff, A. N. (2005). " Brain activation during face perception: Evidence of a developmental change., " J. Cogn Neurosci. 17, 308-319.
7. Bolia, R. S., Nelson, W. T., Ericson, M. A., and Simpson, B. D. (2000). " A speech corpus for multitalker communications research., " J. Acoust. Soc. Am. 107, 1065-1066.
8. Brungart, D. S. (2001a). " Evaluation of speech intelligibility with the coordinate response measure., " J. Acoust. Soc. Am. 109, 2276-2279.
9. Brungart, D. S. (2001b). " Informational and energetic masking effects in the perception of two simultaneous talkers., " J. Acoust. Soc. Am. 109, 1101-1109.
10. Brungart, D. S., and Simpson, B. D. (2002a). " The effects of spatial separation in distance on the informational and energetic masking of a nearby speech signal., " J. Acoust. Soc. Am. 112, 664-676.
11. Brungart, D. S., and Simpson, B. D. (2002b). " Within-ear and across-ear interference in a cocktail-party listening task., " J. Acoust. Soc. Am. 112, 2985-2995.
12. Brungart, D. S., and Simpson, B. D. (2004). " Within-ear and across-ear interference in a dichotic cocktail party listening task: Effects of masker uncertainty., " J. Acoust. Soc. Am. 115, 301-310.
13. Brungart, D. S., and Simpson, B. D. (2005). " Interference from audio distracters during speechreading., " J. Acoust. Soc. Am. 118, 3889-3902.
14. Brungart, D. S., Simpson, B. D., Ericson, M. A., and Scott, K. R. (2001). " Informational and energetic masking effects in the perception of multiple simultaneous talkers., " J. Acoust. Soc. Am. 110, 2527-2538.
15. Brungart, D. S., Simpson, B. D., Darwin, C. J., Arbogast, T. L., and Kidd, G. (2005). " Across-ear interference from parametrically degraded synthetic speech signals in a dichotic cocktail-party listening task., " J. Acoust. Soc. Am. 117, 292-304.
16. Campbell, R.,,, Dodd, B.,, and, Burnham, D. K., (Eds.). (1998). Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-Visual Speech (Psychology Press, Hove, East Sussex, UK).
17. de Gelder, B., Vroomen, J., and Laeng, B. (1998). " Impaired speechreading related to arrested development of face processing., " in Auditory-Visual Speech Processing (AVSP'98), edited by D. Burnham, J. Robert-Ribes, and E. Vatikiotis-Bateson (http://www.isca-speech.org/archive/ avsp98, Terrigal-Sydney, Australia), pp. 157-161.
18. Desjardins, R. N., and Werker, J. F. (2004). " Is the integration of heard and seen speech mandatory for infants? " Dev. Psychobiol. 45, 187-203.
19. Desjardins, R. N., Rogers, J., and Werker, J. F. (1997). " An exploration of why preschoolers perform differently than do adults in audiovisual speech perception tasks., " J. Exp. Child Psychol. 66, 85-110.
20. Dirks, D. D., and Bower, D. R. (1969). " Masking effects of speech competing messages., " J. Speech Hear. Res. 12, 229-245.
21. Doherty-Sneddon, G., Bonner, L., and Bruce, V. (2001). " Cognitive demands of face monitoring: Evidence for visuospatial overload., " Mem. Cognit. 29, 909-919.
22. Durlach, N. I., Mason, C. R., Kidd, G., Jr., Arbogast, T. L., Colburn, H. S., and Shinn-Cunningham, B. G. (2003). " Note on informational masking., " J. Acoust. Soc. Am. 113, 2984-2987.
23. Egan, J. P., Carterette, E. C., and Thwing, E. J. (1954). " Some factors affecting multi-channel listening., " J. Acoust. Soc. Am. 26, 774-782.
24. Fallon, M., Trehub, S. E., and Schneider, B. A. (2000). " Children's perception of speech in multitalker babble., " J. Acoust. Soc. Am. 108, 3023-3029.
25. Freyman, R. L., Balakrishnan, U., and Helfer, K. S. (2001). " Spatial release from informational masking in speech recognition., " J. Acoust. Soc. Am. 109, 2112-2122.
26. Freyman, R. L., Helfer, K. S., McCall, D. D., and Clifton, R. K. (1999). " The role of perceived spatial separation in the unmasking of speech., " J. Acoust. Soc. Am. 106, 3578-3588.
27. Geffen, G., and Sexton, M. A. (1978). " The development of auditory strategies of attention., " Dev. Psychol. 14, 11-17.
28. Geffen, G., and Wale, J. (1979). " Development of selective listening and hemispheric asymmetry., " Dev. Psychol. 15, 138-146.
29. Gibson, E. J. (1969). Principles of Perceptual Learning and Development (Appleton-Century-Crofts, New York).
30. Grant, K. W. (2002). " Measures of auditory-visual integration for speech understanding: A theoretical perspective., " J. Acoust. Soc. Am. 112, 30-33.
31. Grant, K. W., and Seitz, P. F. (1998). " Measures of auditory-visual integration in nonsense syllables and sentences., " J. Acoust. Soc. Am. 104, 2438-2450.
32. Grant, K. W., and Seitz, P. F. (2000). " The use of visible speech cues for improving auditory detection of spoken sentences., " J. Acoust. Soc. Am. 108, 1197-1208.
33. Grant, K. W., Walden, B. E., and Seitz, P. F. (1998). " Auditory-visual speech recognition by hearing-impaired subjects: Consonant recognition, sentence recognition, and auditory-visual integration., " J. Acoust. Soc. Am. 103, 2677-2690.
34. Grant, K. W., Wassenhove, V. v., and Poeppel, D. (2004). " Detection of auditory (cross-spectral) and auditory-visual (cross-modal) synchrony., " Speech Commun. 44, 43-53.
35. Hall, J. W., III, Buss, E., and Grose, J. H. (2005). " Informational masking release in children and adults., " J. Acoust. Soc. Am. 118, 1605-1613.
36. Hall, J. W., III, Grose, J. H., Buss, E., and Dev, M. B. (2002). " Spondee recognition in a two-talker masker and a speech-shaped noise masker in adults and children., " Ear Hear. 23, 159-165.
37. Helfer, K. S., and Freyman, R. L. (2005). " The role of visual speech cues in reducing energetic and informational masking., " J. Acoust. Soc. Am. 117, 842-849.
38. Hollich, G., Newman, R. S., and Jusczyk, P. W. (2005). " Infants' use of synchronized visual information to separate streams of speech., " Child Dev. 76, 598-613.
39. Kidd, G., Jr., Mason, C. R., and Gallun, F. J. (2005a). " Combining energetic and informational masking for speech identification., " J. Acoust. Soc. Am. 118, 982-992.
40. Kidd, G. Jr., Mason, C. R., Brughera, A., and Hartmann, W. M. (2005b). " The role of reverberation in release from masking due to spatial separation of sources for speech identification., " Acust. Acta Acust. 91, 526-536.
41. Kidd, G. Jr., Arbogast, T. L., Mason, C. R., and Gallun, F. J. (2005c). " The advantage of knowing where to listen., " J. Acoust. Soc. Am. 118, 3804-3815.
42. Kidd, G., Jr., Mason, C. R., Arbogast, T. L., Brungart, D. S., and Simpson, B. D. (2003). " Informational masking caused by contralateral stimulation., " J. Acoust. Soc. Am. 113, 1594-1603.
43. Kidd, G., Jr., Mason, C. R., Rohtla, T. L., and Deliwala, P. S. (1998). " Release from masking due to spatial separation of sources in the identification of nonspeech auditory patterns., " J. Acoust. Soc. Am. 104, 422-431.
44. Kishon-Rabin, L., and Henkin, Y. (2000). " Age-related changes in the visual perception of phonologically significant contrasts., " Br. J. Audiol. 34, 363-374.
45. Kuhl, P. K., and Meltzoff, A. N. (1982). " The bimodal perception of speech in infancy., " Science 218, 1138-1141.
46. Lewkowicz, D. J. (1996). " Perception of auditory-visual temporal synchrony in human infants., " J. Exp. Psychol. Hum. Percept. Perform. 22, 1094-1106.
47. Litovsky, R. Y. (2005). " Speech intelligibility and spatial release from masking in young children., " J. Acoust. Soc. Am. 117, 3091-3099.
48. Lutfi, R. A. (1990). " How much masking is informational masking? " J. Acoust. Soc. Am. 88, 2607-2610.
49. Lutfi, R. A., Kistler, D. J., Oh, E. L., Wightman, F. L., and Callahan, M. R. (2003). " One factor underlies individual differences in auditory informational masking within and across age groups., " Percept. Psychophys. 65, 396-406.
50. Lyxell, B., and Holmberg, I. (2000). " Visual speech reading and cognitive performance in hearing-impaired and normal hearing children (11-14 years)., " Br. J. Educ. Psychol. 70, 505-518.
51. Massaro, D. W. (1984). " Children's perception of visual and auditory speech., " Child Dev. 55, 1777-1788.
52. Massaro, D. W., Cohen, M. M., and Gesi, A. T. (1993). " Long-term training, transfer, and retention in learning to lipread., " Percept. Psychophys. 53, 549-562.
53. Massaro, D. W., Thompson, L. A., Barron, B., and Laren, E. (1986). " Developmental changes in visual and auditory contributions to speech perception., " J. Exp. Child Psychol. 41, 93-113.
54. McGurk, H., and MacDonald, J. (1976). " Hearing lips and seeing voices., " Nature (London) 264, 746-748.
55. Mondloch, C. J., Dobson, K. S., Parsons, J., and Maurer, D. (2004). " Why 8-years -olds cannot tell the difference between Steve Martin and Paul Newman: Factors contributing to the slow development of sensitivity to the spacing of facial features., " J. Exp. Child Psychol. 89, 159-181.
56. Mondloch, C. J., Geldart, S., Maurer, D., and Le Grand, R. (2003). " Developmental changes in face processing skills., " J. Exp. Child Psychol. 86, 67-84.
57. Monsen, R. B., and Engerbretson, A. M. (1983). " The accuracy of formant frequency measurements: A comparison of spectrographic analysis and linear prediction., " J. Speech Hear. Res. 26, 91-97.
58. Moore, B. C. J., and Glasberg, B. R. (1987). " Formulae describing frequency selectivity as a function of frequency and level, and their use in calculating excitation patterns., " Hear. Res. 28, 209-225.
59. Napolitano, A. C., and Sloutsky, V. M. (2004). " Is a picture worth a thousand words? The flexible nature of modality dominance in young children., " Child Dev. 75, 1850-1870.
60. Neff, D. L., and Callaghan, B. P. (1988). " Effective properties of multicomponent simultaneous maskers under conditions of uncertainty., " J. Acoust. Soc. Am. 83, 1833-1838.
61. Oh, E. L., and Lutfi, R. A. (1998). " Nonmonotonicity of informational masking., " J. Acoust. Soc. Am. 104, 3489-3499.
62. Oh, E. L., Wightman, F., and Lutfi, R. A. (2001). " Children's detection of pure-tone signals with random multitone maskers., " J. Acoust. Soc. Am. 109, 2888-2895.
63. Robinson, C. W., and Sloutsky, V. M. (2004). " Auditory dominance and its change in the course of development., " Child Dev. 75, 1387-1401.
64. Rosenblum, L. D., Schmuckler, M. A., and Johnson, J. A. (1997). " The McGurk effect in infants., " Percept. Psychophys. 59, 347-357.
65. Schneider, B. A., Trehub, S. E., Morrongiello, B. A., and Thorpe, L. A. (1989). " Developmental changes in masked thresholds., " J. Acoust. Soc. Am. 86, 1733-1742.
66. Schwarzer, G. (2000). " Development of face processing: The effect of face inversion., " Child Dev. 71, 391-401.
67. Sexton, M. A., and Geffen, G. (1979). " Development of three strategies of attention in dichotic monitoring., " Dev. Psychol. 15, 299-310.
68. Slaney, M. (1993). An efficient implementation of the Patterson-Holdsworth auditory filter bank (35), Apple Computer, Inc., Cupertino, CA.
69. Slaney, M. (1994). Auditory Toolbox: Apple Computer, Inc., Cupertino, CA.
70. Sloutsky, V. M., and Napolitano, A. C. (2003). " Is a picture worth a thousand words? Preference for auditory modality in young children., " Child Dev. 74, 822-833.
71. Sommers, M. S., Tye-Murray, N., and Spehar, B. (2005). " Auditory-visual speech perception and auditory-visual enhancement in normal-hearing younger and older adults., " Ear Hear. 26, 263-275.
72. Sumby, W., and Pollack, I. (1954). " Visual contribution to speech intelligibility in noise., " J. Acoust. Soc. Am. 26, 212-215.
73. Summerfield, Q. (1979). " Use of visual information for phonetic perception., " Phonetica 36, 314-331.
74. Taylor, M. J., Batty, M., and Itier, R. J. (2004). " The faces of development: A review of early face processing over childhood., " J. Cogn Neurosci. 16, 1426-1442.
75. van Wassenhove, V., Grant, K. W., and Poeppel, D. (2005). " Visual speech speeds up the neural processing of auditory speech., " Proc. Natl. Acad. Sci. U.S.A. 102, 1181-1186.
76. Watson, C. S., Qiu, W. W., Chamberlain, M. M., and Li, X. (1996). " Auditory and visual speech perception: Confirmation of a modality-independent source of individual differences in speech recognition., " J. Acoust. Soc. Am. 100, 1153-1162.
77. Wightman, F. L., and Kistler, D. J. (2005). " Informational masking of speech in children: Effects of ipsilateral and contralateral distracters., " J. Acoust. Soc. Am. 118, 3164-3176.
78. Wightman, F. L., Callahan, M. R., Lutfi, R. A., Kistler, D. J., and Oh, E. (2003). " Children's detection of pure-tone signals: Informational masking with contralateral maskers., " J. Acoust. Soc. Am. 113, 3297-3305.
79. Yakel, D. A., Rosenblum, L. D., and Fortier, M. A. (2000). " Effects of talker variability on speechreading., " Percept. Psychophys. 62, 1405-1412.