Perceptual weighting of individual and concurrent cues for sentence intelligibility: Frequency, envelope, and fine structure

Journal of the Acoustical Society of America

Volumn 129, Issue 2, 2011, Pages 977-988

  Fogerty, Daniel ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ASSISTIVE; COMPLEX INTERACTION; FINE STRUCTURES; MID-FREQUENCY; NORMAL-HEARING LISTENERS; PERCEPTUAL WEIGHTS; PROCESSING METHOD; SENTENCE INTELLIGIBILITY; SPEECH SIGNALS; SPEECH UNDERSTANDING; TEMPORAL PROPERTY;

ACOUSTIC NOISE; AUDITION; FREQUENCY BANDS; SIGNAL PROCESSING;

ACOUSTIC PROPERTIES;

ADOLESCENT; ADULT; ARTICLE; ASSOCIATION; AUDITORY STIMULATION; AUDITORY THRESHOLD; COMPREHENSION; HUMAN; NOISE; PERCEPTIVE DISCRIMINATION; PURE TONE AUDIOMETRY; SOUND DETECTION; SPEECH; SPEECH AUDIOMETRY; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION; TIME;

ACOUSTIC STIMULATION; ADOLESCENT; AUDIOMETRY, PURE-TONE; AUDIOMETRY, SPEECH; AUDITORY THRESHOLD; COMPREHENSION; CUES; HUMANS; NOISE; SIGNAL DETECTION, PSYCHOLOGICAL; SOUND SPECTROGRAPHY; SPEECH ACOUSTICS; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION; TIME FACTORS; YOUNG ADULT;

EID: 79952122614     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.3531954     Document Type: Article

References (62)

1. ANSI (1997). ANSI S3.5-1997, Methods for the Calculation of the Speech Intelligibility Index. (American National Standards Institute, New York).
2. ANSI (2004). ANSI S3.6-2004, Specifications for Audiometers. (American National Standards Institute, New York).
3. Apoux, F., and Bacon, S. P. (2004). Relative importance of temporal information in various frequency regions for consonant identification in quiet and in noise., J. Acoust. Soc. Am. 116, 1671-1680. 10.1121/1.1781329 (Pubitemid 39202579)
4. Ardoint, M., and Lorenzi, C. (2010). Effects of lowpass and highpass filtering on the intelligibility of speech based on temporal fine structure or envelope cues., Hear. Res. 260, 89-95. 10.1016/j.heares.2009.12.002
5. Berg, B. G. (1989). Analysis of weights in multiple observation tasks., J. Acoust. Soc. Am. 86, 1743-1746. 10.1121/1.398605
6. Berg, B. G., and Green, D. M. (1990). Spectral weights in profile listening., J. Acoust. Soc. Am. 88, 758-766. 10.1121/1.399725 (Pubitemid 20289775)
7. Berg, B. G., and Green, D. M. (1992). Discrimination of complex spectra: Spectral weights and performance efficiency., in Auditory Physiology and Perception, edited by, Y. Cazals, L. Demany, and K. Homer, (Pergamon, London), pp. 373-379.
8. Calandruccio, L., and Doherty, K. A. (2007). Spectral weighting strategies for sentences measured by a correlational method., J. Acoust. Soc. Am. 121, 3827-3836. 10.1121/1.2722211 (Pubitemid 46872137)
9. Calandruccio, L., and Doherty, K. A. (2008). Spectral weighting strategies for hearing-impaired listeners measured using a correlational method., J. Acoust. Soc. Am. 123, 2367-2378. 10.1121/1.2887857 (Pubitemid 351503008)
10. Darwin, C. J., Brungart, D. S., and Simpson, B. D. (2003). Effects of fundamental frequency and vocal-tract length changes on attention to one of two simultaneous talkers., J. Acoust. Soc. Am. 114, 2913-2922. 10.1121/1.1616924 (Pubitemid 37371647)
11. DePaolis, R. A., Janota, C. P., and Frank, T. (1996). Frequency importance functions for words, sentences, and continuous discourse., J. Speech Hear. Res. 39, 714-723.
12. Doherty, K. A., and Turner, C. W. (1996). Use of a correlational method to estimate a listener's weighting function for speech., J. Acoust. Soc. Am. 100, 3769-3773. 10.1121/1.417336 (Pubitemid 26422449)
13. Dorman, M. F., Loizou, P. C., and Rainey, D. (1997). Speech intelligibility as a function of the number of channels of stimulation for signal processors using sine-wave and noise-band outputs., J. Acoust. Soc. Am. 102, 2403-2411. 10.1121/1.419603 (Pubitemid 27441393)
14. Drullman, R., Festen, J. M., and Plomp, R. (1994a). Effect of temporal envelope smearing on speech reception., J. Acoust. Soc. Am. 95, 1053-1064. 10.1121/1.408467 (Pubitemid 24056370)
15. Drullman, R., Festen, J. M., and Plomp, R. (1994b). Effect of reducing slow temporal modulations on speech reception., J. Acoust. Soc. Am. 95, 2670-2680. 10.1121/1.409836 (Pubitemid 24152861)
16. Dubbelboer, F., and Houtgast, T. (2008). The concept of signal-to-noise ratio in the modulation domain and speech intelligibility., J. Acoust. Soc. Am. 124, 3937-3946. 10.1121/1.3001713
17. Fletcher, H., and Galt, R. (1950). Perception of speech and its relation to telephony., J. Acoust. Soc. Am. 22, 89-151. 10.1121/1.1906605
18. Fogerty, D., and Humes, L. E. (2010). Perceptual contributions to monosyllabic word intelligibility: Segmental, lexical, and noise replacement factors., J. Acoust. Soc. Am. 128, 3114-3125. 10.1121/1.3493439
19. Fogerty, D., and Kewley-Port, D. (2009). Perceptual contributions of the consonant-vowel boundary to sentence intelligibility., J. Acoust. Soc. Am. 126, 847-857. 10.1121/1.3159302
20. French, N. E., and Steinberg, J. C. (1947). Factors governing the intelligibility of speech sounds., J. Acoust. Soc. Am. 19, 90-119. 10.1121/1.1916407
21. Gallun, F., and Souza, P. (2008). Exploring the role of the modulation spectrum in phoneme recognition., Ear Hear. 29, 800-813. 10.1097/AUD. 0b013e31817e73ef
22. Garofolo, J., Lamel, L., Fisher, W., Fiscus, J., Pallett, D., and Dahlgren, N. (1990). DARPA TIMIT Acoustic-Phonetic Continuous Speech Corpus CD-ROM., National Institute of Standards and Technology. NTIS Order No. PB91-505065.
23. Grant, K. W., and Braida, L. D. (1991). Evaluating the articulation index for auditory-visual input., J. Acoust. Soc. Am. 89, 2952-2960. 10.1121/1.400733
24. Grant, K. W., and Walden, B. E. (1996). Spectral distribution of prosodic information., J. Speech Hear. Res. 39, 228-238.
25. Greenberg, S., Arai, T., and Silipo, R. (1998). Speech intelligibility derived from exceedingly sparse spectral information., in Proceedings of the International Conference on Spoken Language Processing, pp. 2803-2806.
26. Grosjean, F. (1980). Spoken word recognition processes and the gating paradigm., Percept. Psychophys. 28, 267-283. 10.3758/BF03204386
27. Hopkins, K., and Moore, B. C. J. (2009). The contribution of temporal fine structure to the intelligibility of speech in steady and modulated noise., J. Acoust. Soc. Am. 125, 442-446. 10.1121/1.3037233
28. Hopkins, K., and Moore, B. C. J. (2010). The importance of temporal fine structure information in speech at different spectral regions for normal-hearing and hearing-impaired subjects., J. Acoust. Soc. Am. 127, 1595-1608. 10.1121/1.3293003
29. Hopkins, K., Moore, B. C. J., and Stone, M. A. (2008). Effects of moderate cochlear hearing loss on the ability to benefit from temporal fine structure information in speech., J. Acoust. Soc. Am. 123, 1140-1153. 10.1121/1.2824018 (Pubitemid 351208321)
30. Houtgast, T., and Steeneken, H. J. M. (1985). A review of the MTF concept in room acoustics and its use for estimating speech intelligibility in auditoria., J. Acoust. Soc. Am. 77, 1069-1077. 10.1121/1.392224
31. IEEE (1969). IEEE recommended practice for speech quality measurements., IEEE Trans. Audio Electroacoust. 17, 227-246.
32. Kasturi, K., Loizou, P. C., Dorman, M., and Spahr, T. (2002). The intelligibility of speech with holes' in the spectrum., J. Acoust. Soc. Am. 112 (Pt.1), 1102-1111. 10.1121/1.1498855 (Pubitemid 35006667)
33. Kawahara, H., Masuda-Kastuse, I., and Cheveigne, A. (1999). Restructuring speech representations using a pitch adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds., Speech Commun. 27, 187-207. 10.1016/S0167-6393(98)00085-5
34. Kewley-Port, D., Burkle, T. Z., and Lee, J. H. (2007). Contribution of consonant versus vowel information to sentence intelligibility for young normal-hearing and elderly hearing-impaired listeners., J. Acoust. Soc. Am. 122, 2365-2375. 10.1121/1.2773986 (Pubitemid 47493362)
35. Kong, Y. -Y., and Carlyon, R. P. (2007). Improved speech recognition in noise in simulated binaurally combined acoustic and electric stimulation., J. Acoust. Soc. Am. 121, 3717-3727. 10.1121/1.2717408 (Pubitemid 46872129)
36. Laures, J., and Weismer, G. (1999). The effect of flattened F0 on intelligibility at the sentence-level., J. Speech Lang. Hear. Res. 42, 1148-1156.
37. Leiste, I. (1970). Suprasegmentals (MIT Press, Cambridge, MA), pp. 1-194.
38. Lentz, J. J., and Leek, M. R. (2002). Decision strategies of hearing-impaired listeners in spectral shape discrimination., J. Acoust. Soc. Am. 111, 1389-1398. 10.1121/1.1451066 (Pubitemid 34214079)
39. Li, N., and Loizou, P. C. (2008). A glimpsing account for the benefit of simulated combined acoustic and electric hearing., J. Acoust. Soc. Am. 123, 2287-2294. 10.1121/1.2839013 (Pubitemid 351503002)
40. Liberman, M. C. (1982). The cochlear frequency map for the cat: Labeling auditory-nerve fibers of known characteristic frequency., J. Acoust. Soc. Am. 72, 1441-1449. 10.1121/1.388677 (Pubitemid 13222560)
41. Loizou, P. C. (2007). Speech Enhancement: Theory and Practice (CRC Press, Taylor and Francis, Boca Raton, FL), pp. 1-608.
42. Lutfi, R. A. (1995). Correlation coefficients and correlation ratios as estimates of observer weights in multiple-observation tasks., J. Acoust. Soc. Am. 97, 1333-1334. 10.1121/1.412177
43. Mehr, M. A., Turner, C. W., and Parkinson, A. (2001). Channel weights for speech recognition in cochlear implant users., J. Acoust. Soc. Am. 109, 359-366. 10.1121/1.1322021
44. Miller, G. A., Heise, G. A., and Lichten, W. (1951). The intelligibility of speech as a function of the context of test material., J. Exp. Psychol. 41, 329-335. 10.1037/h0062491
45. Moore, B. C. J. (2008). The role of temporal fine structure processing in pitch perception, masking, and speech perception for normal-hearing and hearing-impaired people., J. Assoc. Res. Otolaryngol. 9, 399-406. 10.1007/s10162-008-0143-x
46. Moore, B. C. J., and Glasberg, B. R. (1983). Suggested formulae for calculating auditory-filter bandwidths and excitation pattern., J. Acoust. Soc. Am. 74, 750-753. 10.1121/1.389861 (Pubitemid 13019047)
47. Moore, D. R., Schnupp, J. W. H., and King, A. J. (2001). Coding the temporal structure of sounds in auditory cortex., Nat. Neurosci. 4, 1055-1056. 10.1038/nn1101-1055 (Pubitemid 34116546)
48. Owren, M. J., and Cardillo, G. C. (2006). The relative roles of vowels and consonants in discriminating talker identity versus word meaning., J. Acoust. Soc. Am. 119, 1727-1739. 10.1121/1.2161431 (Pubitemid 43326039)
49. Phatak, S. A., and Allen, J. B. (2007). Consonant and vowel confusions in speech-weighted noise., J. Acoust. Soc. Am. 121, 2312-2326. 10.1121/1.2642397 (Pubitemid 46548430)
50. Richards, V. M., and Zhu, S. (1994). Relative estimates of combination weights, decision criteria, and internal noise based on correlation coefficients., J. Acoust. Soc. Am. 95, 423-434. 10.1121/1.408336 (Pubitemid 24027839)
51. Rosen, S. (1992). Temporal information in speech: Acoustic, auditory, and linguistic aspects., Philos. Trans. R. Soc. London, Ser. B, 336, 367-373. 10.1098/rstb.1992.0070
52. Shannon, R. V., Zeng, F. -G., Kamath, V., Wygonski, J., and Ekelid, M. (1995). Speech recognition with primarily temporal cues., Science 270, 303-304. 10.1126/science.270.5234.303
53. Shannon, R. V., Zeng, F. -G., and Wygonski, J. (1998). Speech recognition with altered spectral distribution of envelope cues., J. Acoust. Soc. Am. 104, 2467-2476. 10.1121/1.423774 (Pubitemid 28463142)
54. Sherbecoe, R. L., and Studebaker, G. A. (2002). Audibility-index functions for the connected speech test., Ear Hear. 23, 385-398. 10.1097/00003446-200210000-00001 (Pubitemid 35244756)
55. Smith, Z. M., Delgutte,A. J., and Oxenham, A. J. (2002). Chimaeric sounds reveal dichotomies in auditory perception., Nature 416, 87-90. 10.1038/416087a (Pubitemid 34215405)
56. Turner, C. W., Kwon, B. J., Tanaka, C., Knapp, J., Hubbartt, J. L., and Doherty, K. A. (1998). Frequency-weighting functions for broadband speech as estimated by a correlational method., J. Acoust. Soc. Am. 104, 1580-1585. 10.1121/1.424370 (Pubitemid 28421583)
57. Turner, C., Mehr, M., Hughes, M., Brown, C., and Abbas, P. (2002). Within-subject predictors of speech recognition in cochlear implants: A null result., ARLO 3, 95-100. 10.1121/1.1477875 (Pubitemid 38809465)
58. van der Horst, R., Leeuw, A. R., and Dreschler, W. A. (1999). Importance of temporal-envelope cues in consonant recognition., J. Acoust. Soc. Am. 105, 1801-1809. 10.1121/1.426718 (Pubitemid 29115830)
59. Warren, R. M., Reiner, K. R., Bashford, J. A., Jr., and Brubaker, B. S. (1995). Spectral redundancy: Intelligibility of sentences heard through narrow spectral slits., Percept. Psychophys. 57, 175-182. 10.3758/BF03206503
60. Wingfield, A., Lahar, C. J., and Stine, E. A. L. (1989). Age and decision strategies in running memory for speech: Effects of prosody and linguistic structure., J. Gerontol. Psychol. Sci. 44, 106-113.
61. Xu, L., and Pfingst, B. E. (2003). Relative importance of temporal envelope and fine structure in lexical-tone perception., J. Acoust. Soc. Am. 114 (Pt.1), 3024-3027. 10.1121/1.1623786 (Pubitemid 37553613)
62. Xu, L., Thompson, C. S., and Pfingst, B. E. (2005). Relative contributions of spectral and temporal cues for phoneme recognition., J. Acoust. Soc. Am. 117, 3255-3267. 10.1121/1.1886405 (Pubitemid 40675185)