Predicting speech intelligibility based on the signal-to-noise envelope power ratio after modulation-frequency selective processing

Journal of the Acoustical Society of America

Volumn 130, Issue 3, 2011, Pages 1475-1487

  Jørgensen, Søren ^a   Dau, Torsten ^a  

^a TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

IDEAL OBSERVERS; INTERNAL REPRESENTATION; MODEL ESTIMATES; MODULATION DETECTION; MODULATION FILTERBANK; MODULATION FREQUENCIES; NOISY SPEECH; POWER RATIO; SIGNAL TO NOISE; SPECTRAL SUBTRACTIONS; SPEECH TRANSMISSION INDEX; SPEECH-SHAPED NOISE;

FORECASTING; LARGE SCALE SYSTEMS; MODULATION; SIGNAL TO NOISE RATIO; SPEECH COMMUNICATION; SPEECH TRANSMISSION;

SPEECH INTELLIGIBILITY;

ACOUSTICS; ADULT; ARTICLE; AUDITORY STIMULATION; AUDITORY THRESHOLD; CONSTRUCTION WORK AND ARCHITECTURAL PHENOMENA; FEMALE; HUMAN; MALE; NOISE; NONLINEAR SYSTEM; PERCEPTION; PREDICTIVE VALUE; PSYCHOPHYSICS; PURE TONE AUDIOMETRY; RECOGNITION; SIGNAL PROCESSING; SOUND DETECTION; SPEECH; SPEECH AUDIOMETRY; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION; TIME; VIBRATION;

ACOUSTIC STIMULATION; ACOUSTICS; ADULT; AUDIOMETRY, PURE-TONE; AUDIOMETRY, SPEECH; AUDITORY THRESHOLD; FACILITY DESIGN AND CONSTRUCTION; FEMALE; HUMANS; MALE; NOISE; NONLINEAR DYNAMICS; PERCEPTUAL MASKING; PREDICTIVE VALUE OF TESTS; PSYCHOACOUSTICS; RECOGNITION (PSYCHOLOGY); SIGNAL PROCESSING, COMPUTER-ASSISTED; SOUND SPECTROGRAPHY; SPEECH ACOUSTICS; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION; TIME FACTORS; VIBRATION; YOUNG ADULT;

EID: 80052546551     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.3621502     Document Type: Article

References (65)

1. American National Standards Institute (1969). ANSI S3.5, American National Standard Methods for the Calculation of the Articulation Index (American National Standards Institute, New York).
2. American National Standards Institute (1997). ANSI S3.5, Methods for the Calculation of the Speech Intelligibility Index (American National Standards Institute, New York).
3. Berouti, M., Schwartz, R., and Makhoul, J. (1979). Enhancement of speech corrupted by acoustic noise., ICASSP 4, 208-211. (Pubitemid 9454996)
4. Boll, S. (1979). Suppression of acoustic noise in speech using spectral subtraction, IEEE Trans. Acoust. Speech Signal Process. 27, 113-120. 10.1109/TASSP.1979.1163209 (Pubitemid 9467471)
5. Chi, T. Gao, Y. Guyton, M. C. Ru, P., and Shamma, S. (1999). Spectro-temporal modulation transfer functions and speech intelligibility., J. Acoust. Soc. Am. 106, 2719-2732. 10.1121/1.428100 (Pubitemid 29523087)
6. Chi, T., Ru, P., and Shamma, S. (2005). Multiresolution spectrotemporal analysis of complex sounds., J. Acoust. Soc. Am. 118, 887-906. 10.1121/1.1945807 (Pubitemid 41129224)
7. Christensen, C. L. (2009). Odeon Room Acoustics Program, Version 10.1, User Manual, Industrial, Auditorium and Combined Editions (ODEON A/S, Kgs. Lyngby, Denmark), URL http://www.odeon.dk/pdf/OdeonManual10.pdf (Last viewed 02/12/11), pp. 1-145.
8. Christiansen, C., Pedersen, M. S., and Dau, T. (2010). Prediction of speech intelligibility based on an auditory preprocessing model., Speech Commun. 52, 678-692. 10.1016/j.specom.2010.03.004
9. Dau, T., Kollmeier, B., and Kohlrausch, A. (1997a). Modeling auditory processing of amplitude modulation. I. detection and masking with narrow-band carriers., J. Acoust. Soc. Am. 102, 2892-2905. 10.1121/1.420344 (Pubitemid 27486267)
10. Dau, T., Kollmeier, B., and Kohlrausch, A. (1997b). Modeling auditory processing of amplitude modulation: II. spectral and temporal integration., J. Acoust. Soc. Am. 102, 2906-2919. 10.1121/1.420345 (Pubitemid 27486268)
11. Dau, T. Verhey, J., and Kohlrausch, A. (1999). Intrinsic envelope fluctuations and modulation-detection thresholds for narrow-band noise carriers., J. Acoust. Soc. Am. 106, 2752-2760. 10.1121/1.428103 (Pubitemid 29523090)
12. Drullman, R. (1995). Temporal envelope and fine structure cues for speech intelligibility, J. Acoust. Soc. Am. 97, 585-592. 10.1121/1.413112
13. Drullman, R., Festen, J., and Plomp, R. (1994a). Effect of reducing slow temporal modulations on speech reception., J. Acoust. Soc. Am. 95, 2670-2680. 10.1121/1.409836 (Pubitemid 24152861)
14. Drullman, R., Festen, J. M., and Plomp, R. (1994b). Effect of temporal envelope smearing on speech reception., J. Acoust. Soc. Am. 95, 1053-1064. 10.1121/1.408467 (Pubitemid 24056370)
15. Dubbelboer, F., and Houtgast, T. (2007). A detailed study on the effects of noise on speech intelligibility., J. Acoust. Soc. Am. 122, 2865-2871. 10.1121/1.2783131
16. Dubbelboer, F., and Houtgast, T. (2008). The concept of signal-to-noise ratio in the modulation domain and speech intelligibility., J. Acoust. Soc. Am. 124, 3937-3946. 10.1121/1.3001713
17. Duquesnoy, A. J. (1983). Effect of a single interfering noise or speech source upon the binaural sentence intelligibility of aged persons., J. Acoust. Soc. Am. 74, 739-743. 10.1121/1.389859 (Pubitemid 13019046)
18. Duquesnoy, A. J., and Plomp, R. (1980). Effect of reverberation and noise on the intelligibility of sentences in cases of presbyacusis., J. Acoust. Soc. Am. 68, 537-544. 10.1121/1.384767 (Pubitemid 11227341)
19. Egan, J., Lindner, W., and McFadden, D. (1969). Masking-level differences and the form of the psychometric function., Percept. Psychophys. 6, 209-215. 10.3758/BF03207019
20. Egan, J. P. (1965). Masking-level differences as a function of interaural disparities in intensity of signal and of noise., J. Acoust. Soc. Am. 38, 1043-1049. 10.1121/1.1909836
21. Egan, J. P., Clarke, F. R., and Carterette, E. C. (1956). On the transmission and confirmation of messages in noise., J. Acoust. Soc. Am. 28, 536-550. 10.1121/1.1908387
22. Elhilali, M., Chi, T., and Shamma, S. A. (2003). A spectro-temporal modulation index (STMI) for assessment of speech intelligibility., Speech Commun. 41, 331-348. 10.1016/S0167-6393(02)00134-6
23. Elliott, T. M., and Theunissen, F. E. (2009). The modulation transfer function for speech intelligibility., PLoS Comput. Biol. 5, 1000302. 10.1371/journal.pcbi.1000302.g001
24. Ewert, S., and Dau, T. (2000). Characterizing frequency selectivity for envelope fluctuations., J. Acoust. Soc. Am. 108, 1181-1196. 10.1121/1.1288665
25. Ewert, S., and Dau, T. (2004). External and internal limitations in amplitude-modulation processing., J. Acoust. Soc. Am. 116, 478-490. 10.1121/1.1737399 (Pubitemid 38916023)
26. Ewert, S. D., Verhey, J. L., and Dau, T. (2002). Spectro-temporal processing in the envelope-frequency domain., J. Acoust. Soc. Am. 112, 2921-2931. 10.1121/1.1515735 (Pubitemid 37033868)
27. Festen, J., and Plomp, R. (1990). Effects of fluctuating noise and interfering speech on the speech-reception threshold for impaired and normal hearing., J. Acoust. Soc. Am. 88, 1725-1736. 10.1121/1.400247
28. French, N., and Steinberg, J. (1947). Factors governing intelligibility of speech sounds., J. Acoust. Soc. Am. 19, 90-119. 10.1121/1.1916407
29. Fllgrabe, C., Berthommier, F., and Lorenzi, C. (2006). Masking release for consonant features in temporally fluctuating background noise., Hearing Res. 211, 74-84. 10.1016/j.heares.2005.09.001 (Pubitemid 43112413)
30. Fllgrabe, C., Stone, M. A., and Moore, B. C. J. (2009). Contribution of very low amplitude-modulation rates to intelligibility in a competing-speech task (L)., J. Acoust. Soc. Am. 125, 1277-1280. 10.1121/1.3075591
31. Gallun, F., and Souza, P. (2008). Exploring the role of the modulation spectrum in phoneme recognition., Ear Hearing 29, 800-813. 10.1097/AUD. 0b013e31817e73ef
32. Goldsworthy, R., and Greenberg, J. (2004). Analysis of speech-based speech transmission index methods with implications for nonlinear operations., J. Acoust. Soc. Am. 116, 3679-3689. 10.1121/1.1804628 (Pubitemid 40029948)
33. Green, D. M., and Birdsall, T. G. (1964). The effect of vocabulary size, in Signal Detection and Recognition by Human Observers, edited by, John A. Swets, (Wiley, New York), pp. 609-619.
34. Green, D. M., and Swets, J. A. (1988). Signal Detection Theory and Psychophysics (Peninsula Publishing, Los Altos, CA), 238-239.
35. Hirsh, I., Reynolds, E., and Joseph, M. (1954). Intelligibility of different speech materials., J. Acoust. Soc. Am. 26, 530-538. 10.1121/1.1907370
36. Hohmann, V., and Kollmeier, B. (1995). The effect of multichannel dynamic compression on speech intelligibility., J. Acoust. Soc. Am. 97, 1191-1195. 10.1121/1.413092
37. Houtgast, T., Steeneken, H., and Plomp, R. (1980). Predicting speech intelligibility in rooms from the modulation transfer function. I. general room acoustics., Acustica 46, 60-72. (Pubitemid 11477041)
38. Houtgast, T., and Steeneken, H. J. M. (1973). The modulation transfer function in room acoustics as a predictor of speech intelligibility., Acustica 28, 66-73.
39. Houtgast, T., and Steeneken, H. J. M. (1985). A review of the MTF concept in room acoustics and its use for estimating speech intelligibility in auditoria., J. Acoust. Soc. Am. 77, 1069-1077. 10.1121/1.392224
40. International Electrotechnical Commission (2003). IEC60268-16, Sound System Equipment-Part 16: Objective Rating of Speech Intelligibility by Speech Transmission Index (International Electrotechnical Commission, Geneva).
41. International Standardization Organization (2005). ISO389-7, Acoustics-Reference Zero for the Calibration of Audiometric Equipment-Part 7: Reference Threshold of Hearing Under Free-Field and Diffuse-Field Listening Conditions (International Standardization Organization, Geneva).
42. Jepsen, M. L., Ewert, S. D., and Dau, T. (2008). A computational model of human auditory signal processing and perception., J. Acoust. Soc. Am. 124, 422-438. 10.1121/1.2924135 (Pubitemid 352019331)
43. Jrgens, T., and Brand, T. (2009). Microscopic prediction of speech recognition for listeners with normal hearing in noise using an auditory model., J. Acoust. Soc. Am. 126, 2635-2648. 10.1121/1.3224721
44. Keidser, G. (1993). Normative data in quiet and in noise for Dantale'-a Danish speech material., Scand. Audiol. 22, 231-236. 10.3109/01050399309047474 (Pubitemid 23362694)
45. Kruger, B., and Kruger, F. M. (1997). Speech audiometry in the USA, in Speech Audiometry, edited by, Michael Martin, (Whurr, London), Chap. 12, pp. 233-277.
46. Kryter, K. (1960). Speech bandwidth compression through spectrum selection, J. Acoust. Soc. Am. 32, 547-556. 10.1121/1.1908140
47. Lim, J. (1978). Evaluation of a correlation subtraction method for enhancing speech degraded by additive white noise, IEEE Trans. Acoust. Speech 26, 471-472. 10.1109/TASSP.1978.1163129 (Pubitemid 9434766)
48. Ludvigsen, C., Elberling, C., and Keidser, G. (1993). Evaluation of a noise reduction method-comparison between observed scores and scores predicted from STI., Scand. Audiol. Suppl. 22, 50-55. (Pubitemid 23362792)
49. Mickes, L., Wixted, J. T., and Wais, P. E. (2007). A direct test of the unequal-variance signal detection model of recognition memory., Psychonomic Bull. Rev. 14, 858-865. 10.3758/BF03194112
50. Miller, G., and Licklider, J. (1950). Intelligibility of interrupted speech., J. Acoust. Soc. Am. 22, 167-173. 10.1121/1.1906584
51. Miller, G. A. (1947). The masking of speech, Psychol. Bull. 44, 105-129. 10.1037/h0055960
52. Miller, G. A., Heise, G. A., and Lichten, W. (1951). The intelligibility of speech as a function of the context of the test material., J. Exp. Psychol. 41, 329-335. 10.1037/h0062491
53. Moore, B. C. J., and Glasberg, B. R. (1983). Suggested formulae for calculating auditory-filter bandwidths and excitation patterns., J. Acoust. Soc. Am. 74, 750-753. 10.1121/1.389861 (Pubitemid 13019047)
54. Msch, H., and Buus, S. (2001). Using statistical decision theory to predict speech intelligibility. I. model structure., J. Acoust. Soc. Am. 109, 2896-2909. 10.1121/1.1371971 (Pubitemid 32545134)
55. Nielsen, J. B., and Dau, T. (2009). Development of a Danish speech intelligibility test., Int. J. Audiol. 48, 729-741. 10.1080/14992020903019312
56. Noordhoek, I. M., and Drullman, R. (1997). Effect of reducing temporal intensity modulations on sentence intelligibility., J. Acoust. Soc. Am. 101, 498-502. 10.1121/1.417993 (Pubitemid 27026661)
57. Payton, K., and Braida, L. (1999). A method to determine the speech transmission index from speech waveforms., J. Acoust. Soc. Am. 106, 3637-3648. 10.1121/1.428216 (Pubitemid 129520727)
58. Rhebergen, K. S., Versfeld, N. J., and Dreschler, W. A. (2009). The dynamic range of speech, compression, and its effect on the speech reception threshold in stationary and interrupted noise., J. Acoust. Soc. Am. 126, 3236-3245. 10.1121/1.3257225
59. Sarampalis, A., Kalluri, S., Edwards, B., and Hafter, E. (2009). Objective measures of listening effort: Effects of background noise and noise reduction., J. Speech Lang. Hear. Res. 52, 1230-1240. 10.1044/1092-4388(2009/08- 0111)
60. Steeneken, H. J. M., and Houtgast, T. (1980). A physical method for measuring speech-transmission quality., J. Acoust. Soc. Am. 67, 318-326. 10.1121/1.384464 (Pubitemid 10136600)
61. Tsoukalas, D. E., Mourjopoulos, J. N., and Kokkinakis, G. (1997). Speech enhancement based on audible noise suppression., IEEE Trans. Speech Audio Process. 5, 497-514. 10.1109/89.641296 (Pubitemid 127746021)
62. Viemeister, N. F. (1979). Temporal modulation transfer functions based upon modulation thresholds, J. Acoust. Soc. Am. 66, 1364-1380. 10.1121/1.383531 (Pubitemid 10098323)
63. Wagener, K., Josvassen, J. L., and Ardenkjaer, R. (2003). Design, optimization and evaluation of a Danish sentence test in noise., Int. J. Audiol. 42, 10-17. 10.3109/14992020309056080 (Pubitemid 37372682)
64. Warren, R. M., Bashford, Jr., J. A., and Lenz, P. W. (2005). Intelligibilities of 1-octave rectangular bands spanning the speech spectrum when heard separately and paired., J. Acoust. Soc. Am. 118, 3261-3266. 10.1121/1.2047228 (Pubitemid 41619021)
65. Xu, L., Thompson, C. S., and Pfingst, B. E. (2005). Relative contributions of spectral and temporal cues for phoneme recognition., J. Acoust. Soc. Am. 117, 3255-3267. 10.1121/1.1886405 (Pubitemid 40675185)