Objective intelligibility measures based on mutual information for speech subjected to speech enhancement processing

IEEE Transactions on Audio, Speech and Language Processing

Volumn 22, Issue 1, 2014, Pages 6-16

  Taghia, Jalal ^a   Martin, Rainer ^a  

^a RUHR UNIVERSITY BOCHUM   (Germany)

Author keywords

Mutual information; Objective measures; Speech intelligibility prediction

Indexed keywords

AUDITION; FORECASTING; SPEECH ENHANCEMENT; SPEECH RECOGNITION; HIGHER ORDER STATISTICS; INFORMATION THEORY; SIGNAL TO NOISE RATIO; SPEECH;

HEARING INSTRUMENTS; INTELLIGIBILITY PREDICTIONS; LISTENING TESTS; MUTUAL INFORMATIONS; OBJECTIVE MEASURE; SECOND ORDER STATISTICS; SIGNALTONOISE RATIO (SNR); TEMPORAL ENVELOPES; TEMPORAL REPRESENTATIONS;

SPEECH INTELLIGIBILITY;

EID: 84897949130     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2013.2281574     Document Type: Article

References (49)

1. J. Taghia, R. C. Hendriks, and R. Martin, "On mutual information as a measure of speech intelligibility," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Kyoto, Japan, Mar. 2012, pp. 65-68.
2. J. Taghia, R. Martin, J. Taghia, and A. Leijon, "An investigation on mutual information for the linear predictive system and the extrapolation of speech signals," in Proc. 10th ITG Symp. Speech Commun., Braunschweig, Germany, 2012, pp. 227-230.
3. J. B. Allen, "How do humans process and recognize speech?," IEEE Trans. Speech Audio Process., vol. 2, no. 4, pp. 567-577, Oct. 1994.
4. N. French and J. Steinberg, "Factors governing the intelligibility of speech sounds," J. Acoust. Soc. Amer., vol. 19, no. 1, pp. 90-119, 1947.
5. Methods for Calculation of the Speech Intelligibility Index, S3.5-1997, ANSI, New York, NY, USA, 1997.
6. J. M. Kates and K. H. Arehart, "Coherence and the speech intelligibility index," J. Acoust. Soc. Amer., vol. 117, no. 4, pp. 2224-2237, 2005.
7. J. Ma, Y. Hu, and P. Loizou, "Objectivemeasures for predicting speech intelligibility in noisy conditions based on new band-importance functions," J. Acoust. Soc. Amer., vol. 125, no. 5, pp. 3387-3405, 2009.
8. A. Schlesinger and M. M. Boone, "The characterization of the relative information content by spectral features for the objective intelligibility assessment of nonlinearly processed speech," in Proc. Interspeech, 2010, pp. 1309-1312.
9. C. H. Taal, R. C. Hendriks, and R. Heusdens, "An evaluation of objective measures for intelligibility prediction of time-frequency weighted noisy speech," J. Acoust. Soc. Amer., vol. 130, no. 5, pp. 3013-3027, 2011.
10. C. H. Taal, R. C. Hendriks, R. Heusdens, J. Jensen, and U. Kjems, "An evaluation of objective quality measures for speech intelligibility prediction," in Proc. Interspeech, 2009, pp. 1947-1950.
11. C. H. Taal, R. C. Hendriks, R. Heusdens, and J. Jensen, "An algorithm for intelligibility prediction of time-frequency weighted noisy speech," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 7, pp. 2125-2136, Sep. 2011.
12. H. J. M. Steeneken and T. Houtgast, "A physical method for measuring speech-transmission quality," J. Acoust. Soc. Amer., vol. 67, no. 1, pp. 318-326, 1980. (Pubitemid 10136600)
13. R. L. Goldsworthy and J. E. Greenberg, "Analysis of speech-based speech transmission index methods with implications for nonlinear operations," J. Acoust. Soc. Amer., vol. 116, no. 6, pp. 3679-3689, 2004.
14. C. Ludvigsen, C. Elberling, and G. Keidser, "Evaluation of a noise reduction method-comparison between observed scores and scores predicted from STI," Scand. Audiol. Suppl., vol. 38, pp. 50-55, 1993. (Pubitemid 23362792)
15. S. Jørgensen and T. Dau, "Predicting speech intelligibility based on the envelope power signal-to-noise ratio aftermodulation-frequency selective processing," J. Acoust. Soc. Amer., vol. 130, no. 3, pp. 1475-1487, 2011.
16. T. Dau, D. Püschel, and A. Kohlrausch, "A quantitative model of the "effective" signal processing in the auditory system. I. model structure," J. Acoust. Soc. Amer., vol. 99, no. 6, pp. 3615-3622, 1996.
17. C. Christiansen, M. S. Pedersen, and T. Dau, "Prediction of speech intelligibility based on an auditory preprocessing model," Speech Commun., no. 52, pp. 678-692, 2010.
18. J. B. Boldt and D. P. W. Ellis, "A simple correlation-based model of intelligibility for nonlinear speech enhancement and separation," in Proc. EUSIPCO, Glasgow, U.K., Aug. 2009.
19. C. H. Taal, "Prediction and optimization of speech intelligibility in adverse conditions," Ph.D. dissertation, Signal and Information Processing Lab, Delft Univ. of Technol., Delft, The Netherlands, 2013.
20. C. H. Taal, R. C. Hendriks, R. Heusdens, and J. Jensen, "On predicting the difference in intelligibility before and after single-channel noise reduction," in Proc. IWAENC, Tel Aviv, Israel, 2010.
21. Y. Tang and M. Cooke, "Subjective and objective evaluation of speech intelligibility enhancement under constant energy and duration constraints," in Proc. Interspeech, Florence, Italy, Aug. 2011.
22. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York, NY, USA: Wiley, 2006.
23. E. R. Geddes and L. W. Lee, "Auditory perception of nonlinear distortion - Theory," presented at the 115th Conv. Audio Eng. Soc., Oct. 2003, unpublished.
24. L. W. Lee and E. R. Geddes, "Auditory perception of nonlinear distortion," presented at the 115th Conv. Audio Eng. Soc., Oct. 2003, unpublished.
25. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pp. 379-423, 1948.
26. S. Lu, "Measuring dependence via mutual information," M.S. thesis, Dept. of Math. and Statist., Queen's Univ., Kingston, ON, Canada, Sep. 2011.
27. J. Walters-Williams and Y. Li, "Estimation of mutual information: A survey," Lecture Notes in Comput. Sci., vol. 5589, pp. 389-396, 2009.
28. J. Beirlant, E. J. Dudewicz, L. Györfi, and E. C. van der Meulen, "Non-parametric entropy estimation: An overview," Int. J. Math. Statist. Sci., vol. 6, pp. 17-39, 1997.
29. A. Kraskov, H. Stögbauer, and P. Grassberger, "Estimating mutual information," Phys. Rev. E, vol. 69, no. 6, pp. 1-16, 2004, 066138.
30. D. Evans, "A computationally efficient estimator for mutual information," Proc. R. Soc. A, Math., Phys., Eng. Sci., vol. 464, pp. 1203-1215, 2008. (Pubitemid 351390755)
31. L. F. Kozachenko and N. N. Leonenko, "Sample estimate of entropy of a random vector," Probl. Inf. Transm., vol. 23, pp. 95-101, 1987.
32. S. Astakhov, P. Grassberger, A. Kraskov, and H. Stögbauer, "Mutual information least-dependent component analysis," [Online]. Available: http://bsp.teithe.gr/members/downloads/Milca.html
33. C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2006.
34. P. Jax, "Enhancement of band limited speech signals: Algorithms and theoretical bounds," Ph.D. dissertation, Inst. für Nachrichtengeräte und Datenverarbeitung, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany, 2002.
35. Z. R. Yang and M. Zwolinski, "Mutual information theory for adaptive mixture models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 4, pp. 561-403, Apr. 2001.
36. Y. Lee, K. Y. Lee, and J. Lee, "The estimating optimal number of Gaussian mixtures based on incremental k-means for speaker identification," Int. J. Inf. Technol., vol. 12, no. 7, pp. 13-21, 2006.
37. Z. Ghahramani and M. J. Beal, "Variational inference for bayesian mixtures of factor analysers," Adv. Neural Inf. Process. Syst. MIT Press, vol. 12, pp. 449-455, 2000.
38. U. Kjems, J. B. Boldt, M. S. Pedersen, T. Lunner, and D. Wang, "Role of mask pattern in intelligibility of ideal binary-masked noisy speech," J. Acoust. Soc. Amer., vol. 126, no. 3, pp. 1415-1426, 2009.
39. P. Divenyi, Speech Separation by Humans and Machines. Norwell, MA, USA: Kluwer, 2005, ch. 12.
40. K. Wagener, J. L. Josvassen, and R. Ardenkjaer, "Design, optimization and evaluation of a Danish sentence test in noise," Int. J. Audiol., vol. 42, no. 1, pp. 10-17, 2003. (Pubitemid 37372682)
41. Y. Ephraim and D. Malah, "Speech enhancement using a minimum mean-square error short-time spectral amplitude estimator," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-32, no. 6, pp. 1109-1121, Dec. 1984.
42. J. S. Erkelens, R. C. Hendriks, R. Heusdens, and J. Jensen, "Minimum mean-square error estimation of discrete Fourier coefficients with generalized gamma priors," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 6, pp. 1741-1752, Aug. 2007.
43. C. H. Taal, R. C. Hendriks, and R. Heusdens, "A speech preprocessing strategy for intelligibility improvement in noise based on a perceptual distortion measure," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Kyoto, Japan, Mar. 2012, pp. 4061-4064.
44. M. Skowronski and J. Harris, "Applied principles of clear and Lombard speech for automated intelligibility enhancement in noisy environments," Speech Commun., vol. 48, no. 5, pp. 549-558, 2006.
45. B. Sauert, G. Enzner, and P. Vary, "Near end listening enhancement with strict loudspeaker output power constraining," in Proc. Int. Workshop Acoustic Echo and Noise Control (IWAENC), Paris, France, Sep. 2006.
46. J. Koopman, R. Houben, W. A. Dreschler, and J. Verschuure, "Development of a speech in noise test (matrix)," in Proc. 8th EFAS Congr., 10th DGA Congr., Heidelberg, Germany, Jun. 2007.
47. M. G. Kendall, "A new measure of rank correlation," Biometrika, vol. 30, no. 1/2, pp. 81-93, 1938.
48. M. Gómez, B. Schwerin, and K. Paliwal, "Improving objective intelligibility prediction by combining correlation and coherence based methods with a measure based on the negative distortion ratio," Speech Commun., vol. 54, pp. 503-515, 2012.
49. N. Balakrishnan, Handbook of the Logistic Distribution. New York, NY, USA: Marcel Dekker., 1992.