A perspective on single-channel frequency-domain speech enhancement

Synthesis Lectures on Speech and Audio Processing

Volumn 8, Issue , 2011, Pages 1-106

  Benesty, Jacob ^a   Huang, Yiteng ^b  

^a INRS EMT   (Canada)

^b WeVoice Inc   (United States)

Author keywords

frequency domain; interframe correlation; linear and widely linear models; linearly constrained minimum variance (LCMV) filter; maximum signal to noise ratio (SNR) filter; minimum variance distortionless response (MVDR) filter; single channel noise reduction; speech enhancement; tradeoff filter; Wiener filter

Indexed keywords

FREQUENCY DOMAINS; INTER-FRAME; LINEARLY CONSTRAINED MINIMUM VARIANCE; MAXIMUM SIGNAL-TO-NOISE RATIO (SNR) FILTER; MINIMUM VARIANCE DISTORTIONLESS RESPONSE (MVDR) FILTER; SINGLE-CHANNEL NOISE REDUCTION; TRADEOFF FILTER; WIDELY LINEAR MODELS; WIENER FILTERS;

ACOUSTIC NOISE MEASUREMENT; ADAPTIVE FILTERING; ADAPTIVE FILTERS; BLIND SOURCE SEPARATION; FOURIER TRANSFORMS; FREQUENCY DOMAIN ANALYSIS; MICROPHONES; OPTIMIZATION; SIGNAL TO NOISE RATIO; SPEECH ENHANCEMENT;

SIGNAL PROCESSING;

EID: 79954589819     PISSN: 1932121X     EISSN: 19321678     Source Type: Book Series    
DOI: 10.2200/S00344ED1V01Y201104SAP008     Document Type: Article

References (65)

1. P. O. Amblard, M. Gaeta, and J. L. Lacoume, "Statistics for complex variables and signals -Part I: variables," Elsevier Signal Process., vol. 53, pp. 1-13, 1996. DOI: 10.1016/0165-1684(96)00071-0 18 (Pubitemid 126363811)
2. P. O. Amblard, M. Gaeta, and J. L. Lacoume, "Statistics for complex variables and signals -Part II: signals," Elsevier Signal Process., vol. 53, pp. 15-25, 1996. DOI: 10.1016/0165-1684(96)00072-2 18 (Pubitemid 126363812)
3. J. Benesty, J. Chen, Y. Huang, and S. Doclo, "Study of the Wiener filter for noise reduction," in Speech Enhancement, J. Benesty, S. Makino, and J. Chen, Eds., Berlin, Germany: Springer-Verlag, 2005, Chapter 2, pp. 9-41. 12, 14, 54, 55, 66, 67
4. J. Benesty, J. Chen, Y. Huang, and I. Cohen, Noise Reduction in Speech Processing. Berlin, Germany: Springer-Verlag, 2009. 5, 11, 12, 13, 21, 30, 31, 46, 54, 66
5. J. Benesty, J. Chen, and Y. Huang, "On noise reduction in the Karhunen-Loève expansion domain," in Proc. IEEE ICASSP, 2009, pp. 25-28. DOI: 10.1109/ICASSP.2009.4959511 21
6. J. Benesty, J. Chen, and Y. Huang, "On widely linear Wiener and tradeoff filters for noise reduction," Speech Communication, vol. 52, pp. 427-439, May 2010. DOI: 10.1016/j.specom.2010.02.003 6, 39, 47
7. J. Benesty, J. Chen, and Y. Huang, "A widely linear distortionless filter for single-channel noise reduction," IEEE Signal Process. Lett., vol. 17, pp. 469-472, May 2010. DOI: 10.1109/LSP.2010.2043152 6, 44
8. J. Benesty and J. Chen, Optimal Time-Domain Noise Reduction Filters -A Theoretical Study. Berlin, Germany: Springer, 2011. 2
9. J. Benesty, J. Chen, and Y. Huang, Speech Enhancement in the Karhunen-Loève Expansion Domain. San Rafael, CA: Morgan & Claypool Publishers, 2011. 2
10. M. Berouti, M. Schwartz, and J. Makhoul, "Enhancement of speech corrupted by acoustic noise," in Proc. IEEE ICASSP, 1979, pp. 208-211. DOI: 10.1109/ICASSP.1979.1170788 2 (Pubitemid 9454996)
11. S. F. Boll, "Suppression of acoustic noise in speech using spectral subtraction," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-27, pp. 113-120, Apr. 1979. DOI: 10.1109/TASSP.1979.1163209 1
12. V. Bray and M. Valente, "Can omni-directional hearing aids improve speech understanding in noise?" Audiology Online, Sept. 24, 2001.Accessed on Jan. 31, 2011, available at http://www. audiologyonline.com/articles/article- detail.asp?article-id=300. 1
13. J. Capon, "High resolution frequency-wavenumber spectrum analysis," Proc. IEEE, vol. 57, pp. 1408-1418, Aug. 1969. DOI: 10.1109/PROC.1969.7278 44
14. J. Chen, J. Benesty, Y. Huang, and S. Doclo, "New insights into the noise reduction Wiener filter," IEEE Trans. Audio, Speech, Language Process., vol. 14, pp. 1218-1234, July 2006. DOI: 10.1109/TSA.2005.860851 12, 14, 54, 55, 66, 67 (Pubitemid 46547618)
15. J. Chen, J. Benesty, and Y. Huang, "Study of the noise-reduction problem in the Karhunen-Loève expansion domain," IEEE Trans. Audio, Speech, Language Process., vol. 17, pp. 787-802, May 2009. DOI: 10.1109/TASL.2009.2014793 21
16. P. Chevalier, J.-P. Delmas, and A. Oukaci, "Optimal widely linear MVDR beamforming for noncircular signals," in Proc. IEEE ICASSP, 2009, pp. 3573-3576. DOI: 10.1109/ICASSP.2009.4960398 19
17. I. Cohen, "Relaxed statistical model for speech enhancement and a priori SNR estimation," IEEE Trans. Speech, Audio Process., vol. 13, pp. 870-881, Sept. 2005. DOI: 10.1109/TSA.2005.851940 21 (Pubitemid 41558902)
18. Y. Ephraim and D. Malah, "Speech enhancement using a minimum mean-square error shorttime spectral amplitude estimator," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-32, pp. 1109-1121, Dec. 1984. DOI: 10.1109/TASSP.1984.1164453 2, 62 (Pubitemid 15159457)
19. Y. Ephraim and D. Malah, "Speech enhancement using a minimum mean-square error logspectral amplitude estimator," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-33, pp. 443-445, Apr. 1985. DOI: 10.1109/TASSP.1985.1164550 2 (Pubitemid 15109380)
20. Y. Ephraim, D. Malah, and B.-H. Juang, "On the application of hidden Markov models for enhancing noisy speech," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-37, pp. 1846-1856, Dec. 1989. DOI: 10.1109/29.45532 2 (Pubitemid 20642697)
21. Y. Ephraim and H. L.VanTrees, "A signal subspace approach for speech enhancement," IEEE Trans. Speech, Audio Process., vol. 3, pp. 251-266, July 1995. DOI: 10.1109/89.397090 32
22. M. Er and A. Cantoni, "Derivative constraints for broad-band element space antenna array processors," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-31, pp. 1378-1393, Dec. 1983. DOI: 10.1109/TASSP.1983. 1164219 62, 75 (Pubitemid 14552339)
23. J.Eriksson andV.Koivunen,"Complex random vectors and ICAmodels: identifiability,uniqueness, and separability," IEEE Trans. Inf. Theory, vol. 52, pp. 1017-1029, Mar. 2006. DOI: 10.1109/TIT.2005.864440 5, 6 (Pubitemid 46444889)
24. O. Frost, "An algorithm for linearly constrained adaptive array process.," Proc. IEEE, vol. 60, pp. 926-935, Jan. 1972. DOI: 10.1109/PROC.1972.8817 62, 75
25. Y. Hu and P. C. Loizou, "A generalized subspace approach for enhancing speech corrupted by colored noise," IEEE Trans. Speech, Audio Process., vol. 11, pp. 334-341, July 2003. DOI: 10.1109/TSA.2003.814458 32
26. Y. Hu and P. C. Loizou, "A perceptually motivated approach for speech enhancement," IEEE Trans. Speech,Audio Process., vol. 11, pp. 457-465,Sept. 2003.DOI: 10.1109/TSA.2003.815936 32
27. Y. Hu and P. C. Loizou, "Evaluation of objective quality measures for speech enhancement," IEEE Trans. Audio, Speech, Language Process., vol. 16, no. 1, pp. 229-238, Jan. 2008. DOI: 10.1109/TASL.2007.911054 87
28. F. Jabloun and B. Champagne, "Incorporating the human hearing properties in the signal subspace approach for speech enhancement," IEEE Trans. Speech, Audio Process., vol. 11, pp. 700-708, Nov. 2003. DOI: 10.1109/TSA.2003.818031 32
29. R.T. Lacoss, "Data adaptive spectral analysis methods," Geophysics, vol. 36, pp. 661-675, Aug. 1971. DOI: 10.1190/1.1440203 44
30. J. S. Lim and A.V. Oppenheim, "Enhancement and bandwidth compression of noisy speech," Proc. IEEE, vol. 67, pp. 1586-1604, Dec. 1979. DOI: 10.1109/PROC.1979.11540 1, 2 (Pubitemid 10179553)
31. P. C. Loizou, "Speech enhancement based on perceptually motivated Bayesian estimators of the magnitude spectrum," IEEE Trans. Speech, Audio Process., vol. 13, pp. 857-869, Sept. 2005. DOI: 10.1109/TSA.2005.851929 2 (Pubitemid 41558901)
32. P. Loizou, Speech Enhancement: Theory and Practice. Boca Raton, FL: CRC Press, 2007. 5
33. T. Lotter and P.Vary, "Noise reduction by maximum a posteriori spectral amplitude estimation with supergaussian speech modelling," in Proc. IWAENC, 2003, pp. 83-86. 2
34. D. P. Mandic and S. L. Goh, Complex Valued Nonlinear Adaptive Filters: Noncircularity,Widely Linear and Neural Models.Wiley, 2009. 5, 6, 18, 24, 35, 65
35. R. J.McAulay andM.L.Malpass,"Speech enhancement using a soft-decision noise suppression filter," IEEETrans. Acoust., Speech, Signal Process., vol. ASSP-28, pp. 137-145, Apr. 1980.DOI: 10.1109/TASSP.1980.1163394 1, 2
36. E.Ollila, "On the circularity of a complex random variable," IEEE Signal Process. Lett., vol. 15, pp. 841-844, 2008. DOI: 10.1109/LSP.2008.2005050 5, 6, 19
37. B. Picinbono, "On circularity," IEEE Trans. Signal Process., vol. 42, pp. 3473-3482, Dec. 1994. DOI: 10.1109/78.340781 18
38. O. Frost, "An algorithm for linearly constrained adaptive array process.," Proc. IEEE, vol. 60, pp. 926-935, Jan. 1972. DOI: 10.1109/PROC.1972.8817 62, 75
39. Y. Hu and P. C. Loizou, "A generalized subspace approach for enhancing speech corrupted by colored noise," IEEE Trans. Speech, Audio Process., vol. 11, pp. 334-341, July 2003. DOI: 10.1109/TSA.2003.814458 32
40. Y. Hu and P. C. Loizou, "A perceptually motivated approach for speech enhancement," IEEE Trans. Speech,Audio Process., vol. 11, pp. 457-465,Sept. 2003.DOI: 10.1109/TSA.2003.815936 32
41. Y. Hu and P. C. Loizou, "Evaluation of objective quality measures for speech enhancement," IEEE Trans. Audio, Speech, Language Process., vol. 16, no. 1, pp. 229-238, Jan. 2008. DOI: 10.1109/TASL.2007.911054 87
42. F. Jabloun and B. Champagne, "Incorporating the human hearing properties in the signal subspace approach for speech enhancement," IEEE Trans. Speech, Audio Process., vol. 11, pp. 700-708, Nov. 2003. DOI: 10.1109/TSA.2003.818031 32
43. R.T. Lacoss, "Data adaptive spectral analysis methods," Geophysics, vol. 36, pp. 661-675, Aug. 1971. DOI: 10.1190/1.1440203 44
44. J. S. Lim and A.V. Oppenheim, "Enhancement and bandwidth compression of noisy speech," Proc. IEEE, vol. 67, pp. 1586-1604, Dec. 1979. DOI: 10.1109/PROC.1979.11540 1, 2 (Pubitemid 10179553)
45. P. C. Loizou, "Speech enhancement based on perceptually motivated Bayesian estimators of the magnitude spectrum," IEEE Trans. Speech, Audio Process., vol. 13, pp. 857-869, Sept. 2005. DOI: 10.1109/TSA.2005.851929 2 (Pubitemid 41558901)
46. P. Loizou, Speech Enhancement: Theory and Practice. Boca Raton, FL: CRC Press, 2007. 5
47. T. Lotter and P.Vary, "Noise reduction by maximum a posteriori spectral amplitude estimation with supergaussian speech modelling," in Proc. IWAENC, 2003, pp. 83-86. 2
48. D. P. Mandic and S. L. Goh, Complex Valued Nonlinear Adaptive Filters: Noncircularity,Widely Linear and Neural Models.Wiley, 2009. 5, 6, 18, 24, 35, 65
49. R. J.McAulay andM.L.Malpass,"Speech enhancement using a soft-decision noise suppression filter," IEEETrans. Acoust., Speech, Signal Process., vol. ASSP-28, pp. 137-145, Apr. 1980.DOI: 10.1109/TASSP.1980.1163394 1, 2
50. E.Ollila, "On the circularity of a complex random variable," IEEE Signal Process. Lett., vol. 15, pp. 841-844, 2008. DOI: 10.1109/LSP.2008.2005050 5, 6, 19
51. B. Picinbono, "On circularity," IEEE Trans. Signal Process., vol. 42, pp. 3473-3482, Dec. 1994. DOI: 10.1109/78.340781 18
52. B. Picinbono and P. Chevalier, "Widely linear estimation with complex data," IEEE Trans. Signal Process., vol. 43, pp. 2030-2033, Aug. 1995. DOI: 10.1109/78.403373 18, 24, 35, 65
53. E. Plourde and B. Champagne, "Generalized Bayesian estimators of the spectral amplitude for speech enhancement," IEEE Signal Process. Lett., vol. 16, pp. 485-488, June 2009. DOI: 10.1109/LSP.2009.2018225 2
54. T. Rohdenburg, V.Hohmann, and B. Kollmeir, "Objective perceptual quality measures for the evaluation of noise reduction schemes," in Proc. IWAENC, 2005, pp. 169-172. 87
55. M. R. Schroeder, U.S. Patent No. 3,180,936, filed Dec. 1, 1960, issued Apr. 27, 1965. 1
56. M. R. Schroeder, U.S. Patent No. 3,403,224, filed May 28, 1965, issued Sept. 24, 1968. 1
57. M.Souden,J.Benesty,and S. Affes,"On the global outputSNRof the parameterized frequencydomain multichannel noise reduction Wiener filter," IEEE Signal Process. Lett., vol. 17, pp. 425-428, May 2010. DOI: 10.1109/LSP.2010.2042520 48, 60, 73
58. P.Vary andR.Martin, Digital SpeechTransmission: Enhancement, Coding and Error Concealment. Chichester, England: JohnWiley & Sons Ltd, 2006. 5
59. R. Vetter, "Single channel speech enhancement using MDL-based subspace approach in Bark domain," in Proc. IEEE ICASSP, 2001, pp. 641-644.DOI: 10.1109/ICASSP.2001.940913 32 (Pubitemid 32839332)
60. N. Virag, "Single channel speech enhancement based on masking properties of the human auditory system," IEEE Trans. Speech, Audio Process., vol. 7, pp. 126-137, Mar. 1999. DOI: 10.1109/89.748118 32
61. M. R.Weiss, E. Aschkenasy, and T.W. Parsons, "Processing speech signals to attenuate interference," in Proc. IEEE Symposium on Speech Recognition, Carnegie-Mellon Univ., 1974, pp. 292-295. 1
62. P. J.Wolfe and S. J. Godsill, "Efficient alternatives to the Ephraim-Malah suppression rule for audio signal enhancement," EURASIP J. Applied Signal Process., Special Issue: Digital Audio for Multimedia Communications, pp. 1043-1051, Sept. 2003.DOI: 10.1155/S1110865703304111 2
63. C. H. You, S. N. Koh, and and S. Rahardja, "â-order MMSE spectral amplitude estimation for speech enhancement," IEEE Trans. Speech, Audio Process., vol. 13, pp. 475-486, July 2005. DOI: 10.1109/TSA.2005.848883 2 (Pubitemid 41013151)
64. ITU-T Rec. P.862, "Perceptual evaluation of speech quality (PESQ), an objective method for end-to-end speech quality assessment of narrowband telephone networks and speech codecs," Feb. 2001. 78
65. ITU-T Rec. P.862.1, "Mapping function for transforming P.862 raw result scores to MOSLQO," Nov. 2003. 87