A multichannel MMSE-based framework for speech source separation and noise reduction

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 9, 2013, Pages 1913-1928

  Souden, Mehrez ^a,b   Araki, Shoko ^a   Kinoshita, Keisuke ^a   Nakatani, Tomohiro ^a   Sawada, Hiroshi ^a  

^a Nippon Telegraph and Telephone Corporation   (Japan)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Blind source separation; microphone arrays; minimum variance distortionless response; minimum mean square error; noise reduction; Wiener filter

Indexed keywords

EXPECTATION - MAXIMIZATIONS; GAUSSIAN MIXTURE MODEL; MICROPHONE ARRAYS; MINIMUM VARIANCE DISTORTIONLESS RESPONSE; MULTI-CHANNEL RECORDING; POSTERIOR PROBABILITY; SECOND ORDER STATISTICS; WIENER FILTERS;

ACOUSTIC NOISE; BLIND SOURCE SEPARATION; CHANNEL ESTIMATION; IMAGE SEGMENTATION; INDEPENDENT COMPONENT ANALYSIS; MEAN SQUARE ERROR; NOISE ABATEMENT; PROBABILITY; SPEECH SYNTHESIS;

SPEECH ENHANCEMENT;

EID: 84880515131     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2013.2263137     Document Type: Conference Paper

References (50)

1. M. Souden, S. Araki, K. Kinoshita, T. Nakatani, and H. Sawada, "A multichannel MMSE-based framework for joint blind source separation and noise reduction," in Proc. IEEE ICASSP, 2012, pp. 109-112.
2. Y. Ephraim and D. Malah, "Speech enhancement using a minimum mean-square error short-time spectral amplitude estimator," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-32, no. 6, pp. 1109-1121, Dec. 1984.
3. P. Scalart and V. Filho, "Speech enhancement based on a priori signal to noise estimation," in Proc. IEEE ICASSP, 1996, pp. 629-632.
4. P. C. Loizou, Speech Enhancement: Theory and Practice. NewYork, NY, USA: CRC, 2007.
5. J. L. Flanagan, J. D. Johnson, R. Zahn, and G. W. Elko, "Computersteered microhone arrays for sound transduction in large rooms," J. Acoust. Soc. Amer., vol. 75, pp. 1508-1518, Nov. 1985. (Pubitemid 16223789)
6. S. Gannot, D. Burshtein, and E.Weinstein, "Signal enhancement using beamforming and nonstationarity with applications to speech," IEEE Trans. Signal Process., vol. 49, no. 8, pp. 1614-1626, Aug. 2001. (Pubitemid 32732604)
7. S. Doclo, A. Spriet, J. Wouters, and M. Moonen, "Frequency-domain criterion for the speech distortion weighted multichannel Wiener filter for robust noise reduction," Speech Commun., vol. 49, pp. 636-656, 2007. (Pubitemid 47039261)
8. J. Benesty, J. Chen, and Y. Huang, Microphone Array Signal Processing. Berlin, Germany: Springer-Verlag, 2008.
9. M. Souden, J. Benesty, and S. Affes, "On optimal frequency-domain multichannel linear filtering for noise reduction," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 2, pp. 260-276, Feb. 2010.
10. B. Cornelis, M. Moonen, and J. Wouters, "Performance analysis of multichannel Wiener filter based noise reduction in hearing aids under second order statistics estimation errors," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 5, pp. 1368-1381, Jul. 2011.
11. M. Souden, J. Chen, J. Benesty, and S. Affes, "An integrated solution for online multichannel noise tracking and reduction," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 7, pp. 2159-2169, Sep. 2011.
12. K. Ngo, A. Spriet, M. Moonen, J.Wouters, and S. H. Jensen, "Variable speech distortion weighted multichannel Wiener filter based on soft output voice activity detection for noise reduction in hearing aids," in Proc. IWAENC, 2008.
13. T. Nakatani, S. Araki, M. Delcroix, T. Yoshioka, and M. Fujimoto, "Reduction of highly nonstationary ambient noise by integrating spectral and locational characteristics of speech and noise for robust ASR," in Proc. ISCA Interspeech, 2011, pp. 1785-1788.
14. R. Martin, "Noise power spectral density estimation based on optimal smoothing and minimum statistics," IEEE Trans. Speech, Audio Process., vol. 9, no. 5, pp. 504-512, Jul. 2001. (Pubitemid 32631178)
15. I. Cohen and B. Berdugo, "Noise estimation by minima controlled recursive averaging for robust speech enhancement," IEEE Signal Process. Lett., vol. 9, no. 1, pp. 12-15, Jan. 2002. (Pubitemid 34306628)
16. S. Affes and Y. Grenier, "A signal subspace tracking algorithm for microphone array processing of speech," IEEE Trans. Speech Audio Process., vol. 5, no. 5, pp. 425-437, Sep. 1997. (Pubitemid 127746015)
17. D. Burshtein and S. Gannot, "Speech enhancement using a mixturemaximum model," IEEE Trans. Signal Process., vol. 49, no. 8, pp. 1614-1626, Aug. 2001.
18. M. Delcroix, K. Kinoshita, T. Nakatani, S. Araki, A. Ogawa, T. Hori, S.Watanabe, M. Fujimoto, T. Yoshioka, T. Oba, Y. Kubo, M. Souden, S.-J. Hahm, and A. Nakamura, "Speech recognition in the presence of highly non-stationary noise based on spatial, spectral and temporal speech/noise modeling combined with dynamic variance adapatation," in Proc. CHiME Workshop, 2011, pp. 12-17.
19. A. J. Bell and T. J. Sejnowsky, "An information maximization approach to blind separation and blind deconvolution," Neural Computat., vol. 7, pp. 1129-1159, 1995.
20. A. Hyvarinen, "Fast and robust fixed-point algorithms for independent component analysis," IEEE Trans. Neural Netw., vol. 10, no. 3, pp. 626-634, May 1999.
21. H. Sawada, R. Mukai, S. Araki, and S. Makino, "Frequency-domain blind source separation," in Speech Enhance, J. Benesty, S. Makino, and J. Chen, Eds. New York, NY, USA: Springer, 2005.
22. S. Markovich, S. Gannot, and I. Cohen, "Multichannel eigenspace beamforming in a reverberant noisy environment with multiple interfering speech signals," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 6, pp. 1071-1086, Aug. 2009.
23. M. Aoki,M. Okamoto, S. Aoki, H. Matsui, T. Sakurai, and Y. Kaneda, "Sound source segregation based on estimating the incident angle of each frequency component of input signals acquired by multiple microphones," Acoust. Sci. Technol., vol. 22, pp. 149-157, Feb. 2001. (Pubitemid 32514398)
24. O. Yilmaz and S. Rickard, "Blind separation of speech mixtures via time-frequency masking," IEEE Trans. Signal Process., vol. 52, no. 7, pp. 1830-1847, Jul. 2004.
25. N. Madhu and R. Martin, "A versatile framework for speaker separation using a model-based speaker localization approach," IEEE Trans. Audio, Speech Lang. Process., vol. 19, no. 7, pp. 1900-1912, Sep. 2011.
26. S. Araki, T. Nakatani, H. Sawada, and S. Makino, "Stereo source separation and source counting with MAP estimation with Dirichlet prior considering spatial aliasing problem," in Proc. ICA, 2009, pp. 742-750.
27. H. Sawada, S. Araki, and S. Makino, "A two-stage frequency domain blind source separation method for underdetermined convolutive mixtures," in Proc. IEEE WASPAA, 2007, pp. 139-142.
28. H. Sawada, S. Araki, and S. Makino, "Underdetermined convolutive blind source separation via frequency bin-wise clustering and permutation alignement," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 3, pp. 516-527, Mar. 2011.
29. P. D. O'Grady and B. A. Pearlmutter, "Soft-LOST: EM on a mixture of oriented lines," in Proc. ICA, Sep. 2004, pp. 430-436. (Pubitemid 39751061)
30. P. D. O'Grady and B. A. Pearlmutter, "The LOST algorithm: Finding lines and separating speech mixtures," EURASIP J. Adv. Signal Process., pp. 1-17, 2008.
31. D. H. Tran and R. Haeb-Umbach, "Blind separation employing directional statistics in an expectation maximization framework," in Proc. IEEE ICASSP, 2010, pp. 241-244.
32. J. H. Dibiase, H. F. Silverman, andM. S. Brandstein, "Robust localization in reverberant rooms," in Microphone Arrays: Signal Processing Techniques and Applications,M. S. Brstein and D.Ward, Eds. Berlin, Germany: Springer-Verlag, 2001, pp. 157-180.
33. T. Hori, S. Araki, T. Yoshioka, M. Fujimoto, S. Watanabe, T. Oba, A. Ogawa, K. Otsuka, D. Mikami, K. Kinoshita, T. Nakatani, A. Nakamura, and J. Yamato, "Low-latency real-time meeting recognition and understanding using distant microphones and omni-directional camera," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 2, pp. 499-513, Feb. 2011.
34. H. L. Van Trees, Detection, Estimation, and Modulation Theory Part IV: Optimum Array Processing. New York, NY, USA: Wiley, 2002.
35. J. Sherman and J. W. Morrison, "Adjustment of an inverse matrix corresponding to a change in one element of a given matrix," Anna. Math. Statist., vol. 21, pp. 124-127, 1950.
36. K. V. Mardia and I. L. Dryden, "The complex Watson distribution and shape analysis," J. R. Statist. Soc.: Ser. B, vol. 61, pp. 913-926, 1999.
37. J. T. Kent, "The complex Bingham distribution and shape analysis," J. R. Statist. Soc., vol. B, pp. 285-299, 1994.
38. S. Rennie, J. Hershey, and P. Olsen, "Single channel multi-talker speech recognition: Graphical modeling approaches," IEEE Signal Process. Mag., vol. 27, no. 5, pp. 66-80, Nov. 2010.
39. D. Y. Kim, C. K. Un, and N. S. Kim, "Speech recognition in noisy environments using first-order vector Taylor series," Speech Commun., pp. 39-49, 1998. (Pubitemid 128435865)
40. W. M. Fisher, G. R. Doddington, and K. M. Goudie-Marshall, "The DARPA speech recognition research database: Specifications and status," in Proc. DARPA Worksh0p Speech Recognit., 1986, pp. 93-99.
41. [Online]. Available: http://tosa.mri.co.jp/sounddb/indexe.htm
42. A. P. Varga, H. J. M. Steenekan, M. Tomlinson, and D. Jones, "The Noisex-92 study on the effect of additive noise on automatic speech recognition," Tech. Rep. DRA Speech Research Unit, 1992.
43. E. Vincent, R. Gribonval, and C. Fevotte, "Performance measurement in blind audio source separation," IEEE Trans. Speech Audio Process., vol. 14, no. 5, pp. 1462-1469, Jul. 2006. (Pubitemid 46547636)
44. R. Talmon, I. Cohen, and S. Gannot, "Convolutive transfer function generalized sidelobe canceler," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 7, pp. 1420-1434, Sep. 2009.
45. S. Furui, K.Maekawa, and H. Isahara, "A Japanese national project on spontaneous speech corpus and processing technology," in Proc. ISCA ASR, 2000, pp. 244-248.
46. E. McDermott, S. Watanabe, and A. Nakamura, "Discriminative training based on an integrated view ofMPE and MMI in margin and error space," in Proc. IEEE ICASSP, 2010, pp. 4894-4897.
47. R. Kneser and H. Ney, "Improved backing-off for m-gram language modeling," in Proc. IEEE ICASSP, 1995, pp. 181-184.
48. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," Comput. Speech Lang., vol. 9, pp. 171-185, 1995.
49. T. Hori, "NTT speech recognizer with outlook on the next generation: SOLON," in Proc. NTT Workshop Commun. Scene Anal., 2004, p. S-6.
50. [Online]. Available: http://www.kecl.ntt.co.jp/icl/signal/souden/ 2006, and the Itakura Prize Innovative Young Researcher Award from (ASJ) in 2008.