Complex ratio masking for monaural speech separation

IEEE/ACM Transactions on Audio Speech and Language Processing

Volumn 24, Issue 3, 2016, Pages 483-492

  Williamson, Donald S ^a   Wang, Yuxuan ^a,b   Wang, DeLiang ^a  

^a The Ohio State University   (United States)

^b GOOGLE INC   (United States)

Author keywords

Complex ideal ratio mask; Deep neural networks; Speech quality; Speech separation

Indexed keywords

COMPLEX NETWORKS; QUALITY CONTROL; SEPARATION; SOURCE SEPARATION; SPEECH ANALYSIS; SPEECH ENHANCEMENT;

DEEP NEURAL NETWORKS; IDEAL RATIO MASK; MAGNITUDE SPECTRUM; PERCEPTUAL EVALUATION OF SPEECH QUALITIES; PERCEPTUAL QUALITY; SHORT TIME FOURIER TRANSFORMS; SPEECH QUALITY; SPEECH SEPARATION;

SPEECH;

EID: 84962808663     PISSN: 23299290     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASLP.2015.2512042     Document Type: Article

References (35)

1. D. L. Wang, and J. S. Lim, "The unimportance of phase in speech enhancement, " IEEE Trans. Acoust. Speech Signal Process., ASSP-30, no. 4, pp. 679-681, Aug. 1982.
2. Y. Ephraim, and D. Malah, "Speech enhancement using a minimum mean-square error short-time spectral amplitude estimator, " IEEE Trans. Acoust. Speech Signal Process., ASSP-32, no. 6, pp. 1109-1121, Dec. 1984.
3. A. V. Oppenheim, J. S. Lim, "The importance of phase in signals, " Proc. IEEE, vol. 69, no. 5, pp. 529-541, May 1981.
4. K. Paliwal, K. Wójcicki, and B. Shannon, "The importance of phase in speech enhancement, " Speech Commun., vol. 53, pp. 465-494, 2010.
5. D. Gunawan, and D. Sen, "Iterative phase estimation for the synthesis of separated sources from single-channel mixtures, " IEEE Signal Process. Lett., vol. 17, no. 5, pp. 421-424, May 2010.
6. P. Mowlaee, R. Saeidi, and R. Martin, "Phase estimation for signal reconstruction in single-channel speech separation, " Proc. Interspeech, 2012, pp. 1-4.
7. M. Krawczyk, and T. Gerkmann, "STFT phase reconstruction in voiced speech for an improved single-channel speech enhancement, " IEEE/ACM Trans. Audio Speech Lang Process., vol. 22, no. 12, pp. 1931-1940, Dec. 2014.
8. G. Kim, Y. Lu, Y. Hu, and P. Loizou, "An algorithm that improves speech intelligibility in noise for normal-hearing listeners, " J. Acoust. Soc. Amer., vol. 126, pp. 1486-1494, 2009.
9. E. W. Healy, S. E. Yoho, Y. Wang, and D. L. Wang, "An algorithm to improve speech recognition in noise for hearing-impaired listeners, " J. Acoust. Soc. Amer., vol. 134, pp. 3029-3038, 2013.
10. K. Sugiyama, and R. Miyahara, "Phase randomization-a new paradigm for single-channel signal enhancement, " Proc. ICASSP, 2013, pp. 7487- 7491.
11. Y. Wang, A. Narayanan, and D. L. Wang, "On training targets for supervised speech separation, " IEEE/ACM Trans. Audio, Speech, Lang. Process., vol. 22, no. 12, pp. 1849-1858, Dec. 2014.
12. H. Erdogan, J. R. Hershey, S.Watanabe, and J. L. Roux, "Phase-sensitive and recognition-boosted speech separation using deep recurrent neural networks, " Proc. ICASSP, 2015, pp. 708-712.
13. Y.Wang, and D. L.Wang, "A deep neural network for time-domain signal reconstruction, " Proc. ICASSP, 2015, pp. 4390-4394.
14. P. C. Loizou, Speech Enhancement: Theory and Practice, Boca Raton, FL, USA: CRC, 2007.
15. D. S. Williamson, Y. Wang, and D. L. Wang, "Estimating nonnegative matrix model activations with deep neural networks to increase perceptual speech quality, " J. Acoust. Soc. Amer., vol. 138, pp. 1399-1407, 2015.
16. Y. Wang, K. Han, and D. L. Wang, "Exploring monaural features for classification-based speech segregation, " IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 2, pp. 270-279, Feb. 2013.
17. X.-L. Zhang, and D. L. Wang, "Boosted deep neural networks and multi-resolution cochleagram features for voice activity detection, " Proc. Interspeech, 2014, pp. 1534-1538.
18. R. Caruana, "Multitask learning, " Mach. Learn., vol. 28, pp. 41-75, 1997.
19. X. Glorot, A. Bordes, and Y. Bengio, "Deep sparse rectifier neural networks, " Proc. AISTATS, 2011, vol. 15, pp. 315-323.
20. J. Duchi, E. Hazan, and Y. Singer, "Adaptive subgradient methods for online learning and stochastic optimization, " J. Mach. Learn. Res., vol. 12, pp. 2121-2159, 2010.
21. "IEEE recommended practice for speech quality measurements, " IEEE Trans. Audio Electroacoust., AE-17, pp. 225-246, 1969.
22. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, D. S. Pallett, and N. L. Dahlgren, "DARPA TIMIT acoustic phonetic continuous speech corpus, " 1993, http://www.ldc.upenn.edu/Catalog/LDC93S1.html.
23. C. Chen, and J. A. Bilmes, "MVA processing of speech features, " IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 1, pp. 257-270, Jan. 2007.
24. J. Chen, Y. Wang, and D. Wang, "A feature study for classification-based speech separation at low signal-to-noise ratios, " IEEE/ACMTrans. Audio, Speech, Lang Process., vol. 22, no. 12, pp. 2112-2121, Dec. 2014.
25. R. M. Parry, and I. Essa, "Incorporating phase information for source separation via spectrogram factorization, " Proc. ICASSP, 2007, pp. 661- 664.
26. H. Kameoka, N. Ono, K. Kashino, and S. Sagayama, "Complex NMF: A new sparse representation for acoustic signals, " Proc. ICASSP, 2009, pp. 3437-3440.
27. B. King, and L. Atlas, "Single-channel source separation using complex matrix factorization, " IEEE Trans. Audio Speech Lang. Process., vol. 19, no. 8, pp. 2591-2597, Nov. 2011.
28. D.W. Griffin, and J. S. Lim, "Signal estimation from modified short-time Fourier transform, " IEEE Trans. Acoust. Speech Signal Process., ASSP- 32, no. 2, pp. 236-243, Apr. 1984.
29. Perceptual evaluation of speech quality (PESQ), an objective method for end-to-end speech quality assessment of narrowband telephone networks and speech codecs, ITU-R 862, 2001.
30. C. H. Taal, R. C. Hendriks, R. Heusdens, and J. Jensen, "An algorithm for intelligibility prediction of time frequency weighted noisy speech, " IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 7, pp. 2125-2136, Sep. 2011.
31. Y. Hu, and P. C. Loizou, "Evaluation of objective quality measures for speech enhancement, " IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 1, pp. 229-238, Jan. 2008.
32. K. H. Arehart, J. M. Kates, M. C. Anderson, and L. O. Harvey, "Effects of noise and distortion on speech quality judgments in normal-hearing and hearing-impaired listeners, " J. Acoust. Soc. Amer., vol. 122, pp. 1150- 1164, 2007.
33. R. Koning, N. Madhu, and J. Wouters, "Ideal time-frequency masking algorithms lead to different speech intelligibility and quality in normalhearing and cochlear implant listeners, " IEEE Trans. Biomed. Eng., vol. 62, no. 1, pp. 331-341, Jan. 2015.
34. D. S. Williamson, Y. Wang, and D. L. Wang, "Reconstruction techniques for improving the perceptual quality of binary masked speech, " J. Acoust. Soc. Amer., vol. 136, pp. 892-902, 2014.
35. A. Gaich, and P. Mowlaee, "On speech quality estimation of phase-aware single-channel speech enhancement, " Proc. ICASSP, 2015, pp. 216-220.