On training targets for supervised speech separation

IEEE/ACM Transactions on Audio Speech and Language Processing

Volumn 22, Issue 12, 2014, Pages 1849-1858

  Wang, Yuxuan ^a   Narayanan, Arun ^a   Wang, De Liang ^a  

^a Ohio State University   (United States)

Author keywords

Deep neural networks; Speech separation; Supervised learning; Training targets

Indexed keywords

FACTORIZATION; FAST FOURIER TRANSFORMS; SEPARATION; SPEECH; SPEECH ANALYSIS; SPEECH ENHANCEMENT; SUPERVISED LEARNING;

DEEP NEURAL NETWORKS; IDEAL BINARY MASK (IBM); NONNEGATIVE MATRIX FACTORIZATION; SHORT TIME FOURIER TRANSFORMS; SPECTRAL MAGNITUDES; SPEECH SEPARATION; SUPERVISED LEARNING PROBLEMS; TIME-FREQUENCY REPRESENTATIONS;

SPEECH INTELLIGIBILITY;

EID: 84921740463     PISSN: 23299290     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASLP.2014.2352935     Document Type: Article

References (39)

1. M. Anzalone, L. Calandruccio, K. Doherty, and L. Carney, "Determination of the potential benefit of time-frequency gain manipulation," Ear Hear., vol. 27, no. 5, pp. 480-492, 2006.
2. D. Brungart, P. Chang, B. Simpson, and D. Wang, "Isolating the energetic component of speech-on-speech masking with ideal time-frequency segregation," J. Acoust. Soc. Amer., vol. 120, pp. 4007-4018, 2006.
3. C. Chen and J. Bilmes, "MVA processing of speech features," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 1, pp. 257-270, Jan.2007.
4. J. Chen, Y. Wang, and D. Wang, "A feature study for classificationbased speech separation at very low signal-to-noise ratio," in Proc.ICASSP, 2014, pp. 7059-7063.
5. J. Duchi, E. Hazan, and Y. Singer, "Adaptive subgradient methods for online learning and stochastic optimization," J. Mach. Learn. Res., pp.2121-2159, 2011.
6. J. Erkelens,R.Hendriks, R. Heusdens, and J. Jensen, "Minimummeansquare error estimation of discrete fourier coefficients with generalized gamma priors," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 6, pp. 1741-1752, Aug. 2007.
7. J. Garofolo, DARPA TIMIT acoustic-phonetic continuous speech corpus. Gaithersburg, MD, USA: Nat. Inst. of Standards Technol., 1993.
8. X. Glorot, A. Bordes, and Y. Bengio, "Deep sparse rectifier networks," in Proc. 14th Int. Conf. Artif. Intell. Statist. JMLR W&CP Volume,2011, vol. 15, pp. 315-323.
9. C. Gulcehre and Y. Bengio, "Knowledge matters: Importance of prior information for optimization," in Proc. Int. Conf. Learn. Representat.(ICLR), 2013.
10. K. Han and D. Wang, "A classification based approach to speech segregation," J. Acoust. Soc. Amer., vol. 132, pp. 3475-3483, 2012.
11. K. Han, Y.Wang, and D.Wang, "Learning spectralmapping for speech dereverberation," in Proc. ICASSP, 2014, pp. 4648-4652.
12. E. Healy, S. Yoho, Y. Wang, and D. Wang, "An algorithm to improve speech recognition in noise for hearing-impaired listeners," J. Acous.Soc. Amer., pp. 3029-3038, 2013.
13. R. Hendriks, R. Heusdens, and J. Jensen, "MMSE based noise PSD tracking with low complexity," in Proc. ICASSP, 2010, pp. 4266-4269.
14. J. R. Hershey, S. J. Rennie, P. A. Olsen, and T. T. Kristjansson, "Super-human multi-talker speech recognition: A graphical modeling approach," Comput. Speech Lang., pp. 45-66, 2010.
15. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. R.Salakhutdinov, "Improving neural networks by preventing co-adaptation of feature detectors," arXiv preprint arXiv:1207.0580, 2012.
16. Z. Jin and D.Wang, "A supervised learning approach to monaural segregation of reverberant speech," IEEE Trans. Audio, Speech, Lang.Process., vol. 17, no. 4, pp. 625-638, May 2009.
17. G. Kim, Y. Lu, Y. Hu, and P. Loizou, "An algorithm that improves speech intelligibility in noise for normal-hearing listeners," J. Acoust.Soc. Amer., pp. 1486-1494, 2009.
18. U. Kjems, J. Boldt, M. Pedersen, T. Lunner, and D. Wang, "Role of mask pattern in intelligibility of ideal binary-masked noisy speech," J.Acoust. Soc. Amer., vol. 126, pp. 1415-1426, 2009.
19. N. Li and P. Loizou, "Factors influencing intelligibility of ideal binary- masked speech: Implications for noise reduction," J. Acoust. Soc.Amer., vol. 123, no. 3, pp. 1673-1682, 2008.
20. Y. Li and D.Wang, "On the optimality of ideal binary time-frequency masks," Speech Commun., pp. 230-239, 2009.
21. P. C. Loizou, Speech Enhancement: Theory and Practice. Boca Raton, FL, USA: CRC, 2007.
22. N. Mohammadiha, P. Smaragdis, and A. Leijon, "Supervised and unsupervised speech enhancement approaches using nonnegative matrix factorization," IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no.10, pp. 2140-2151, Oct. 2013.
23. A. Narayanan and D. Wang, "Ideal ratio mask estimation using deep neural networks for robust speech recognition," in Proc. ICASSP, 2013, pp. 7092-7096.
24. A. Narayanan and D.Wang, "The role of binary mask patterns in automatic speech recognition in background noise," J. Acoust. Soc. Amer., pp. 3083-3093, 2013.
25. R. Plomp, The Intelligent Ear: On the Nature of Sound Perception.Mahwah, NJ, USA: Lawrence Erlbaum Associates, 2002.
26. A. M. Reddy and B. Raj, "Soft mask methods for single-channel speaker separation," IEEE Trans. Audio, Speech, Lang. Process., vol.15, no. 6, pp. 1766-1776, Aug. 2007.
27. A. Rix, J. Beerends, M. Hollier, and A. Hekstra, "Perceptual evaluation of speech quality (PESQ)-a new method for speech quality assessment of telephone networks and codecs," in Proc. ICASSP, 2001, pp.749-752.
28. S. Srinivasan, N. Roman, and D. Wang, "Binary and ratio time-frequency masks for robust speech recognition," Speech Commun., vol.48, no. 11, pp. 1486-1501, 2006.
29. C. Taal, R. Hendriks, R. Heusdens, and J. Jensen, "An algorithm for intelligibility prediction of time-frequency weighted noisy speech," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 7, pp.2125-2136, Sep. 2011.
30. A. Varga and H. Steeneken, "Assessment for automatic speech recognition: II. NOISEX-92: A database and an experiment to study the effect of additive noise on speech recognition systems," Speech Commun., vol. 12, pp. 247-251, 1993.
31. T. Virtanen, J. Gemmeke, and B. Raj, "Active-set Newton algorithm for overcomplete non-negative representations of audio," IEEE Trans.Audio, Speech, Lang. Process., vol. 21, no. 11, pp. 2277-2289, Nov.2013.
32. D.Wang, "On ideal binary mask as the computational goal of auditory scene analysis," in Speech Separation by Humans and Machines, P.Divenyi, Ed. Norwell, MA, USA: Kluwer, 2005, pp. 181-197.
33. D. Wang, U. Kjems, M. Pedersen, J. Boldt, and T. Lunner, "Speech intelligibility in background noise with ideal binary time-frequency masking," J. Acoust. Soc. Amer., vol. 125, pp. 2336-2347, 2009.
34. Y. Wang, K. Han, and D. Wang, "Exploring monaural features for classification-based speech segregation," IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 2, pp. 270-279, Feb. 2013.
35. Y. Wang and D. Wang, "Cocktail party processing via structured prediction," in Proc. NIPS, 2012, pp. 224-232.
36. Y. Wang and D. Wang, "Towards scaling up classification-based speech separation," IEEE Trans. Audio, Speech, Lang. Process., vol.21, no. 7, pp. 1381-1390, Jul. 2013.
37. Y. Wang and D. Wang, "A structure-preserving training target for supervised speech separation," in Proc. ICASSP, 2014, pp. 6127-6131.
38. J. Woodruff, "Integrating monaural and binaural cues for sound localization and segregation in reverberant environments," Ph.D. dissertation, The Ohio State Univ., Columbus, OH, USA, 2012.
39. Y. Xu, J. Du, L. Dai, and C. Lee, "An experimental study on speech enhancement based on deep neural networks," IEEE Signal Processing Lett., vol. 21, no. 1, pp. 66-68, Jan. 2014.