Evaluating source separation algorithms with reverberant speech

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 7, 2010, Pages 1872-1883

  Mandel, Michael I ^a   Bressler, Scott ^b   Shinn Cunningham, Barbara ^b   Ellis, Daniel P W ^c  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b BOSTON UNIVERSITY   (United States)

^c Columbia University ^*  (United States)

Author keywords

Intelligibility; objective evaluation; reverberation; speech enhancement; timefrequency masking; underdetermined source separation

Indexed keywords

AUTOMATIC SPEECH RECOGNITION; HUMAN LISTENERS; HUMAN PERFORMANCE; INTELLIGIBILITY; OBJECTIVE EVALUATION; OBJECTIVE MEASURE; PRIORI KNOWLEDGE; SEPARATION PERFORMANCE; SIGNAL SEPARATION; SOURCE SEPARATION; SPEECH SEPARATION; TIME FREQUENCY;

ALGORITHMS; REVERBERATION; SIGNAL ANALYSIS; SPEECH ENHANCEMENT; SPEECH RECOGNITION;

SPEECH INTELLIGIBILITY;

EID: 77955698002     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2010.2052252     Document Type: Article

References (38)

1. D. P. W. Ellis, "Evaluating speech separation systems," in Speech Separation by Humans and Machines, P. Divenyi, Ed. Norwell, MA: Kluwer, 2004, ch. 20, pp. 295-304.
2. D. S. Brungart, P. S. Chang, B. D. Simpson, and D. Wang, "Isolating the energetic component of speech-on-speech masking with ideal time-frequency segregation," J. Acoust. Soc. Amer., vol.120, no.6, pp. 4007-4018, 2006.
3. D. Wang, U. Kjems, M. S. Pedersen, J. B. Boldt, and T. Lunner, "Speech perception of noise with binary gains," J. Acoust. Soc. Amer., vol.124, no.4, pp. 2303-2307, 2008.
4. M. Weintraub, "A theory and computational model of auditory monaural sound separation," Ph.D. dissertation, Stanford Univ. Dept. of Elect. Eng., Stanford, CA, 1985.
5. Y. Hu and P. C. Loizou, "Evaluation of objective quality measures for speech enhancement," IEEE Trans. Audio, Speech, Lang. Process., vol.16, no.1, pp. 229-238, Jan. 2008.
6. L. D. Persia, D. Milone, H. Rufiner, and M.Yanagida, "Perceptual evaluation of blind source separation for robust speech recognition," Signal Process., vol.88, no.10, pp. 2578-2583, Oct. 2008.
7. R. V. Shannon, F.-G. Zeng, V. Kamath, J. Wygonski, and M. Ekelid, "Speech recognition with primarily temporal cues," Science, vol.270, no.5234, pp. 303-304, Oct. 1995.
8. C. M. Chernick, S. Leigh, K. L. Mills, and R. Toense, "Testing the ability of speech recognizers to measure the effectiveness of encoding algorithms for digital speech transmission," in Proc. IEEE Military Commun. Conf., 1999, vol.2, pp. 1468-1472.
9. W. Jiang and H. Schulzrinne, "Speech recognition performance as an effective perceived quality predictor," in Proc. IEEE Int. Workshop Quality of Service, 2002, pp. 269-275.
10. G. Hu and D. Wang, "Monaural speech separation," Adv. Neur. Inf. Process. Syst., vol.15, pp. 1221-1228, 2003.
11. O. Y?lmaz and S. Rickard, "Blind separation of speech mixtures via time-frequency masking," IEEE Trans. Signal Process., vol.52, no.7, pp. 1830-1847, Jul. 2004.
12. P. C. Loizou, Speech Enhancement: Theory and Practice. Boca Raton, FL: CRC, 2007.
13. Y. Li and D.Wang, "On the optimality of ideal binary time-frequency masks," Speech Commun., vol.51, no.3, pp. 230-239, Mar. 2009.
14. S. Bressler and B. G. Shinn-Cunningham, "Effects of pitch and spatial separation on selective attention in anechoic and reverberant environments," J. Acoust. Soc. Amer., vol.123, no.5, pp. 2978-2978, 2008.
15. D. S. Brungart, "Informational and energetic masking effects in the perception of two simultaneous talkers," J. Acoust. Soc. Amer., vol.109, no.3, pp. 1101-1109, 2001.
16. D. S. Brungart, B. D. Simpson, and R. L. Freyman, "Precedence-based speech segregation in a virtual auditory environment," J. Acoust. Soc. Amer., vol.118, no.5, pp. 3241-3251, 2005.
17. G. Kidd, T. L. Arbogast, C. R. Mason, and F. J. Gallun, "The advantage of knowing where to listen," J. Acoust. Soc. Amer., vol.118, no.6, pp. 3804-3815, 2005.
18. C. R. Mason, T. L. Rohtla, and P. S. Deliwala, "Release from masking due to spatial separation of sources in the identification of nonspeech auditory patterns," J. Acoust. Soc. Amer., vol.104, no.1, pp. 422-431, 1998.
19. R. L. Freyman, U. Balakrishnan, and K. S. Helfer, "Effect of number of masking talkers and auditory priming on informational masking in speech recognition," J. Acoust. Soc. Amer., vol.115, no.5, pp. 2246-2256, 2004.
20. B. G. Shinn-Cunningham, "Object-based auditory and visual attention," Trends in Cognitive Sci., vol.12, no.5, pp. 182-186, May 2008.
21. B. G. Shinn-Cunningham, N. Kopco, and T. J. Martin, "Localizing nearby sound sources in a classroom: Binaural room impulse responses," J. Acoust. Soc. Amer., vol.117, no.5, pp. 3100-3115, 2005.
22. M. I. Mandel, R. J.Weiss, and D. P. W. Ellis, "Model-based expectation maximization source separation and localization," IEEE Trans. Audio, Speech, Lang. Process., vol.18, no.2, pp. 382-394, Feb. 2010.
23. A. Jourjine, S. Rickard, and O. Y?lmaz, "Blind separation of disjoint orthogonal signals: Demixing n sources from 2 mixtures," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2000, vol.5, pp. 2985-2988.
24. H. Sawada, S. Araki, and S. Makino, "A two-stage frequency-domain blind source separation method for underdetermined convolutive mixtures," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., 2007, pp. 139-142.
25. J. Mouba and S. Marchand, "A source localization/separation/ respatialization system based on unsupervised classification of interaural cues," in Proc. Int. Conf. Digital Audio Effects, 2006, pp. 233-238.
26. B. Raj, M. L. Seltzer, and R. M. Stern, "Reconstruction of missing features for robust speech recognition," Speech. Commun., vol.43, no.4, pp. 275-296, Sep. 2004.
27. M. Cooke, P. Green, L. Josifovski, and A. Vizinho, "Robust automatic speech recognition with missing and unreliable acoustic data," Speech. Commun., vol.34, no.3, pp. 267-285, Jun. 2001.
28. D. Kolossa, A. Klimas, and R. Orglmeister, "Separation and robust recognition of noisy, convolutive speech mixtures using time-frequency masking and missing data techniques," in Proc. IEEEWorkshop Applicat. Signal Process. Audio Acoust., 2005, pp. 82-85.
29. A. P. Varga and R. K. Moore, "Hidden markov model decomposition of speech and noise," in Proc. IEEE Int. Conf. Acoust. Speech, Signal Process., 1990, vol.2, pp. 845-848.
30. R. J. Weiss and D. P. W. Ellis, "Monaural speech separation using source-adapted models," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2007, pp. 114-117.
31. J. R. Hershey, S. J. Rennie, P. A. Olsen, and T. T. Kristjansson, "Super-human multi-talker speech recognition: A graphical modeling approach," Comput. Speech Lang., Jan. 2009.
32. M. Seltzer, B. Raj, and R. Stern, "A Bayesian classifier for spectrographic mask estimation for missing feature speech recognition," Speech Commun., vol.43, no.4, pp. 379-393, Sep. 2004.
33. H.-M. Park and R. M. Stern, "Missing feature speech recognition using dereverberation and echo suppression in reverberant environments," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2007, vol.4, pp. 381-384.
34. S. A. Gelfand and S. Silman, "Effects of small room reverberation upon the recognition of some consonant features," J. Acoust. Soc. Amer., vol.66, no.1, pp. 22-29, 1979.
35. E. Vincent, S. Araki, and P. Bofill, "The 2008 signal separation evaluation campaign: A community-based approach to large-scale evaluation," Ind. Compon. Anal. Signal Separat., pp. 734-741, 2009.
36. E. Vincent, R. Gribonval, and C. Fevotte, "Performance measurement in blind audio source separation," IEEE Trans. Audio, Speech, Lang. Process., vol.14, no.4, pp. 1462-1469, Jul. 2006. (Pubitemid 46547636)
37. M. I. Mandel, D. P. W. Ellis, and T. Jebara, "An EM algorithm for localizing multiple sound sources in reverberant environments," in Advances in Neural Information Processing Systems, B. Schölkopf, J. Platt, and T. Hoffman, Eds. Cambridge, MA: MIT Press, 2007, pp. 953-960.
38. M. I. Mandel and D. P. W. Ellis, "EM localization and separation using interaural level and phase cues," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., 2007, pp. 275-278.