Sequential organization of speech in reverberant environments by integrating monaural grouping and binaural localization

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 7, 2010, Pages 1856-1866

  Woodruff, John ^a   Wang, Deliang ^a  

^a The Ohio State University   (United States)

Author keywords

Binaural speech segregation; computational auditory scene analysis; monaural grouping; sequential organization; sound localization

Indexed keywords

COMPUTATIONAL AUDITORY SCENE ANALYSIS; MONAURAL GROUPING; SEQUENTIAL ORGANIZATION; SOUND LOCALIZATION; SPEECH SEGREGATION;

PATIENT REHABILITATION; REVERBERATION; SPEECH ANALYSIS; SPEECH PROCESSING;

SEGREGATION (METALLOGRAPHY);

EID: 77955697785     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2010.2050087     Document Type: Article

References (40)

1. Microphone Arrays: Signal Processing Techniques and Applications, M. Brandstein and D. Ward, Eds.. New York: Springer, 2001.
2. Computational Auditory Scene Analysis: Principles, Algorithms, and Applications, D. L. Wang and G. J. Brown, Eds.. Hoboken, NJ: Wiley/IEEE Press, 2006.
3. G. J. Brown and K. J. Palomaki, "Reverberation," in Computational Auditory Scene Analysis: Principles, Algorithms, and Applications, D. L. Wang and G. J. Brown, Eds. New York: Wiley/IEEE Press, 2006, pp. 209-250.
4. S. Harding, J. Barker, and G. J. Brown, "Mask estimation for missing data speech recognition based on statistics of binaural interaction," IEEE Trans. Audio, Speech, and Lang. Process., vol.14, no.1, pp. 58-67, Jan. 2006.
5. N. Roman, S. Srinivasan, and D. L. Wang, "Binaural segregation in multisource reverberant environments," J. Acoust. Soc. Amer., vol.120, no.6, pp. 4040-4051, 2006.
6. Y. Izumi, N. Ono, and S. Sagayama, "Sparseness-based 2CH BSS using the EM algorithm in reverberant environment," in Proc. WASPAA, Oct. 2007, pp. 147-150.
7. M. I. Mandel and D. P. W. Ellis, "EM localization and separation using interaural level and phase cues," in Proc. WASPAA, Oct. 2007, pp. 275-278.
8. H. Sawada, S. Araki, and S. Makino, "A two-state frequency-domain blind source separation method for underdetermined convolutive mixtures," in Proc. WASPAA, Oct. 2007, pp. 139-142.
9. A. S. Bregman, Auditory Scene Analysis. Cambridge, MA: MIT Press, 1990.
10. J. F. Culling and Q. S. Summerfield, "Perceptual separation of concurrent speech sounds: Absence of across-frequency grouping by common interaural delay," J. Acoust. Soc. Amer., vol.98, pp. 785-797, 1995.
11. C. J. Darwin and R. W. Hukin, "Auditory objects of attention: The role of interaural time differences," J. Exp. Psychol. Hum. Percept. Perform., vol.25, pp. 617-629, 1999.
12. W. M. Hartmann, "How we localize sounds," Phys. Today, pp. 24-29, Nov. 1999.
13. C. J. Darwin, "Spatial hearing and perceiving sources," in Auditory Perception of Sound Sources, W. A. Yost, A. N. Popper, and R. R. Fay, Eds. New York: Springer, 2007, pp. 215-232.
14. A. Shamsoddini and P. N. Denbigh, "A sound segregation algorithm for reverberant conditions," Speech Commun., vol.33, pp. 179-196, 2001.
15. H. Christensen, N. Ma, S. N. Wrigley, and J. Barker, "A speech fragment approach to localising multiple speakers in reverberant environments," in Proc. ICASSP, Apr. 2009, pp. 4593-4596.
16. J. Woodruff and D. L. Wang, "On the role of localization cues in binaural segregation of reverberant speech," in Proc. ICASSP, Apr. 2009, pp. 2205-2208.
17. J. Woodruff and D. L. Wang, "Integrating monaural and binaural analysis for localizing multiple reverberant sound sources," in Proc. ICASSP, Mar. 2010, pp. 2706-2709.
18. S. Vishnubhotla and C. Y. Epsy-Wilson, "An algorithm for speech segregation of co-channel speech," in Proc. ICASSP, Apr. 2009, pp. 109-112.
19. Z. Jin and D. L. Wang, "A supervised learning approach to monaural segregation of reverberant speech," IEEE Trans. Audio, Speech, Lang. Process., vol.17, pp. 625-638, 2009.
20. G. Hu and D. L. Wang, "Segregation of unvoiced speech from nonspeech interference," J. Acoust. Soc. Amer., vol.124, pp. 1306-1319, 2008.
21. Y. Shao and D. L. Wang, "Sequential organization of speech in computational auditory scene analysis," Speech Commun., vol.51, pp. 657-667, 2009.
22. D. R. Campbell, The ROOMSIM User Guide (v3.3) 2004.
23. W. G. Gardner and K. D. Martin, "HRTF measurements of a KEMAR," J. Acoust. Soc. Amer., vol.97, pp. 3907-3908, 1995.
24. J. B. Allen and D. A. Berkley, "Image method for efficiently simulating small-room acoustics," J. Acoust. Soc. Amer., vol.65, pp. 943-950, 1979.
25. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, D. S. Pallett, and N. L. Dahlgren, "DARPA TIMIT acoustic phonetic continuous speech corpus," 1993.
26. R. D. Patterson, I. Nimmo-Smith, J. Holdsworth, and P. Rice, "An efficient auditory filterbank based on the gammatone function," Cambridge, U.K., Tech. Rep., MRC Applied Psychology Unit, 1988.
27. B. R. Glasberg and B. C. J. Moore, "Derivation of auditory filter shapes from notched-noise data," Hear. Res., vol.47, pp. 103-138, 1990.
28. G. Hu and D. L. Wang, "A tandem algorithm for pitch estimation and voiced speech segregation," IEEE Trans. Audio, Speech, Lang. Process., 2010, to be published.
29. G. Hu, "Monaural speech organization and segregation," Ph.D. dissertation, The Ohio State Univ., Columbus, OH, 2006.
30. J. Blauert, Spatial Hearing-The Psychophysics of Human Sound Localization. Cambridge, MA: MIT Press, 1997.
31. B. Silverman, Density Estimation for Statistics and Data Analysis. London, U.K.: Chapman & Hall, 1986.
32. N. Roman, D. L. Wang, and G. J. Brown, "Speech segregation based on sound localization," J. Acoust. Soc. Amer., vol.114, no.4, pp. 2236-2252, 2003.
33. R. Y. Litovsky, H. S. Colburn, W. A. Yost, and S. J. Guzman, "The precedence effect," J. Acoust. Soc. Amer., vol.106, pp. 1633-1654, 1999.
34. C. Faller and J. Merimaa, "Source localization in complex listening situations: Selection of binaural cues based on interaural coherence," J. Acoust. Soc. Amer., vol.116, no.5, pp. 3075-3089, 2004.
35. K. W. Wilson and T. Darrell, "Learning a precedence effect-like weighting function for the generalized cross-correlation framework," IEEE Trans. Audio, Speech, Lang. Process., vol.14, no.6, pp. 2156-2164, Nov. 2006.
36. Y. Shao and D. L. Wang, "Model-based sequential organization in cochannel speech," IEEE Trans. Audio, Speech, Lang. Process., vol.14, no.1, pp. 289-298, Jan. 2006.
37. J. H. DiBiase, H. F. Silverman, and M. S. Brandstein, "Robust localization in reverberant rooms," in Microphone Arrays: Signal Processing Techniques and Applications, M. Brandstein and D.Ward, Eds. New York: Springer, 2001, ch. 8, pp. 157-180.
38. C. Liu, B. C. Wheeler,W. D. O'Brien, R. C. Bilger, C. R. Lansing, and A. S. Feng, "Localization of multiple sound sources with two microphones," J. Acoust. Soc. Amer., vol.108, no.4, pp. 1888-1905, 2000.
39. D. L.Wang, "On ideal binary masks as the computational goal of auditory scene analysis," in Speech Separation by Humans and Machines, P. Divenyi, Ed. Boston, MA: Kluwer, 2005, pp. 181-197.
40. D. Brungart, P. S. Chang, B. D. Simpson, and D. L. Wang, "Isolating the energetic component of speech-on-speech masking with an ideal binary time-frequency mask," J. Acoust. Soc. Amer., vol.120, pp. 4007-4018, 2006.