Binaural detection, localization, and segregation in reverberant environments based on joint pitch and azimuth cues

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 4, 2013, Pages 806-815

  Woodruff, John ^a   Wang, Deliang ^a,b  

^a The Ohio State University   (United States)

^b OHIO STATE UNIVERSITY   (United States)

Author keywords

Binaural speech segregation; computational auditory scene analysis; multipitch tracking; sound localization; source detection

Indexed keywords

ACROSS TIME; COMPUTATIONAL AUDITORY SCENE ANALYSIS; ESTIMATED STATE; MARKOV MODEL; MULTISOURCES; PERFORMANCE GAIN; PITCH ESTIMATION; REVERBERANT CONDITION; REVERBERANT ENVIRONMENT; SEGREGATION OF SPEECH; SOUND LOCALIZATION; SOURCE DETECTION; SPEECH SEGREGATION; STATE SPACE; TIME FREQUENCY;

ENCODING (SYMBOLS); HIDDEN MARKOV MODELS; REVERBERATION;

CONTINUOUS SPEECH RECOGNITION;

EID: 84872925389     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2236316     Document Type: Article

References (43)

1. P. Boersma, "Accurate short-time analysis of the fundamental fre quency and the harmonics-to-noise ratio of a sampled sound," Inst. Phonetic Sci., vol. 17, pp. 97-110, 1993.
2. J. S. Bradley, "Predictors of speech intelligibility in rooms," J. Acoust. Soc. Amer., vol. 80, pp. 837-845, 1986. (Pubitemid 16054531)
3. Microphone Arrays: Signal Processing Techniques and Applications, M. Brstein and D. Ward, Eds. New York: Springer, 2001.
4. A. S. Bregman, Auditory Scene Analysis. Cambridge, MA: MIT Press, 1990.
5. H. Buchner, R. Aichner, and W. Kellermann, "Blind source separation for convolutive mixtures: A unified treatment," in Audio Signal Processing for Next-Generation Multimedia Communications Systems, Y. Huang and J. Benesty, Eds. Dordrecht, The Netherlands: Kluwer, 2004, pp. 255-294.
6. D. R. Campbell, "The ROOMSIM User Guide (v3.3)," 2004 [Online]. Available: http://media.paisley.ac.uk/~campbell/Roomsim/
7. C. J. Darwin, "Spatial hearing and perceiving sources," in Auditory Perception of Sound Sources, W. A. Yost, A. N. Popper, and R. R. Fay, Eds. New York: Springer, 2007, pp. 215-232.
8. N. Q. K. Duong, E. Vincent, and R. Gribonval, "Under-determined reverberant audio source separation using a full-rank spatial covariance model," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 7, pp. 1830-1840, Sep. 2010.
9. A. S. Feng and D. L. Jones, "Location-based grouping," in Computational Auditory Scene Analysis: Principles, Algorithms and Applications, D. L. Wang and G. J. Brown, Eds. New York: Wiley/IEEE Press, 2006, pp. 187-208.
10. O. L. Frost, "An algorithm for linearly constrained adaptive array processing," Proc. IEEE, vol. 60, no. 8, pp. 926-935, Aug. 1972.
11. W. G. Gardner and K. D. Martin, "HRTF measurements of a KEMAR," J. Acoust. Soc. Amer., vol. 97, pp. 3907-3908, 1995.
12. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, D. S. Pallett, and N. L. Dahlgren, "DARPA TIMIT acoustic phonetic continuous speech corpus," 1993 [Online]. Available: http://www.ldc.upenn.edu/Catalog/ LDC93S1.html
13. D. J. Hand, "Idiot's Bayes-Not so stupid after all?," Int. Statist. Rev., vol. 69, no. 3, pp. 385-398, 2001.
14. R. C. Hendriks, R. Heusdens, U. Kjems, and J. Jensen, "On optimal multichannel mean-squared error estimators for speech enhancement," IEEE Signal Process. Lett., vol. 16, no. 10, pp. 885-888, Oct. 2009.
15. C. Hummersone, R. Mason, and T. Brookes, "Dynamic precedence effect modeling for source separation in reverberant environments," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 7, pp. 1867-1871, Sep. 2010.
16. J. R. Jensen, M. G. Christensen, and S. H. Jensen, "Joint DOA and fundamental frequency estimation methods based on 2-d filtering," in Proc. EUSIPCO, 2010.
17. Z. Jin and D. L. Wang, "A supervised learning approach to monaural segregation of reverberant speech," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 4, pp. 625-638, May 2009.
18. Z. Jin and D. L. Wang, "HMM-based multipitch tracking for noisy and reverberant speech," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 5, pp. 1091-1102, Jul. 2011.
19. M. Képesi, F. Pernkopf, and M. Wohlmayr, "Joint position pitch tracking for 2-channel audio," in Proc. Int. Workshop Content Based Multimedia Indexing, 2007.
20. G. Kim, Y. Lu, Y. Hu, and P. Loizou, "An algorithm that improves speech intelligibility in noise for normal-hearing listeners," J. Acoust. Soc. Amer., vol. 126, no. 3, pp. 1486-1494, 2009.
21. R. F. Lyon, "A computational model of binaural localization and separation," in Proc. ICASSP, 1983, pp. 1148-1151.
22. N. Ma, J. Barker, H. Christensen, and P. Green, "Binaural cues for fragment-based speech recognition in reverberant multisource environments," in Proc. INTERSPEECH, 2011.
23. M. I. Mandel, R. J. Weiss, and D. P. W. Ellis, "Model-based expectation-maximization source separation and localization," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 2, pp. 382-394, Feb. 2010.
24. T. Nakatani, M. Goto, and H. G. Okuno, "Localization by harmonic structure and its application to harmonic sound stream segregation," in Proc. ICASSP, 1996, pp. 653-656.
25. J. Nix and V. Hohmann, "Combined estimation of spectral envelopes and sound source direction of concurrent voices by multidimensional statistical filtering," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 3, pp. 995-1008, Mar. 2007.
26. Ö. Yilmaz and S. Rickard, "Blind separation of speech mixtures via time-frequency masking," IEEE Trans. Signal Process., vol. 52, no. 7, pp. 1830-1847, Jul. 2004.
27. R. D. Patterson, I. Nimmo-Smith, J. Holdsworth, and P. Rice, "An Efficient Auditory Filterbank based on the Gammatone Function, MRC App. Psych. Unit," Tech. Rep. Cambridge, 1988.
28. N. Roman, D. L. Wang, and G. Brown, "Speech segregation based on sound localization," J. Acoust. Soc. Amer, vol. 114, pp. 2236-2252, 2003. (Pubitemid 37266649)
29. N. Roman and J. Woodruff, "Intelligibility of reverberant noisy speech with ideal binary masking," J. Acoust. Soc. Amer, vol. 130, pp. 2153-2161, 2011.
30. A. Shamsoddini and P. N. Denbigh, "A sound segregation algorithm for reverberant conditions," Speech Commun., vol. 33, pp. 179-196, 2001. (Pubitemid 32034413)
31. B. G. Shinn-Cunningham, "Influences of spatial cues on grouping and understanding sound," inProc. Forum Acusticum, 2005.
32. K. U. Simmer, J. Bitzer, and C. Marro, "Post-filtering techniques," in Microphone Arrays: Signal Processing Techniques and Applications. New York: Springer, 2001, pp. 39-60.
33. M. Souden, J. Benesty, and S. Affes, "On optimal frequency-domain multichannel linear filtering for noise reduction," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 2, pp. 260-275, Feb. 2010.
34. D. L. Wang, "On ideal binary masks as the computational goal of auditory scene analysis," in Speech Separation by Humans and Machines, P. Divenyi, Ed. Boston, MA: Kluwer, 2005, pp. 181-197.
35. D. L. Wang and G. J. Brown, Eds., Computational Auditory Scene Analysis: Principles, Algorithms, and Applications Hoboken, NJ, Wiley/IEEE Press, 2006.
36. D. L. Wang, U. Kjems, M. S. Pedersen, J. B. Boldt, and T. Lunner, "Speech intelligibility in background noise with ideal binary time-frequency masking," J. Acoust. Soc. Amer, vol. 125, pp. 2336-2347, 2009.
37. R. Weiss, M. Mandel, and Ellis, "Combining localization cues and source model constraints for binaural source separation," Speech Commun, vol. 53, pp. 606-621, 2011.
38. J. Woodruff and D. L. Wang, "Sequential organization of speech in reverberant environments by integrating monaural grouping and binaural localization," IEEE Trans. Acoust., Speech, Signal Process., vol. 18, no. 7, pp. 1856-1866, Sep. 2010.
39. J. Woodruff and D. L. Wang, "Binaural localization of multiple sources in reverberant and noisy environments," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 5, pp. 1503-1512, Jul. 2012.
40. W. S. Woods, M. Hansen, T. Wittkop, and B. Kollmeier, "A simple architecture for using multiple cues in sound separation," inProc. ICSLP, 1996.
41. S. N. Wrigley and G. J. Brown, "Binaural speech separation using recurrent timing neural networks for joint F0-localisation estimation," inMachine Learning for Multimodel Interaction. Berlin/Heidelberg, Germany: Springer, 2008, pp. 271-282. (Pubitemid 351333606)
42. M. Wu, D. L. Wang, and G. J. Brown, "A multipitch tracking algorithm for noisy speech," IEEE Trans. Speech Audio Process., vol 11 no. 3, pp. 229-241, May 2003.
43. J. X. Zhang, M. G. Christensen, S. H. Jensen, and M. Moonen, "Joint DOA and multi-pitch estimation based on subspace techniques," EURASIP J. Adv. Signal Process., vol 2012, pp. 1-11, 2012.