A direct masking approach to robust ASR

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 10, 2013, Pages 1993-2005

  Hartmann, William ^a   Narayanan, Arun ^a   Fosler Lussier, Eric ^a   Wang, Deliang ^a,b  

^a The Ohio State University   (United States)

^b OHIO STATE UNIVERSITY   (United States)

Author keywords

Direct masking; ideal binary mask; robust automatic speech recognition

Indexed keywords

BINARY MASKS; CEPSTRAL FEATURES; IDEAL BINARY MASK; LARGE VOCABULARY; MISSING ENERGY; MISSING FEATURES; ROBUST AUTOMATIC SPEECH RECOGNITION; SPEECH SEGREGATION;

ACOUSTICS; ELECTRICAL ENGINEERING;

SPEECH RECOGNITION;

EID: 84881088302     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2013.2263802     Document Type: Article

References (44)

1. Y. Gong, "Speech recognition in noisy environments: A survey," Speech Commun., vol. 16, pp. 261-291, 1995.
2. M. J. F. Gales and S. J. Young, "Robust continuous speech recognition using parallel model combination," IEEE Trans. Speech Audio Process., vol. 4, no. 5, pp. 352-359, Sep. 1996.
3. H. Hermansky, N. Morgan, and H.-G. Hirsch, "Recognition of speech in additive and convolutional noise based on RASTA spectral processing," in Proc. ICASSP, 1993, vol. 10, pp. 509-512.
4. S. F. Boll, "Suppression of acoustic noise in speech using spectral subtraction," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-27, no. 2, pp. 113-120, Apr. 1979.
5. A. S. Bregman, Auditory Scene Analysis. Cambridge, MA, USA: MIT Press, 1994.
6. D. L. Wang, "On ideal binary mask as the computational goal of auditory scene analysis," in Speech Separation by Humans and Machines, P. Divenyi, Ed. Norwell, MA, USA: Kluwer, 2005, pp. 181-197.
7. B. Raj and R. M. Stern, "Missing-feature approaches in speech recognition," IEEE Signal Process. Mag., vol. 22, no. 2, pp. 101-116, Sep. 2005.
8. A. Narayanan and D. L. Wang, "The role of binary mask patterns in automatic speech recognition in background noise," J. Acoust. Soc. Amer., vol. 133, no. 5, pp. 8083-8093, 2013.
9. M. Weintraub, "The GRASP sound separation system," in Proc. IEEE ICASSP, 1984, pp. 18A.6.1-18A.6.4.
10. G. J. Brown and M. Cooke, "Computational auditory scene analysis," Comput. Speech Lang., vol. 8, pp. 297-336, 1994.
11. D. L. Wang and G. J. Brown, "Separation of speech from interfering sounds based on oscillatory correlation," IEEE Trans. Neural Netw., vol. 10, no. 3, pp. 684-697, May 1999.
12. D. L. Wang, U. Kjems, M. S. Pedersen, J. B. Boldt, and T. Lunner, "Speech intelligibility in background noise with ideal binary timefre-quency masking," J. Acoust. Soc. Amer., vol. 125, pp. 2336-2347, 2009.
13. M. Cooke, P. Green, L. Josifovski, and A. Vizinho, "Robust automatic speech recognition with missing and unreliable acoustic data," Speech Commun., vol. 34, pp. 267-285, 2001.
14. B. Raj, M. L. Seltzer, and R. M. Stern, "Reconstruction of missing features for robust speech recognition," Speech Commun., vol. 43, pp. 275-296, 2004.
15. M. V. Segbroeck and H. V. Hamme, "Advances in missing feature techniques for robut large-vocabulary continuous speech recognition," IEEE Trans. Acoust., Speech, Signal Process., vol. 19, no. 1, pp. 123-137, Jan. 2011.
16. W. Hartmann and E. Fosler-Lussier, "Investigations into the incorporation of the ideal binary mask in ASR," in Proc. IEEE ICASSP, Prague, Czech Republic, May 2011, pp. 4804-4807.
17. M. Cooke, A. Morris, and P. Green, "Recognising occluded speech," in Proc. ESCA Workshop Auditory Basis of Speech Percept., 1996, pp. 297-300.
18. M. Cooke, P. Green, and M. Crawford, "Handling missing data in speech recognition," in Proc. ICSLP, 1994.
19. S. Ahmad and V. Tresp, "Some solutions to the missing feature problem in vision," in Advances in Neural Information Processing Systems 5 (NIPS'92), S. J. Hanson, J. D. Cowen, and C. L. Giles, Eds. San Mateo, CA, USA: Morgan Kaufmann, 1993.
20. R. Lippmann and B. A. Carlson, "Using missing feature theory to actively select features for robust speech recognition with interruptions, filtering, and noise," in Proc. Eurospeech'97, 1997, pp. 37-40.
21. S. B. Davis and P. Mermelstein, "Comparison of parametric representation for monosyllabic word recognition in continuously spoken sentences," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-28, no. 4, pp. 357-366, Aug. 1980.
22. S. Srinivasan, N. Roman, and D. L. Wang, "Binary and ratio time-frequency masks for robust speech recognition," Speech Commun., vol. 48, pp. 1486-1501, 2006.
23. S. Srinivasan and D. L. Wang, "Transforming binary uncertainties for robust speech recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 7, pp. 2130-2140, Sep. 2007.
24. P. Li, Y. Guan, S. Wang, B. Xu, and W. Liu, "Monaural speech separation based on MAXVQ and CASA for robust speech recognition," Comput. Speech Lang., vol. 24, no. 1, pp. 30-44, Jan. 2010.
25. J. Barker, L. Josifovski, M. Cooke, and P. Green, "Soft decisions in missing data techniques for robust automatic speech recognition," in Proc. Int. Conf. Spoken Lang., Beijing, China, 2000, pp. 373-376.
26. J. V. Hout and A. Alwan, "A novel approach to soft-mask estimation and log-spectral enhancement for robust speech recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2012, pp. 4105-4108.
27. W. Kim and J. H. L. Hansen, "Missing-feature reconstruction by leveraging temporal spectral correlation for robust speech recognition in background noise conditions," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 8, pp. 2111-2120, Nov. 2010.
28. R. G. Leonard, "A database for speaker-independent digit recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1984, pp. 111-114.
29. J. Gemmeke and B. Cranen, "Noise reduction through compressed sensing," in Proc. Interspeech, 2008.
30. Y. Wang and H. V. Hamme, "Multi-candidate missing data imputation for robust speech recognition," EURASIP J. Audio, Speech, Music Process., vol. 17, 2012, doi:10.1186/1687-4722-2012-17.
31. N. Parihar and J. Picone, "Analysis of the aurora large vocabulary extensions," in Proc. Eurospeech, Geneva, Switzerland, Sep. 2003, vol. 4, pp. 337-340.
32. J. Barker, M. Cooke, and D. P. W. Ellis, "Decoding speech in the presence of other sources," Speech Commun., vol. 45, pp. 5-25, 2005.
33. S. Srinivasan and D. L. Wang, "Robust speech recognition by integrating speech separation and hypothesis testing," Speech Commun., vol. 52, pp. 72-81, 2010.
34. D. L. Wang and G. Brown, Eds., Computational Auditory Scene Analysis: Principles, Algorithms, and Applications. New York, NY, USA: Wiley-IEEE Press, 2006.
35. J. Barker, M. Cooke, and D. P. Ellis, The RESPITE-CASA-Toolkit Project [Online]. Available: http://staffwww.dcs.shef.ac.uk/people/J. Barker/ctk.html 2002
36. S. Srinivasan, "Integrating computational auditory scene analysis and automatic speech recognition," Ph.D. dissertation, The Ohio State Univ., Columbus, OH, USA, 2006.
37. M. Weintraub, "A theory and computational model of computational auditory scene analysis," Ph.D. dissertation, Stanford Univ., Stanford, NY, USA, 1985.
38. S. Young, G. Evermann, T. Hain, D. Kershaw, G. Moore, J. Odell, D. Ollason, D. Povey, V. Valtchev, and P. Woodland, The HTK Book. Cambridge, U.K.: Cambridge Univ. Publishing Dept., 2002 [Online]. Available: http://htk.eng.cam. ac.uk
39. A. P. Varga, H. J. M. Steeneken, M. Tomlinson, and D. Jones, "The NOISEX-92 study on the effect of additive noise on automatic speech recognition," Speech Research Unit, Defense Research Agency, Malvern, UK, 1992, Tech. Rep..
40. D. Paul and J. Baker, "The design of wall street journal-based CSR corpus," in Proc. Int. Conf. Spoken Lang., Banff, AB, Canada, Oct. 1992, pp. 899-902.
41. R. C. Hendriks, R. Heusdens, and J. Jensen, "MMSE based noise PSD tracking with low complexity," in Proc. IEEE ICASSP, 2010, pp. 4266-4269.
42. J. S. Erkelens, R. C. Hendriks, R. Heusdens, and J. Jensen, "Minimum mean-square error estimation of discrete Fourier coefficients with generalized gamma priors," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 6, pp. 1741-1752, Aug. 2007.
43. D. P. Ellis, J. A. Bilmes, E. Fosler-Lussier, H. Hermansky, D. Johnson, B. Kingsbury, and N. Morgan, "The SPRACHcore Software Package," [Online]. Available: http://www.icsi.berkeley.edu/~dpwe/projects/sprach/ sprachcore.html 2010
44. C.-P. Chen and J. A. Bilmes, "MVA processing of speech features," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 1, pp. 257-270, Jan. 2007.