A novel mask estimation method employing posterior-based representative mean estimate for missing-feature speech recognition

IEEE Transactions on Audio, Speech and Language Processing

Volumn 19, Issue 5, 2011, Pages 1434-1443

  Kim, Wooil ^a   Hansen, John H L ^a  

^a The University of Texas at Dallas   (United States)

Author keywords

Background noise; mask estimation; missing feature; posterior based representative mean (PRM) estimate; robust speech recognition

Indexed keywords

BACKGROUND NOISE; COMPONENT CLASSIFIERS; ESTIMATION METHODS; FEATURE COMPENSATION; IN-VEHICLE; MISSING-FEATURE; MODEL COMBINATION; NOISE CONDITIONS; NOISE SIGNALS; PERFORMANCE EVALUATION; POSTERIOR PROBABILITY; POSTERIOR-BASED REPRESENTATIVE MEAN (PRM) ESTIMATE; RECOGNITION PERFORMANCE; ROBUST SPEECH RECOGNITION; SPECTRAL COMPONENTS; SPECTRAL SUBTRACTIONS; SPEECH MODELS; SPEECH RECOGNITION PERFORMANCE; SPEECH UTTERANCE; WEIGHTED SUM; WORD ERROR RATE;

ESTIMATION; FEATURE EXTRACTION;

SPEECH RECOGNITION;

EID: 79956289561     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2010.2091633     Document Type: Article

References (43)

1. W. Kim and J. H. L. Hansen, "Mask estimation employing posterior- based representative mean for missing-feature speech recognition with time-varying background noise," in Proc. IEEE ASRU'09, Merano, Italy, Dec. 2009, pp. 194-198.
2. W. Kim and J. H. L. Hansen, "Feature compensation in the cepstral domain employing model combination," Speech Commun., vol. 51, no. 2, pp. 83-96, 2009.
3. A. P. Varga, H. J. M. Steeneken, M. Tomlinson, and D. Jones, "The NOISEX-92 study on the effect of additive noise on automatic speech recognition," in Tech. Rep., Speech Res. Unit, Defense Res. Agency, Malvern, U.K., 1992, (Available from NOISEX-92 CD-ROMS).
4. H. Heuvel, J. Boudy, R. Comeyne, S. Euler,A.Moreno, and G. Richard, "The Speechdat-Car multilingual speech databases for in-car applications: Some first validation results," in Proc. Eurospeech'99, Sep. 1999.
5. T. Crystal, A. Schmidt-Nelson, and E. Marsh, "Speech in noisy environments (SPINE) adds news dimension to speech recognition R&D," in Proc. HLT Conf., San Diego, CA, Mar. 2002.
6. P. Angkititrakul, M. Petracca, A. Sathyanarayana, and J. H. L. Hansen, "UTDrive: Driver behavior and speech interactive systems for in-vehicle environments," in Proc. IEEE Intell. Veh. Conf., 2007, pp. 566-569.
7. J. H. L. Hansen, X. Zhang, M. Akbacak, U. Yapanel, B. Pellom, W. Ward, and P. Angkititrakul, "CU-move: Advances for in-vehicle speech systems for route navigation," in DSP for In-Vehicle and Mobile Systems, Abut, J. H. L. Hansen, and Takeda, Eds. New York: Springer., 2004, ch. 2.
8. J. H. L. Hansen, R. Huang, B. Zhou, M. Seadle, J. R. Deller Jr., A. R. Gurijala, M. Kurimo, and P. Angkititrakul, "Speechfind: Advances in spoken document retrieval for a National Gallery of the SpokenWord," IEEE Trans. Speech Audio Process., vol. 13, no. 5, pp. 712-730, Sep. 2005.
9. W. Kim and J. H. L. Hansen, "Speechfind for CDP: Advances in spoken document retrieval for the U.S. collaborative digitization program," in Proc. IEEE ASRU2007, 2007, pp. 687-692.
10. J. H. L. Hansen, "Analysis and compensation of speech under stress and noise for environmental robustness in speech recognition," Speech Commun., vol. 20, no. 2, pp. 151-170, 1996.
11. S. F. Boll, "Suppression of acoustic noise in speech using spectral subtraction," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-27, no. 2, pp. 113-120, Apr. 1979.
12. Y. Ephraim and D. Malah, "Speech enhancement using minimum mean square error short time spectral amplitude estimator," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-32, no. 6, pp. 1109-1121, Dec. 1984.
13. J. H. L. Hansen and M. Clements, "Constrained iterative speech enhancement with application to speech recognition," IEEE Trans. Signal Process., vol. 39, no. 4, pp. 795-805, Apr. 1991.
14. J. H. L. Hansen, "Morphological constrained enhancement with adaptive cepstral compensation (MCE-ACC) for speech recognition in noise and Lombard effect," IEEE Trans. Speech Audio Process., vol. 2, no. 4, pp. 598-614, Oct. 1994.
15. P. J. Moreno, B. Raj, and R. M. Stern, "Data-driven environmental compensation for speech recognition: A unified approach," Speech Commun., vol. 24, no. 4, pp. 267-285, 1998. (Pubitemid 128424259)
16. N. S. Kim, "Feature domain compensation of nonstationary noise for robust speech recognition," Speech Commun., vol. 37, pp. 231-248, 2002. (Pubitemid 34524841)
17. V. Stouten, H.Van hamme, and P.Wambacq, "Joint removal of additive and convolutional noise with model-based feature enhancement," in Proc. ICASSP'04, 2004, pp. 949-952.
18. A. Sasou, T. Tanaka, S. Nakamura, and F. Asano, "HMM-based feature compensation methods: An evaluation using the Aurora2," in Proc. ICSLP'04, 2004, pp. 121-124.
19. J. L. Gauvain and C. H. Lee, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains," IEEE Trans. Speech Audio Process., vol. 2, no. 2, pp. 291-298, Apr. 1994.
20. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density HMMs," Comput. Speech Lang., vol. 9, pp. 171-185, 1995.
21. M. J. F. Gales and S. J. Young, "Robust continuous speech recognition using parallel model combination," IEEE Trans. Speech Audio Process., vol. 4, no. 5, pp. 352-359, Sep. 1996. (Pubitemid 126753023)
22. J. Barker,M. Cooke, and P. Green, "Robust ASR based on clean speech models: An evaluation of missing data techniques for connected digit recognition in noise," in Proc. Eurospeech'01, 2001, pp. 213-216.
23. M. Cook, P. Green, L. Josifovski, and A. Vizinho, "Robust automatic speech recognition with missing and unreliable acoustic data," Speech Commun., vol. 34, no. 3, pp. 267-285, 2001. (Pubitemid 32284867)
24. K. J. Palomaki, G. J. Brown, and J. P. Barker, "Techniques for handling convolutional distortion with missing data automatic speech recognition," Speech Commun., vol. 43, pp. 123-142, 2004.
25. B. Raj, M. L. Seltzer, and R. M. Stern, "Reconstruction of missing features for robust speech recognition," Speech Commun., vol. 43, no. 4, pp. 275-296, 2004.
26. H. Van Hamme, "Robust speech recognition using cepstral domain missing data techniques and noisy masks," in Proc. ICASSP'04, May 2004, pp. 213-216.
27. B. Raj and R. M. Stern, "Missing-feature approaches in speech recognition," IEEE Signal Process. Mag., vol. 22, no. 5, pp. 101-116, Sep. 2005. (Pubitemid 41488524)
28. W. Kim and J. H. L. Hansen, "Missing-feature reconstruction for bandlimited speech recognition in spoken document retrieval," in Proc. Interspeech' 06, Sep. 2006, pp. 2306-2309.
29. W. Kim and J. H. L. Hansen, "Time-frequency correlation based missing-feature reconstruction for robust speech recognition in band-restricted conditions," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 7, pp. 1292-1304, Sep. 2009.
30. A. Vizinho, P. Green, M. M. Cooke, and L. Josifovski, "Missing data theory, spectral subtraction and signal-to-Noise estimation for robust ASR: An integrated study," in Proc. Eurospeech'99, Sep. 1999, pp. 2407-2410.
31. M. L. Seltzer, B. Raj, and R. M. Stern, "A Bayesian classifier for spectrographic mask estimation for missing-feature speech recognition," Speech Commun., vol. 43, no. 4, pp. 379-393, 2004.
32. W. Kim, R. M. Stern, and H. Ko, "Environment-independent mask estimation for missing-feature reconstruction," in Proc. Interspeech'05, Sep. 2005, pp. 2637-2640. (Pubitemid 43908637)
33. W. Kim and R. M. Stern, "Band-independent mask estimation for missing-feature reconstruction in the presence of unknown background noise," in Proc. ICASSP'06, May 2006, pp. 305-308.
34. P. Jancovic, M.Kokuer, and F. Murtagh, "High-likelihood model based on reliability statistics for robust combination of features: Application to noisy speech recognition," in Proc. Eurospeech'03, 2003, pp. 2161-2164.
35. S. Harding, J. Barker, and G. J. Brown, "Mask estimation based on sound localisation for missing data speech recognition," in Proc. ICASSP'05, 2005, pp. 537-540.
36. S. Srinivasan, N. Roman, and D. Wang, "Binary and ratio time-frequency masks for robust speech recognition," Speech Commun., vol. 48, no. 11, pp. 1486-1501, 2006. (Pubitemid 44634774)
37. H. Park and R. M. Stern, "Spatial separation of speech signals using amplitude estimation based on interaural comparisons of zero crossings," Speech Commun., vol. 51, no. 1, pp. 15-25, 2009.
38. H. G. Hirsch and D. Pearce, "The AURORA experimental framework for the performance evaluations of speech recognition systems under noisy conditions," in Proc. ISCA ITRW ASR2000, 2000.
39. ETSI Standard Document, ETSI ES 201 108 v1.1.2 (2000-04), 2000.
40. [Online]. Available: http://spib.rice.edu/spib/select-noise.html
41. R. Martin, "Spectral subtraction based on minimum statistics," in Proc. EUSIPCO-94, 1994, pp. 1182-1185.
42. ETSI Standard Document, ETSI ES 202 050 v1.1.1 (2002-10), 2002.
43. NIST SPeech Quality Assurance (SPQA) Package Version 2.3 [Online]. Available: http://www.nist.gov/speech