Model-based feature enhancement for reverberant speech recognition

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 7, 2010, Pages 1692-1707

  Krueger, Alexander ^a   Haeb Umbach, Reinhold ^a  

^a UNIVERSITY OF PADERBORN   (Germany)

Author keywords

Automatic speech recognition (ASR); feature enhancement; reverberant speech recognition

Indexed keywords

AUTOMATIC SPEECH RECOGNITION; BAYESIAN INFERENCE; ENHANCEMENT TECHNIQUES; FEATURE ENHANCEMENT; FEATURE VECTORS; INTERMEDIATE STAGE; LINEAR DYNAMICAL MODELS; MEL-FREQUENCY CEPSTRAL COEFFICIENTS; MICROPHONE SIGNALS; MINIMUM MEAN SQUARE ERROR ESTIMATE; MODEL-BASED; OBSERVATION MODEL; POWER SPECTRAL; PRIORI MODEL; REAL-TIME APPLICATION; REVERBERANT ENVIRONMENT; REVERBERANT SPEECH RECOGNITION; REVERBERATION TIME; ROOM IMPULSE RESPONSE; SIMPLIFIED MODELS; TWO PARAMETER;

ARCHITECTURAL ACOUSTICS; BAYESIAN NETWORKS; COMPUTATIONAL COMPLEXITY; IMPULSE RESPONSE; INFERENCE ENGINES; MAXIMUM LIKELIHOOD; REVERBERATION; SPECTROSCOPY; STOCHASTIC MODELS;

SPEECH RECOGNITION;

EID: 77955673019     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2010.2049684     Document Type: Article

References (46)

1. E. Habets, "Single- and multi-microphone speech dereverberation using spectral enhancement," Ph.D. dissertation, Technische Univ. Eindhoven, Eindhoven, The Netherlands, Jun. 25, 2007.
2. M. Gürelli and C. Nikias, "Evam: An eigenvector-based algorithm for multichannel blind deconvolution of input colored signals," IEEE Trans. Signal Process., vol.43, no.1, pp. 134-149, Jan. 1995.
3. M. Delcroix, T. Hikichi, and M. Miyoshi, "On the use of lime dereverberation algorithm in an acoustic environment with a noise source," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'06), May 2006, vol.1, pp. I-I.
4. S. Gannot and M. Moonen, "Subspace methods for multimicrophone speech dereverberation," EURASIP J. Appl. Signal Process., vol.11, pp. 1074-1090, 2003.
5. M. Wu and D. Wang, "A two-stage algorithm for one-microphone reverberant speech enhancement," IEEE Trans. Audio, Speech, Lang. Process., vol.14, no.3, pp. 774-784, May 2006.
6. K. Lebart, J. Boucher, and P. Denbigh, "A new method based on spectral subtraction for speech dereverberation," Acta Acust. United with Acust., vol.87, no.8, pp. 359-366, 2001.
7. H. W. Löllmann and P. Vary, "Low delay noise reduction and dereverberation for hearing aids," EURASIP J. Adv. Signal Process., 2009.
8. K. Kinoshita, M. Delcroix, T. Nakatani, and M. Miyoshi, "Suppression of late reverberation effect on speech signal using long-term multiplestep linear prediction," IEEE Trans. Audio, Speech, Lang. Process., vol.17, no.4, pp. 534-545, May 2009.
9. T. Yoshioka, T. Nakatani, and M. Miyoshi, "Integrated speech enhancement method using noise suppression and dereverberation," IEEE Trans. Audio, Speech, Lang. Process., vol.17, no.2, pp. 231-246, Feb. 2009.
10. B. Yegnanarayana, S. Mahadeva Prasanna, and K. Sreenivasa Rao, "Speech enhancement using excitation source information," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'02), 2002, vol.1, pp. I-541-I-544, vol.1.
11. B. Yegnanarayana and P. Murthy, "Enhancement of reverberant speech using LP residual signal," IEEE Trans. Speech Audio Process., vol.8, no.3, pp. 267-281, May 2000.
12. M. Unoki, K. Sakata, M. Furukawa, and M. Akagi, "A speech dereverberation method based on the MTF concept in power envelope restoration," Acoust. Sci. Technol., vol.25, no.4, pp. 243-254, 2004.
13. T. Langhans and H. Strube, "Speech enhancement by nonlinear multiband envelope filtering," in Proc. IEEE Int. Conf. . Acoust., Speech, Signal Process., May 1982, vol.7, pp. 156-159.
14. S. Subramaniam, A. Petropulu, and C. Wendt, "Cepstrum-based deconvolution for speech dereverberation," IEEE Trans. Speech Audio Process., vol.4, no.5, pp. 392-396, Sep. 1996.
15. R. Kennedy and B. Radlovic, "Iterative cepstrum-based approach for speech dereverberation," in Proc. 5th Int. Symp. Signal Process. and Its Applicat. ISSPA'99, 1999, vol.1, pp. 55-58, vol.1.
16. L. Couvreur and C. Couvreur, "Blind model selection for automatic speech recognition in reverberant environments," J. VLSI Signal Process. Syst., vol. 36, no. 2/3, pp. 189-203, 2004.
17. H.-G. Hirsch and H. Finster, "A new approach for the adaptation of HMMs to reverberation and background noise," Speech Commun., vol.50, no.3, pp. 244-263, 2008.
18. M. Delcroix, T. Nakatani, and S. Watanabe, "Static and dynamic variance compensation for recognition of reverberant speech with dereverberation preprocessing," IEEE Trans. Audio, Speech, Lang. Process., vol.17, no.2, pp. 324-334, Feb. 2009.
19. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," Comput. Speech Lang., vol.9, no.2, pp. 171-185, 1995.
20. M. J. F. Gales and P. C. Woodland, "Mean and variance adaptation within the MLLR framework," Comput. Speech Lang., vol.10, no.4, pp. 249-264, 1996.
21. M. J. F. Gales, "Maximum likelihood linear transformations for HMMbased speech recognition," Comput. Speech Lang., vol.12, no.2, pp. 75-98, 1998.
22. C. K. Raut, T. Nishimoto, and S. Sagayama, "Model adaptation by state splitting of HMM for long reverberation," in Proc. Interspeech, Sep. 2005.
23. A. Sehr and W. Kellerman, "A new concept for feature-domain dereverberation for robust distant-talking asr," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. ICASSP'07, 2007, vol.4, pp. IV-369-IV-372.
24. H. Hermansky and N. Morgan, "RASTA processing of speech," IEEE Trans. Speech Audio Process., vol.2, no.4, pp. 578-589, Oct. 1994.
25. B. E. D. Kingsbury and N. Morgan, "Recognizing reverberant speech with rasta-plp," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. ICASSP'97, Apr. 21-24, 1997, vol.2, pp. 1259-1262.
26. A. E. Rosenberg, C.-H. Lee, and F. K. Soong, "Cepstral channel normalization techniques for HMM-based speaker verification," in ICSLP'94, 1994, pp. 1835-1838.
27. Y. Avargel and I. Cohen, "On multiplicative transfer function approximation in the short-time Fourier transform domain," IEEE Signal Process. Lett., vol.14, no.5, pp. 337-340, May 2007. (Pubitemid 46614474)
28. A. Krueger and R. Haeb-Umbach, "Model based feature enhancement for automatic speech recognition in reverberant environments," in Proc. Interspeech'09, 2009, pp. 1231-1234.
29. M. Wölfel, "Enhanced speech features by single-channel joint compensation of noise and reverberation," IEEE Trans. Audio, Speech, Lang. Process., vol.17, no.2, pp. 312-323, Feb. 2009.
30. ETSI Standard Document, 2000. Speech Processing, Transmission and Quality Aspects (STQ); Distributed Speech Recognition; Front-End Feature Extraction Algorithm; Compression Algorithms, ETSI ES 201 108 v1.1.2, (2000-04).
31. A. Sehr and W. Kellermann, "Towards robust distant-talking automatic speech recognition in reverberant environments," in Speech and Audio Processing in Adverse Environments. Berlin, Heidelberg, Germany: Springer, 2008.
32. S. Qian and D. Chen, "Discrete Gabor transform," IEEE Trans. Signal Process., vol.41, no.7, pp. 2429-2438, Jul. 1993.
33. S. Farkash and S. Raz, "Linear systems in Gabor time-frequency space," IEEE Trans. Signal Process., vol.42, no.3, pp. 611-617, Mar. 1994.
34. Y. Avargel and I. Cohen, "System identification in the short-time Fourier transform domain with crossband filtering," IEEE Trans. Audio, Speech, Lang. Process., vol.15, no.4, pp. 1305-1319, May 2007.
35. H. Kuttruff, Room Acoustics, 4th ed. London, U.K.: Spon, 2000.
36. R. Ratnam, D. L. Jones, B. C. Wheeler,W. D. O'Brien, C. R. Lansing, and A. S. Feng, "Blind estimation of reverberation time," J. Acoust. Soc. Amer., vol.114, no.5, pp. 2877-2892, Nov. 2003.
37. K. Murphy, "Switching Kalman Filters," U.C. Berkeley, Berkeley, CA, 1998, Tech. Rep..
38. J. Droppo and A. Acero, "Noise robust speech recognition with a switching linear dynamic model," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'04), 2004, vol.1, pp. I-953-I-956, vol.1.
39. Y. Bar-Shalom, X. R. Li, and T. Kirubarajan, Estimation with Applications to Tracking and Navigation: Theory, Algorithms, and Software. New York: Wiley, 2001.
40. V. Ion and R. Haeb-Umbach, "A novel uncertainty decoding rule with applications to transmission error robust speech recognition," IEEE Trans. Audio Speech Lang. Process., vol.16, no.5, pp. 1047-1060, 2008.
41. V. Ion and R. Haeb-Umbach, "Uncertainty decoding for distributed speech recognition over error-prone networks," Speech Commun., vol.48, no.11, pp. 1435-1446, 2006.
42. H. Hirsch, "Aurora-5 experimental framework for the performance evaluation of speech recognition in case of a hands-free speech input in noisy environments," Niederrhein Univ. of Applied Sciences, 2007, Tech. Rep..
43. S. J. Young, G. Evermann, M. J. F. Gales, T. Hain, D. Kershaw, G. Moore, J. Odell, D. Ollason, D. Povey, V. Valtchev, and P. C. Woodland, The HTK Book, Version 3.4.. Cambridge, U.K.: Cambridge Univ. Eng. Dept., 2006.
44. H. G. Hirsch and H. Finster, "The simulation of realistic acoustic input scenarios for speech recognition systems," in Proc. Interspeech'05, 2005, pp. 2697-2700.
45. J. B. Allen, "Image method for efficiently simulating small-room acoustics," J. Acoust. Soc. Amer., vol.65, no.4, pp. 943-950, 1979.
46. H.-G. Hirsch, "Automatic speech recognition in adverse acoustic conditions," in Advances in Digital Speech Transmission, R. Martin, U. Heute, and C. Antweiler, Eds. New York:Wiley , 2007, pp. 461-496.