Sub-band temporal modulation envelopes and their normalization for automatic speech recognition in reverberant environments

Computer Speech and Language

Volumn 25, Issue 3, 2011, Pages 571-584

  Lu, Xugang ^a   Unoki, Masashi ^b   Nakamura, Satoshi ^a  

^a NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

^b JAPAN ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

Automatic speech recognition; Speech reverberation; Sub band temporal modulation envelope; Temporal modulation

Indexed keywords

AUTOMATIC SPEECH RECOGNITION; BAND PASS; CONSTANT BANDWIDTH; EXTRACTION METHOD; HILBERT TRANSFORM; INVERSE FOURIER TRANSFORMS; LOW-PASS FILTERING; MEAN AND VARIANCE NORMALIZATIONS; MEL-FREQUENCY CEPSTRAL COEFFICIENTS; MODULATION SPECTRUM; MODULATION TRANSFER; MODULATION TRANSFER FUNCTION; NORMALIZATION METHODS; PHASE INFORMATION; RECOGNITION PERFORMANCE; RECORDING ENVIRONMENT; REVERBERANT ENVIRONMENT; REVERBERANT ROOM; SUB-BAND TEMPORAL MODULATION ENVELOPE; SUB-BANDS; TEMPORAL FILTERING; TEMPORAL MODULATION; TEMPORAL MODULATIONS;

BANDPASS FILTERS; FOURIER TRANSFORMS; LOW PASS FILTERS; MODULATION; REVERBERATION;

SPEECH RECOGNITION;

EID: 79952625580     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2010.10.002     Document Type: Article

References (39)

1. J.B. Allen, D.A. Berkley, and J. Blauert Multi-microphone signal-processing technique to remove room reverberation from speech signals Journal of the Acoustical Society of America 62 4 1977 912 915 (Pubitemid 8199278)
2. http://sp.shinshu-u.ac.jp/CENSREC/. AURORA-2J database.
3. C. Avendano, and H. Hermansky On the properties of temporal processing for speech in adverse environments Workshop on Applications of Signal Processing to Audio and Acoustics 1997 Mohonk Mountain House New Paltz, New York
4. S.F. Boll Suppression of acoustic noise in speech using spectral subtraction IEEE Transactions on Acoustics, Speech, and Signal Processing ASSP-27 1979 113 120
5. M.S. Brandstein, D.B. Ward, Microphone Arrays: Signal Processing Techniques and Applications 1st ed. 2000 Springer-Verlag Berlin
6. C.P. Chen, and J. Bilmes MVA processing of speech features IEEE Transactions on Audio, Speech, and Language Processing 15 1 2007 257 270
7. R. Drullman, J.M. Festen, and R. Plomp Effects of reducing slow temporal modulations on speech reception Journal of the Acoustical Society of America 95 5 1994 2670 2680 (Pubitemid 24152861)
8. Y. Ephraim, and D. Malah Speech enhancement using a minimum mean square error log-spectral amplitude estimator IEEE Transactions on Acoustics, Speech and Signal Processing 33 2 1985 443 445
9. S. Furui, and M.M. Sondhi Advances in Speech Signal Processing 1991 Marcel Dekker, Inc. New York
10. H. Hermansky, and N. Morgan RASTA processing of speech IEEE Transactions on Audio, Speech, and Language Processing 2 4 1994 578 589
11. H. Hermansky, N. Morgan, and H.G. Hirsch Recognition of speech in additive and convolutional noise based on RASTA spectral processing Proc. ICASSP'93 1993 83 86
12. S. Hirobayashi, H. Nomura, T. Koike, and M. Tohyama Speech waveform recovery from a reverberant speech signal using inverse filtering of the power envelope transfer function. IEICE Transactions A J81-A 10 1998 1323 1330
13. S. Hirobayashi, and T. Yamabuchi Validation of blind dereverberation using power envelope inverse filtering and filter banks IEICE Transactions A J83-A 8 2000 1029 1033
14. T. Houtgast, and H.J.M. Steeneken The modulation transfer function in room acoustics as a predictor of speech intelligibility Acustica 28 1973 66 73
15. T. Houtgast, and H.J.M. Steeneken A review of the MTF concept in room acoustics and its use for estimating speech intellgibility in auditoria Journal of the Acoustical Society of America 77 3 1985 1069 1077
16. N. Kanedera, T. Arai, H. Hermansky, and M. Pavel On the relative importance of various components of the modulation spectrum for automatic speech recognition Speech Communication 28 1 1999 43 55
17. K. Kinoshita, T. Nakatani, and M. Miyoshi Spectral subtraction steered by multi-step forward linear prediction for single channel speech dereverberation Proc. ICASSP'06, I 2006 817 820
18. Liu, F.; Stern, R.; Huang, X.; Acero, A.; 1993. Efficient cepstral normalization for robust speech recognition. In: Proceedings of ARPA Human Language Technology Workshop.
19. X. Lu, M. Unoki, and M. Akagi A robust feature extraction based on the MTF concept for speech recognition in reverberant environment Proc. ICSLP'06 2006 2546 2549
20. X. Lu, M. Unoki, and M. Akagi Comparative evaluation of modulation-transfer-function-based blind restoration of sub-band power envelopes of speech as a front-end processor for automatic speech recognition systems Acoustical Science and Technology 29 6 2008 351 361
21. J.G. Lyons, and K.K. Paliwal Effect of compressing the dynamic range of the power spectrum in modulation filtering based speech enhancement Proc. INTERSPEECH'08 2008 387 390
22. M. Miyoshi, and Y. Kaneda Inverse filtering of room acoustics IEEE Transactions on Acoustics, Speech, and Signal Processing ASSP-36 1988 145 152
23. S. Nakagawa A survey on automatic speech recognition IEICE Transactions D-II J83-D-II 2 2000 433 457
24. T. Nakatani, K. Kinoshita, and M. Miyoshi Harmonicity-based blind dereverberation for single-channel speech signals IEEE Transactions on Audio, Speech, and Language Processing 15 1 2007 80 95
25. T. Nakatani, and M. Miyoshi Blind dereverberation of single channel speech signal based on harmonic structure Proc. ICASSP'03, 1 2003 92 95
26. Nakatani, T.; Miyoshi, M.; Kinoshita, K.; 2005. Blind dereverberation of monaural speech signals based on harmonic structure. IEICE D-II, J88-D-II (3), 509-520.
27. Neumann, J.; Gasas, J.R.; Macho, D.; Hidalgo, J.R.; 2007. Integration of audio-visual sensors and technologies in a smart room. Personal and Ubiquitous Computing. Springer London, ISSN: 1617-4909 (print).
28. M.R. Schroeder Modulation transfer function: definition and measurement Acustica 49 1981 179 182 (Pubitemid 12508801)
29. B.J. Shannon, and K.K. Paliwal A comparative study of filter bank spacing for speech recognition Microelectronic Engineering Research Conference 2003 1 3
30. R.V. Shannon, F. Zeng, V. Kamath, J. Wygonski, and M. Ekelid Speech recognition with primarily temporal cues Science 270 1995 303 304
31. T. Takiguchi, S. Nakamura, and K. Shikano Hands-free speech recognition by HMM composition in noisy reverberant environments IEICE Transactions D-II J79-D-II 12 1996 2047 2053
32. The HTK Book (version 3.2), 2002. Cambridge University Engineering Department.
33. M. Unoki, M. Furukawa, K. Sakata, and M. Akagi An improved method based on the MTF concept for restoring the power envelope from a reverberant signal Acoustical Science and Technology 25 4 2004 232 242
34. M. Unoki, T. Hosorogiya, and Y. Ishimoto Comparative evaluations of robust and accurate F0 estimates in reverberant environments Proc. ICASSP'08 2008 4569 4572
35. M. Unoki, K. Sakata, M. Furukawa, and M. Akagi A speech dereverberation method based on the MTF concept in power envelope restoration Acoustical Science and Technology 25 4 2004 243 254
36. S.V. Vaseghi Advanced Digital Signal Processing and Noise Reduction 2nd ed. 2000 John Wiley & Sons, Ltd.
37. P.J. Wolfe, and S.J. Godsill Efficient alternatives to the Ephraim and Malah suppression rule for audio signal enhancement EURASIP Journal on Applied Signal Processing 10 2003 1043 1051
38. X. Xiao, E.S. Chng, and H. Li Temporal structure normalization of speech feature for robust speech recognition IEEE Signal Processing Letters 14 7 2007 500 503 (Pubitemid 47018924)
39. X. Xiao, E.S. Chng, and H. Li Normalization of speech modulation spectra for robust speech recognition IEEE Transactions on Audio, Speech, and Language Processing 16 8 2008 1662 1674