Far-field speech recognition using CNN-DNN-HMM with convolution in time

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2015-August, Issue , 2015, Pages 4360-4364

  Yoshioka, Takuya ^a   Karita, Shigeki ^a,b   Nakatani, Tomohiro ^a  

^a NTT Communication Science Laboratories   (Japan)

^b OSAKA UNIVERSITY   (Japan)

Author keywords

convolutional neural network; deep neural network; Far field speech recognition; reverberation

Indexed keywords

AUDIO SIGNAL PROCESSING; CONVOLUTION; DEEP NEURAL NETWORKS; NEURAL NETWORKS; REVERBERATION; SPEECH; SPEECH COMMUNICATION;

CONVOLUTIONAL NEURAL NETWORK; DEREVERBERATION; FAR FIELD; LONG-TERM CORRELATIONS; MODELLING CAPABILITIES; SHORT-TIME CORRELATIONS; SPECTRAL ENERGY; TEST ENVIRONMENT;

SPEECH RECOGNITION;

EID: 84946020145     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2015.7178794     Document Type: Conference Paper

References (30)

1. N. Morgan and H. Bourlard, Continuous speech recognition: an introduction to the hybrid HMM/connectionist approach, IEEE Signal Process. Mag., vol. 12, no. 3, pp. 24-42, 1995
2. G. E. Dahl, D. Yu, L. Deng, and A. Acero, Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition, IEEE Trans. Audio, Speech, Language Process., vol. 20, no. 1, pp. 30-42, 2012
3. G. Hinton, L. Deng, D. Yu, G. Dahl, A.-r. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kinsgbury, Deep neural networks for acoustic modeling in speech recognition, IEEE Signal Process. Mag., vol. 29, no. 6, pp. 82-97, 2012
4. T. Yoshioka and M. J. F. Gales, Environmentally robust ASR front-end for deep neural network acoustic models, Comp. Speech, Language, vol. 31, no. 1, pp. 65-86, 2015
5. S. Renals and P. Swietojanski, Neural networks for distant speech recognition, in Proc. Joint Workshop Hands-free Speech Commun. Microphone Arrays, 2014, pp. 172-176
6. M. Delcroix, T. Yoshioka, A. Ogawa, Y. Kubo, M. Fujimoto, I. Nobutaka, K. Kinoshita, M. Espi, T. Hori, T. Nakatani, and A. Nakamura, Linear prediction-based dereverberation with advanced speech enhancement and recognition technologies for the REVERB challenge, in Proc. REVERB Worksh., 2014
7. T. Yoshioka, A. Sehr, M. Delcroix, K. Kinoshita, R. Maas, T. Nakatani, and W. Kellermann, Making machines understand us in reverberant rooms: robustness against reverberation for automatic speech recognition, IEEE Signal Process. Mag., vol. 29, no. 6, pp. 114-126, 2012
8. T. Yoshioka and T. Nakatani, Generalization of multi-channel linear prediction methods for blind MIMO impulse response shortening, IEEE Trans. Audio, Speech, Language Process., vol. 20, no. 10, pp. 2707-2720, 2012
9. A. Krueger and R. Haeb-Umbach, Model-based feature enhancement for reverberant speech recognition, IEEE Trans. Audio, Speech, Language Process., vol. 18, no. 7, pp. 1692-1707, 2010
10. M. J. F. Gales and Y.-Q. Wang, Model-based approaches to handling additive noise in reverberant environments, in Proc. Joint Workshop Hands-free Speech Commun. Microphone Arrays, 2011, pp. 121-126
11. A. Sehr, R. Maas, and W. Kellermann, Reverberation modelbased decoding in the logmelspec domain for robust distanttalking speech recognition, IEEE Trans. Audio, Speech, Language Process., vol. 18, no. 7, pp. 1676-1691, 2010
12. Y.-Q. Wang and M. J. F. Gales, Improving reverberant VTS for hands-free robust speech recognition, in Proc. Workshop. Automat. Speech Recognition, Understanding, 2011, pp. 113-118
13. T. Yoshioka, X. Chen, and M. J. F. Gales, Impact of singlemicrophone dereverberation on DNN-based meeting transcription systems, in Proc. Int. Conf. Acoust., Speech, Signal Process., 2014, pp. 5527-5531
14. K. Lebart, J. M. Boucher, and P. N. Denbigh, A new method based on spectral subtraction for speech dereverberation, Acta Acustica United with Acustica, vol. 87, pp. 359-366, 2001
15. E. A. P. Habets, Single-and multi-microphone speech dereverberation using spectral enhancement, Ph.D. thesis, Eindhoven University of Technology, 2006
16. K. Kumar and R. Stern, Maximum-likelihood-based cepstral inverse filtering for blind speech dereverberation, in Proc. Int. Conf. Acoust., Speech, Signal Process., 2010, pp. 4282-4285
17. K. M. Knill, M. J. F. Gales, S. P. Rath, P. C. Woodland, C. Zhang, and S.-X Zhang, Investigation of multilingual deep neural networks for spoken term detection, in Proc. Workshop. Automat. Speech Recognition, Understanding, 2013, pp. 138-143
18. L. Tóth, Combining time-and frequency-domain convolution in convolutional neural network-based phone recognition, in Proc. Int. Conf. Acoust., Speech, Signal Process., 2014, pp. 190-194
19. O. Abdel-Hamid, L. Deng, and D. Yu, Exploring convolutional neural network structures and optimization techniques for speech recognition, in Proc. Interspeech, 2013, pp. 3366-3370
20. T. N. Sainath, B. Kingsbury, A.-r. Mohamed, G. E. Dahl, G. Saon, H. Soltau, T. Beran, A. Y. Aravkin, and B. Ramabhadran, Improvements to deep convolutional neural networks for LVCSR, in Proc.Workshop. Automat. Speech Recognition, Understanding, 2013, pp. 315-320
21. P. Swietojanski, A. Ghoshal, and S. Renals, Convolutional neural networks for distant speech recognition, IEEE Signal Process. Letters, vol. 21, no. 9, pp. 1120-1124, 2014
22. X. Xiao, Z. Shengkui, D. H. H. Nguyen, Z. Xionghu, D. Jones, E.-S. Chng, and H. Li, The NTU-ADSC systems for reverberation challenge 2014, in Proc. REVERB Worksh., 2014
23. F. J. Weninger, S. Watanabe, J. Le Roux, J. Hershey, Y. Tachioka, J. T. Geiger, B. W. Schuller, and G. Rigoll, The MERL/MELCO/TUM system for the REVERB challenge using deep recurrent neural network feature enhancement, in Proc. REVERB Worksh., 2014
24. V. Mitra, W. Wang, Y. Lei, A. Kathol, G. Sivaraman, and C. Espy-Wilson, Robust features and system fusion for reverberation-robust speech recognition, in Proc. REVERB Worksh., 2014
25. A. Narayanan and D. Wang, Joint noise adaptive training for robust automatic speech recognition, in Proc. Int. Conf. Acoust., Speech, Signal Process., 2014, pp. 2523-2527
26. F.Weninger, S.Watanabe, Y. Tachioka, and B. Schuller, Deep recurrent de-noising auto-encoder and blind de-reverberation for reverberated speech recognition, in Proc. Int. Conf. Acoust., Speech, Signal Process., 2014, pp. 4656-4660
27. O. Abdel-Hamid, A.-r. Mohamed, H. Jiang, L. Deng, G. Penn, and D. Yu, Convolutional neural networks for speech recognition, IEEE/ACM Trans. Audio, Speech, Language Process., vol. 22, no. 10, pp. 1533-1545, 2014
28. K. Kinoshita, T. Yoshioka, T. Nakatani, A. Sehr, W. Kellermann, and R. Maas, The REVERB challenge: a common evaluation framework for dereverberation and recognition of reverberant speech, in Proc. IEEE Worksh. Appl. Signal Process. Audio, Acoust., 2013
29. The REVERB challenge-evaluating de-reverberation and ASR techniques in reverberant environments, http://reverb2014.dereverberation.com
30. F. Seide, G. Li, X. Chen, and D. Yu, Feature engineering in context-dependent deep neural networks for conversational speech transcription, in Proc. Workshop. Automat. Speech Recognition, Understanding, 2011, pp. 24-29