JHU ASpIRE system: Robust LVCSR with TDNNS, iVector adaptation and RNN-LMS

2015 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2015 - Proceedings

Volumn , Issue , 2016, Pages 539-546

  Peddinti, Vijayaditya ^a   Chen, Guoguo ^a   Manohar, Vimal ^a   Ko, Tom ^b   Povey, Daniel ^a   Khudanpur, Sanjeev ^a  

^a Whiting School of Engineering   (United States)

^b HUAWEI NOAH S ARK LAB   (China)

Author keywords

far field speech recognition; iVectors; recurrent neural network language models; time delay neural networks

Indexed keywords

COMPUTATIONAL LINGUISTICS; FEEDFORWARD NEURAL NETWORKS; NEURAL NETWORKS; PROGRAM PROCESSORS; RECURRENT NEURAL NETWORKS; REVERBERATION; SPEECH; TIME DELAY;

DISTRIBUTED OPTIMIZATION; ENVIRONMENT ADAPTATION; FAR FIELD; I-VECTORS; LONG-TERM INTERACTION; REVERBERANT ENVIRONMENT; STATE OF THE ART; TIME DELAY NEURAL NETWORKS;

SPEECH RECOGNITION;

EID: 84964483822     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2015.7404842     Document Type: Conference Paper

References (35)

1. T. Yoshioka, A. Sehr, M. Delcroix, K. Kinoshita, R. Maas, T. Nakatani, and W. Kellermann, "Making machines understand us in reverberant rooms: Robustness against reverberation for automatic speech recognition," Signal Processing Magazine, IEEE, vol. 29, no. 6, pp. 114-126, Nov 2012
2. A. Waibel, T. Hanazawa, G. Hinton, K. Shikano, and K. Lang, "Phoneme recognition using time-delay neural networks," IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 37, no. 3, pp. 328-339, Mar. 1989
3. V. Peddinti, D. Povey, and S. Khudanpur, "A time delay neural network architecture for efficient modeling of long temporal contexts," in Proceedings of INTERSPEECH, 2015
4. S. Xue, O. Abdel-Hamid, H. Jiang, L. Dai, and Q.-F. Liu, "Fast Adaptation of Deep Neural Network based on Discriminant Codes for Speech Recognition," IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. PP, no. 99, pp. 1-1, 2014
5. M. Karafiat, L. Burget, P. Matejka, O. Glembek, and J. Cernocky, "iVector-based discriminative adaptation for automatic speech recognition," in 2011 IEEE Workshop on Automatic Speech Recognition &Understanding. IEEE, Dec. 2011, pp. 152-157
6. G. Saon, H. Soltau, D. Nahamoo, and M. Picheny, "Speaker adaptation of neural network acoustic models using i-vectors," in Automatic Speech Recognition and Understanding (ASRU), 2013 IEEE Workshop on, Dec 2013, pp. 55-59
7. M. J. Alam, V. Gupta, P. Kenny, and P. Dumouchel, "Use of multiple front-ends and i-vector-based speaker adaptation for robust speech recognition," Proc. of IEEE REVERB Workshop, 2014
8. Automatic Speech recognition In Reverberant Environments (ASpIRE) Challenge, 2015 (accessed March 23 , 2015), http://www:iarpa:gov/index:php/working-with-iarpa/ prize-challenges/306-automatic-speech-in-reverberantenvironments-aspire-challenge
9. C. Cieri, D. Miller, and K. Walker, "The fisher corpus a resource for the next generations of speech-to-text." in LREC, vol. 4, 2004, pp. 69-71
10. D. Povey, X. Zhang, and S. Khudanpur, "Parallel training of Deep Neural Networks with Natural Gradient and Parameter Averaging," in Proceedings of the ICLR Workshop, 2015
11. S. B. Davis and P. Mermelstein, "Comparison of parametric representation for monosyllabic word recognition in continuously spoken sentences," IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 28, no. 4, pp. 357-366, 1980
12. N. Dehak, P. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, "Front-end factor analysis for speaker verification," IEEE Transactions on Audio, Speech, and Language Processing, vol. 19, no. 4, pp. 788-798, May 2011
13. V. Peddinti, G. Chen, D. Povey, and S. Khudanpur, "Reverberation robust acoustic modeling using i-vectors with time delay neural networks," in Proceedings of Interspeech, 2015
14. X. Zhang, J. Trmal, D. Povey, and S. Khudanpur, "Improving deep neural network acoustic models using generalized maxout networks," in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, May 2014, pp. 215-219
15. S. Nakamura, K. Hiyane, F. Asano, T. Nishiura, and T. Yamada, "Acoustical sound database in real environments for sound scene understanding and hands-free speech recognition." in LREC, 2000
16. K. Kinoshita, M. Delcroix, T. Yoshioka, T. Nakatani, A. Sehr, W. Kellermann, and R. Maas, "The reverb challenge: A common evaluation framework for dereverberation and recognition of reverberant speech," in Applications of Signal Processing to Audio and Acoustics (WASPAA), 2013 IEEE Workshop on. IEEE, 2013, pp. 1-4
17. M. Jeub, M. Schafer, and P. Vary, "A binaural room impulse response database for the evaluation of dereverberation algorithms," in Digital Signal Processing, 2009 16th International Conference on. IEEE, 2009, pp. 1-5
18. T. Ko, V. Peddinti, D. Povey, and S. Khudanpur, "Audio augmentation for speech recognition," in Proceedings of INTERSPEECH, 2015
19. M. Huijbregts and F. de Jong, "Robust speech/non-speech classification in heterogeneous multimedia content," Speech Communication, vol. 53, no. 2, pp. 143-153, 2011. [Online]. Available: http://www:sciencedirect:com/science/ article/pii/S0167639310001421
20. M. Gibson, "Minimum bayes risk acoustic model estimation and adaptation," Ph.D. dissertation, University of Sheffield, 2008
21. K. Vesely, A. Ghoshal, L. Burget, and D. Povey, "Sequencediscriminative training of deep neural networks." in Proceedings of INTERSPEECH, 2013, pp. 2345-2349
22. V. Manohar, D. Povey, and S. Khudanpur, "Semi-supervised maximum mutual information training of deep neural network acoustic models," in Proceedings of INTERSPEECH, 2015
23. M. Delcroix, T. Yoshioka, A. Ogawa, Y. Kubo, M. Fujimoto, N. Ito, K. Kinoshita, M. Espi, T. Hori, T. Nakatani et al., "Linear prediction-based dereverberation with advanced speech enhancement and recognition technologies for the reverb challenge," in Proc. IEEE REVERB Workshop, 2014
24. Y. Tachioka, T. Narita, F. Weninger, and S. Watanabe, "Dual system combination approach for various reverberant environments with dereverberation techniques," in Proc. of IEEE REVERB Workshop, 2014
25. G. Chen, H. Xu, M. Wu, D. Povey, and S. Khudanpur, "Pronunciation and silence probability modeling for ASR," in Proceedings of INTERSPEECH, 2015
26. T. Hain, "Implicit modelling of pronunciation variation in automatic speech recognition," Speech Communication, vol. 46, no. 2, pp. 171-188, 2005
27. B. Peskin, M. Newman, D. McAllaster, V. Nagesha, H. Richards, S. Wegmann, M. Hunt, and L. Gillick, "Improvements in recognition of conversational telephone speech," in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), vol. 1. IEEE, 1999, pp. 53-56
28. T. Hain, P. Woodland, G. Evermann, and D. Povey, "The CUHTK March 2000 Hub5e transcription system," in Proceedings of Speech Transcription Workshop, vol. 1, 2000
29. E. Fosler, M. Weintraub, S. Wegmann, Y.-H. Kao, S. Khudanpur, C. Galles, and M. Saraclar, "Automatic learning of word pronunciation from data," in Proceedings of the International Conference on Spoken Language Processing, 1996
30. A. Stolcke et al., "SRILM-an extensible language modeling toolkit." in Proceedings of INTERSPEECH, 2002
31. V. Panayotov, G. Chen, D. Povey, and S. Khudanpur, "Librispeech an ASR corpus based on public domain audio books," in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2015
32. T. Mikolov, S. Kombrink, A. Deoras, L. Burget, and J. Cernocky, "Rnnlm-recurrent neural network language modeling toolkit," in Proc. of the 2011 ASRU Workshop, 2011, pp. 196-201
33. T. Mikolov, A. Deoras, D. Povey, L. Burget, and J. Černocky, "Strategies for training large scale neural network language models," in Automatic Speech Recognition and Understanding (ASRU), 2011 IEEE Workshop on. IEEE, 2011, pp. 196-201
34. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning internal representations by error propagation," DTIC Document, Tech. Rep., 1985
35. X. Liu, Y. Wang, X. Chen, M. J. Gales, and P. C. Woodland, "Efficient lattice rescoring using recurrent neural network language models," in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 2014, pp. 4908-4912