Towards utterance-based neural network adaptation in acoustic modeling

2015 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2015 - Proceedings

Volumn , Issue , 2016, Pages 289-295

  Himawan, Ivan ^a   Motlicek, Petr ^a   Font, Marc Ferras ^a   Madikeri, Srikanth ^a  

^a IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

acoustic model adaptation; AMI corpus; Deep neural networks; environmental robustness; LHUC

Indexed keywords

ABILITY TESTING; ACOUSTIC NOISE; SPEECH PROCESSING;

ACOUSTIC MODEL ADAPTATION; AMI CORPUS; DEEP NEURAL NETWORKS; ENVIRONMENTAL ROBUSTNESS; LHUC;

SPEECH RECOGNITION;

EID: 84964497075     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2015.7404807     Document Type: Conference Paper

References (32)

1. T. Yoshioka et al., "Making Machines Understand Us in Reverberant Rooms: Robustness Against Reverberation for Automatic Speech Recognition," IEEE Signal Processing Magazine, Nov. 2012
2. Dong Yu and Li Deng, Automatic Speech Recognition-A Deep Learning Approach, Springer Publishing Company, Incorporated, 2014
3. Shi Yin et al., "Noisy training for deep neural networks in speech recognition," EURASIP Journal on Audio, Speech, and Music Processing, 2015
4. Arnab Ghoshal, Pawel Swietojanski, and Steve Renals, "Multilingual training of deep neural networks," in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, 2013
5. Jui-Ting Huang et al., "Cross-Language Knowledge Transfer Using Multilingual Deep Neural Network With Shared Hidden Layers," in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, 2013
6. Chao Weng, Dong Yu, Michael L. Seltzer, and Jasha Droppo, "Single-Channel Mixed Speech Recognition using Deep Neural Network," in Proceedings of IEEE International Conference on Acoustic, Speech and Signal Processing, 2014
7. Shaofei Xue, Ossama Abdel-Hamid, Hui Jiang, and Lirong Dai, "Direct Adaptation of Hybrid DNN/HMM Model for Fast Speaker Adaptation in LVCSR based on Speaker Code," in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, 2014
8. C. Legetter and P. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," Computer Speech and Language, vol. 9, no. 2, pp. 171-185, 1995
9. P. C. Woodland, "Speaker Adaptation for Continuous Density HMMs: A Review," in Proceedings ISCA ITRWorkshop on Adaptation Methods for Speech Recognition, 2001
10. M. J. F. Gales, "Maximum likelihood linear transformations for HMM-based speech recognition," Computer Speech and Language, 1998
11. Yongqiang Wang and M. J. F. Gales, "Speaker and Noise Factorization for Robust Speech Recognition," IEEE Transactions on Audio, Speech, and Language Processing, 2012
12. Frank Seide et al., "Feature Engineering in Context-Dependent Deep Neural Networks for Conversational Speech Transcription," in Proceedings of IEEE Workshop on Automatic Speech Recognition and Understanding, 2011
13. Dong Yu et al., "Feature learning in deep neural networks-studies on speech recognition tasks," in Proceedings of the International Conference on Learning Representations, 2013
14. Takuya Yoshioka, Xie Chen, and Mark J. F. Gales, "Impact of single-microphone dereverberation on DNNbased meeting transcription systems," in Proceedings of IEEE International Conference on Acoustic, Speech and Signal Processing, 2014
15. D. Kim and M. J. F. Gales, "Adaptive training with noisy constrained maximum likelihood linear regression for noise robust speech recognition," in Proceedings of Interspeech, 2009
16. Pawel Swietojanski and Steve Renals, "Learning Hidden Unit Contributions for Unsupervised Speaker Adaptation of Neural Network Acoustic Models," in Proceedings of IEEE Spoken Language Technology Workshop, 2014
17. Yan Huang, M. Slaney, M. L. Seltzer, and Y. Gong, "Towards Better Performance with Heterogeneous Training Data in Acoustic Modeling using Deep Neural Networks," in Proceedings of Interspeech, 2014
18. V. Abrash, H. Franco, A. Sankar, and M. Cohen, "Connectionist Speaker Normalization and Adaptation," in Proceedings Eurospeech, 1995, pp. 2183-2186
19. Bo Li and Khe Chai Sim, "Comparison of discriminative input and output transformations for speaker adaptation in the hybrid NN/HMM systems," in Proceedings of Interspeech, 2010
20. R. Price, K.-I. Iso, and K. Shinoda, "Speaker adaptation of deep neural networks using a hierarchy of output layers," in Proceedings of IEEE Spoken Language Technology Workshop, 2014
21. Michael L. Seltzer et al., "An investigation of deep neural networks for noise robust speech recognition," in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, 2013
22. Hank Liao, "Speaker adaptation of context dependent deep neural networks," in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, 2013
23. Dong Yu et al., "KL-Divergence Regularized Deep Neural Network Adaptation for Improved Large Vocabulary Speech Recognition," in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, 2013
24. Kaisheng Yao et al., "Adaptation of Context-Dependent Deep Neural Networks for Automatic Speech Recognition," in Proceedings of IEEE Spoken Language Technology Workshop, 2012
25. Jian Xue et al., "Singular Value Decomposition Based Low-Footprint Speaker Adaptation and Personalization for Deep Neural Network," in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, 2014
26. H. Bourlard and N. Morgan, Connectionist Speech Recognition-A Hybrid Approach, Kluwer Academic, 1994
27. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning representations by back-propagating errors," Nature, vol. 323, pp. 533-536, Oct. 1986
28. Geoffrey Hinton et al., "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups," IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82-97, Nov. 2012
29. Thomas Hain et al., "Transcribing Meetings With the AMIDA Systems," IEEE Transactions on Audio, Speech and Language Processing, vol. 20, no. 2, pp. 486-498, 2012
30. Pawel Swietojanski, Arnab Ghoshal, and Steve Renals, "Hybrid Acoustic Models for Distant and Multichannel Large Vocabulary Speech Recognition," in Proceedings of IEEE Workshop on Automatic Speech Recognition and Understanding, 2013
31. Daniel Povey et al., "The Kaldi speech recognition toolkit," in Proceedings of IEEE Workshop on Automatic Speech Recognition and Understanding, 2011
32. Tasos Anastasakos, John McDonough, and John Makhoul, "Speaker adaptive training: A maximum likelihood approach to speaker normalization," in Proceedings of IEEE International Conference on Acoustic, Speech and Signal Processing, 1997