SAT-LHUC: Speaker adaptive training for learning hidden unit contributions

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2016-May, Issue , 2016, Pages 5010-5014

  Swietojanski, Pawel ^a   Renais, Steve ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Deep Neural Networks; LHUC; SAT

Indexed keywords

EID: 84973299594     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2016.7472631     Document Type: Conference Paper

References (44)

1. T Anastasakos, J McDonough, R Schwartz, and J Makhoul, "A compact model for speaker-adaptive training, " in Proc ICSLP, 1996, pp. 1137-1140.
2. MJF Gales, "Cluster adaptive training of hidden markov models, " Speech and Audio Processing, IEEE Transactions on, vol. 8, no. 4, pp. 417-428, 2000.
3. CJ Leggetter and PC Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models, " Computer Speech & Language, vol. 9, pp. 171-185, 1995.
4. MJF Gales, "Maximum likelihood linear transformations for HMMbased speech recognition, " Computer Speech and Language, vol. 12, pp. 75-98, April 1998.
5. G Hinton, L Deng, D Yu, GE Dahl, A Mohamed, N Jaitly, A Senior, V Vanhoucke, P Nguyen, TN Sainath, and B Kingsbury, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, " Signal Processing Magazine, IEEE, vol. 29, no. 6, pp. 82-97, Nov 2012.
6. A Mohamed, TN Sainath, G Dahl, B Ramabhadran, GE Hinton, and MA Picheny, "Deep belief networks using discriminative features for phone recognition, " in Proc. ICASSP, May 2011, pp. 5060-5063.
7. F Seide, X Chen, and D Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription, " in Proc IEEE ASRU, 2011.
8. P Swietojanski, A Ghoshal, and S Renals, "Revisiting hybrid and GMM-HMM system combination techniques, " in Proc IEEE ICASSP, 2013.
9. G Saon, H Soltau, D Nahamoo, and M Picheny, "Speaker adaptation of neural network acoustic models using i-vectors., " in Proc IEEE ASRU, 2013, pp. 55-59.
10. J Neto, L Almeida, M Hochberg, C Martins, L Nunes, S Renals, and T Robinson, "Speaker adaptation for hybrid HMM-ANN continuous speech recognition system, " in Proc Eurospeech, 1995, pp. 2171-2174.
11. V Abrash, H Franco, A Sankar, and M Cohen, "Connectionist speaker normalization and adaptation, " in Proc Eurospeech, 1995, pp. 2183-2186.
12. K Yao, D Yu, F Seide, H Su, L Deng, and Y Gong, "Adaptation of context-dependent deep neural networks for automatic speech recognition., " in Proc IEEE SLT, 2012.
13. D Yu, K Yao, H Su, G Li, and F Seide, "KL-divergence regularized deep neural network adaptation for improved large vocabulary speech recognition., " in Proc IEEE ICASSP, 2013, pp. 7893-7897.
14. H Liao, "Speaker adaptation of context dependent deep neural networks., " in In Proc. ICASSP. 2013, pp. 7947-7951, IEEE.
15. O Abdel-Hamid and H Jiang, "Rapid and effective speaker adaptation of convolutional neural network based models for speech recognition., " in Proc. Interspeech. pp. 1248-1252, ISCA.
16. P Swietojanski and S Renals, "Learning hidden unit contributions for unsupervised speaker adaptation of neural network acoustic models, " in Proc. IEEE SLT, 2014.
17. P Swietojanski and S Renals, "Differentiable pooling for unsupervised speaker adaptation, " in Proc. IEEE ICASSP, 2015.
18. N Dehak, PJ Kenny, R Dehak, P Dumouchel, and P Ouellet, "Front end factor analysis for speaker verification, " IEEE Trans Audio, Speech and Language Processing, vol. 19, pp. 788-798, 2010.
19. M Karafiat, L Burget, P Matejka, O Glembek, and J Cernozky, "iVector-based discriminative adaptation for automatic speech recognition, " in Proc IEEE ASRU, 2011.
20. Y Miao, H Zhang, and F Metze, "Towards speaker adaptive training of deep neural network acoustic models, " in Proc. Interspeech, 2014.
21. P Bell, P Swietojanski, and S Renals, "Multi-level adaptive networks in tandem and hybrid ASR systems, " in Proc IEEE ICASSP, 2013.
22. Y Liu, P Karanasou, and T Hain, "An investigation into speaker informed DNN front-end for LVCSR, " in Proc IEEE ICASSP, 2015.
23. JS Bridle and S Cox, "Recnorm: Simultaneous normalisation and classification applied to speech recognition, " in Advances in Neural Information Processing Systems 3, 1990, pp. 234-240.
24. J Trmal, J Zelinka, and L Müller, "On speaker adaptive training of artificial neural networks, " in Proc. Interspeech, 2010.
25. O Abdel-Hamid and H Jiang, "Fast speaker adaptation of hybrid NN/HMM model for speech recognition based on discriminative learning of speaker code, " in Proc IEEE ICASSP, 2013, pp. 4277-4280.
26. C Wu and M Gales, "Multi-basis adaptive neural network for rapid adaptation in speech recognition, " in Proc. ICASSP. 2015, IEEE.
27. T Tan, Y Qian, M Yin, Y Zhuang, and K Yu, "Cluster adaptive training for deep neural network, " in Proc. ICASSP. 2015, IEEE.
28. M Delcroix, K Kinoshita, T Hori, and T Nakatani, "Context adaptive deep neural networks for fast acoustic model adaptation, " in Proc. ICASSP. 2015, IEEE.
29. M Cettolo, C Girardi, and M Federico, "Wit3: Web inventory of transcribed and translated talks, " in Proc EAMT, 2012, pp. 261-268.
30. John J Godfrey, Edward C Holliman, and Jane McDaniel, "SWITCHBOARD: Telephone speech corpus for research and development, " in Proc. ICASSP. IEEE, 1992, pp. 517-520.
31. J Carletta, "Unleashing the killer corpus: Experiences in creating the multi-everything AMI meeting corpus., " Language Resources and Evaluation, vol. 41, no. 2, pp. 181-190, 2007.
32. S Renals, T Hain, and H Bourlard, "Recognition and understanding of meetings: The AMI and AMIDA projects, " in Proc. of the IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU'07, Kyoto, 12 2007, IDIAP-RR 07-46.
33. GE Dahl, D Yu, L Deng, and A Acero, "Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 20, no. 1, pp. 30-42, 2012.
34. P Swietojanski, A Ghoshal, and S Renals, "Revisiting hybrid and GMM-HMM system combination techniques, " in Proc. ICASSP, 2013.
35. P Bell, P Swietojanski, J Driesen, MSinclair, F McInnes, and S Renals, "The UEDIN ASR Systems for the IWSLT 2014 Evaluation, " in Proc. IWSLT, 2014.
36. K Vesely, A Ghoshal, L Burget, and D Povey, "Sequencediscriminative training of deep neural networks, " in Proc. Interspeech, Lyon, France, August 2013.
37. D Povey, A Ghoshal, G Boulianne, L Burget, O Glembek, N Goel, M Hannemann, P Motlícek, Y Qian, P Schwarz, J Silovský, G Stemmer, and K Veselý, "The Kaldi speech recognition toolkit, " in Proc. IEEE ASRU, December 2011.
38. P Swietojanski, A Ghoshal, and S Renals, "Hybrid acoustic models for distant and multichannel large vocabulary speech recognition, " in Proc. IEEE ASRU, December 2013.
39. C Zhang and PC Woodland, "Parameterised Sigmoid and ReLU Hidden Activation Functions for DNN Acoustic Modelling, " in Proc. Interspeech, 2015.
40. M Wester, Z Wu, and J Yamagishi, "Human vs machine spoofing detection on wideband and narrowband data, " in Proc. of Interspeech, September 2015.
41. J Fiscus, W M Fisher, A F Martin, M A Przybocki, and D S Pallett, "2000 NIST evaluation of conversational speech recognition over the telephone: English and Mandarin performance results, " in Proc. Speech Transcription Workshop. Citeseer, 2000.
42. P Swietojanski, J Li, and S Renals, "Learning hidden unit contributions for unsupervised acoustic model adaptation, " arXiv: 1601. 02828, 2016.
43. D Povey, Discriminative training for large vocabulary speech recognition, Ph. D. Thesis, University of Cambridge, 2003.
44. B Kingsbury, "Lattice-based optimization of sequence classification criteria for neural-network acoustic modeling, " in Proc. IEEE ICASSP, 2009, pp. 3761-3764.