Speaker dependent bottleneck layer training for Speaker adaptation in automatic speech recognition

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2014, Pages 2199-2203

  Doddipatla, Rama ^a   Hasan, Madina ^a   Hain, Thomas ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Automatic speech recognition; Bottleneck features; Deep neural networks; Speaker adaptation

Indexed keywords

LINEAR TRANSFORMATIONS; SPEECH COMMUNICATION; SPEECH PROCESSING;

AUTOMATIC SPEECH RECOGNITION; BOTTLENECK FEATURES; DEEP NEURAL NETWORKS; DISCRIMINATIVE FEATURES; GLOBAL TRANSFORMATION; MATRIX TRANSFORMATION; SPEAKER ADAPTATION; SPEAKER ADAPTIVE TRAININGS;

SPEECH RECOGNITION;

EID: 84910028538     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. A. Mohamed, G. Dahl, and G. Hinton, "Deep belief networks for phone recognition, " in Proc. NIPS Workshop Deep Learning for Speech Recognition and Related Applications, 2009.
2. A. Mohamed, T. N. Sainath, G. E. Dahl, B. Ramabhadran, G. E. Hinton, and M. Picheny, "Deep belief networks using discriminative features for phone recognition, " in Proc. ICASSP, 2011.
3. A. Mohamed, G. Dahl, and G. Hinton, "Acoustic modeling using deep belief networks, " IEEE Trans. Audio Speech Lang. Processing, vol. 20, no. 1, pp. 1422, Jan. 2012.
4. F. Seide, G. Li, and D. Yu, "Conversational Speech Transcription Using Context-Dependent Deep Neural Networks, " In Inter speech 2011.
5. G. E. Dahl, D. Yu, L. Deng, and A. Acero, "Context-dependent pre-trained deep neural networks for large vocabulary speech recognition, " IEEE Trans. on Audio, Speech, and Language Processing, vol. 20, no. 1, pp. 3042, 2012.
6. G. Hinton, L. Deng, D. Yu, G. Dahl, A.-R. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition, " IEEE Signal Processing Magazine, 2012.
7. C. J. Leggetter and P. C.Woodland, "Maximum Likelihood Linear Regression for Speaker Adaptation of Continuous Density Hidden Markov Models, " Computer Speech & Language, vol. 9, no. 2, pp. 171 - 185, 1995.
8. V. V. Digalakis, D. Rtischev, and L. G. Neumeyer, "Speaker Adaptation using Constrained Estimation of Gaussian Mixtures, " IEEE Trans. on Speech and Audio Processing, vol. 3, no. 5, pp. 357 -366, Sep. 1995.
9. M. J. F. Gales, "Maximum Likelihood Linear Transformations for HMM-Based Speech Recognition, " Computer Speech and Language, vol. 12, no. 2, pp. 75-98, 1998.
10. T. Anastasakos, J. McDonough, R. Schwartz, and J. Makhoul, "A Compact Model for Speaker-Adaptive Training, " in Proc. of ICSLP, pp. 1137-1140, Oct. 1996.
11. J. S. Bridle, and S. Cox, "Rec Norm: Simultaneous Normalisation and Classification Applied to Speech Recognition, " in NIPS, page 234-240, 1990.
12. J. P. Neto, L. B. Almeida, M. Hochberg, C. Martins, L. Nunes, S. Renals, and T. Robinson, "Speaker-adaptation for hybrid HMM-ANN continuous speech recognition system, " in EURO SPEECH, 1995.
13. B. Li, and K. C. Sim, "Comparison of discriminative input and output transformations for speaker adaptation in the hybrid NN/HMM systems, " in INTER SPEECH, 2010.
14. R. Gemello, F. Mana, S. Scanzio, P. Laface, and R. D. Mori, "Adaptation of hybrid ANN/HMM models using linear hidden transformations and conservative training, " in ICASSP, 2006.
15. F. Seide, G. Li, X. Chen, and D. Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription, " in ASRU, 2011.
16. K. Yao, D. Yu F. Seide, H. Su, L. Deng and Y. Gong, "Adaptation of context-dependent deep neural networks for automatic speech recognition, " in IEEE SLT, 2012.
17. M. Ferras and H. Bourlard, "MLP-based factor analysis for tandem speech recognition, " in ICASSP, 2013.
18. O. Abdel-Hamid and H. Jiang, "Fast speaker adaptation of hybrid NN/HMM model for speech recognition based on discriminative learning of speaker code, " in ICASSP, 2013.
19. O. Abdel-Hamid and H. Jiang, "Rapid and effective speaker adaptation of convolutional neural network based models for speech recognition, " in INTERSPEECH, 2013.
20. G. Soan, H. Soltau, D. Nahamoo and M. Picheny, "Speaker adaptation of neural network acoustic models using i-vectors, " in ASRU 2013.
21. Y. Liu, P. Zhang and T. Hain, "Using neural network front-ends on far field multiple microphones based speech recognition, " to apper ICASSP 2014.
22. J. Carletta, S. Ashby, S. Bourban, M. Guillemot, M. Kronenthal, G. Lathoud, M. Lincoln, I. McCowan, T. Hain, W. Kraaij, W. Post, J. Kadlec, P.Wellner, M. Flynn, and D. Reidsma, "The AMI meeting corpus, " In Proc. MLMI05, Edinburgh, 2005.
23. T. Hain, L. Burget, J. Dines, G. Garau, M. Karafíat, D. A. van Leeuwen, M. Lincoln, V. Wan: The 2007 AMI(DA) System for Meeting Transcription. CLEAR 2007: 414-428.
24. A. Janin, D. Baron, J. Edwards, D. Ellis, D. Gelbart, N. Morgan, B. Peskin, T. Pfau, E. Shriberg, A. Stolcke, and C. Wooters. "The ICSI meeting corpus, " In ICASSP 2003.
25. NIST: Rich transcription evaluations (2007- 2009), http://www.itl.nist.gov/iad/mig//tests/rt/.
26. N. Kumar and A. G. Andreou, "Heteroscedastic discriminant analysis and reduced rank HMMs for improved speech recognition, " Speech Communication, vol. 26, no. 4, pp. 283 297, 1998.
27. TNet: Neural Network Trainer. http://speech.fit.vutbr.cz/software/neural-network-trainertnet.
28. NIST, "Speech recognition scoring toolkit (SCTK), " http://www.nist.gov/speech/tools/.