Learning factorized feature transforms for speaker normalization

2015 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2015 - Proceedings

Volumn , Issue , 2016, Pages 145-152

  Samarakoon, Lahiru ^a   Sim, Khe Chai ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Automatic speech recognition; deep neural networks; speaker normalization

Indexed keywords

MAXIMUM LIKELIHOOD; MAXIMUM LIKELIHOOD ESTIMATION;

ACOUSTIC FEATURES; AUTOMATIC SPEECH RECOGNITION; CONSTRAINED MAXIMUM LIKELIHOOD LINEAR REGRESSIONS (CMLLR); DEEP NEURAL NETWORKS; FEATURE TRANSFORM; SPEAKER DEPENDENTS; SPEAKER NORMALIZATION; SPEAKER VARIABILITY;

SPEECH RECOGNITION;

EID: 84964489805     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2015.7404787     Document Type: Conference Paper

References (31)

1. G. Hinton, L. Deng, D. Yu, G.E. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T.N. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups," IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82-97, 2012
2. J. Gauvain and C.H. Lee, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of markov chains," IEEE Transactions on Speech and Audio Processing, vol. 2, no. 2, pp. 291-298, 1994
3. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden markov models," Computer Speech and Language, vol. 9, no. 2, pp. 171-186, 1995
4. H. Hermansky, D.P.W. Ellis, and S. Sharma, "Tandem connectionist feature extraction for conventional HMM systems," in Proc. ICASSP, 2000, pp. 1635-1638
5. P. Bell, P. Swietojanski, and S. Renals, "Multi-level adaptive networks in tandem and hybrid ASR systems," in Proc. ICASSP, 2013, pp. 6975-6979
6. N. Morgan and H. Bourlard, "Continuous speech recognition using multilayer perceptrons with hidden markov models," in Proc. ICASSP, 1990, pp. 413-416
7. D. Yu, K. Yao, H. Su, G. Li, and F. Seide, "Kldivergence regularized deep neural network adaptation for improved large vocabulary speech recognition," in Proc. ICASSP, 2013, pp. 7893-7897
8. V. Gupta, P. Kenny, P. Ouellet, and T. Stafylakis, "Ivector-based speaker adaptation of deep neural networks for French broadcast audio transcription," in Proc. ICASSP, 2014, pp. 6334-6338
9. G. Saon, H. Soltau, D. Nahamoo, and M. Picheny, "Speaker adaptation of neural network acoustic models using i-vectors," in Proc. ASRU, 2013, pp. 55-59
10. O. Abdel-Hamid and H. Jiang, "Fast speaker adaptation of hybrid NN/HMM model for speech recognition based on discriminative learning of speaker code," in Proc. ICASSP, 2013, pp. 7942-7946
11. N. Dehak, P. J. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, "Front end factor analysis for speaker verification," IEEE Transactions on Audio, Speech and Language Processing, 2010
12. O. Glembek, L. Burget, P. Matejka, M. Karafiat, and P. Kenny, "Simplification and optimization of i-vector extraction," in Proc. ICASSP, 2011, pp. 4516-4519
13. V. Abrash, H. Franco, A. Sankar, and M. Cohen, "Connectionist speaker normalization and adaptation," in Proc. Eurospeech, 1995, pp. 2183-2186
14. B. Li and K. C. Sim, "Comparison of discriminative input and output transformation for speaker adaptation in the hybrid nn/hmm systems," in Proc. Interspeech, 2010, pp. 526-529
15. F. Seide, Gang Li, Xie Chen, and Dong Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription," in Proc. ASRU, 2011, pp. 24-29
16. R. Gemello, F. Mana, S. Scanzio, P. Laface, and R. D. Mori, "Adaptation of hybrid ANN/HMM models using linear hidden transformations and conservative training," in Proc. ICASSP, 2006, pp. 1189-1192
17. X. Li and J. Bilmes, "Regularized adaptation of discriminative classifiers," in Proc. ICASSP, 2006, vol. 1, pp. 1-1
18. J. Xue, J. Li, D. Yu, M. Seltzer, and Y. Gong, "Singular value decomposition based low-footprint speaker adaptation and personalization for deep neural network," in Proc. ICASSP, 2014, pp. 6359-6363
19. J. Stadermann and G. Rigoll, "Two-stage speaker adaptation of hybrid tied-posterior acoustic models," in Proc. ICASSP, 2005, pp. 977-980
20. K. Yao, D. Yu, F. Seide, H. Su, L. Deng, and Y. Gong, "Adaptation of context-dependent deep neural networks for automatic speech recognition," in Proc. SLT, 2012, pp. 366-369
21. P. Swietojanski and S. Renals, "Learning hidden unit contributions for unsupervised speaker adaptation of neural network acoustic models," in Proc. SLT, 2014, pp. 171-176
22. P. Swietojanski and S. Renals, "Differentiable pooling for unsupervised speaker adaptation," in Proc. ICASSP, 2015, pp. 4305-4309
23. S. Dupont and L. Cheboub, "Fast speaker adaptation of artificial neural networks for automatic speech recognition," in Proc. ICASSP, 2000, pp. 1795-1798
24. T. Tian, Q. Yanmin, Y. Maofan, Z. Yimeng, and K. Yu, "Cluster adaptive training for deep neural network," in Proc. ICASSP, 2015, pp. 4325-4329
25. C. Wu and M. J. F. Gales, "Multi-basis adaptive neural network for rapid adaptation in speech recognition," in Proc. ICASSP, 2015, pp. 4315-4319
26. A. Senior and I. Lopez-Moreno, "Improving dnn speaker independence with i-vector inputs," in Proc. ICASSP, 2014, pp. 225-229
27. H. Huang and K. C. Sim, "An investigation of augmenting speaker representations to improve speaker normalization for DNN-based speech recognition," in Proc. ICASSP, 2015, pp. 4610-4613
28. M.J.F. Gales, "Maximum likelihood linear transformations for hmm-based speech recognition," Computer speech &language, vol. 12, no. 2, pp. 75-98, 1998
29. M.J.F. Gales, "Semi-tied covariance matrices for hidden markov models," IEEE Transactions on Speech and Audio Processing, vol. 7, no. 3, pp. 272-281, 1999
30. D. Yu, A. Eversole, M. Seltzer, K. Yao, Z. Huang, B. Guenter, O. Kuchaiev, Y. Zhang, F. Seide, H. Wang, et al., "An introduction to computational networks and the computational network toolkit," Tech. Rep., Tech. Rep. MSR, Microsoft Research, 2014, http://codebox/cntk, 2014
31. D. Povey, A. Ghoshal, G. Boulianne, N. Goel, M. Hannemann, Y. Qian, P. Schwarz, and G. Stemmer, "The kaldi speech recognition toolkit," in Proc. ASRU, 2011