On combining i-vectors and discriminative adaptation methods for unsupervised speaker normalization in DNN acoustic models

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2016-May, Issue , 2016, Pages 5275-5279

  Samarakoon, Lahiru ^a   Sim, Khe Chai ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Automatic speech recognition; deep neural networks; speaker normalization

Indexed keywords

EID: 84973352080     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2016.7472684     Document Type: Conference Paper

References (30)

1. G. Hinton, L. Deng, D. Yu, G. E. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, " IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82-97, 2012.
2. J. Gauvain and C. H. Lee, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of markov chains, " IEEE Transactions on Speech and Audio Processing, vol. 2, no. 2, pp. 291-298, 1994.
3. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden markov models, " Computer Speech & Language, vol. 9, no. 2, pp. 171-185, 1995.
4. H. Hermansky, D. P. W. Ellis, and S. Sharma, "Tandem connectionist feature extraction for conventional HMM systems, " in ICASSP. IEEE, 2000, pp. 1635-1638.
5. P. Bell, P. Swietojanski, and S. Renals, "Multi-level adaptive networks in tandem and hybrid ASR systems, " in ICASSP. IEEE, 2013, pp. 6975-6979.
6. L. T. Samarakoon and K. C. Sim, "Learning factorized transforms for speaker normalization, " in ASRU. IEEE, 2015.
7. D. Yu, K. Yao, H. Su, G. Li, and F. Seide, "Kl-divergence regularized deep neural network adaptation for improved large vocabulary speech recognition, " in ICASSP. IEEE, 2013, pp. 7893-7897.
8. V. Gupta, P. Kenny, P. Ouellet, and T. Stafylakis, "I-vectorbased speaker adaptation of deep neural networks for French broadcast audio transcription, " in ICASSP. IEEE, 2014, pp. 6334-6338.
9. G. Saon, H. Soltau, D. Nahamoo, and M. Picheny, "Speaker adaptation of neural network acoustic models using i-vectors, " in ASRU. IEEE, 2013, pp. 55-59.
10. O. Abdel-Hamid and H. Jiang, "Fast speaker adaptation of hybrid NN/HMM model for speech recognition based on discriminative learning of speaker code, " in ICASSP. IEEE, 2013, pp. 7942-7946.
11. P. Swietojanski and S. Renals, "Learning hidden unit contributions for unsupervised speaker adaptation of neural network acoustic models, " in SLT. IEEE, 2014, pp. 171-176.
12. V. Abrash, H. Franco, A. Sankar, and M. Cohen, "Connectionist speaker normalization and adaptation, " in Eurospeech. ISCA, 1995, pp. 2183-2186.
13. B. Li and K. C. Sim, "Comparison of discriminative input and output transformation for speaker adaptation in the hybrid nn/hmm systems, " in INTERSPEECH. ISCA, 2010, pp. 526-529.
14. R. Gemello, F. Mana, S. Scanzio, P. Laface, and R. D. Mori, "Adaptation of hybrid ANN/HMM models using linear hidden transformations and conservative training, " in ICASSP. IEEE, 2006, pp. 1189-1192.
15. X. Li and J. Bilmes, "Regularized adaptation of discriminative classifiers, " in ICASSP. IEEE, 2006, vol. 1, pp. I-I.
16. J. Stadermann and G. Rigoll, "Two-stage speaker adaptation of hybrid tied-posterior acoustic models, " in ICASSP. IEEE, 2005, pp. 977-980.
17. K. Yao, D. Yu, F. Seide, H. Su, L. Deng, and Y. Gong, "Adaptation of context-dependent deep neural networks for automatic speech recognition, " in SLT. IEEE, 2012, pp. 366-369.
18. P. Swietojanski and S. Renals, "Differentiable pooling for unsupervised speaker adaptation, " in ICASSP. IEEE, 2015, pp. 4305-4309.
19. A. Senior and I. Lopez-Moreno, "Improving dnn speaker independence with i-vector inputs, " in ICASSP. IEEE, 2014, pp. 225-229.
20. H. Huang and K. C. Sim, "An investigation of augmenting speaker representations to improve speaker normalization for DNN-based speech recognition, " in ICASSP. IEEE, 2015, pp. 4610-4613.
21. T. Tian, Q. Yanmin, Y. Maofan, Z. Yimeng, and K. Yu, "Cluster adaptive training for deep neural network, " in ICASSP. IEEE, 2015, pp. 4325-4329.
22. C. Wu and M. J. F. Gales, "Multi-basis adaptive neural network for rapid adaptation in speech recognition, " in ICASSP. IEEE, 2015, pp. 4315-4319.
23. Yajie M., Hao Z., and Florian M., "Towards speaker adaptive training of deep neural network acoustic models, " in INTERSPEECH. ISCA, 2014.
24. O. Toshihiko, M. Shodai, L Xugang, H. Chiori, and K. Souichi, "Speaker adaptive training using deep neural networks, " in ICASSP. IEEE, 2014, pp. 6349-6353.
25. A. Rousseau, P. Deléglise, and Y. Esteve, "Ted-lium: an automatic speech recognition dedicated corpus., " in LREC. ELRA, 2012, pp. 125-129.
26. M. J. F. Gales, "Semi-tied covariance matrices for hidden markov models, " IEEE Transactions on Speech and Audio Processing, vol. 7, no. 3, pp. 272-281, 1999.
27. D. Yu, A. Eversole, M. Seltzer, K. Yao, Z. Huang, B. Guenter, O. Kuchaiev, Y. Zhang, F. Seide, H. Wang, et al., "An introduction to computational networks and the computational network toolkit, " Tech. Rep., Tech. Rep. MSR, Microsoft Research, 2014, http: //codebox/cntk, 2014.
28. W. Williams, N. Prasad, D. Mrva, T. Ash, and T. Robinson, "Scaling recurrent neural network language models, " in ICASSP. IEEE, 2015, pp. 5391-5395.
29. D. Povey, A. Ghoshal, G. Boulianne, N. Goel, M. Hannemann, Y. Qian, P. Schwarz, and G. Stemmer, "The kaldi speech recognition toolkit, " in ASRU. IEEE, 2011.
30. D. Povey, M. Hannemann, G. Boulianne, L. Burget, A. Ghoshal, M. Janda, M. Karafiát, S. Kombrink, P. Motlicek, Y. Qian, et al., "Generating exact lattices in the wfst framework, " in ICASSP. IEEE, 2012, pp. 4213-4216.