Direct adaptation of hybrid DNN/HMM model for fast speaker adaptation in LVCSR based on speaker code

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 6339-6343

  Xue, Shaofei ^a   Abdel Hamid, Ossama ^b   Jiang, Hui ^b   Dai, Lirong ^a  

^a University of Science and Technology of China   (China)

^b YORK UNIVERSITY   (Canada)

Author keywords

Deep Neural Network (DNN); Fast Speaker Adaptation; Hybrid DNN HMM; Speaker Code

Indexed keywords

BACKPROPAGATION ALGORITHMS; CODES (SYMBOLS); ELECTRIC SWITCHBOARDS; SIGNAL PROCESSING;

ADAPTATION METHODS; CONNECTION WEIGHTS; DEEP NEURAL NETWORKS; FAST SPEAKER ADAPTATION; HYBRID DNN-HMM; RELATIVE REDUCTION; SPEAKER CODE; TRAINING PROCESS;

SPEECH RECOGNITION;

EID: 84905284226     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6854824     Document Type: Conference Paper

References (25)

1. Ossama Abdel-Hamid and Hui Jiang, "Fast speaker adaptation of hybrid NN/HMM model for speech recognition based on discriminative learning of speaker code," in IEEE International Conference of Acoustics,Speech and Signal Processing (ICASSP), 2013.
2. J. L. Gauvain and Chin-Hui Lee, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains," IEEE Transactions on Speech and audio processing, vol. 2, no. 2, pp. 291-298, 1994.
3. S. M. Ahadi and P. C. Woodland, "Combined Bayesian and predictive techniques for rapid speaker adaptation of continuous density hidden Markov models," Computer speech &language, vol. 11, no. 3, pp. 187-206, 1997.
4. Christopher Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," Computer Speech &Language, vol. 9, no. 2, pp. 171-185, 1995.
5. Mark J. F. Gales, "Maximum likelihood linear transformations for HMM-based speech recognition," Computer speech &language, vol. 12, no. 2, pp. 75-98, 1998.
6. Vassilios V Digalakis, Dimitry Rtischev, and Leonardo G Neumeyer, "Speaker adaptation using constrained estimation of Gaussian mixtures," IEEE Transactions on Speech and Audio Processing, vol. 3, no. 5, pp. 357-366, 1995.
7. Joao Neto, Lus Almeida, Mike Hochberg, Ciro Martins, Lus Nunes, Steve Renals, and Tony Robinson, "Speaker-adaptation for hybrid HMM-ANN continuous speech recognition system," in EUROSPEECH, 1995.
8. Roberto Gemello, Franco Mana, Stefano Scanzio, Pietro Laface, and Renato De Mori, "Linear hidden transformations for adaptation of hybrid ANN/HMM models," Speech Communication, vol. 49, no. 10, pp. 827-835, 2007.
9. Jan Stadermann and Gerhard Rigoll, "Two-stage speaker adaptation of hybrid tied-posterior acoustic models," in IEEE International Conference of Acoustics,Speech and Signal Processing (ICASSP), 2005.
10. Sabato Marco Siniscalchi, Jinyu Li, and Chin-Hui Lee, "Hermitian based hidden activation functions for adaptation of hybrid HMM/ANN models," in INTERSPEECH, 2012.
11. Dong Yu, Kaisheng Yao, Hang Su, Gang Li, and Frank Seide, "KL-divergence regularized deep neural network adaptation for improved large vocabulary speech recognition," in IEEE International Conference of Acoustics,Speech and Signal Processing (ICASSP), 2013.
12. Hank Liao, "Speaker adaptation of context dependent deep neural networks," in IEEE International Conference of Acoustics, Speech and Signal Processing (ICASSP), 2013.
13. Ossama Abdel-Hamid and Hui Jiang, "Rapid and effective speaker adaptation of convolutional neural network based models for speech recognition," in INTERSPEECH, 2013.
14. Bridle J. S. and S. J. Cox, "RecNorm: simultaneous normalization and classification applied to speech recognition," Advances in Neural Information Processing Systems, vol. 3, 1991.
15. Nikko Strom, "Speaker adaptation by modeling the speaker variation in a continuous speech recognition system," in Spoken Language, 1996. ICSLP 96. Proceedings., Fourth International Conference on. IEEE, 1996, vol. 2, pp. 989-992.
16. Shaofei Xue, Ossama Abdel-Hamid, Hui Jiang, and Lirong Dai, "Speaker adaptation of deep neural network based on discriminant codes," submitted to IEEE Transactions on Acoustics, Speech and Signal Processing, Feb 2014.
17. K-F Lee and H-W Hon, "Speaker-independent phone recognition using hidden Markov models," IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 37, no. 11, pp. 1641-1648, 1989.
18. Abdel-rahman Mohamed, George E Dahl, and Geoffrey Hinton, "Acoustic modeling using deep belief networks," IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 1, pp. 14-22, 2012.
19. Jia Pan, Cong Liu, Zhiguo Wang, Yu Hu, and Hui Jiang, "Investigation of deep neural networks (DNN) for large vocabulary continuous speech recognition: Why DNN surpasses GMMs in acoustic modeling," in 8th International Symposium on Chinese Spoken Language Processing (ISCSLP), 2012, pp. 301-305.
20. Yebo Bao, Hui Jiang, Cong Liu, Yu Hu, and Lirong Dai, "Investigation on dimensionality reduction of concatenated features with deep neural network for LVCSR systems," in IEEE 11th International Conference on Signal Processing (ICSP), 2012, vol. 1, pp. 562-566.
21. Yebo Bao, Hui Jiang, Lirong Dai, and Cong Liu, "Incoherent training of deep neural networks to de-correlate bottleneck features for speech recognition," in IEEE International Conference of Acoustics,Speech and Signal Processing (ICASSP), 2013.
22. Shiliang Zhang, Yebo Bao, Pan Zhou, Hui Jiang, and Lirong Dai, "Improving deep neural networks for LVCSR using dropout and shrinking structure," in IEEE International Conference of Acoustics,Speech and Signal Processing (ICASSP), 2014.
23. Hang Su, Gang Li, Dong Yu, and Frank Seide, "Error back propagation for sequence training of context-dependent deep networks for conversational speech transcription," in IEEE International Conference of Acoustics,Speech and Signal Processing (ICASSP), 2013.
24. Pan Zhou, Lirong Dai, Hui Jiang, Yu Hu, and Qingfeng Liu, "A state-clustering based multiple deep neural networks modelling approach for speech recognition," in IEEE International Conference of Acoustics,Speech and Signal Processing (ICASSP), 2013.
25. Pan Zhou, Lirong Dai, and Hui Jiang, "Sequence training of multiple deep neural networks for better performance and faster training speed," in IEEE International Conference of Acoustics, Speech and Signal Processing (ICASSP), 2014.