Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2013, Pages 7304-7308

  Huang, Jui Ting ^a   Li, Jinyu ^a   Yu, Dong ^b   Deng, Li ^b   Gong, Yifan ^a  

^a MICROSOFT   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

CD DNN HMM; deep neural network; multilingual speech recognition; multitask learning; transfer learning

Indexed keywords

CD-DNN-HMM; DEEP NEURAL NETWORKS; MULTILINGUAL SPEECH RECOGNITION; MULTITASK LEARNING; TRANSFER LEARNING;

KNOWLEDGE MANAGEMENT; LEARNING ALGORITHMS; LINEAR TRANSFORMATIONS; MATHEMATICAL TRANSFORMATIONS; SIGNAL PROCESSING;

NEURAL NETWORKS;

EID: 84890527497     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2013.6639081     Document Type: Conference Paper

References (25)

1. G. Dahl, D. Yu, L. Deng, and A. Acero, "Context-dependent pre-trained deep neural networks for large vocabulary speech recognition," IEEE Trans. Speech and Audio Proc., vol. 20, no. 1, pp. 30-42, 2012
2. D. Yu, L. Deng, and G. Dahl, "Roles of pretraining and finetuning in context-dependent DNN-HMMs for real-world speech recognition," in Proc. NIPS Workshop on Deep Learning and Unsupervised Feature Learning, Dec. 2010.
3. F. Seide, G. Li, and D. Yu, "Conversational speech transcription using context-dependent deep neural networks," in Proc. Interspeech, pp. 437-440, 2011.
4. F. Seide, G. Li, X. Chen, D. Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription," in Proc. ASRU, pp. 24-29, 2011.
5. A. Mohamed, G. Dahl, and G. Hinton, "Acoustic modeling using deep belief networks," IEEE Trans. on Audio, Speech, and Language Processing, vol. 20, no. 1, pp. 14-22, 2012.
6. N. Jaitly, P. Nguyen, and V. Vanhoucke, "application of pretrained deep neural networks to large vocabulary speech recognition," in Proc. Interspeech, 2012.
7. T. N. Sainath, B. Kingsbury, B. Ramabhadran, P. Fousek, P. Novak, and A.-r. Mohamed, "Making deep belief networks effective for large vocabulary continuous speech recognition," in Proc. ASRU, pp. 30-35, 2011.
8. B. Kingsbury, T. N. Sainath, and H. Soltau, "Scalable minimum bayes risk training of deep neural network acoustic models using distributed hessian-free optimization," in Proc. Interspeech, 2012.
9. H. Su, G. Li, D. Yu, F. Seide, "Error back propagation for sequence training of context-dependent deep networks for conversational speech transcription", in Proc. ICASSP 2013.
10. M. Seltzer, D. Yu, Y. Wang, "An investigation of deep neural networks for noise robust speech recognition", in Proc. ICASSP 2013.
11. G. Hinton, L. Deng, D. Yu, G. Dahl, A.-R. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kings-bury, "Deep neural networks for acoustic modeling in speech recognition," IEEE Signal Processing Magazine, 2012.
12. R. Caruana, "Multitask Learning," Machine Learning, Vol. 28, pp. 41-75, Kluwer Academic Publishers, 1997
13. Q. Le, M. Ranzato, R. Monga, M. Devin, K. Chen, G. Corrado, J. Dean, A. Ng, "Building high-level features using large scale unsupervised learning," International Conference in Machine Learning, 2012
14. P. Swietojanski, A. Ghoshal, S. Renals, "Unsupervised crosslingual knowledge transfer in DNN-based LVCSR," in Proc. SLT 2012.
15. T. Schultz and A. Waibel, "Language independent and language adaptive acoustic modeling for speech recognition," in Speech Communication, August 2001, Volume 35, Issue 1-2, pp. 31-51
16. H. Lin, L. Deng, D. Yu, Y. Gong, A. Acero, and C-H Lee, "A study on multilingual acoustic modeling for large vocabulary ASR," in Proc. ICASSP, pp. 4333-4336, 2009
17. T. Niesler, "Language-dependent state clustering for multilingual acoustic modeling," Speech Communication, vol. 49, 2007
18. D. Yu, L. Deng, P. Liu, J. Wu, Y. Gong, A. Acero, "crosslingual speech recognition under runtime resource constraints," in Proc. ICASSP, pp. 4193-4196, 2009
19. L. Burget et al, "Multilingual Acoustic Modeling for Speech Recognition Based on Subspace Gaussian Mixture Models," in Proc. ICASSP, Dallas, 2010
20. A. Stolcke, F. Grzl, M-Y Hwang, X. Lei, N. Morgan, D. Vergyri, "Cross-domain and cross-lingual portability of acoustic features estimated by multilayer perceptrons," in Proc. ICASSP, 2006
21. S. Thomas, S. Ganapathy and H. Hermansky, "Cross-lingual and Multi-stream Posterior Features for Low Resource LVCSR Systems," in Proc. Interspeech, 2010
22. C. Plahl, R. Schlueter and H. Ney, "Cross-lingual portability of Chinese and English neural network features for French and German LVCSR," in Proc. ASRU, USA, 2011
23. N. Vu, W. Breiter, F. Metze, T. Schultz, "An investigation on initialization schemes for multilayer perceptron training using multilingual data and their effect on ASR performance," in Proc. Interspeech, 2012
24. S. Thomas, S. Ganapathy and H. Hermansky, "Multilingual MLP features for low-resource LVCSR systems," in Proc. ICASSP, 2012
25. R. Collobert and J. Weston, "A unified architecture for natural language processing: deep neural networks with multitask learning," in International Conference in Machine Learning, 2008.