DNN acoustic modeling with modular multi-lingual feature extraction networks

2013 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2013 - Proceedings

Volumn , Issue , 2013, Pages 344-349

  Gehring, Jonas ^a   Nguyen, Quoc Bao ^a   Metze, Florian ^b   Waibel, Alex ^a,b  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

^b Carnegie Mellon University ^*  (United States)

Author keywords

Deep Neural Networks; Large Vocabulary Speech Recognition; Low Resource Acoustic Modeling; Multi Lingual Acoustic Modeling

Indexed keywords

ACOUSTIC FEATURES; ACOUSTIC MODEL; ACOUSTIC MODEL TRAININGS; CONVERSATIONAL TELEPHONE SPEECH; DEEP NEURAL NETWORKS; FEATURE EXTRACTOR; HIGH-LEVEL FEATURES; MULTIPLE LANGUAGES;

FEATURE EXTRACTION; NEURAL NETWORKS; SPEECH RECOGNITION; SPEECH TRANSMISSION;

LINGUISTICS;

EID: 84893642465     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2013.6707754     Document Type: Conference Paper

References (28)

1. A. Waibel, T. Hanazawa, G.E. Hinton, K. Shikano, and K.J. Lang, "Phoneme recognition using time-delay neural networks, " Acoustics, Speech and Signal Processing, IEEE Transactions on, vol. 37, no. 3, pp. 328-339, 1989. (Pubitemid 19065785)
2. R.P. Lippmann, "Review of neural networks for speech recognition, " Neural computation, vol. 1, no. 1, pp. 1-38, 1989.
3. H.A. Bourlard and N. Morgan, Connectionist speech recognition: A hybrid approach, vol. 247, Springer, 1994.
4. P. Haffner and A. Waibel, "Multi-state time delay neural networks for continuous speech recognition, " Advances in Neural Information Processing Systems, pp. 135-135, 1993.
5. G.E. Dahl, D. Yu, L. Deng, and A. Acero, "Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 20, no. 1, pp. 30-42, 2012.
6. F. Seide, G. Li, and D. Yu, "Conversational speech transcription using context-dependent deep neural networks, " in Proc. Interspeech, 2011, pp. 437-440.
7. K. Vesely, M. Karafiát, F. Grezl, M. Janda, and E. Egorova, "The language-independent bottleneck features, " in Spoken Language Technology Workshop (SLT), 2012 IEEE. IEEE, 2012, pp. 336-341.
8. G Heigold, V Vanhoucke, A Senior, P Nguyen, M Ranzato, M Devin, and J Dean, "Multilingual acoustic models using distributed deep neural networks, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, 2013.
9. A Waibel, H Sawai, and K Shikano, "Modularity and scaling in large phonemic neural networks, " Acoustics, Speech and Signal Processing, IEEE Transactions on, vol. 37, no. 12, pp. 1888-1898, 1989. (Pubitemid 20642700)
10. Hynek Hermansky, Sangita Sharma, and Pratibha Jain, "Dataderived nonlinear mapping for feature extraction in hmm, " in Proc. ASRU. Citeseer, 1999, vol. 99.
11. F. Valente, M. Magimai-Doss, C. Plahl, and S.V. Ravuri, "Hierarchical processing of the modulation spectrum for GALE Mandarin LVCSR system., " in Proc. Interspeech, 2009, pp. 2963-2966.
12. J. Gehring, W. Lee, K. Kilgour, I. Lane, Y. Miao, and A. Waibel, "Modular combination of deep neural networks for acoustic modeling, " in Proc. Interspeech, 2013, to appear.
13. P. Swietojanski, A. Ghoshal, and S. Renals, "Unsupervised cross-lingual knowledge transfer in DNN-based LVCSR, " in Spoken Language Technology Workshop (SLT), 2012 IEEE. IEEE, 2012, pp. 246-251.
14. F. Grézl, M. Karafiát, S. Kontár, and J. Cernocky, "Probabilistic and bottle-neck features for LVCSR of meetings, " in Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on. IEEE, 2007, vol. 4, pp. IV-757.
15. J Gehring, Y Miao, F Metze, and A Waibel, "Extracting deep bottleneck features using stacked auto-encoders, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013.
16. Y Bengio, P Lamblin, D Popovici, and H Larochelle, "Greedy layer-wise training of deep networks, " Advances in neural information processing systems, vol. 19, pp. 153, 2007.
17. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P.A. Manzagol, "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion, " The Journal of Machine Learning Research, vol. 11, pp. 3371- 3408, 2010.
18. N.T. Vu, W. Breiter, F. Metze, and T. Schultz, "An investigation on initialization schemes for multilayer perceptron training using multilingual data and their effect on ASR performance, " in Proc. Interspeech, 2012.
19. S. Scanzio, P. Laface, L. Fissore, R. Gemello, and F. Mana, "On the use of a multilingual neural network front-end., " in Proc. Interspeech, 2008, pp. 2711-2714.
20. D. Yu, L. Deng, and G. Dahl, "Roles of pre-training and finetuning in context-dependent dbn-hmms for real-world speech recognition, " in Proc. NIPS Workshop on Deep Learning and Unsupervised Feature Learning, 2010.
21. K. Kilgour, T. Seytzer, Q.B. Nguyen, and A. Waibel, "Warped minimum variance distortionless response based bottle neck features for LVCSR, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, 2013.
22. A. Ghoshal, P. Swietojanski, and S. Renals, "Multilingual training of deep-neural netowrks, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, 2013.
23. K Laskowski, MHeldner, and J Edlund, "The fundamental frequency variation spectrum, " Proceedings of FONETIK 2008, pp. 29-32, 2008.
24. F. Metze, Z.A. Sheik, A. Waibel, J. Gehring, K. Kilgour, Q.B. Nguyen, and V.H. Nguyen, "Models of tone for tonal and non-tonal languages, " in Automatic Speech Recognition and Understanding (ASRU), 2011 IEEE Workshop on. IEEE, 2013, submitted for review.
25. "IARPA, Office for Incisive Analysis, Babel Program, " http://www.iarpa.gov/Programs/ia/Babel/babel.html Retrieved 2013-06-29.
26. M. Finke, P. Geutner, H. Hild, T. Kemp, K. Ries, and M.Westphal, "The Karlsruhe-Verbmobil speech recognition engine, " in Acoustics, Speech, and Signal Processing, 1997. ICASSP- 97., 1997 IEEE International Conference on. IEEE, 1997, vol. 1, pp. 83-86.
27. J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, and Y. Bengio, "Theano: A CPU and GPU Math Expression Compiler, " in Proceedings of the Python for Scientific Computing Conference (SciPy), June 2010, Oral Presentation.
28. Jinyu Li, Dong Yu, Jui-Ting Huang, and Yifan Gong, "Improving wideband speech recognition using mixed-bandwidth training data in CD-DNN-HMM, " in Spoken Language Technology Workshop (SLT), 2012 IEEE. IEEE, 2012, pp. 131-136.