Multilingual hierarchical MRASTA features for ASR

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2013, Pages 2222-2226

  Tüske, Zoltán ^a   Schlüter, Ralf ^a   Ney, Hermann ^a,b  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b UFR 919 Laboratoire d'Informatique Pour la Mécanique et les Sciences de l'Ingénieur   (France)

Author keywords

Bottleneck; Deep MLP; Hierarchical; LVCSR; MRASTA; Multilingual

Indexed keywords

FEATURE EXTRACTION; SPEECH RECOGNITION;

BOTTLENECK; DEEP MLP; HIERARCHICAL; LVCSR; MRASTA; MULTILINGUAL;

HIERARCHICAL SYSTEMS;

EID: 84906215094     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. A. Stolcke, F. Grezl, M.-Y. Hwang, X. Lei, N. Morgan, and D. Vergyri, "Cross-domain and cross-language portability of acoustic features estimated by multilayer perceptrons, " in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2006, pp. 321-324.
2. O. Cetin, M. Magimai-Doss, K. Livescu, A. Kantor, S. King, C. Bartels, and J. Frankel, "Monolingual and cross lingual comparison of tandem features derived from articulatory and phone MLPs, " in Proc. of IEEE Automatic Speech Recognition and Understanding Workshop, 2007, pp. 36-41.
3. C. Plahl, R. Schluter, and H. Ney, "Cross-lingual Portability of Chinese and English Neural Network Features for French and German LVCSR, " in Proc. of IEEE Automatic Speech Recognition and Understanding Workshop, 2011, pp. 371-376.
4. L. Toth, J. Frankel, G. Gosztolya, and S. King, "Cross-lingual Portability of MLP-Based Tandem Features-A Case Study for English and Hungarian, " in Proc. of Interspeech, 2008, pp. 2695- 2698.
5. F. Grezl, M. Karafiat, and M. Janda, "Study of probabilistic and bottle-neck features in multilingual environment, " in Proc. of IEEE Automatic Speech Recognition and Understanding Workshop, 2011, pp. 359-364.
6. Z. Tuske, J. Pinto, D. Willett, and R. Schluter, "Investigation on cross- And multilingual MLP features under matched and mismatched acoustical conditions, " in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2013, accepted for publication.
7. N. T. Vu, W. Breiter, F. Metze, and T. Schultz, "An Investigation on Initialization Schemes for Multilayer Perceptron Training Using Multilingual Data and Their Effect on ASR Performance, " in Proc. of Interspeech, 2012.
8. S. Thomas, S. Ganapathy, and H. Hermansky, "Multilingual MLP features for low-resource LVCSR systems, " in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2012, pp. 4269-4272.
9. H. Hermansky, D. P. Ellis, and S. Sharma, "Tandem connectionist feature extraction for conventional HMM systems, " in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, vol. 3, 2000, pp. 1635-1638.
10. F. Grezl, M. Karafiat, S. Kontar, and J. Cernocky, "Probabilistic and bottle-neck features for LVCSR of meetings, " in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2007, pp. 757-760.
11. T. Schultz and A. Waibel, "Fast Bootstrapping Of LVCSR Systems With Multilingual Phoneme Sets, " in Proc of Eurospeech, 1997.
12. H. Lin, L. Deng, D. Yu, Y. Gong, A. Acero, and C.-H. Lee, "A study on multilingual acoustic modeling for large vocabulary ASR, " in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2009, pp. 4333-4336.
13. D. Imseng, H. Bourlard, and M. Magimai-Doss, "Towards mixed language speech recognition systems, " in Proc. of Interspeech, 2010, pp. 278-281.
14. T. Schultz and A. Waibel, "Development of Multilingual Acoustic Models in the Global Phone Project, " in Proc. ofWorkshop on Text, Speech, and Dialogue, 1998.
15. W. Byrne, P. Beyerlein, J. M. Huerta, S. Khudanpur, B. Marthi, J. Morgan, N. Peterek, J. Picone, D. Vergyri, and W. Wang, "Towards language independent acoustic modeling, " in Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 2, 2000, pp. 1029-1032.
16. S. Thomas, S. Ganapathy, and H. Hermansky, "Cross-lingual and multi stream posterior features for low resource LVCSR systems, " in Proc. of Interspeech, 2010, pp. 877-880.
17. S. Scanzio, P. Laface, L. Fissore, R. Gemello, and F. Mana, "On the Use of a Multilingual Neural Network Front-End, " in Proc. of Interspeech, 2008, pp. 2711-2714.
18. L. Burget, P. Schwarz, M. Agarwal, P. Akayazi, K. Feng, A. Ghoshal, O. Glembek, N. Goel, M. Karafiat, D. Povey, A. Rastrow, R. C. Rose, and S. Thomas, "Multilingual acoustic modeling for speech recognition based on subspace Gaussian mixture models, " in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2013, 2010, pp. 4334-4337.
19. K. Vesely, M. Karafiat, F. Grezl, M. Janda, and E. Egorova, "The language-independent bottleneck features, " in Proc. of IEEE Workshop on Spoken Language Technology, 2012, pp. 336-341.
20. H. Hermansky and P. Fousek, "Multi-resolution RASTA filtering for TANDEM-based ASR, " in Proc. of Interspeech, 2005, pp. 361-364.
21. C. Plahl, R. Schluter, and H. Ney, "Hierarchical Bottle Neck Features for LVCSR, " in Proc. of Interspeech, 2010, pp. 1197-1200.
22. F. Seide, G. Li, and D. Yu, "Conversational Speech Transcription Using Context-Dependent Deep Neural Networks, " in Proc of Interspeech, 2011, pp. 437-440.
23. T. N. Sainath, B. Kingsbury, and B. Ramabhadran, "Auto-encoder bottleneck features using deep belief networks, " in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2012, pp. 4153-4156.
24. Z. Tuske, R. Schluter, and H. Ney, "Deep hierarchical bottleneck MRASTA features for LVCSR, " in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2013, accepted for publication.
25. M. Nußbaum-Thom, S. Wiesler, M. Sundermeyer, C. Plahl, S. Hahn, R. Schluter, and H. Ney, "The RWTH 2009 QUAERO ASR evaluation system for English and German, " in Proc. of Interspeech, 2010, pp. 1517-1520.
26. M. Sundermeyer, M. Nußbaum-Thom, S.Wiesler, C. Plahl, A.-D. Mousa, S. Hahn, D. Nolden, R. Schluter, and H. Ney, "The RWTH 2010 QUAERO ASR Evaluation System for English, French, and German, " in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2011, pp. 2212-2215.
27. F. Valente and H. Hermansky, "Hierarchical and parallel processing of modulation spectrum for ASR applications, " in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2008, pp. 4165-4168.
28. D. Rybach, S. Hahn, P. Lehnen, D. Nolden, M. Sundermeyer, Z. Tuske, S. Wiesler, R. Schluter, and H. Ney, "RASR - The RWTH Aachen University Open Source Speech Recognition Toolkit, " in Proc. of IEEE Automatic Speech Recognition and Understanding Workshop, 2011.
29. M. J. F. Gales, "Maximum likelihood linear transformations for HMM-based speech recognition, " Computer Speech and Language, vol. 12, pp. 75-98, 1998.
30. G. Stemmer, F. Brugnara, and D. Giuliani, "Adaptive training using simple target models, " in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, vol. 1, 2005, pp. 997-1000.
31. M. A. B. Shaik, A. E.-D. Mousa, R. Schluter, and H. Ney, "Hybrid language models using mixed types of sub-lexical units for open vocabulary German LVCSR, " in Proc. of Interspeech, 2011, pp. 1441-1444.
32. M. A. B. Shaik, A. E.-D. Mousa, R. Schluter, and H. Ney, "Using morpheme and syllable based sub-words for Polish LVCSR, " in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2011, pp. 4680-4683.