Combination of recurrent neural networks and factored language models for code-switching language modeling

ACL 2013 - 51st Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference

Volumn 2, Issue , 2013, Pages 206-211

  Adel, Heike ^a   Vu, Ngoc Thang ^a   Schultz, Tanja ^a  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

Author keywords

Code switching; Factored language models; Language modeling; Multilingual speech processing; Recurrent neural networks

Indexed keywords

CODES (SYMBOLS); RECURRENT NEURAL NETWORKS; SPEECH PROCESSING;

BACKOFF; CODE-SWITCHING; LANGUAGE INFORMATIONS; LANGUAGE MODEL; LINEAR INTERPOLATION; MULTILINGUAL SPEECH PROCESSING; N-GRAM LANGUAGE MODELS; PART-OF-SPEECH TAGS;

COMPUTATIONAL LINGUISTICS;

EID: 84907341834     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. H. Adel, N.T. Vu, F. Kraus, T. Schlippe, and T. Schultz. 2013 Recurrent Neural Network Language Modeling for Code Switching Conversational Speech In: Proceedings of ICASSP 2013.
2. P. Auer 1999 Code-Switching in Conversation, Routledge.
3. P. Auer 1999 From codeswitching via language mixing to fused lects toward a dynamic typology of bilingual speech In: International Journal of Bilingualism, Vol. 3, no. 4, pp. 309-332.
4. J.A. Bilmes and K. Kirchhoff. 2003 Factored Language Models and Generalized Parallel Backoff In: Proceedings of NAACL, 2003.
5. E.G. Bokamba 1989 Are there syntactic constraints on code-mixing? In: World Englishes, Vol. 8, no. 3, pp. 277-292.
6. J.Y.C. Chan, PC Ching, T. Lee, and H. Cao 2006 Automatic speech recognition of Cantonese-English code-mixing utterances In: Proceeding of Interspeech 2006.
7. K. Duh and K. Kirchhoff. 2004. Automatic Learning of Language Model Structure, pg 148. In: Proceedings of the 20th international conference on Computational Linguistics.
8. A. El-Desoky, R. Schlüter, H. Ney 2010 A Hybrid Morphologically Decomposed Factored Language Models for Arabic LVCSR In: NAACL 2010.
9. D.C. Lyu, T.P. Tan, E.S. Cheng, H. Li 2011 An Analysis of Mandarin-English Code-Switching Speech Corpus: SEAME In: Proceedings of Interspeech 2011.
10. M.P. Marcus, M.A. Marcinkiewicz, and B. Santorini. 1993 Building a large annotated corpus of english: The penn treebank In: Computational Linguistics, Vol. 19, no. 2, pp. 313-330.
11. T. Mikolov, M. Karafiat, L. Burget, J. Jernocky and S. Khudanpur. 2010 Recurrent Neural Network based Language Model In: Proceedings of Interspeech 2010.
12. T. Mikolov, S. Kombrink, L. Burget, J. Jernocky and S. Khudanpur. 2011 Extensions of Recurrent Neural Network Language Model In: Proceedings of ICASSP 2011.
13. P. Muysken 2000 Bilingual speech: A typology of code-mixing In: Cambridge University Press, Vol. 11.
14. I. Oparin, M. Sundermeyer, H. Ney, J.-L. Gauvain 2012 Performance analysis of Neural Networks in combination with n-gram language models In: ICASSP, 2012.
15. S. Poplack 1978 Syntactic structure and social function of code-switching, Centro de Estudios Puertorriquenos, City University of New York.
16. S. Poplack 1980 Sometimes ill start a sentence in spanish y termino en espanol: toward a typology of code-switching In: Linguistics, Vol. 18, no. 7-8, pp. 581-618.
17. R. Rosenfeld 2000 Two decades of statistical language modeling: Where do we go from here? In: Proceedings of the IEEE 88.8 (2000): 1270-1278.
18. T. Schultz, P. Fung, and C. Burgmer, 2010 Detecting code-switch events based on textual features.
19. Y. Shi, P. Wiggers, M. Jonker 2011 Towards Recurrent Neural Network Language Model with Linguistics and Contextual Features In: Proceedings of Interspeech 2011.
20. T. Solorio, Y. Liu 2008 Part-of-speech tagging for English-Spanish code-switched text In: Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2008.
21. T. Solorio, Y. Liu 2008 Learning to predict codeswitching points In: Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2008.
22. K. Toutanova, C.D. Manning 2000 Enriching the knowledge sources used in a maximum entropy part-of-speech tagger In: Proceedings of the 2000 Joint SIGDAT conference on Empirical methods in natural language processing and very large corpora: held in conjunction with the 38th Annual Meeting of the Association for Computational Linguistics, Vol. 13.
23. K. Toutanova, D. Klein, C.D. Manning, and Y. Singer 2003 Feature-rich part-of-speech tagging with a cyclic dependency network In: Proceedings of NAACL 2003.
24. N.T. Vu, D.C. Lyu, J. Weiner, D. Telaar, T. Schlippe, F. Blaicher, E.S. Chng, T. Schultz, H. Li 2012 A First Speech Recognition System For Mandarin-English Code-Switch Conversational Speech In: Proceedings of Interspeech 2012.
25. N.T. Vu, H. Adel, T. Schultz 2013 An Investigation of Code-Switching Attitude Dependent Language Modeling In: In Statistical Language and Speech Processing, First International Conference, 2013.
26. N. Xue, F. Xia, F.D. Chiou, and M. Palmer 2005 The penn chinese treebank: Phrase structure annotation of a large corpusk In: Natural Language Engineering, Vol. 11, no. 2, pp. 207.