Recurrent neural network language modeling for code switching conversational speech

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2013, Pages 8411-8415

  Adel, Heike ^a   Vu, Ngoc Thang ^a   Kraus, Franziska ^a   Schlippe, Tim ^a   Li, Haizhou ^b   Schultz, Tanja ^a  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

code switching; recurrent neural network language model

Indexed keywords

CODE-SWITCHING; CONVERSATIONAL SPEECH; INPUT LAYERS; LANGUAGE MODEL; MIXED ERRORS; NETWORK LANGUAGE; PART-OF-SPEECH TAGS; TEXTUAL FEATURES;

COMPUTATIONAL LINGUISTICS; RECURRENT NEURAL NETWORKS; SIGNAL PROCESSING; SPEECH RECOGNITION;

SWITCHING;

EID: 84890519772     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2013.6639306     Document Type: Conference Paper

References (25)

1. P. Auer, Code-switching in conversation, Routledge, 1999.
2. T. Mikolov, M. Karafiat, L. Burget, J. Cernocky, and S. Khudanpur, "Recurrent neural network based language model," in Proceedings of Interspeech, 2010.
3. T. Mikolov, S. Kombrink, L. Burget, JH Cernocky, and S. Khudanpur, "Extensions of recurrent neural network language model," in Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on. IEEE, 2011, pp. 5528-5531.
4. Y. Shi, P. Wiggers, and C.M. Jonker, "Towards recurrent neural networks language models with linguistic and contextual features," Interspeech, 2012.
5. S. Poplack, Syntactic structure and social function of codeswitching, vol. 2, Centro de Estudios Puertorriquenos,[City University of New York], 1978.
6. E.G. Bokamba, "Are there syntactic constraints on codemixing?," World Englishes, vol. 8, no. 3, pp. 277-292, 1989.
7. P. Muysken, Bilingual speech: A typology of code-mixing, vol. 11, Cambridge University Press, 2000.
8. P. Auer, "From codeswitching via language mixing to fused lects toward a dynamic typology of bilingual speech," International Journal of Bilingualism, vol. 3, no. 4, pp. 309-332, 1999.
9. S. Poplack, "Sometimes ill start a sentence in spanish y termino en espanol: toward a typology of code-switching1," Linguistics, vol. 18, no. 7-8, pp. 581-618, 1980.
10. T. Solorio and Y. Liu, "Learning to predict code-switching points," in Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2008, pp. 973-981.
11. J.Y.C. Chan, PC Ching, T. Lee, and H. Cao, "Automatic speech recognition of cantonese-english code-mixing utterances," in Proceedings of Interspeech, 2006.
12. N.T. Vu, D.C. Lyu, J. Weiner, D. Telaar, T. Schlippe, F. Blaicher, E.S. Chng, T. Schultz, and H. Li, "A first speech recognition system for mandarin-english code-switch conversational speech," in Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on. IEEE, 2012, pp. 4889-4892.
13. T. Mikolov, S. Kombrink, A. Deoras, L. Burget, and J. Cernock y, "RNNLM-recurrent neural network language modeling toolkit," in Proceedings of the 2011 ASRUWorkshop, 2011, pp. 196-201.
14. D.C. Lyu, T.P. Tan, E.S. Chng, and H. Li, "An analysis of a mandarin-english code-switching speech corpus: Seame," Age, vol. 21, pp. 25-8, 2010.
15. I.T. Schultz, P. Fung, and C. Burgmer, "Detecting code-switch events based on textual features," 2010.
16. K. Toutanova, D. Klein, C.D. Manning, and Y. Singer, "Feature-rich part-of-speech tagging with a cyclic dependency network," in Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology-Volume 1. Association for Computational Linguistics, 2003, pp. 173-180.
17. K. Toutanova and C.D. Manning, "Enriching the knowledge sources used in a maximum entropy part-of-speech tagger," in Proceedings of the 2000 Joint SIGDAT conference on Empirical methods in natural language processing and very large corpora: held in conjunction with the 38th Annual Meeting of the Association for Computational Linguistics-Volume 13. Association for Computational Linguistics, 2000, pp. 63-70.
18. N. Xue, F. Xia, F.D. Chiou, and M. Palmer, "The penn chinese treebank: Phrase structure annotation of a large corpus," Natural Language Engineering, vol. 11, no. 2, pp. 207, 2005.
19. M.P. Marcus, M.A. Marcinkiewicz, and B. Santorini, "Building a large annotated corpus of english: The penn treebank," Computational linguistics, vol. 19, no. 2, pp. 313-330, 1993.
20. N.T. Vu,W. Breiter, F. Metze, and T. Schultz, "An investigation on initialization schemes for multilayer perceptron training using multilingual data and their effect on asr performance," Interspeech, 2012.
21. J. Weiner, N.T. Vu, D. Telaar, F. Metze, T. Schultz, D.-C. Lyu, E.-S. Chng, and H. Li, "Integration of language identification into a recognition system for spoken conversations containing code-switches," in SLTU, 2012.
22. "CMU pronouncation dictionary for english," http://www. speech.cs.cmu.edu/cgi-bin/cmudict.
23. R. Hsiao, M. Fuhs, Y.C. Tam, Q. Jin, and T. Schultz, "The CMU-InterACT 2008 mandarin transcription system," in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, 2008.
24. W. Chen, Y. Tan, E. Chng, and H. Li, "The development of a singapore english call resource," Oriental COCOSDA, Nepal, 2010.
25. A. Stolcke et al., "SRILM-an extensible language modeling toolkit," in Proceedings of the international conference on spoken language processing, 2002, vol. 2, pp. 901-904.