CSLM - A modular open-source continuous space language modeling toolkit

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2013, Pages 1198-1202

  Schwenk, Holger ^a  

^a UNIVERSITÉ DU MAINE   (France)

Author keywords

Continuous space methods; Language modeling; Machine translation; Speech recognition

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS; SPEECH RECOGNITION; VOCABULARY CONTROL;

CONTINUOUS SPACES; LANGUAGE MODEL; LARGE VOCABULARY SPEECH RECOGNITION; MACHINE TRANSLATIONS; MODULAR ARCHITECTURES; N-GRAM LANGUAGE MODELS; NATURAL LANGUAGE PROCESSING APPLICATIONS; STATISTICAL MACHINE TRANSLATION;

COMPUTATIONAL LINGUISTICS;

EID: 84906261494     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. S. F. Chen and J. T. Goodman, "An empirical study of smoothing techniques for language modeling, " Computer Speech & Language, vol. 13, no. 4, pp. 359-394, 1999.
2. J. T. Goodman, "A bit of progress in language modeling, " Computer Speech & Language, vol. 15, pp. 403-434, 2001.
3. Y. Bengio and R. Ducharme, "A neural probabilistic language model, " in NIPS, vol. 13, 2001, pp. 932-938.
4. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin, "A neural probabilistic language model, " JMLR, vol. 3, no. 2, pp. 1137- 1155, 2003.
5. S. F. Chen, "Shrinking exponential language models, " in NAACL, 2009.
6. H. Schwenk, "Efficient training of large neural networks for language modeling, " in IJCNN, 2004, pp. 3059-3062.
7. H. Schwenk, "Continuous space language models, " Computer Speech and Language, vol. 21, pp. 492-518, 2007.
8. T. Mikolov, M. Karafit, L. Burget, J. ernock, and S. Khudanpur, "Recurrent neural network based language model, " in Interspeech, 2010, pp. 1045-1048.
9. T. Mikolov, S. Kombrink, L. Burget, J. Cernocky, and S. Khudanpur, "Extensions of recurrent neural network language model, " in ICASSP, 2011, pp. 5528-5531.
10. J. Park, X. Liu, M. J. F. Gales, and P. C. Woodland, "Improved neural network based language modelling and adaptation, " in Interspeech, 2010, pp. 1041-1044.
11. X. Liu, M. J. F. Gales, and P. C. Woodland, "Improving LVCSR system combination using neural network language model cross adaptation, " in Interspeech, 2011, pp. 2857-2860.
12. H.-S. Le, I. Oparin, A. Allauzen, J.-L. Gauvain, and F. Yvon, "Structured output layer neural network language model, " in ICASSP, 2011, pp. 5524-5527.
13. H.-S. Le, I. Oparin, A. Messaoudi, A. Allauzen, J.-L. Gauvain, and F. Yvon, "Large vocabulary SOUL neural network language models, " in Interspeech, 2011.
14. F. Morin and Y. Bengio, "Hierarchical probabilistic neural network language model, " in Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics, 2005.
15. A. Mnih and G. Hinton, "A scalable hierarchical distributed language model, " in NIPS, 2008.
16. P. Xu, A. Gunawardana, and S. Khudanpur, "Efficient subsampling for training complex language models, " in EMNLP, 2011, pp. 1128-1136.
17. H. Schwenk, "Continuous space translation models for phrasebased statistical machine translation, " in Coling, 2012, pp. 1071- 1080.
18. H. Schwenk and J.-L. Gauvain, "Training neural network language models on very large corpora, " in EMNLP, 2005, pp. 201- 208.
19. H. Schwenk, "Continuous space language models for statistical machine translation, " The Prague Bulletin of Mathematical Linguistics, no. 93, pp. 137-146, 2010.
20. H. Schwenk, A. Rousseau, and M. Attik, "Large, pruned or continuous space language models on a GPU for statistical machine translation, " in NAACL-HLT workshop on the Future of Language Modeling for HLT, 2012, pp. 11-19. [Online]. Available: http://www.aclweb.org/anthology/W12-2702.
21. A. Stolcke, "SRILM - An extensible language modeling toolkit, " in ICSLP, 2002, 901-904.
22. K. Heafield, "Ken LM: Faster and smaller language model queries, " in Sixth Workshop on SMT, 2011.
23. F. Bougares, P. Delglise, Y. Estve, and M. Rouvier, "LIUM ASR system for etape french evaluation campaign: experiments on system combination using open-source recognizers, " in International Conference on Text, Speech and Dialogue, 2013.
24. P. Koehn, H. Hoang, A. Birch, C. Callison-Burch, M. Federico, N. Bertoldi, B. Cowan, W. Shen, C. Moran, R. Zens, C. Dyer, O. Bojar, A. Constantin, and E. Herbst, "Moses: Open source toolkit for statistical machine translation, " in ACL, demonstration session, 2007.
25. R. C. Moore and W. Lewis, "Intelligent selection of language model training data, " in ACL, 2010, pp. 220-224.
26. K. Papineni, S. Roukos, T. Ward, and W. Zhu, "BLEU: A method for automatic evaluation of machine translation, " in ACL, 2002, pp. 311-318.