Class-Based language modeling for translating into morphologically rich languages

COLING 2014 - 25th International Conference on Computational Linguistics, Proceedings of COLING 2014: Technical Papers

Volumn , Issue , 2014, Pages 1918-1927

  Bisazza, Arianna ^a   Monz, Christof ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER AIDED LANGUAGE TRANSLATION; LINGUISTICS; MODELING LANGUAGES; SPEECH TRANSMISSION; TRANSLATION (LANGUAGES);

CLASS-BASED; CLASS-BASED LANGUAGE MODEL; COMBINATION METHOD; DATA SPARSITY; EFFECTIVE APPROACHES; N-GRAM MODELING; STATISTICAL MACHINE TRANSLATION; TRANSLATION QUALITY;

COMPUTATIONAL LINGUISTICS;

EID: 84925992796     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (37)

1. Waleed Ammar, Victor Chahuneau, Michael Denkowski, Greg Hanneman, Wang Ling, Austin Matthews, Kenton Murray, Nicola Segall, Alon Lavie, and Chris Dyer. 2013. The CMU machine translation systems at WMT 2013: Syntax, synthetic translation options, and pseudo-references. In Proceedings of the Eighth Workshop on Statistical Machine Translation, pages 70-77, Sofia, Bulgaria, August. Association for Computational Linguistics.
2. Lalit R. Bahl, Peter F. Brown, Peter V. de Souza, Robert L. Mercer, and David Nahamoo. 1991. A fast algorithm for deleted interpolation. In Eurospeech. ISCA.
3. Alexandra Birch, Miles Osborne, and Philipp Koehn. 2007. CCG supertags in factored statistical machine translation. In Proceedings of the Second Workshop on Statistical Machine Translation, pages 9-16, Prague, Czech Republic, June. Association for Computational Linguistics.
4. Arianna Bisazza and Marcello Federico. 2012. Cutting the long tail: Hybrid language models for translation style adaptation. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, pages 439-448, Avignon, France, April. Association for Computational Linguistics.
5. Onɱrej Bojar, Christian Buck, Chris Callison-Burch, Christian Federmann, Barry Haddow, Philipp Koehn, Christof Monz, Matt Post, Radu Soricut, and Lucia Specia. 2013. Findings of the 2013Workshop on Statistical Machine Translation. In Proceedings of the Eighth Workshop on Statistical Machine Translation, pages 1-44, Sofia, Bulgaria, August. Association for Computational Linguistics.
6. Peter F. Brown, Peter V. deSouza, Robert L. Mercer, Vincent J. Della Pietra, and Jenifer C. Lai. 1992. Class-based n-gram models of natural language. Computational Linguistics, 18(4):467-479.
7. Simon Carter and Christof Monz. 2011. Syntactic discriminative language model rerankers for statistical machine translation. Machine Translation, 25(4):317-339.
8. Victor Chahuneau, Eva Schlinger, Noah A. Smith, and Chris Dyer. 2013. Translating into morphologically rich languages with synthetic phrases. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 1677-1687, Seattle, Washington, USA, October. Association for Computational Linguistics.
9. Stanley F. Chen and Joshua Goodman. 1999. An empirical study of smoothing techniques for language modeling. Computer Speech and Language, 4(13):359-393.
10. Colin Cherry, Robert C. Moore, and Chris Quirk. 2012. On hierarchical re-ordering and permutation parsing for phrase-based decoding. In Proceedings of the Seventh Workshop on Statistical Machine Translation, pages 200-209, Montŕeal, Canada, June. Association for Computational Linguistics.
11. Nadir Durrani, Philipp Koehn, Helmut Schmid, and Alexander Fraser. 2014. Investigating the usefulness of generalized word representations in SMT. In Proceedings of the 25th International Conference on Computational Linguistics (COLING), Dublin, Ireland, August.
12. Chris Dyer, Kevin Gimpel, Jonathan H. Clark, and Noah A. Smith. 2011. The CMU-ARK German-English Translation System. In Proceedings of the Sixth Workshop on Statistical Machine Translation, pages 337-343, Edinburgh, Scotland, July. Association for Computational Linguistics.
13. George Foster and Roland Kuhn. 2007. Mixture-model adaptation for SMT. In Proceedings of the Second Workshop on Statistical Machine Translation, pages 128-135, Prague, Czech Republic, June. Association for Computational Linguistics.
14. Michel Galley and Christopher D. Manning. 2008. A simple and effective hierarchical phrase reordering model. In EMNLP '08: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 848-856, Morristown, NJ, USA. Association for Computational Linguistics.
15. Michel Galley and Christopher D. Manning. 2009. Quadratic-time dependency parsing for machine translation. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pages 773-781, Suntec, Singapore, August. Association for Computational Linguistics.
16. Joshua T. Goodman. 2001. A bit of progress in language modeling. Computer Speech & Language, 15(4):403- 434.
17. Spence Green and John DeNero. 2012. A class-based agreement model for generating accurately inflected translations. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, ACL '12, pages 146-155, Stroudsburg, PA, USA. Association for Computational Linguistics.
18. Səsa Hasan, Oliver Bender, and Hermann Ney. 2006. Reranking translation hypotheses using structural properties. In Proceedings of the EACL'06 Workshop on Learning Structured Information in Natural Language Applications, pages 41-48, Trento, Italy, April.
19. Hany Hassan, Khalil Sima'an, and Andy Way. 2007. Supertagged phrase-based statistical machine translation. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 288-295, Prague, Czech Republic, June. Association for Computational Linguistics.
20. Mark Hopkins and Jonathan May. 2011. Tuning as ranking. In Proceedings of 2011 Conference on Empirical Methods in Natural Language Processing (EMNLP'11).
21. Philipp Koehn, Franz Josef Och, and Daniel Marcu. 2003. Statistical phrase-based translation. In Proceedings of HLT-NAACL 2003, pages 127-133, Edmonton, Canada.
22. Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, and Evan Herbst. 2007. Moses: Open Source Toolkit for Statistical Machine Translation. In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics Companion Volume Proceedings of the Demo and Poster Sessions, pages 177-180, Prague, Czech Republic. Association for Computational Linguistics.
23. Abby Levenberg and Miles Osborne. 2009. Stream-based randomised language models for SMT. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 2 - Volume 2, EMNLP '09, pages 756-764, Stroudsburg, PA, USA. Association for Computational Linguistics.
24. Christof Monz. 2011. Statistical Machine Translation with Local Language Models. In Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pages 869-879, Edinburgh, Scotland, UK., July. Association for Computational Linguistics.
25. Thomas Muller, Hinrich Schutze, and Helmut Schmid. 2012. A comparative investigation of morphological language modeling for the languages of the European Union. In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 386-395, Montŕeal, Canada, June. Association for Computational Linguistics.
26. Eric W. Noreen. 1989. Computer Intensive Methods for Testing Hypotheses. An Introduction. Wiley-Interscience.
27. Franz Josef Och. 1999. An efficient method for determining bilingual word classes. In Proceedings of the 9th Conference of the European Chapter of the Association for Computational Linguistics (EACL), pages 71-76.
28. Franz Josef Och. 2003. Minimum error rate training in statistical machine translation. In Erhard Hinrichs and Dan Roth, editors, Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pages 160-167.
29. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association of Computational Linguistics (ACL), pages 311-318, Philadelphia, PA.
30. Stefan Riezler and John T. Maxwell. 2005. On some pitfalls in automatic evaluation and significance testing for MT. In Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, pages 57-64, Ann Arbor, Michigan, June. Association for Computational Linguistics.
31. Hinrich Schutze and Michael Walsh. 2011. Half-context language models. Comput. Linguist., 37(4):843-865, December.
32. Lane Schwartz, Chris Callison-Burch, William Schuler, and Stephen Wu. 2011. Incremental syntactic language models for phrase-based translation. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 620-631, Portland, Oregon, USA, June. Association for Computational Linguistics.
33. Jakob Uszkoreit and Thorsten Brants. 2008. Distributed word clustering for large scale class-based language modeling in machine translation. In Proceedings of ACL-08: HLT, pages 755-762, Columbus, Ohio, June. Association for Computational Linguistics.
34. Philip Williams and Philipp Koehn. 2011. Agreement constraints for statistical machine translation into German. In Proceedings of the Sixth Workshop on Statistical Machine Translation, pages 217-226, Edinburgh, Scotland, July. Association for Computational Linguistics.
35. Ian H. Witten and Timothy C. Bell. 1991. The zero-frequency problem: Estimating the probabilities of novel events in adaptive text compression. IEEE Trans. Inform. Theory, IT-37(4):1085-1094.
36. Joern Wuebker, Stephan Peitz, Felix Rietig, and Hermann Ney. 2013. Improving statistical machine translation with word class models. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 1377-1381, Seattle, Washington, USA, October. Association for Computational Linguistics.
37. Ali Yazgan and Murat Saraçlar. 2004. Hybrid language models for out of vocabulary word detection in large vocabulary conversational speech recognition. In Proceedings of ICASSP, volume 1, pages I - 745-8 vol.1, may.