Cutting the long tail: Hybrid language models for translation style adaptation

EACL 2012 - 13th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings

Volumn , Issue , 2012, Pages 439-448

  Bisazza, Arianna ^a   Federico, Marcello ^a  

^a FONDAZIONE BRUNO KESSLER   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; LINGUISTICS; MODELING LANGUAGES;

HYBRID LANGUAGE MODEL; LONG TAIL; PHRASE-BASED STATISTICAL MACHINE TRANSLATION; STATISTICAL MACHINE TRANSLATION; TARGET LANGUAGE; TRAINING DATA;

TRANSLATION (LANGUAGES);

EID: 84904341732     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, pages 65-72, Ann Arbor, Michigan, June. Association for Computational Linguistics.
2. Jerome R. Bellegarda. 2004. Statistical language model adaptation: Review and perspectives. Speech Communication, 42(1):93 - 108.
3. Alexandra Birch, Miles Osborne, and Philipp Koehn. 2007. CCG supertags in factored statistical machine translation. In Proceedings of the Second Workshop on Statistical Machine Translation, pages 9-16, Prague, Czech Republic, June. Association for Computational Linguistics.
4. Arianna Bisazza, Nick Ruiz, and Marcello Federico. 2011. Fill-up versus Interpolation Methods for Phrase-based SMT Adaptation. In International Workshop on Spoken Language Translation (IWSLT), San Francisco, CA.
5. P. F. Brown, V. J. Della Pietra, P. V. de Souza, J. C. Lai, and R. L. Mercer. 1992. Class-based n-gram models of natural language. Computational Linguistics, 18(4):467-479.
6. Mauro Cettolo, Nicola Bertoldi, and Marcello Federico. 2011. Methods for smoothing the optimizer instability in SMT. In MT Summit XIII: The Thirteenth Machine Translation Summit, pages 32-39, Xiamen, China.
7. Jonathan Clark, Chris Dyer, Alon Lavie, and Noah Smith. 2011. Better hypothesis testing for statistical machine translation: Controlling for optimizer instability. In Proceedings of the Association for Computational Lingustics, ACL 2011, Portland, Oregon, USA. Association for Computational Linguistics. available at http://www.cs.cmu.edu/jhclark/pubs/significance.pdf.
8. Mona Diab, Kadri Hacioglu, and Daniel Jurafsky. 2004. Automatic Tagging of Arabic Text: From Raw Text to Base Phrase Chunks. In Daniel Marcu Susan Dumais and Salim Roukos, editors, HLTNAACL 2004: Short Papers, pages 149-152, Boston, Massachusetts, USA, May 2 - May 7. Association for Computational Linguistics.
9. Marcello Federico, Nicola Bertoldi, and Mauro Cettolo. 2008. IRSTLM: An Open Source Toolkit for Handling Large Scale Language Models. In Proceedings of Interspeech, pages 1618-1621, Melbourne, Australia.
10. Marcello Federico, Luisa Bentivogli, Michael Paul, and Sebastian Sẗuker. 2011. Overview of the IWSLT 2011 Evaluation Campaign. In International Workshop on Spoken Language Translation (IWSLT), San Francisco, CA.
11. George Foster and Roland Kuhn. 2007. Mixturemodel adaptation for SMT. In Proceedings of the Second Workshop on Statistical Machine Translation, pages 128-135, Prague, Czech Republic, June. Association for Computational Linguistics.
12. Michel Galley and Christopher D. Manning. 2008. A simple and effective hierarchical phrase reordering model. In EMNLP '08: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 848-856, Morristown, NJ, USA. Association for Computational Linguistics.
13. Christian Hardmeier, Jörg Tiedemann, Markus Saers, Marcello Federico, and Mathur Prashant. 2011. The Uppsala-FBK systems at WMT 2011. In Proceedings of the Sixth Workshop on Statistical Machine Translation, pages 372-378, Edinburgh, Scotland, July. Association for Computational Linguistics.
14. Katrin Kirchhoff and Mei Yang. 2005. Improved language modeling for statistical machine translation. In Proceedings of the ACL Workshop on Building and Using Parallel Texts, pages 125-128, Ann Arbor, Michigan, June. Association for Computational Linguistics.
15. Philipp Koehn and Hieu Hoang. 2007. Factored translation models. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 868- 876, Prague, Czech Republic, June. Association for Computational Linguistics.
16. Philipp Koehn, Amittai Axelrod, Alexandra Birch Mayne, Chris Callison-Burch, Miles Osborne, and David Talbot. 2005. Edinburgh system description for the 2005 IWSLT speech translation evaluation. In Proc. of the International Workshop on Spoken Language Translation, October.
17. P. Koehn, H. Hoang, A. Birch, C. Callison-Burch, M. Federico, N. Bertoldi, B. Cowan, W. Shen, C. Moran, R. Zens, C. Dyer, O. Bojar, A. Constantin, and E. Herbst. 2007. Moses: Open Source Toolkit for Statistical Machine Translation. In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics Companion Volume Proceedings of the Demo and Poster Sessions, pages 177-180, Prague, Czech Republic.
18. Christof Monz. 2011. Statistical Machine Translation with Local Language Models. In Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pages 869-879, Edinburgh, Scotland, UK., July. Association for Computational Linguistics.
19. Preslav Nakov. 2008. Improving English-Spanish Statistical Machine Translation: Experiments in Domain Adaptation, Sentence Paraphrasing, Tokenization, and Recasing. In Workshop on Statistical Machine Translation, Association for Computational Linguistics.
20. Franz Josef Och. 1999. An efficient method for determining bilingual word classes. In Proceedings of the 9th Conference of the European Chapter of the Association for Computational Linguistics (EACL), pages 71-76.
21. Franz Josef Och. 2003. Minimum Error Rate Training in Statistical Machine Translation. In Erhard Hinrichs and Dan Roth, editors, Proceedings of the41st Annual Meeting of the Association for Computational Linguistics, pages 160-167.
22. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association of Computational Linguistics (ACL), pages 311-318, Philadelphia, PA.
23. Stefan Riezler and John T. Maxwell. 2005. On some pitfalls in automatic evaluation and significance testing for MT. In Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, pages 57-64, Ann Arbor, Michigan, June. Association for Computational Linguistics.
24. R. Rosenfeld. 2000. Two decades of statistical language modeling: Where do we go from here? Proceedings of the IEEE, 88(8):1270 -1278.
25. Nick Ruiz and Marcello Federico. 2011. Topic adaptation for lecture translation through bilingual latent semantic models. In Proceedings of the Sixth Workshop on Statistical Machine Translation, pages 294-302, Edinburgh, Scotland, July. Association for Computational Linguistics.
26. Nick Ruiz, Arianna Bisazza, Fabio Brugnara, Daniele Falavigna, Diego Giuliani, Suhel Jaber, Roberto Gretter, and Marcello Federico. 2011. FBK @ IWSLT 2011. In International Workshop on Spoken Language Translation (IWSLT), San Francisco, CA.
27. Helmut Schmid. 1994. Probabilistic part-of-speech tagging using decision trees. In Proceedings of International Conference on New Methods in Language Processing.
28. Matthew Snover, Bonnie Dorr, Rich Schwartz, Linnea Micciulla, and John Makhoul. 2006. A study of translation edit rate with targeted human annotation. In 5th Conference of the Association for Machine Translation in the Americas (AMTA), Boston, Massachusetts, August.
29. Christoph Tillmann. 2004. A Unigram Orientation Model for Statistical Machine Translation. In Proceedings of the Joint Conference on Human Language Technologies and the Annual Meeting of the North American Chapter of the Association of Computational Linguistics (HLT-NAACL).
30. A. Yazgan and M. Saraclar. 2004. Hybrid language models for out of vocabulary word detection in large vocabulary conversational speech recognition. In Proceedings of ICASSP, volume 1, pages 745-748 vol.1, may.