Towards using web-crawled data for domain adaptation in statistical machine translation

Proceedings of the 15th International Conference of the European Association for Machine Translation, EAMT 2011

Volumn , Issue , 2011, Pages 297-304

  Pecina, Pavel ^a   Toral, Antonio ^a   Way, Andy ^a   Papavassiliou, Vassilis ^b   Prokopidis, Prokopis ^b   Giagkou, Maria ^b  

^a DUBLIN CITY UNIVERSITY   (Ireland)

^b INSTITUTE FOR LANGUAGE AND SPEECH PROCESSING   (Greece)

Author keywords

[No Author keywords available]

Indexed keywords

DOMAIN ADAPTATION; DOMAIN SPECIFIC; LANGUAGE MODELLING; LANGUAGE PAIRS; MACHINE TRANSLATIONS; NATURAL ENVIRONMENTS; PARALLEL DATA; STATISTICAL MACHINE TRANSLATION; SYSTEM TUNING; WEB CRAWLING;

LINGUISTICS;

INFORMATION THEORY;

EID: 84857522271     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Ardö, Anders. 2005. Focused crawling in the ALVIS semantic search engine. In Proceedings of the 2nd European Semantic Web Conference, pages 19-20, Heraklion, Greece.
2. Banerjee, Satanjeev and Alon Lavie. 2005. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, pages 65-72, Ann Arbor, Michigan.
3. Banerjee, Pratyush, Jinhua Du, Baoli Li, Sudip Naskar, Andy Way, and Josef van Genabith. 2010. Combining multi-domain statistical machine translation models using automatic classifiers. In AMTA 2010: The Ninth Conference of the Association for Machine Translation in the Americas, pages 141-150.
4. Baroni, M. and S. Bernardini. 2004. Bootcat: Bootstrapping corpora and terms from the web. In Proceedings of the 4th Language Resources and Evaluation Conference, pages 1313-1316, Lisbon.
5. Doddington, George. 2002. Automatic evaluation of machine translation quality using n-gram cooccurrence statistics. In Proceedings of the second international conference on Human Language Technology Research, HLT '02, pages 138-145, San Diego, California.
6. Eck, Matthias, Stephan Vogel, and Alex Waibel. 2004. Language model adaptation for statistical machine translation based on information retrieval. In International Conference on Language Resources and Evaluation, Lisbon, Portugal.
7. Esplà-Gomis, Miquel and Mikel L. Forcada. 2010. Combining content-based and url-based heuristics to harvest aligned bitexts from multilingual sites with bitextor. The Prague Bulletin of Mathemathical Lingustics, 93:77-86.
8. Finch, Andrew and Eiichiro Sumita. 2008. Dynamic model interpolation for statistical machine translation. In Proceedings of the Third Workshop on Statistical Machine Translation, StatMT '08, pages 208-215, Columbus, Ohio, USA.
9. Hildebrand, Almut Silja, Matthias Eck, Stephan Vogel, and Alex Waibel. 2005. Adaptation of the translation model for statistical machine translation based on information retrieval. In Proceedings of the 10th Annual Conference of the European Association for Machine Translation, pages 133-142, Budapest, Hungary.
10. Hua, Wu, Wang Haifeng, and Liu Zhanyi. 2005. Alignment model adaptation for domain-specific word alignment. In 43rd Annual Meeting on Association for Computational Linguistics, ACL '05, pages 467-474, Ann Arbor, Michigan, USA.
11. Koehn, Philipp and Josh Schroeder. 2007. Experiments in domain adaptation for statistical machine translation. In Proceedings of the Second Workshop on Statistical Machine Translation, StatMT '07, pages 224-227, Prague, Czech Republic.
12. Koehn, Philipp, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondřej Bojar, Alexandra Constantin, and Evan Herbst. 2007. Moses: open source toolkit for statistical machine translation. In Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, ACL '07, pages 177-180, Prague, Czech Republic.
13. Koehn, Philipp. 2005. Europarl: A Parallel Corpus for Statistical Machine Translation. In Conference Proceedings: the tenth Machine Translation Summit, pages 79-86, Phuket, Thailand.
14. Kohlschütter, Christian, Peter Fankhauser, and Wolfgang Nejdl. 2010. Boilerplate detection using shallow text features. In Proceedings of the 3rd ACM International Conference on Web Search and Data Mining, pages 441-450, New York.
15. Langlais, Philippe. 2002. Improving a general-purpose statistical translation engine by terminological lexicons. In COLING-02 on COMPUTERM 2002: second international workshop on computational terminology - Volume 14, pages 1-7, Taipei, Taiwan.
16. Munteanu, Dragos Stefan and Daniel Marcu. 2005. Improving machine translation performance by exploiting non-parallel corpora. Comput. Linguist., 31:477-504.
17. Nakov, Preslav. 2008. Improving English-Spanish statistical machine translation: experiments in domain adaptation, sentence paraphrasing, tokenization, and recasing. In Proceedings of the Third Workshop on Statistical Machine Translation, StatMT '08, pages 147-150, Columbus, Ohio, USA.
18. Och, Franz Josef. 2003. Minimum error rate training in statistical machine translation. In 41st Annual Meeting on Association for Computational Linguistics, ACL '03, pages 160-167, Sapporo, Japan.
19. Papineni, Kishore, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a method for automatic evaluation of machine translation. In 40th Annual Meeting on Association for Computational Linguistics, ACL '02, pages 311-318, Philadelphia, USA.
20. Penkale, Sergio, Rejwanul Haque, Sandipan Dandapat, Pratyush Banerjee, Ankit K. Srivastava, Jinhua Du, Pavel Pecina, Sudip Kumar Naskar, Mikel L. Forcada, and Andy Way. 2010. MaTrEx: the DCU MT system for WMT 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 143-148, Uppsala, Sweden.
21. Stolcke, Andreas. 2002. SRILM - an extensible language modeling toolkit. In Proceedings of International Conference on Spoken Language Processing, pages 257-286, Denver, Colorado, USA.
22. Theobald, Martin, Jonathan Siddharth, and Andreas Paepcke. 2008. Spotsigs: robust and efficient near duplicate detection in large web collections. In Proceedings of the 31st Annual International ACM SI-GIR Conference on Research and Development in Information Retrieval, pages 563-570, Singapore.
23. Wu, Hua and Haifeng Wang. 2004. Improving domainspecific word alignment with a general bilingual corpus. In Proceedings of the 6th Conference of the Association for Machine Translation in the Americas, pages 262-271, Washington, DC.