TerrorCat: A Translation Error Categorization-based MT Quality Metric

WMT 2012 - 7th Workshop on Statistical Machine Translation, Proceedings of the Workshop

Volumn , Issue , 2012, Pages 64-70

  Fishel, Mark ^a   Sennrich, Rico ^a   Popovi´, Maja ^b   Bojar, Onďrej ^c  

^a UNIVERSITY OF ZURICH   (Switzerland)

^b GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

^c CHARLES UNIVERSITY   (Czech Republic)

Author keywords

[No Author keywords available]

Indexed keywords

MACHINE TRANSLATION;

ERROR CATEGORIZATIONS; HUMAN JUDGMENTS; PAIR-WISE COMPARISON; QUALITY METRICES; SYSTEM LEVELS;

COMPUTATIONAL LINGUISTICS;

EID: 85104444252     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Chris Callison-Burch, Philipp Koehn, Christof Monz, Kay Peterson, Mark Przybocki, and Omar Zaidan. 2010. Findings of the 2010 joint workshop on statistical machine translation and metrics for machine translation. In Proceedings of the Joint FifthWorkshop on Statistical Machine Translation and MetricsMATR, pages 17-53, Uppsala, Sweden.
2. Daniel Dahlmeier, Chang Liu, and Hwee Tou Ng. 2011. Tesla at wmt 2011: Translation evaluation and tunable metric. In Proceedings of the Sixth Workshop on Statistical Machine Translation, pages 78-84, Edinburgh, Scotland.
3. Mark Fishel, Onďrej Bojar, and Maja Popovíc. 2012. Terra: a collection of translation error-annotated corpora. In Proceedings of the 8th LREC, page in print, Istanbul, Turkey.
4. Mark Hall, Eibe Frank, Geoffrey Holmes, Bernhard Pfahringer, Peter Reutemann, and Ian H. Witten. 2009. The weka data mining software: An update. SIGKDD Explorations, 11.
5. Thorsten Joachims. 2006. Training linear SVMs in linear time. In Proceedings of the ACM Conference on Knowledge Discovery and Data Mining (KDD), Philadelphia, USA.
6. Percy Liang, Ben Taskar, and Dan Klein. 2006. Alignment by agreement. In Proceedings of the HLTNAACL Conference, pages 104-111, New York, NY.
7. Kishore Papineni, Salim Roukos, Todd Ward, and Wei- Jing Zhu. 2002. Bleu: A method for automatic evaluation of machine translation. In ACL '02: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, pages 311-318, Morristown, NJ, USA. Association for Computational Linguistics.
8. Kristen Parton, Joel Tetreault, Nitin Madnani, and Martin Chodorow. 2011. E-rating machine translation. In Proceedings of the Sixth Workshop on Statistical Machine Translation, pages 108-115, Edinburgh, Scotland.
9. John C. Platt. 1998. Using analytic qp and sparseness to speed training of support vector machines. In Proceedings of Neural Information Processing Systems 11, pages 557-564, Denver, CO.
10. Maja Popovíc and Hermann Ney. 2011. Towards automatic error analysis of machine translation output. Computational Linguistics, 37(4):657-688.
11. Helmut Schmid. 1995. Improvements in part-of-speech tagging with an application to german. In Proceedings of the ACL SIGDAT-Workshop, Dublin, Ireland.
12. Drahoḿira Spoustova, Jan Hajǐc, Jan Votrubec, Pavel Krbec, and Pavel Kvˇetǒn. 2007. The best of two worlds: Cooperation of statistical and rule-based taggers for Czech. In Proceedings of the Workshop on Balto- Slavonic Natural Language Processing, ACL 2007, pages 67-74, Praha.
13. Daniel Zeman, Mark Fishel, Jan Berka, and Onďrej Bojar. 2011. Addicter: What is wrong with my translations? The Prague Bulletin of Mathematical Linguistics, 96:79-88.