Beyond Linguistic Equivalence. An Empirical Study of Translation Evaluation in a Translation Learner Corpus

EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014

Volumn , Issue , 2014, Pages 47-56

  Vela, Mihaela ^a   Schumann, Anne Kathrin ^a   Wurm, Andrea ^a  

^a SAARLAND UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; TRANSLATION (LANGUAGES);

AUTOMATIC EVALUATION; AUTOMATIC TRANSLATION; EMPIRICAL STUDIES; HUMAN EVALUATION; HUMAN EXPERT; LEARNER CORPORA; MT EVALUATIONS; PROPERTY; QUALITY ESTIMATION; TRANSLATION QUALITY;

QUALITY CONTROL;

EID: 84970017327     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. Alexandra Birch, Barry Haddow, Ulrich Germann, Maria Nadejde, Christian Buck, and Philipp Koehn. 2013. The feasibility of HMEANT as a human MT evaluation metric. In Proceedings of the 8th Workshop on SMT, pages 52-61.
2. Ondřej Bojar, Christian Buck, Chris Callison-Burch, Barry Haddow, Philipp Koehn, Christof Monz, Matt Post, Hervé Saint-Amand, Radu Soricut, and Lucia Specia, editors. 2013. Proceedings of the 8th Workshop on SMT. ACL.
3. Chris Callison-Burch, Cameron Fordyce, Philipp Koehn, Christof Monz, and Josh Schroeder. 2007. (Meta-) evaluation of machine translation. In Proceedings of the 2nd Workshop on SMT, pages 136-158.
4. Michael Denkowski and Alon Lavie. 2011. Meteor 1.3: Automatic metric for reliable optimization and evaluation of machine translation systems. In Proceedings of the 6th Workshop on SMT, pages 85-91.
5. Deutsches Institut für Normung. 2006. DIN EN 15038:2006-08: Übersetzungsdienstleistungen-Dienstleistungsanforderungen. Beuth.
6. Dilek Dizdar. 2003. Skopostheorie. In Handbuch Translation, pages 104-107. Stauffenburg.
7. George Doddington. 2002. Automatic evaluation of machine translation quality using n-gram co-occurrence statistics. In Proceedings of the 2nd International Conference on HLT, pages 138-145.
8. Mireia Farrús, Marta R. Costa-Jussà, José B. Mariño, and José A. R. Fonollosa. 2010. Linguistic-based evaluation criteria to identify statistical machine translation errors. In Proceedings of the 14th Annual Conference of the EAMT, pages 167-173.
9. Christian Federmann. 2012. Appraise: An open-source toolkit for manual evaluation of machine translation output. PBML, 98:25-35, 9.
10. Hans Hönig. 2003. Humanübersetzung (therapeutisch vs. diagnostisch). In Handbuch Translation, pages 378-381. Stauffenburg.
11. Brigitte Horn-Helf. 1999. Technisches Übersetzen in Theorie und Praxis. Franke.
12. Paul Kußmaul. 2000. Kreatives Übersetzen. Stauffenburg.
13. Vladimir Iosifovich Levenshtein. 1966. Binary codes capable of correcting deletions, insertions and reversals. Soviet Physics Doklady, 10(8):707-710.
14. Chi-Kiu Lo and Dekai Wu. 2011. MEANT: An inexpensive, high-accuracy, semi-automatic metric for evaluating translation utility based on semantic roles. In Proceedings of the 49th Annual Meeting of the ACL, pages 220-229.
15. Tucker Maney, Linda Sibert, Dennis Perzanowski, Kalyan Gupta, and Astrid Schmidt-Nielsen. 2012. Toward determining the comprehensibility of machine translations. In Proceedings of the 1st PITR, pages 1-7.
16. Elvira Mertin. 2006. Prozessorientiertes Qualitätsmanagement im Dienstleistungsbereich Übersetzen. Peter Lang.
17. Christiane Nord. 2003. Transparenz der Korrektur. In Handbuch Translation, pages 384-387. Stauffenburg.
18. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the ACL, pages 311-318.
19. Maja Popović, Eleftherios Avramidis, Aljoscha Burchardt, Sabine Hunsicker, Sven Schmeier, Cindy Tscherwinka, David Vilar, and Hans Uszkoreit. 2013. Learning from human judgements of machine translation output. In MT Summit, pages 231-238.
20. Lothar Sachs and Jürgen Hedderich. 2009. Angewandte Statistik. Methodensammlung mit R. Springer.
21. Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006. A study of translation edit rate with targeted human annotation. In Proceedings of AMTA, pages 223-231.
22. Matthew Snover, Nitin Madnani, Bonnie Dorr, and Richard Schwartz. 2009. Fluency, adequacy, or HTER? Exploring different human judgments with a tunable MT metric. In Proceedings of the 4th Workshop on SMT, pages 259-268.
23. Society of Automotive Engineers. 2005. SAE J2450:2005-08: Translation Quality Metric. SAE.
24. Harold Somers. 2011. Machine translation: History, development, and limitations. In The Oxford Handbook of Translation Studies, pages 427-440. Oxford University Press.
25. Sara Stymne and Lars Ahrenberg. 2012. On the practice of error analysis for machine translation evaluation. In Proceedings of the 8th LREC, pages 1785-1790.
26. Christoph Tillmann, Stephan Vogel, Hermann Ney, Alexander Zubiaga, and Hassan Sawaf. 1997. Accelerated DP based search for statistical translation. In Proceedings of the EUROSPEECH, pages 2667-2670.
27. Sandra Weiss and Lars Ahrenberg. 2012. Error profiling for evaluation of machine-translated text: a polish-english case study. In Proceedings of the Eighth LREC, pages 1764-1770.
28. Kevin Windle and Anthony Pym. 2011. European thinking on secular translation. In The Oxford Handbook of Translation Studies, pages 7-22. Oxford University Press.
29. Andrea Wurm. 2013. Eigennamen und Realia in einem Korpus studentischer Übersetzungen (KOPTE). trans-kom, 6(2):381-419.