Exploiting objective annotations for measuring translation post-editing effort

Proceedings of the 15th International Conference of the European Association for Machine Translation, EAMT 2011

Volumn , Issue , 2011, Pages 73-80

  Specia, Lucia ^a  

^a UNIVERSITY OF WOLVERHAMPTON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BAD QUALITY; HUMAN ANNOTATIONS; LEARNING QUALITY; MACHINE TRANSLATION SYSTEMS; OVERALL QUALITY; TASK-BASED;

INFORMATION THEORY;

HUMAN FORM MODELS;

EID: 84855681615     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Blatz, John, Erin Fitzgerald, George Foster, Simona Gandrabur, Cyril Goutte, Alex Kulesza, Alberto Sanchis, and Nicola Ueffing. 2004. Confidence Estimation for Machine Translation. In Proceedings of the 20th Conference on Computational Linguistics, pages 315-321, Geneva, Switzerland.
2. Callison-Burch, Chris, Philipp Koehn, Christof Monz, Kay Peterson, Mark Przybocki, and Omar Zaidan. 2010. Findings of the 2010 joint workshop on statistical machine translation and metrics for machine translation. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 17-53, Uppsala, Sweden.
3. Chang, Chih-Chung and Chih-Jen Lin, 2001. LIBSVM: a library for support vector machines. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm.
4. Doddington, George. 2002. Automatic Evaluation of Machine Translation Quality Using N-gram Cooccurrence Statistics. In Proceedings of the 2nd International Conference on Human Language Technology, pages 138-145, San Diego, California.
5. He, Yifan, Yanjun Ma, Josef van Genabith, and Andy Way. 2010. Bridging SMT and TM with Translation Recommendation. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 622-630, Uppsala, Sweden.
6. Koehn, Philipp, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondřej Bojar, Alexandra Constantin, and Evan Herbst. 2007. Moses: open source toolkit for statistical machine translation. In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics: Demo and Poster Sessions, pages 177-180, Prague, Czech Republic.
7. Och, Franz Josef and Herman Ney. 2003. A Systematic Comparison of Various Statistical Alignment Models. Computational Linguistics, 29(1): 19-51.
8. Papineni, Kishore, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a Method for Automatic Evaluation of Machine Translation. In 40th Annual Meeting of the Association for Computational Linguistics, pages 311-318, Philadelphia, Pennsylvania.
9. Quirk, Chris. 2004. Training a Sentence-Level Machine Translation Confidence Measure. In Proceedings of the 4th Conference on Language Resources and Evaluation, pages 825-828, Lisbon, Portugal.
10. Snover, Matthew, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006. A Study of Translation Edit Rate with Targeted Human Annotation. In Proceedings of the 7th Conference of the Association for Machine Translation in the Americas (AMTA), pages 223-231.
11. Snover, Matthew, Nitin Madnani, Bonnie Dorr, and Richard Schwartz. 2010. TER-Plus: Paraphrase, Semantic, and Alignment Enhancements to Translation Edit Rate. Machine Translation, 23(2-3): 117-127.
12. Soricut, Radu and Abdessamad Echihabi. 2010. Trustrank: Inducing trust in automatic translations via ranking. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 612-621, Uppsala, Sweden.
13. Specia, Lucia and Atefeh Farzindar. 2010. Estimating machine translation post-editing effort with hter. In Proceedings of the AMTA-2010 Workshop Bringing MT to the User: MT Research and the Translation Industry, Denver, Colorado.
14. Specia, Lucia, Marco Turchi, Nicola Cancedda, Marc Dymetman, and Nello Cristianini. 2009a. Estimating the Sentence-Level Quality of Machine Translation Systems. In Proceedings of the 13th Conference of the European Association for Machine Translation, pages 28-37, Barcelona, Spain.
15. Specia, Lucia, Marco Turchi, Zhuoran Wang, John Shawe-Taylor, and Craig Saunders. 2009b. Improving the confidence of machine translation quality estimates. In Proceedings of the Machine Translation Summit XII, Ottawa, Canada.
16. Specia, Lucia, Nicola Cancedda, and Marc Dymetman. 2010. A dataset for assessing machine translation evaluation metrics. In Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'IO), Valletta, Malta.
17. Tillmann, Christoph, Stefan Vogel, Hermann Ney, A. Zubiaga, and H. Sawaf. 1997. Accelerated DP based Search for Statistical Translation. In Proceedings of the European Conference on Speech Communication and Technology, pages 2667-2670, Rhodes, Greece.