Regression and Ranking based Optimisation for Sentence Level Machine Translation Evaluation

WMT 2011 - 6thWorkshop on Statistical Machine Translation, Proceedings of the Workshop

Volumn , Issue , 2011, Pages 123-129

  Song, Xingyi ^a   Cohn, Trevor ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; MACHINE TRANSLATION; OPTIMIZATION;

'CURRENT; AUTOMATIC EVALUATION; EVALUATION METRICS; HEURISTICS APPROACHES; HUMAN JUDGMENTS; MACHINE TRANSLATION EVALUATIONS; MACHINE TRANSLATIONS; OPTIMISATIONS; SENTENCE LEVEL; SYSTEMS PERFORMANCE;

HEURISTIC METHODS;

EID: 84885880217     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Josha S. Albercht and Rebecca Hwa. 2008. Regression for machine translation evaluation at the sentence level. Machine Translation, 22:1-27.
2. Satanjeev Banerjee and Alon Lavie. 2005. Meteor: An automatic metric for mt evaluation with improved correlation with human judgments. Proceedings of the ACL-05 Workshop.
3. Steven Bird and Edward Loper. 2004. Nltk: The natural language toolkit. In Proceedings of the ACL demonstration session, pages 214-217, Barcelona, July.
4. Chris Callison-Burch, Miles Osborne, and Philipp Koehn. 2006. Re-evaluating the role of bleu in machine translation research. In In EACL, pages 249-256.
5. Chris Callison-Burch, Cameron Fordyce, Philipp Koehn, Christof Monz, and Josh Schroeder. 2007. (meta-) evaluation of machine translation. In Proceedings of the Second Workshop on Statistical Machine Translation, pages 136-158, Prague, Czech Republic, June. Association for Computational Linguistics.
6. Chris Callison-Burch, Cameron Fordyce, Philipp Koehn, Christof Monz, and Josh Schroeder. 2008. Further meta-evaluation of machine translation. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 70-106, Columbus, Ohio, June. Association for Computational Linguistics.
7. Chris Callison-Burch, Philipp Koehn, Christof Monz, and Josh Schroeder. 2009. Findings of the 2009 Workshop on Statistical Machine Translation. In Proceedings of the Fourth Workshop on Statistical Machine Translation, pages 1-28, Athens, Greece, March. Association for Computational Linguistics.
8. Chris Callison-Burch, Philipp Koehn, Christof Monz, Kay Peterson, Mark Przybocki, and Omar Zaidan. 2010. Findings of the 2010 joint workshop on statistical machine translation and metrics for machine translation. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 17-53, Uppsala, Sweden, July. Association for Computational Linguistics. Revised August 2010.
9. David Chiang, Steve DeNeefe, Yee Seng Chan, and Hwee Tou Ng. 2008a. Decomposability of translation metrics for improved evaluation and efficient algorithms. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, EMNLP'08, pages 610-619, Stroudsburg, PA, USA. Association for Computational Linguistics.
10. David Chiang, Yuval Marton, and Philip Resnik. 2008b. Online large-margin training of syntactic and structural translation features. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, EMNLP'08, pages 224-233, Stroudsburg, PA, USA. Association for Computational Linguistics.
11. Simon Corston-Oliver, Michael Gamon, and Chris Brockett. 2001. A machine learning approach to the automatic evaluation of machine translation. In proceedings of the Association for Computational Linguistics.
12. Doddington and George. 2002. Automatic evaluation of machine translation quality using n-gram co-occurrence statistics. In Proceedings of the second international conference on Human Language Technology Research, HLT'02, pages 138-145, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
13. Kevin Duh. 2008. Ranking vs. regression in machine translation evaluation. In In Proceedings of the Third Workshop on Statistical Machine Translation, pages 191-194, Columbus,Ohio, June.
14. T. Joachims. 1999. Making large-scale svm learning practical. Advances in Kernel Methods - Support Vector Learning,.
15. T. Joachims. 2002. Optimizing search engines using clickthrough data. In Proceedings of the ACM Conference on Knowledge Discovery and Data Mining (KDD).
16. Chin-Yew Lin and Franz Josef Och. 2004. Orange: a method for evaluating automatic evaluation metrics for machine translation. In Proceedings of the 20th international conference on Computational Linguistics, COLING'04, Stroudsburg, PA, USA. Association for Computational Linguistics.
17. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, ACL'02, pages 311-318, Stroudsburg, PA, USA. Association for Computational Linguistics.
18. C Quirk. 2004. Training a sentence-level machine translation confidence measure. In In: Proceedings of the international conference on language resources and evaluation, pages 825-828, Lisbon, Portugal.
19. Alex J. Smola and Bernhard Schlkopf. 2004. A tutorial on support vector regression. STATISTICS AND COMPUTING, 14:199-222.
20. Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and Ralph Weischedel. 2006. A study of translation error rate with targeted human annotation.
21. L. Specia and J. Gimenez. 2010. Combining confidence estimation and reference-based metrics for segment-level mt evaluation. In The Ninth Conference of the Association for Machine Translation in the Americas, Denver,Colorado.