Results of the WMT13 Metrics Shared Task

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2013, Pages 45-51

  Macháček, Matouš ^a   Bojar, Ondřej ^a  

^a CHARLES UNIVERSITY   (Czech Republic)

Author keywords

[No Author keywords available]

Indexed keywords

LEVEL CORRELATION; METRIC SCORES; RESEARCH GROUPS; STANDARD METRICS; SYSTEM LEVELS;

TRANSLATION (LANGUAGES);

EID: 85122671957     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Eleftherios Avramidis and Maja Popović. 2013. Machine learning methods for comparative and time-oriented Quality Estimation of Machine Translation output. In Proceedings of the Eight Workshop on Statistical Machine Translation.
2. Ondřej Bojar, Christian Buck, Chris Callison-Burch, Christian Federmann, Barry Haddow, Philipp Koehn, Christof Monz, Matt Post, Radu Soricut, and Lucia Specia. 2013. Findings of the 2013 workshop on statistical machine translation. In Proceedings of the Eight Workshop on Statistical Machine Translation.
3. Chris Callison-Burch, Philipp Koehn, Christof Monz, Matt Post, Radu Soricut, and Lucia Specia. 2012. Findings of the 2012 workshop on statistical machine translation. In Proceedings of the Seventh Workshop on Statistical Machine Translation, pages 10-51, Montréal, Canada, June. Association for Computational Linguistics.
4. Michael Denkowski and Alon Lavie. 2011. Meteor 1.3: Automatic Metric for Reliable Optimization and Evaluation of Machine Translation Systems. In Proceedings of the EMNLP 2011 Workshop on Statistical Machine Translation.
5. George Doddington. 2002. Automatic evaluation of machine translation quality using n-gram co-occurrence statistics. In Proceedings of the second international conference on Human Language Technology Research, HLT'02, pages 138-145, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
6. Mark Fishel. 2013. Ranking Translations using Error Analysis and Quality Estimation. In Proceedings of the Eight Workshop on Statistical Machine Translation.
7. Najeh Hajlaoui and Andrei Popescu-Belis. 2013. Assessing the accuracy of discourse connective translations: Validation of an automatic metric. In 14th International Conference on Intelligent Text Processing and Computational Linguistics, page 12. University of the Aegean, Springer, March.
8. Najeh Hajlaoui. 2013. Are ACT's scores increasing with better translation quality. In Proceedings of the Eight Workshop on Statistical Machine Translation.
9. Aaron Li-Feng Han, Derek F. Wong, Lidia S. Chao, Yi Lu, Liangye He, Yiming Wang, and Jiaji Zhou. 2013. A Description of Tunable Machine Translation Evaluation Systems in WMT13 Metrics Task. In Proceedings of the Eight Workshop on Statistical Machine Translation.
10. Gregor Leusch, Nicola Ueffing, and Hermann Ney. 2006. Cder: Efficient mt evaluation using block movements. In In Proceedings of EACL, pages 241-248.
11. Chi-Kiu Lo and Dekai Wu. 2013. MEANT @ WMT2013 metrics evaluation. In Proceedings of the Eight Workshop on Statistical Machine Translation.
12. Kishore Papineni, Salim Roukos, Todd Ward, and Wei jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. pages 311-318.
13. Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006. A study of translation edit rate with targeted human annotation. In In Proceedings of Association for Machine Translation in the Americas, pages 223-231.
14. Xingyi Song, Trevor Cohn, and Lucia Specia. 2013. BLEU deconstructed: Designing a better MT evaluation metric. March.
15. Xiaofeng Wu, Hui Yu, and Qun Liu. 2013. DCU Participation in WMT2013 Metrics Task. In Proceedings of the Eight Workshop on Statistical Machine Translation.