Results of the wmt14 metrics shared task

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2014, Pages 293-301

  Machacek, Matous ^a   Bojar, Ondrej ^a  

^a CHARLES UNIVERSITY   (Czech Republic)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS;

LEVEL CORRELATION; RESEARCH GROUPS; STANDARD METRICS; SYSTEM LEVELS;

TRANSLATION (LANGUAGES);

EID: 85122610649     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Barancikova, P. (2014). Parmesan: Improving Meteor by More Fine-grained Paraphrasing. In Proceedings of the Ninth Workshop on Statistical Machine Translation, Baltimore, USA. Association for Computational Linguistics.
2. Bojar, O., Buck, C., Federmann, C., Haddow, B., Koehn, P., Leveling, J., Monz, C., Pecina, P., Post, M., Saint-Amand, H., Soricut, R., Specia, L., and Tamchyna, A. (2014). Findings of the 2014 workshop on statistical machine translation. In Proceedings of the Ninth Workshop on Statistical Machine Translation.
3. Callison-Burch, C., Koehn, P., Monz, C., Post, M., Soricut, R., and Specia, L. (2012). Findings of the 2012 workshop on statistical machine translation. In Proceedings of the Seventh Workshop on Statistical Machine Translation, pages 10? 51, Montreal, Canada. Association for Computational Linguistics.
4. Chen, B. and Cherry, C. (2014). A Systematic Comparison of Smoothing Techniques for Sentence-Level BLEU. In Proceedings of the Ninth Workshop on Statistical Machine Translation, Baltimore, USA. Association for Computational Linguistics.
5. Comelles, E. and Atserias, J. (2014). VERTa participation in the WMT14 Metrics Task. In Proceedings of the Ninth Workshop on Statistical Machine Translation, Baltimore, USA. Association for Computational Linguistics.
6. Denkowski, M. and Lavie, A. (2014). Meteor Universal: Language Specific Translation Evaluation for Any Target Language. In Proceedings of the Ninth Workshop on Statistical Machine Translation, Baltimore, USA. Association for Computational Linguistics.
7. Doddington, G. (2002). Automatic evaluation of machine translation quality using n-gram cooccurrence statistics. In Proceedings of the second international conference on Human Language Technology Research, HLT ?02, pages 138?145, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
8. Echizenya, H. (2014). Application of Prize based on Sentence Length in Chunk-based Automatic Evaluation of Machine Translation. In Proceedings of the Ninth Workshop on Statistical Machine Translation, Baltimore, USA. Association for Computational Linguistics.
9. Gautam, S. and Bhattacharyya, P. (2014). LAYERED: Description of Metric for Machine Translation Evaluation in WMT14 Metrics Task. In Proceedings of the Ninth Workshop on Statistical Machine Translation, Baltimore, USA. Association for Computational Linguistics.
10. Gonzalez, M., Barron-Cedeno, A., and Marquez, L. (2014). IPA and STOUT: Leveraging Linguistic and Source-based Features for Machine Translation Evaluation. In Proceedings of the Ninth Workshop on Statistical Machine Translation, Baltimore, USA. Association for Computational Linguistics.
11. Guzman, F., Joty, S., Marquez, L., and Nakov, P. (2014). DiscoTK: Using Discourse Structure for Machine Translation Evaluation. In Proceedings of the Ninth Workshop on Statistical Machine Translation, Baltimore, USA. Association for Computational Linguistics.
12. Koehn, P. and Monz, C. (2006). Manual and automatic evaluation of machine translation between european languages. In Proceedings on the Workshop on Statistical Machine Translation, pages 102?121, New York City. Association for Computational Linguistics.
13. Leusch, G., Ueffing, N., and Ney, H. (2006). CDER: Efficient MT Evaluation Using Block Movements. In In Proceedings of EACL, pages 241?248.
14. Libovicky, J. and Pecina, P. (2014). Tolerant BLEU: A Submission to the WMT14 Metrics Task. In Proceedings of the Ninth Workshop on Statistical Machine Translation, Baltimore, USA. Association for Computational Linguistics.
15. Machacek, M. and Bojar, O. (2013). Results of the WMT13 Metrics Shared Task. In Proceedings of the Eighth Workshop on Statistical Machine Translation, pages 45?51, Sofia, Bulgaria. Association for Computational Linguistics.
16. Mahmoudi, A., Faili, H., Dehghan, M., and Maleki, J. (2013). ELEXR: Automatic Evaluation of Machine Translation Using Lexical Relationships. In Castro, F., Gelbukh, A., and Gonzalez, M., editors, Advances in Artificial Intelligence and Its Applications, volume 8265 of Lecture Notes in Computer Science, pages 394? 405. Springer Berlin Heidelberg.
17. Papineni, K., Roukos, S., Ward, T., and jing Zhu, W. (2002). BLEU: A method for automatic evaluation of machine translation. pages 311?318.
18. Snover, M., Dorr, B., Schwartz, R., Micciulla, L., and Makhoul, J. (2006). A study of translation edit rate with targeted human annotation. In In Proceedings of Association for Machine Translation in the Americas, pages 223?231.
19. Stanojevic, M. and Simaan, K. (2014). BEER: A Smooth Sentence Level Evaluation Metric with Rich Ingredients. In Proceedings of the Ninth Workshop on Statistical Machine Translation, Baltimore, USA. Association for Computational Linguistics.
20. Vazquez-Alvarez, Y. and Huckvale, M. (2002). The reliability of the itu-T p.85 standard for the evaluation of text-To-speech systems. In Hansen, J. H. L. and Pellom, B. L., editors, INTERSPEECH. ISCA.
21. Wu, X. and Yu, H. (2014). RED, The DCU Submission of Metrics Tasks. In Proceedings of the Ninth Workshop on Statistical Machine Translation, Baltimore, USA. Association for Computational Linguistics.