METEOR: An automatic metric for MT evaluation with high levels of correlation with human judgments

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2007, Pages 228-231

  Lavie, Alon ^a   Agarwal, Abhaya ^a  

^a Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; MACHINE TRANSLATION; NATURAL LANGUAGE PROCESSING SYSTEMS;

AUTOMATIC METRICS; AUTOMATIC METRICS FOR MT; HUMAN JUDGMENTS; MACHINE TRANSLATION EVALUATIONS; METRIC PARAMETER; MT EVALUATIONS; TECHNICAL DETAILS; TRANSLATION QUALITY;

QUALITY CONTROL;

EID: 85120046073     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. In Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, pages 65-72, Ann Arbor, Michigan, June.
2. John Blatz, Erin Fitzgerald, George Foster, Simona Gandrabur, Cyril Goutte, Alex Kulesza, Alberto Sanchis, and Nicola Ueffing. 2003. Confidence Estimation for Machine Translation. Technical Report Natural Language Engineering Workshop Final Report, Johns Hopkins University.
3. Marvin Humphrey. 2007. Perl Interface to Snowball Stemmers. http://search.cpan.org/creamyg/Lingua-Stem-Snowball-0.941/lib/Lingua/Stem/Snowball.pm.
4. Alon Lavie, Kenji Sagae, and Shyamsundar Jayaraman. 2004. The Significance of Recall in Automatic Metrics for MT Evaluation. In Proceedings of the 6th Conference of the Association for Machine Translation in the Americas (AMTA-2004), pages 134-143, Washington, DC, September.
5. Gregor Leusch, Nicola Ueffing, and Hermann Ney. 2006. CDER: Efficient MT Evaluation Using Block Movements. In Proceedings of the Thirteenth Conference of the European Chapter of the Association for Computational Linguistics.
6. I. Dan Melamed, Ryan Green, and Joseph Turian. 2003. Precision and Recall of Machine Translation. In Proceedings of the HLT-NAACL 2003 Conference: Short Papers, pages 61-63, Edmonton, Alberta.
7. George Miller and Christiane Fellbaum. 2007. WordNet. http://wordnet.princeton.edu/.
8. Franz Josef Och. 2003. Minimum Error Rate Training for Statistical Machine Translation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics.
9. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a Method for Automatic Evaluation of Machine Translation. In Proceedings of 40th Annual Meeting of the Association for Computational Linguistics (ACL), pages 311-318, Philadelphia, PA, July.
10. Martin Porter. 2001. The Porter Stemming Algorithm. http://www.tartarus.org/martin/PorterStemmer/index.html.
11. Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006. A Study of Translation Edit Rate with Targeted Human Annotation. In Proceedings of the 7th Conference of the Association for Machine Translation in the Americas (AMTA-2006), pages 223-231, Cambridge, MA, August.
12. C. van Rijsbergen, 1979. Information Retrieval. Butterworths, London, UK, 2nd edition.