Extending the BLEU MT evaluation method with frequency weightings

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2004, Pages 621-628

  Babych, Bogdan ^a   Hartley, Anthony ^a  

^a UNIVERSITY OF LEEDS   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

MACHINE TRANSLATION;

AUTOMATIC METHOD; EVALUATION METHODS; FREQUENCY WEIGHTINGS; HUMAN'S INTUITION; LEXICAL ITEMS; MACHINE TRANSLATION EVALUATIONS; MODEL USE; MT EVALUATIONS; STATISTICAL WEIGHT;

COMPUTATIONAL LINGUISTICS;

EID: 85040349021     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. Akiba, Y., K. Imamura and E. Sumita. 2001. Using multiple edit distances to automatically rank machine translation output. In Proc. MT Summit VIII. p. 15–20.
2. Akiba, Y., E. Sumita, H. Nakaiwa, S. Yamamoto and H.G. Okuno. 2003. Experimental Comparison of MT Evaluation Methods: RED vs. BLEU. In Proc. MT Summit IX, URL: http://www.amtaweb.org/summit/MTSummit/ FinalPapers/55-Akiba-final.pdf.
3. Babych, B., A. Hartley and E. Atwell. 2003. Statistical Modelling of MT output corpora for Information Extraction. In: Proceedings of the Corpus Linguistics 2003 conference, Lancaster University (UK), 28 - 31 March 2003, pp. 62-70.
4. Babych, B. and A. Hartley. 2004. Modelling legitimate translation variation for automatic evaluation of MT quality. In: Proceedings of LREC 2004 (forthcoming).
5. Papineni, K., S. Roukos, T. Ward, W.-J. Zhu. 2002 BLEU: a method for automatic evaluation of machine translation. Proceedings of the 40th Annual Meeting of the Association for the Computational Linguistics (ACL), Philadelphia, July 2002, pp. 311-318.
6. Salton, G. and M.E. Lesk. 1968. Computer evaluation of indexing and text processing. Journal of the ACM, 15(1), 8-36.
7. Vinay, J.P. and J.Darbelnet. 1995. Comparative stylistics of French and English: a methodology for translation / translated and edited by Juan C. Sager, M.-J. Hamel. J. Benjamins Pub., Amsterdam, Philadelphia.
8. White, J., T. O’Connell and F. O’Mara. 1994. The ARPA MT evaluation methodologies: evolution, lessons and future approaches. Proceedings of the 1st Conference of the Association for Machine Translation in the Americas. Columbia, MD, October 1994. pp. 193-205.
9. White, J. 2003. How to evaluate machine translation. In: H. Somers. (Ed.) Computers and Translation: a translator’s guide. Ed. J. Benjamins B.V., Amsterdam, Philadelphia, pp. 211-244.