The significance of recall in automatic metrics for MT evaluation

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3265, Issue , 2004, Pages 134-143

  Lavie, Alon ^a   Sagae, Kenji ^a   Jayaraman, Shyamsundar ^a  

^a Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION;

AUTOMATIC METRICS FOR MT; HARMONIC MEAN; HUMAN JUDGMENTS; MACHINE TRANSLATION EVALUATIONS; N-GRAMS; PRECISION AND RECALL; RECENT RESEARCHES; TRANSLATION QUALITY;

QUALITY CONTROL;

EID: 35048903630     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-30194-3_16     Document Type: Article

References (14)

1. Papineni, Kishore, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a Method for Automatic Evaluation of Machine Translation. In Proceedings of 40th Annual Meeting of the Association for Computational Linguistics (ACL), pages 311-318, Philadelphia, PA, July.
2. Doddington, George. 2002. Automatic Evaluation of Machine Translation Quality Using N-gram Co-Occurrence Statistics. In Proceedings of the Second Conference on Human Language Technology (HLT-2002). San Diego, CA. pp. 128-132.
3. K.-Y. Su, M.-W. Wu, and J.-S. Chang. 1992. A New Quantitative Quality Measure for Machine Translation Systems. In Proceedings of the fifteenth International Conference on Computational Linguistics (COLING-92). Nantes, France, pp. 433-439.
4. Y. Akiba, K. Imamura, and E. Sumita. 2001. Using Multiple Edit Distances to Automatically Rank Machine Translation Output. In Proceedings of MT Summit VIII. Santiago de Compostela, Spain, pp. 15-20.
5. S. Niessen, F. J. Och, G. Leusch, and H. Ney. 2000. An Evaluation Tool for Machine Translation: Fast Evaluation for Machine Translation Research. In Proceedings of the Second International Conference on Language Resources and Evaluation (LREC-2000). Athens, Greece, pp. 39-45.
6. Gregor Leusch, Nicola Ueffing and Herman Ney. 2003. String-to-String Distance Measure with Applications to Machine Translation Evaluation. In Proceedings of MT Summit IX. New Orleans, LA. Sept. 2003. pp. 240-247.
7. I. Dan Melamed, R. Green and J. Turian. 2003. Precision and Recall of Machine Translation. In Proceedings of HLT-NAACL 2003. Edmonton, Canada. May 2003. Short Papers: pp. 61-63.
8. Joseph P. Turian, Luke Shen and I. Dan Melamed. 2003. Evaluation of Machine Translation and its Evaluation. In Proceedings of MT Summit IX. New Orleans, LA. Sept. 2003. pp. 386-393.
9. Chin-Yew Lin and Eduard Hovy. 2003. Automatic Evaluation of Summaries Using N-gram Co-occurrence Statistics. In Proceedings of HLT-NAACL 2003. Edmonton, Canada. May 2003. pp. 71-78.
10. C. van Rijsbergen. 1979. Information Retrieval. Butterworths. London, England. 2nd Edition.
11. Deborah Coughlin. 2003. Correlating Automated and Human Assessments of Machine Translation Quality. In Proceedings of MT Summit IX. New Orleans, LA. Sept. 2003. pp. 63-70.
12. Bradley Efron and Robert Tibshirani. 1986. Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy. Statistical Science, 1(1). pp. 54-77.
13. George Doddington. 2003. Automatic Evaluation of Language Translation using N-gram Co-occurrence Statistics. Presentation at DARPA/TIDES 2003 MT Workshop. NIST, Gathersberg, MD. July 2003.
14. Bo Pang, Kevin Knight and Daniel Marcu. 2003. Syntax-based Alignment of Multiple Translations: Extracting Paraphrases and Generating New Sentences. In Proceedings of HLT-NAACL 2003. Edmonton, Canada. May 2003. pp. 102-109.