Ranking vs. regression in machine translation evaluation

3rd Workshop on Statistical Machine Translation, WMT 2008 at the Annual Meeting of the Association for Computational Linguistics, ACL 2008

Volumn , Issue , 2008, Pages 191-194

  Duh, Kevin ^a  

^a University of Washington   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; LEARNING ALGORITHMS; MACHINE TRANSLATION; NATURAL LANGUAGE PROCESSING SYSTEMS; QUALITY CONTROL;

AUTOMATIC EVALUATION; AUTOMATIC MACHINES; EVALUATION METHODS; HUMAN JUDGMENTS; MACHINE TRANSLATION EVALUATIONS; MACHINE TRANSLATION SYSTEMS; MACHINE TRANSLATIONS; RESEARCH TOPICS; TRANSLATION MACHINES; TRANSLATION QUALITY;

REGRESSION ANALYSIS;

EID: 57349157869     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. J. Albrecht and R. Hwa. 2007. A re-examination of machine learning approaches for sentence-level MT evaluation. In ACL.
2. S. Banerjee and A. Lavie. 2005. Meteor: An automatic metric for mt evaluation with improved correlation with human judgments. In ACL 2005 Wksp on Intrinsic/Extrinsic Evaluation for MT/Summarization.
3. J. Blatz et al. 2003. Confidence estimation for machine translation. Technical report, Johns Hopkins University, Natural Language Engineering Workshop.
4. C. Callison-Burch et al. 2007. (meta-) evaluation of machine translation. In ACL2007 SMT Workshop.
5. S. Corston-Oliver, M. Gamon, and C. Brockett. 2001. A machine learning approach to the automatic evaluation of machine translation. In ACL.
6. H. Drucker et al. 1996. Support vector regression machines. In NIPS.
7. M. Fligner and J. Verducci. 1988. Multistage ranking models. Journal of American Statistical Assoc., 88.
8. Y. Freund, R. Iyer, R. Schapire, and Y. Singer. 2003. An efficient boosting method for combining preferences. JMLR, 4.
9. T. Joachims. 2002. Optimizing search engines using clickthrough data. In KDD.
10. D. Kauchak and R. Barzilay. 2006. Paraphrasing for automatic evaluation. In NAACL-HLT.
11. A. Kulesza and S. Shieber. 2004. A learning approach to improving sentence-level mt evaluation. In TMI.
12. C.-Y. Lin and F. Och. 2004. Automatic evaluation of machine translation quality using longest common subsequence and skip-bigram statistics. In ACL.
13. D. Liu and D. Gildea. 2005. Syntactic features for evaluation of machine translation. In ACL 2005 Wksp on Intrinsic/Extrinsic Evaluation for MT/Summarization.
14. M. Meilă, K. Phadnis, A. Patterson, and J. Bilmes. 2007. Consensus ranking under the exponential model. In Conf. on Uncertainty in Artificial Intelligence (UAI).
15. K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In ACL.
16. M. Snover, B. Dorr, R. Schwartz, L. Micciulla, and J. Makhoul. 2006. A study of translation edit rate with targeted human annotation. In Conf. of Assoc. for Machine Translation in the Americas (AMTA-2006).
17. D. Vilar, G. Leusch, H. Ney, and R. Banchs. 2007. Human evaluation of machine translation through binary system comparisons. In ACL2007 SMT Workshop.
18. Y. Ye, M. Zhou, and C.-Y. Lin. 2007. Sentence level machine translation evaluation as a ranking problem. In ACL2007 Wksp on Statistical Machine Translation.