Improving AMBER, an MT Evaluation Metric

WMT 2012 - 7th Workshop on Statistical Machine Translation, Proceedings of the Workshop

Volumn , Issue , 2012, Pages 59-63

  Chen, Boxing ^a   Kuhn, Roland ^a   Foster, George ^a  

^a NATIONAL RESEARCH COUNCIL CANADA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; LINEAR PROGRAMMING;

DOWNHILL SIMPLEX ALGORITHMS; EVALUATION METRICS; HUMAN JUDGMENTS; MACHINE TRANSLATION EVALUATIONS; MT EVALUATIONS; PERFORMANCE;

AMBER;

EID: 85122967679     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. C. Callison-Burch, P. Koehn, C. Monz, K. Peterson, M. Przybocki and O. Zaidan. 2010. Findings of the 2010 Joint Workshop on Statistical Machine Translation and Metrics for Machine Translation. In Proceedings of WMT.
2. C. Callison-Burch, C. Fordyce, P. Koehn, C. Monz and J. Schroeder. 2008. Further Meta-Evaluation of Machine Translation. In Proceedings of WMT.
3. B. Chen, R. Kuhn, and S. Larkin. 2012. PORT: a Precision- Order-Recall MT Evaluation Metric for Tuning. Accepted for publication in Proceedings of ACL.
4. B. Chen and R. Kuhn. 2011. AMBER: a Modified BLEU, Enhanced Ranking Metric. In Proceedings of the Sixth Workshop on Statistical Machine Translation, Edinburgh, Scotland.
5. H. Isozaki, T. Hirao, K. Duh, K. Sudoh, H. Tsukada. 2010. Automatic Evaluation of Translation Quality for Distant Language Pairs. In Proceedings of EMNLP.
6. J. Nelder and R. Mead. 1965. A simplex method for function minimization. Computer Journal V. 7, pages 308-313.
7. K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu. 2002. BLEU: a method for automatic evaluation of machine translation. In Proceedings of ACL.
8. W. Press, S. Teukolsky, W. Vetterling and B. Flannery. 2002. Numerical Recipes in C++. Cambridge University Press, Cambridge, UK.
9. C. Spearman. 1904. The proof and measurement of association between two things. In American Journal of Psychology, V. 15, pages 72-101.
10. S. Vogel, H. Ney, and C. Tillmann. 1996. HMM based word alignment in statistical translation. In Proceedings of COLING.