Simulating Human Judgment in Machine Translation Evaluation Campaigns

2012 International Workshop on Spoken Language Translation, IWSLT 2012

Volumn , Issue , 2012, Pages 179-184

  Koehn, Philipp ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER AIDED LANGUAGE TRANSLATION; MACHINE TRANSLATION;

HUMAN JUDGMENTS; MACHINE TRANSLATION EVALUATIONS; MONTE CARLO MODEL; RANKING METHODS;

COMPUTATIONAL LINGUISTICS;

EID: 84907369527     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (6)

1. C. Callison-Burch, P. Koehn, C. Monz, M. Post, R. Soricut, and L. Specia, “Findings of the 2012 workshop on statistical machine translation,” in Proceedings of the Seventh Workshop on Statistical Machine Translation. Montreal, Canada: Association for Computational Linguistics, June 2012, pp. 10-48. [Online]. Available: http://www.aclweb.org/anthology/W12-3102
2. M. Paul, M. Federico, and S. Stücker, “Overview of the IWSLT 2010 Evaluation Campaign,” in Proceedings of the seventh International Workshop on Spoken Language Translation (IWSLT), M. Federico, I. Lane, M. Paul, and F. Yvon, Eds., 2010, pp. 3-27.
3. O. Bojar, M. Ercegovčević, M. Popel, and O. Zaidan, “A grain of salt for the wmt manual evaluation,” in Proceedings of the Sixth Workshop on Statistical Machine Translation. Edinburgh, Scotland: Association for Computational Linguistics, July 2011, pp. 1-11. [Online]. Available: http://www.aclweb.org/anthology/W11-2101
4. A. Lopez, “Putting human assessments of machine translation systems in order,” in Proceedings of the Seventh Workshop on Statistical Machine Translation. Montreal, Canada: Association for Computational Linguistics, June 2012, pp. 1-9. [Online]. Available: http://www.aclweb.org/anthology/W12-3101
5. M. Dreyer and D. Marcu, “Hyter: Meaning-equivalent semantics for translation evaluation,” in Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Montréal, Canada: Association for Computational Linguistics, June 2012, pp. 162-171. [Online]. Available: http://www.aclweb.org/anthology/N12-1017
6. B. Efron and R. J. Tibshirani, An Introduction to the Bootstrap. Chapman and Hall, 1993.