Discotk: Using discourse structure for machine translation evaluation

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2014, Pages 402-408

  Joty, Shafiq ^a   Guzman, Francisco ^a   Marquez, Lluis ^a   Nakov, Preslav ^a  

^a QATAR COMPUTING RESEARCH INSTITUTE   (Qatar)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER AIDED LANGUAGE TRANSLATION; MACHINE TRANSLATION; NATURAL LANGUAGE PROCESSING SYSTEMS; TEXT PROCESSING;

AUTOMATIC METRICS; AUTOMATIC TRANSLATION; CONVOLUTION KERNEL; DISCOURSE STRUCTURE; HUMAN JUDGMENTS; MACHINE TRANSLATION EVALUATIONS; MT EVALUATIONS; RHETORICAL STRUCTURE THEORY; SYSTEM LEVELS; TREE REPRESENTATION;

COMPUTATIONAL LINGUISTICS;

EID: 85122641281     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Chris Callison-Burch, Miles Osborne, and Philipp Koehn. 2006. Re-evaluating the role of BLEU in machine translation research. In Proceedings of the Eleventh Conference of the European Chapter of the Association for Computational Linguistics, EACL06, pages 249?256, Trento, Italy.
2. David Chiang, Yuval Marton, and Philip Resnik. 2008. Online large-margin training of syntactic and structural translation features. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, EMNLP08, pages 224?233, Honolulu, Hawaii.
3. Michael Collins and Nigel Duffy. 2001. Convolution Kernels for Natural Language. In Neural Information Processing Systems, NIPS01, pages 625?632, Vancouver, Canada.
4. Deborah Coughlin. 2003. Correlating automated and human assessments of machine translation quality. In Proceedings of the Machine Translation Summit IX,MT Summit03, pages 23?27, New Orleans, LA, USA.
5. Christopher Culy and Susanne Riehemann. 2003. The limits of n-gram translation evaluation metrics. In Proceedings of the Machine Translation Summit IX, MT Summit03, pages 1?8, New Orleans, LA, USA.
6. Michael Denkowski and Alon Lavie. 2012. Challenges in predicting machine translation utility for human post-editors. In Proceedings of the Tenth Conference of the Association for Machine Translation in the Americas, AMTA12, pages 40?49, San Diego, CA, USA.
7. George Doddington. 2002. Automatic evaluation of machine translation quality using n-gram cooccurrence statistics. In Proceedings of the Second International Conference on Human Language Technology Research, HLT02, pages 138?145, San Francisco, CA, USA.
8. Jesus Gimenez and Lluis Marquez. 2010. Linguistic Measures for Automatic Machine Translation Evaluation. Machine Translation, 24(3?4):77?86.
9. Francisco Guzman, Shafiq Joty, Lluis Marquez, and Preslav Nakov. 2014. Using discourse structure improves machine translation evaluation. In Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics, ACL14, Baltimore, MD, USA.
10. Mark Hopkins and Jonathan May. 2011. Tuning as ranking. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, EMNLP11, pages 1352?1362, Edinburgh, Scotland, UK.
11. Shafiq Joty, Giuseppe Carenini, and Raymond Ng. 2012. A Novel Discriminative Framework for Sentence-Level Discourse Analysis. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, EMNLP-CoNLL12, pages 904?915, Jeju Island, Korea.
12. Alon Lavie and Abhaya Agarwal. 2007. METEOR: An automatic metric for MT evaluation with high levels of correlation with human judgments. In Proceedings of the Second Workshop on Statistical Machine Translation, WMT07, pages 228?231, Prague, Czech Republic.
13. Alon Lavie and Michael Denkowski. 2009. The METEOR metric for automatic evaluation of machine translation. Machine Translation, 23(2-3):105?115.
14. Matous Machacek and Ondrej Bojar. 2014. Results of the WMT14 Metrics Shared Task. In Proceedings of the Ninth Workshop on Statistical Machine Translation, WMT14, Baltimore, MD, USA.
15. William Mann and Sandra Thompson. 1988. Rhetorical Structure Theory: Toward a Functional Theory of Text Organization. Text, 8(3):243?281.
16. Alessandro Moschitti, Silvia Quarteroni, Roberto Basili, and Suresh Manandhar. 2007. Exploiting syntactic and shallow semantic kernels for question answer classification. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, ACL07, pages 776?783, Prague, Czech Republic.
17. Franz Josef Och. 2003. Minimum error rate training in statistical machine translation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, ACL03, pages 160?167, Sapporo, Japan.
18. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A method for automatic evaluation of machine translation. In Proceedings of 40th Annual Meeting of the Association for Computational Linguistics, ACL02, pages 311? 318, Philadelphia, PA, USA.
19. Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006. A study of translation edit rate with targeted human annotation. In Proceedings of the Seventh Biennial Conference of the Association for Machine Translation in the Americas, AMTA06, pages 223?231, Cambridge, MA, USA.
20. Taro Watanabe, Jun Suzuki, Hajime Tsukada, and Hideki Isozaki. 2007. Online large-margin training for statistical machine translation. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, EMNLP-CoNLL07, pages 764?773, Prague, Czech Republic.