Expected dependency pair match: Predicting translation quality with expected syntactic structure

Machine Translation

Volumn 23, Issue 2-3, 2009, Pages 169-179

  Kahn, Jeremy G ^a   Snover, Matthew ^b   Ostendorf, Mari ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

Dependency trees; Machine translation evaluation; Syntax

Indexed keywords

DEPENDENCY PAIRS; EVALUATION METHOD; MACHINE TRANSLATIONS; STATISTICAL PARSER; SYNTACTIC FEATURES; SYNTACTIC STRUCTURE; TRANSLATION QUALITY;

INFORMATION THEORY; SPEECH TRANSMISSION;

SYNTACTICS;

EID: 77954757758     PISSN: 09226567     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10590-009-9057-6     Document Type: Article

References (17)

1. Banerjee S, Lavie A (2005) METEOR: an automatic metric for MT evaluation with improved correlation with human judgments. In: Proceedings of the ACL workshop on intrinsic and extrinsic evaluation measures for MT and/or summarization, pp 65-72
2. Cahill A, Burke M, O'Donovan R, Van Genabith J, Way A (2004) Long-distance dependency resolution in automatically acquired wide-coverage PCFG-based LFG approximations. In: Proceedings of the ACL, pp 319-326
3. Callison-Burch C (2006) Re-evaluating the role of BLEU in machine translation research. In: Proceedings of the EACL, pp 249-256
4. Charniak E, Johnson M (2005) Coarse-to-fine n-best parsing and MaxEnt discriminative reranking. In: Proceedings of the ACL, pp 173-180
5. Charniak E, Knight K, Yamada K (2003) Syntax-based language models for statistical machine translation. In: Proceedings of the MT Summit IX
6. Kahn JG, Roark B, Ostendorf M (2008) Automatic syntactic MT evaluation with expected dependency pair match. In: MetricsMATR: NIST metrics for machine translation challenge
7. LDC (2003) Multiple translation Chinese corpus, part 2. Catalog number LDC2003T17
8. LDC (2006) Multiple translation Chinese corpus, part 4. Catalog number LDC2006T04
9. LDC (2008) GALE phase 2 + retest evaluation references. Catalog number LDC2008E11
10. Liu D, Gildea D (2005) Syntactic features for evaluation of machine translation. In Proceedings of the ACL workshop on intrinsic and extrinsic evaluation measures for MT and/or summarization, pp 25-32
11. Magerman DM (1995) Statistical decision-tree models for parsing. In: Proceedings of the ACL, pp 276-283
12. Owczarzak K, Genabith Jvan, Way A (2007a) Evaluating machine translation with LFG dependencies. Mach Transl 21 (2):95-119
13. Owczarzak K, van Genabith J, Way A (2007b) Labelled dependencies in machine translation evaluation. In: Proceedings of the second workshop on statistical machine translation, pp 104-111
14. Papineni K, Roukos S, Ward T, Zhu WJ (2002) BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the ACL, pp 311-318
15. Roark B, Harper M, Charniak E, Dorr B, Johnson M, Kahn JG, Liu Y, Ostendorf M, Hale J, Krasnyanskaya A, Lease M, Shafran I, Snover M, Stewart R, Yung L (2006) SParseval: evaluation metrics for parsing speech. In: Proceedings of the LREC
16. Snover M, Dorr B, Schwartz R, Micciulla L, Makhoul J (2006) A study of translation edit rate with targeted human annotation. In: Proceedings of the AMTA
17. Snover M, Madnani N, Dorr B, Schwartz R (2009) Fluency, adequacy, or HTER? Exploring different human judgments with a tunable MT metric. In: Proceedings of the workshop on statistical machine translation at EACL