Evaluating word order recursively over permutation-forests

Proceedings of SSST 2014 - 8th Workshop on Syntax, Semantics and Structure in Statistical Translation

Volumn , Issue , 2014, Pages 138-147

  Stanojević, Miloš ^a   Sima’an, Khalil ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS;

LANGUAGE PAIRS; LEXICALIZATION; MEASURE WORDS; N-GRAMS; PERMUTATION GROUP; SENTENCE LEVEL; SPEARMAN'S RHO; SYSTEM OUTPUT; TREE DECOMPOSITION; WORD ORDERS;

FORESTRY;

EID: 84975080013     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Michael H. Albert and Mike D. Atkinson. 2005. Simple permutations and pattern restricted permutations. Discrete Mathematics, 300(1-3):1–15.
2. Alexandra Birch and Miles Osborne. 2010. LRscore for Evaluating Lexical and Reordering Quality in MT. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 327–332, Uppsala, Sweden, July. Association for Computational Linguistics.
3. Alexandra Birch and Miles Osborne. 2011. Reordering Metrics for MT. In Proceedings of the Association for Computational Linguistics, Portland, Oregon, USA. Association for Computational Linguistics.
4. Alexandra Birch, Miles Osborne, and Phil Blunsom. 2010. Metrics for MT evaluation: evaluating reordering. Machine Translation, pages 1–12.
5. Ondřej Bojar, Christian Buck, Chris Callison-Burch, Christian Federmann, Barry Haddow, Philipp Koehn, Christof Monz, Matt Post, Radu Soricut, and Lucia Specia. 2013. Findings of the 2013 Workshop on Statistical Machine Translation. In Proceedings of the Eighth Workshop on Statistical Machine Translation, pages 1–44, Sofia, Bulgaria, August. Association for Computational Linguistics.
6. Chris Callison-Burch, Philipp Koehn, Christof Monz, Matt Post, Radu Soricut, and Lucia Specia. 2012. Findings of the 2012 Workshop on Statistical Machine Translation. In Proceedings of the Seventh Workshop on Statistical Machine Translation, pages 10–51, Montréal, Canada, June. Association for Computational Linguistics.
7. Michael Denkowski and Alon Lavie. 2011. Meteor 1.3: Automatic Metric for Reliable Optimization and Evaluation of Machine Translation Systems. In Proceedings of the EMNLP 2011 Workshop on Statistical Machine Translation.
8. Daniel Gildea, Giorgio Satta, and Hao Zhang. 2006. Factoring Synchronous Grammars by Sorting. In ACL.
9. Hideki Isozaki, Tsutomu Hirao, Kevin Duh, Katsuhito Sudoh, and Hajime Tsukada. 2010. Automatic evaluation of translation quality for distant language pairs. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, EMNLP’10, pages 944–952, Stroudsburg, PA, USA. Association for Computational Linguistics.
10. Mirella Lapata. 2006. Automatic Evaluation of Information Ordering: Kendall’s Tau. Computational Linguistics, 32(4):471–484.
11. Alon Lavie, Kenji Sagae, and Shyamsundar Jayaraman. 2004. The significance of recall in automatic metrics for MT evaluation. In Proceedings of the Sixth Conference of the Association for Machine Translation in the Americas.
12. Matouš Macháček and Ondřej Bojar. 2013. Results of the WMT13 Metrics Shared Task. In Proceedings of the Eighth Workshop on Statistical Machine Translation, pages 45–51, Sofia, Bulgaria, August. Association for Computational Linguistics.
13. Gideon Maillette de Buy Wenniger and Khalil Sima’an. 2011. Hierarchical Translation Equivalence over Word Alignments. In ILLC Prepublication Series, PP-2011-38. University of Amsterdam.
14. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of ACL’02, pages 311–318, Philadelphia, PA, USA.
15. Miloš Stanojević and Khalil Sima’an. 2014. BEER: BEtter Evaluation as Ranking. In Proceedings of the Ninth Workshop on Statistical Machine Translation, pages 414–419, Baltimore, Maryland, USA, June. Association for Computational Linguistics.
16. David Talbot, Hideto Kazawa, Hiroshi Ichikawa, Jason Katz-Brown, Masakazu Seno, and Franz Och. 2011. A Lightweight Evaluation Framework for Machine Translation Reordering. In Proceedings of the Sixth Workshop on Statistical Machine Translation, pages 12–21, Edinburgh, Scotland, July. Association for Computational Linguistics.
17. Dekai Wu. 1997. Stochastic inversion transduction grammars and bilingual parsing of parallel corpora. Computational Linguistics, 3(23):377–403.
18. Hao Zhang and Daniel Gildea. 2007. Factorization of Synchronous Context-Free Grammars in Linear Time. In NAACL Workshop on Syntax and Structure in Statistical Translation (SSST), pages 25–32.
19. Hao Zhang, Daniel Gildea, and David Chiang. 2008. Extracting synchronous grammar rules from word-level alignments in linear time. In Proceedings of the 22nd International Conference on Computational Linguistics-Volume 1, pages 1081–1088. Association for Computational Linguistics.