Beer 1.1: Illc uva submission to metrics and tuning task

10th Workshop on Statistical Machine Translation, WMT 2015 at the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP 2015 - Proceedings

Volumn , Issue , 2015, Pages 396-401

  Stanojević, Miloš ^a   Sima'an, Khalil ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS;

DEPENDENCY TREES; EVALUATION METRICS; SENTENCE LEVEL;

BEER;

EID: 85120003610     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Alexandra Birch and Miles Osborne. 2010. LRscore for Evaluating Lexical and Reordering Quality in MT. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 327-332, Uppsala, Sweden, July. Association for Computational Linguistics.
2. Danqi Chen and Christopher D Manning. 2014. A fast and accurate dependency parser using neural networks. In Empirical Methods in Natural Language Processing (EMNLP).
3. Michael Denkowski and Alon Lavie. 2011. Meteor 1.3: Automatic metric for reliable optimization and evaluation of machine translation systems. In Proceedings of the Sixth Workshop on Statistical Machine Translation, WMT '11, pages 85-91, Stroudsburg, PA, USA. Association for Computational Linguistics.
4. Y. He and A.Way. 2009. Improving the objective function in minimum error rate training. Proceedings of the Twelfth Machine Translation Summit, pages 238-245.
5. Ralf Herbrich, Thore Graepel, and Klaus Obermayer. 1999. Support Vector Learning for Ordinal Regression. In In International Conference on Artificial Neural Networks, pages 97-102.
6. Hideki Isozaki, Tsutomu Hirao, Kevin Duh, Katsuhito Sudoh, and Hajime Tsukada. 2010. Automatic Evaluation of Translation Quality for Distant Language Pairs. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, EMNLP '10, pages 944-952, Stroudsburg, PA, USA. Association for Computational Linguistics.
7. Matous Machacek and Ondrej Bojar. 2014. Results of the wmt14 metrics shared task. In Proceedings of the Ninth Workshop on Statistical Machine Translation, pages 293-301, Baltimore, Maryland, USA, June. Association for Computational Linguistics.
8. Michael Denkowski and Alon Lavie. 2014. Meteor Universal: Language Specific Translation Evaluation for Any Target Language. In Proceedings of the ACL 2014Workshop on Statistical Machine Translation.
9. Kishore Papineni, Salim Roukos, ToddWard, andWei-Jing Zhu. 2002. Bleu: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, ACL '02, pages 311-318, Stroudsburg, PA, USA. Association for Computational Linguistics.
10. Maja Popović and Hermann Ney. 2009. Syntaxoriented evaluation measures for machine translation output. In Proceedings of the Fourth Workshop on Statistical Machine Translation, StatMT '09, pages 29-32, Stroudsburg, PA, USA. Association for Computational Linguistics.
11. Miloš Stanojević and Khalil Sima'an. 2014a. BEER: BEtter Evaluation as Ranking. In Proceedings of the Ninth Workshop on Statistical Machine Translation, pages 414-419, Baltimore, Maryland, USA, June. Association for Computational Linguistics.
12. Miloš Stanojević and Khalil Sima'an. 2014b. Evaluating Word Order Recursively over Permutation-Forests. In Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation, pages 138-147, Doha, Qatar, October. Association for Computational Linguistics.
13. Miloš Stanojević and Khalil Sima'an. 2014c. Fitting Sentence Level Translation Evaluation with Many Dense Features. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 202-206, Doha, Qatar, October. Association for Computational Linguistics.
14. Miloš Stanojević. 2015. Removing Biases from Trainable MT Metrics by Using Self-Training. arXiv preprint arXiv:1508.02445.
15. Hui Yu, XiaofengWu, Jun Xie, Wenbin Jiang, Qun Liu, and Shouxun Lin. 2014. Red: A reference dependency based mt evaluation metric. In COLING'14, pages 2042-2051.
16. Hao Zhang and Daniel Gildea. 2007. Factorization of synchronous context-free grammars in linear time. In In NAACL Workshop on Syntax and Structure in Statistical Translation (SSST.