Fusion of word and letter based metrics for automatic MT evaluation

IJCAI International Joint Conference on Artificial Intelligence

Volumn , Issue , 2013, Pages 2204-2210

  Yang, Muyun ^a   Zhu, Junguo ^a   Li, Sheng ^a   Zhao, Tiejun ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

EMPIRICAL STUDIES; EVALUATION METRICS; GREEDY STRATEGIES; LANGUAGE INDEPENDENTS; LINGUISTIC FEATURES; LINGUISTIC INFORMATION; MACHINE TRANSLATIONS; TRANSLATION QUALITY;

ARTIFICIAL INTELLIGENCE; LINGUISTICS;

TRANSLATION (LANGUAGES);

EID: 84896061972     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Joshua S. Albrecht and Rebecca Hwa, Regression for Machine Translation Evaluation at the Sentence Level. Machine Translation. 22: 1-27. 2008.
2. Enrique Amig?, J. Giménez, Julio Gonzalo, and Felisa Verdejo. The Contribution of Linguistic Features to Automatic Machine Translation Evaluation. In proceedings ACL-IJCNLP 2009, 2009.
3. Satanjeev Banerjee and Alon Lavie. METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. In Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and /or Summarization, pages: 65-72. 2005.
4. John Blatz and Alex Kulesza. Confidence Estimation for Machine Translation. Technical Report, Johns Hopkins University, Natural Language Engineering Workshop, 2003.
5. C. Callison-Burch, Cameron Fordyce, and Philipp Koehn, Chrisof Monz and Josh Schroeder. Further Meta-evaluation of Machine Translation. In Proceedings of WMT08. pages: 70-106, 2008
6. C. Callison-Burch, Miles Osborne, and Philipp Koehn. Re-evaluating the Role of BLEU in Machine Translation Research. In Proceedings of EACL 2006, page: 249-256, 2006
7. C. Callison-Burch, Philipp Koehn, Christof Monz, and Josh Schroeder. Findings of the 2009 Workshop on Statistical Machine Translation. In Proceedings of WMT09, 2009.
8. C. Callison-Burch, Philipp Koehn, Christof Monz, Kay Peterson, Mark Przybocki, and Omar Zaidan, Findings of the 2010 Joint Workshop on Statistical Machine Translation and Metrics for Machine Translation. In Proceedings of WMT10, 2010. (http://www.cs.jhu.edu/~ccb/publications/findings-of-the-wmt10- shared-tasks.pdf)
9. David Chiang, Yuval Marton and Philip Resnik. Online Large-Margin Training of Syntactic and Structural Translation Features. In Proceedings of ACL08, pages: 224-233, 2008
10. S. Corston-Oliver, Michael Gamon and Chris Brockett. A Machine Learning Approach to the Automatic Evaluation of Machine Translation. In Proceedings of the ACL01, pages: 148-155, 2001.
11. George Doddington. Automatic Evaluation of Machine Translation Quality Using N-gram Co-Occurrence Statistics. In Proceedings of the 2nd HLT, pages: 138-145, 2002.
12. Kevin Duh. Ranking vs. Regression in Machine Translation Evaluation. In Proceedings of WMT08 2008.
13. J. Giménez and L. Màrquez. A Smorgasbord of Features for Automatic MT Evaluation. In Proceedings of WMT 07, pages: 195-198, 2007.
14. Thorsten Joachims. Making large-scale SVM learning practical. Advances in Kernel Methods-Support Vector Learning. 1999. MIT-Press.
15. Kahn G. Jeremy, Mathew Snover and Mari Ostendorf, Expected Dependency Pair Match: Predicting Translation Quality with Expected Syntactic Structure. Machine Translation. 23: 169-179, 2009.
16. Imamura Kenji, Eiichiro Sumita, and Yuji Matsumoto. Feedback Cleaning of Machine Translation Rules Using Automatic Evaluation. In Proceedings of the ACL03, page: 311-318 2003.
17. Alex Kulesza and Stuart M. Shieber. A Learning Approach to Improving Sentence-level MT Evaluation. In Proceedings of the 10th TMI, 2004.
18. Audrey Le and Mark Przybocki. NIST 2005 Machine Translation Evaluation Official Results. In Official Release of Automatic Evaluation Scores for all Submission, 2005.
19. C.-Y. Lin and F.J. Och. Automatic Evaluation of Machine Translation Quality Using Longest Common Subsequence and Skip-Bigram Statistics. In Proceedings of ACL04. pages: 605-612, 2004.
20. Ding and Daniel Gildea. Syntactic Features for Evaluation of Machine Translation. Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and /or Summarization, pages: 25-32, 2005.
21. Dan I., Ryan Green, and Joseph P. Turian. Precision and Recall of Machine Translation. In Proceedings of HLT-NAACL03, 2003.
22. Sonja Nießen, F.J. Och, Gregor Leusch, and Hermann Ney. An Evaluation Tool for Machine Translation: Fast Evaluation for MT Research. In Proceedings of LREC2000, 2000.
23. F.J. Och. Minimum Error Rate Training in Statistical Machine Translation. In Proceedings of the ACL03, pages: 160-167, 2003
24. Karolina Owczarzak, J. van Genabith, and Andy Way. Evaluating Machine Translation with LFG Dependencies. Machine Translation 21(2): 95-119, 2007.
25. Sebastian Pad?, Daniel Cer, Michel Galley, Dan Jurafsky, and Christopher D. Manning. Measuring Machine Translation Quality as Semantic Equivalence: A Metric Based on Entailment Features. Machine Translation 23: 181-193, 2009.
26. Kishore, Salim Roukos, Todd Ward, and W.-J. Zhu. BLEU: A Method for Automatic Evaluation of Machine Translation. In Proceedings of ACL02, page: 311-318, 2002.
27. Maja Popović and Hermann Ney. Syntax-oriented Evaluation Measures for Machine Translation Output. In Proceedings of WMT09, pages, 29-32, 2009.
28. Matthew, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. A Study of Translation Edit Rate with Targeted Human Annotation. In Proceedings of AMTA, pages: 223-231, 2006.
29. Christoph Tillmann, Stefan Vogel, Hermann Ney, A. Zubiaga, and H. Sawaf. Accelerated DP-based Search for Statistical Translation. In Proceedings of European Conference on Speech Communication and Technology, 1997.
30. Ye Yang, Ming Zhou and C.-Y. Lin. Sentence Level Machine Translation Evaluation as a Ranking. In Proceedings of the ACL-2007 Workshop on Statistical Machine Translation, 2007.