SMT versus AI redux: How semantic fames evaluate MT more accurately

IJCAI International Joint Conference on Artificial Intelligence

Volumn , Issue , 2011, Pages 1838-1845

  Lo, Chi Kiu ^a   Wu, Dekai ^a  

^a HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

LEXICAL SEMANTICS; MACHINE TRANSLATIONS; QUANTITATIVE OBJECTIVES; SEMANTIC EVENT; SEMANTIC FRAMES; SEMANTIC ROLE LABELING; SEMI-AUTOMATICS; TRANSLATION QUALITY;

ARTIFICIAL INTELLIGENCE; KNOWLEDGE REPRESENTATION;

SEMANTICS;

EID: 84881079327     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.5591/978-1-57735-516-8/IJCAI11-308     Document Type: Conference Paper

References (27)

1. Collin F. Baker, Charles J. Fillmore, and John B. Lowe. The Berkeley FrameNet project. In COLING-ACL'98, Montreal,Canada, August 1998.
2. Satanjeev Banerjee and Alon Lavie. METEOR: An automatic metric for MT evaluation with improved correlation with human judgement. In Workshop on Intrinsic and Extrinsic Evaluation Measures for MT and/or Summarization at the 43th Annual Meeting of the Association of Computational Linguistics (ACL-2005), Ann Arbor, Michigan, June 2005.
3. Chris Callison-Burch, Cameron Fordyce, Philipp Koehn, Christof Monz, and Josh Schroeder. Further meta-evaluation of machine translation. In Proceedings of the 3rd Workshop on Statistical Machine Translation, pages 70-106, 2008.
4. Chris Callison-Burch, Philipp Koehn, Christof Monz, Kay Peterson, Mark Pryzbocki, and Omar Zaidan. Findings of the 2010 Joint Workshop on Statistical Machine Translation and Metrics for Machine Translation. In Joint 5th Workshop on Statistical Machine Translation and MetricsMATR, pages 17-53, Uppsala, Sweden, Jul 2010.
5. Marine Carpuat and Dekai Wu. Improving statistical machine translation using word sense disambiguation. In 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL 2007), pages 61-72, Prague, Jun 2007.
6. Marine Carpuat and Dekai Wu. Evaluation of context-dependent phrasal translation lexicons for statistical machine translation. In Sixth International Conference on Language Resources and Evaluation (LREC-2008), Marrakech, May 2008. European Language Resources Association (ELRA).
7. Yee Seng Chan, Hwee Tou Ng, and David Chiang. Word sense disambiguation improves statistical machine translation. In 45th Annual Meeting of the Association for Computational Linguistics (ACL-07), Prague, Jun 2007.
8. George Doddington. Automatic evaluation of machine translation quality using n-gram co-occurrence statistics. In Human Language Technology conference (HLT-2002), San Diego, CA, 2002.
9. Charles J. Fillmore. The case for case. In Bach and Harms, editors, Universals in Linguistic Theory, pages 1-88. Holt, Rinehart, and Winston, 1968.
10. Pascale Fung, Zhaojun Wu, Yongsheng Yang, and Dekai Wu. Automatic learning of Chinese-English semantic structure mapping. In IEEE/ACL 2006 Workshop on Spoken Language Technology (SLT 2006), Aruba, Dec 2006.
11. Pascale Fung, Zhaojun Wu, Yongsheng Yang, and Dekai Wu. Learning bilingual semantic frames: Shallow semantic parsing vs. semantic role projection. In 11th Conference on Theoretical and Methodological Issues in Machine Translation (TMI-07), pages 75-84, Skövde, Sweden, Sep 2007.
12. Jesús Giménez and Lluís Màrquez. Context-aware discriminative phrase selection for statistical machine translations. In Workshop on Statistical Machine Translation, Prague, Jun 2007.
13. Jesús Giménez and Lluís Màrquez. A smorgasbord of features for automatic MT evaluation. In 3rd ACL Workshop on Statistical Machine Translation, pages 195-198, Columbus, OH, Jun 2008.
14. Gregor Leusch, Nicola Ueffing, and Hermann Ney. Cder: Efficient mt evaluation using block movements. In EACL-2006 (11th Conference of the European Chapter of the Association for Computational Linguistics), pages 241-248, Trento, Italy, April 2006.
15. Chi-kiu Lo and Dekai Wu. Evaluating machine translation utility via semantic role labels. In Seventh International Conference on Language Resources and Evaluation (LREC-2010), pages 2873-2877, Malta, May 2010.
16. Chi-kiu Lo and Dekai Wu. Semantic vs. syntactic vs. n-gram structure for machine translation evaluation. In DekaiWu, editor, Proceedings of SSST-4, FourthWorkshop on Syntax and Structure in Statistical Translation (at COLING 2010), pages 52-60, Beijing, Aug 2010.
17. Chi-kiu Lo and Dekai Wu. MEANT: An inexpensive, high-accuracy, semi-automatic metric for evaluating translation utility via semantic frames. In 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL HLT 2011), Portland, Oregon, Jun 2011.
18. Sonja Nießen, Franz Josef Och, Gregor Leusch, and Hermann Ney. An evaluation tool for machine translation: Fast evaluation for MT research. In Second International Conference on Language Resources and Evaluation (LREC-2000), 2000.
19. Martha Palmer, Paul Kingsbury, and Daniel Gildea. The Proposition Bank: An annotated corpus of semantic roles. Computational Linguistics, 31(1):71-105, Mar 2005.
20. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. BLEU: A method for automatic evaluation of machine translations. In 40th Annual Meeting of the Association for Computational Linguistics (ACL-2002), pages 311-318, Philadelphia, Jul 2002.
21. Sameer Pradhan, Wayne Ward, Kadri Hacioglu, James H. Martin, and Dan Jurafsky. Shallow semantic parsing using Support Vector Machines. In Proceedings of the 2004 Conference on Human Language Technology and the North American Chapter of the Association for Computational Linguistics (HLT-NAACL-04), 2004.
22. Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. A study of translation edit rate with targeted human annotation. In AMTA, pages 223-231, Boston, MA, 2006. Association for Machine Translation in the Americas.
23. Christoph Tillmann, Stefan Vogel, Hermann Ney, A. Zubiaga, and H. Sawaf. Accelerated DP-based search for statistical translation. In Fifth European Conference on Speech Communication and Technology (Eurospeech'97), pages 2667-2670, Rhodes, Greece, 1997.
24. Dekai Wu and Pascale Fung. Can semantic role labeling improve SMT? In 13th Annual Conference of the European Association for Machine Translation (EAMT 2009), pages 218-225, Barcelona, May 2009.
25. Dekai Wu and Pascale Fung. Semantic roles for SMT: A hybrid two-pass model. In Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL HLT 2009), Boulder, CO, Jun 2009.
26. Nianwen Xue and Martha Palmer. Automatic semantic role labeling for chinese verbs. In 19th International Joint Conference on Artificial Intelligence (IJCAI-05), Edinburgh, 2005.
27. Omar F. Zaidan and Chris Callison-Burch. Feasibility of human-in-the-loop minimum error rate training. In 2009 Conference on Empirical Methods in Natural Language Processing (EMNLP 2009), Singapore, Aug 2009.