Extending machine translation evaluation metrics with lexical cohesion to document level

EMNLP-CoNLL 2012 - 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Proceedings of the Conference

Volumn , Issue , 2012, Pages 1060-1068

  Wong, Billy T M ^a   Kit, Chunyu ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

EVALUATION METRICS; LEXICAL COHESION; MACHINE TRANSLATION EVALUATIONS; MACHINE TRANSLATIONS; TEXT COHERENCES;

ADHESION;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84883395070     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, pages 65-72, Ann Arbor, Michigan.
2. Regina Barzilay and Michael Elhadad. 1997. Using lexical chains for text summarization. In Proceedings of the ACL Workshop on Intelligent Scalable Text Summarization, pages 10-17.
3. Jill Burstein. 2003. The E-rater scoring engine: Automated essay scoring with natural language processing. In Mark D. Shermis and Jill Burstein, editors, Automated Essay Scoring: A Cross-Disciplinary Perspective, chapter 7, pages 113-122. Lawrence Erlbaum Associates.
4. Marine Carpuat. 2009. One translation per discourse. In Proceedings of the NAACL HLT Workshop on Semantic Evaluations: Recent Achievements and Future Directions, pages 19-27, Boulder, Colorado.
5. Bruno Cartoni, Andrea Gesmundo, James Henderson, Cristina Grisot, Paola Merlo, Thomas Meyer, Jacques Moeschler, Sandrine Zufferey, and Andrei Popescu-Belis. 2011. Improving MT coherence through text-level processing of input texts: The COMTIS project. In Tralogy, Paris.
6. Samuel W. K. Chan. 2004. Extraction of sailent textual patterns: Synergy between lexical cohesion and contextual coherence. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 34(2):205-218.
7. Elisabet Comelles, Jesus Giménez, Lluìs Márquez, Irene Castellòn, and Victoria Arranz. 2010. Document-level automatic MT evaluation based on discourse representations. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and Metrics-MATR, pages 333-338, Uppsala.
8. Christiane Fellbaum. 1998. WordNet: An Electronic Lexical Database. MIT Press, Cambridge, MA.
9. Zhengxian Gong, Min Zhang, and Guodong Zhou. 2011. Cache-based document-level statistical machine translation. In EMNLP 2011, pages 909-919, Edinburgh, Scotland.
10. M. A. K. Halliday and Ruqaiya Hasan. 1976. Cohesion in English. London: Longman.
11. Masaki Itagaki, Takako Aikawa, and Xiaodong He. 2007. Automatic validation of terminology translation consistency with statistical method. In MT Summit XI, pages 269-274.
12. Hans Kamp and Uwe Reyle. 1993. From Discourse to Logic: An Introduction to Modeltheoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory. Dordrecht: Kluwer.
13. Margaret King, Andrei Popescu-Belis, and Eduard Hovy. 2003. FEMTI: Creating and using a framework for MT evaluation. In MT Summit IX, pages 224-231, New Orleans.
14. Jing Li, Le Sun, Chunyu Kit, and Jonathan Webster. 2007. A query-focused multi-document summarizer based on lexical chains. In DUC 2007, Rochester, New York.
15. Kazem Lotfipour-Saedi. 1997. Lexical cohesion and translation equivalence. Meta, 42(1):185-192.
16. Xiaoyi Ma. 2006. Multiple-Translation Chinese (MTC) part 4. Linguistic Data Consortium.
17. William C. Mann and Sandra A. Thompson. 1988. Rhetorical structure theory: Toward a functional theory of text organization. Text, 8(3):243-281.
18. Keith J. Miller and Michelle Vanni. 2001. Scaling the ISLE taxonomy: Development of metrics for the multi-dimensional characterisation of machine translation quality. In MT Summit VIII, pages 229-238.
19. Jane Morris and Graeme Hirst. 1991. Lexical cohesion computed by thesaural relations as an indicator of the structure of text. Computational Linguistics, 17(1):21-48.
20. Masaki Murata and Makoto Nagao. 1993. Determination of referential property and number of nouns in Japanese sentences for machine translation into English. In TMI 1993, pages 218-225, Kyoto.
21. Masaki Murata, Kiyotaka Uchimoto, Qing Ma, and Hitoshi Isahara. 2001. A machine-learning approach to estimating the referential properties of Japanese noun phrases. In CICLING 2001, pages 142-153, Mexico-City.
22. Hiromi Nakaiwa and Satoru Ikehara. 1992. Zero pronoun resolution in a machine translation system by using Japanese to English verbal semantic attributes. In ANLP 1992, pages 201-208.
23. Hiromi Nakaiwa and Satoshi Shirai. 1996. Anaphora resolution of Japanese zero pronouns with deictic reference. In COLING 1996, pages 812-817, Copenhagen.
24. Hiromi Nakaiwa, Satoshi Shirai, Satoru Ikehara, and Tsukasa Kawaok. 1995. Extrasentential resolution of Japanese zero pronouns using semantic and pragmatic constraints. In Proceedings of the AAAI 1995 Spring Symposium Series: Empirical Methods in Discourse Interpretation and Generation, pages 99-105, Stanford.
25. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A method for automatic evaluation of machine translation. In ACL 2002, pages 311-318.
26. Jesús Peral, Manuel Palomar, and Antonio Ferràndez. 1999. Coreference-oriented interlingual slot structure and machine translation. In Proceedings of the ACL Workshop on Coreference and its Applications, pages 69-76, College Park, MD.
27. Martin F. Porter. 1980. An algorithm for suffix stripping. Program, 14(3):130-137.
28. Mark Przybocki, Kay Peterson, and Sébastien Bronsart. 2009. 2008 NIST metrics for machine translation (MetricsMATR08) development data. Linguistic Data Consortium.
29. Matthew Snover, Bonnie Dorr, Richard Schwartz, Lin-nea Micciulla, and John Makhoul. 2006. A study of translation edit rate with targeted human annotation. In AMTA 2006, pages 223-231.
30. Matthew Snover, Nitin Madnani, Bonnie J. Dorr, and Richard Schwartz. 2009. Fluency, adequacy, or HTER? Exploring different human judgments with a tunable MT metric. In Proceedings of the 4th Workshop on Statistical Machine Translation, pages 259-268, Athens.
31. Georges van Slype. 1979. Critical Study of Methods for Evaluating the Quality of Machine Translation. Technical report, Bureau Marcel van Dijk /European Commission, Brussels.
32. Muriel Vasconcellos. 1989. Cohesion and coherence in the presentation of machine translation products. In James E. Alatis, editor, Georgetown University Round Table on Languages and Linguistics 1989: Language Teaching, Testing, and Technology: Lessons from the Past with a View Toward the Future, pages 89-105. Georgetown University Press.
33. Eric M. Visser and Masaru Fuji. 1996. Using sentence connectors for evaluating MT output. In COLING 1996, pages 1066-1069.
34. Yorick Wilks. 1978. The Value of the Monolingual Component in MT Evaluation and its Role in the Battelle. Report on Systran, Luxembourg CEC Memorandum.
35. Billy T. M. Wong, Cecilia F. K. Pun, Chunyu Kit, and Jonathan J. Webster. 2011. Lexical cohesion for evaluation of machine translation at document level. In NLP-KE 2011, pages 238-242, Tokushima.
36. Billy Tak-Ming Wong. 2010. Semantic evaluation of machine translation. In LREC 2010, pages 2884-2888, Valletta.
37. Zhibiao Wu and Martha Palmer. 1994. Verb semantics and lexical selection. In ACL 1994, pages 133-138, Las Cruces.
38. Tong Xiao, Jingbo Zhu, Shujie Yao, and Hao Zhang. 2011. Document-level consistency verification in machine translation. In MT summit XIII, pages 131-138, Xiamen.