Lexical cohesion for evaluation of machine translation at document level

NLP-KE 2011 - Proceedings of the 7th International Conference on Natural Language Processing and Knowledge Engineering

Volumn , Issue , 2011, Pages 238-242

  Wong, Billy T M ^a   Pun, Cecilia F K ^a   Kit, Chunyu ^a   Webster, Jonathan J ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

evaluation metric; lexical cohesion; machine translation evaluation; text coherence

Indexed keywords

AUTOMATIC EVALUATION; DOCUMENT STRUCTURE; EVALUATION METRICS; LEXICAL COHESION; MACHINE TRANSLATION EVALUATIONS; MACHINE TRANSLATIONS; SENTENCE LEVEL;

ADHESION; COMPUTATIONAL LINGUISTICS; INFORMATION THEORY; KNOWLEDGE ENGINEERING; QUALITY CONTROL;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84857244183     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/NLPKE.2011.6138201     Document Type: Conference Paper

References (19)

1. K. Papineni, S. Roukos, T. Ward and W.-J. Zhu. "BLEU: A method for automatic evaluation of machine translation," Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL-2002), pp. 311-318. Philadelphia, PA,2002.
2. M. Snover, N. Madnani, BJ. Dorr and R. Schwartz. "Fluency, adequacy, or HTER? Exploring different human judgments with a tunable MT metric," Proceedings of the EACL-2009 Workshop on Statistical Machine Translation (WMT09), pp. 259-268. Athens, Greece, 2009.
3. S. Banerjee and A. Lavie. "METEOR: An automatic metric for MT evaluation with improved correlation with human judgments," Proceedings of Workshop on Intrinsic and Extrinsic Evaluation Measures for MT and/or Summarization at the 43th Annual Meeting of the Association of Computational Linguistics (ACL-2005), Ann Arbor, Michigan, 2005.
4. B. Wong and C. Kit. "ATEC: Automatic evaluation of machine translation via word choice and word order," Machine Translation, vol. 23(2), pp. 141-155,2009.
5. K. J. Miller and M. Vanni. "Scaling the ISLE taxonomy: Development of metrics for the multi-dimensional characterisation of machine translation quality," Proceedings of MT Summit VIII, pp. 229-234. Santiago de Compostela, Spain, 2001.
6. E. M. Visser and M. Fuji. "Using sentence connectors for evaluating MT output," Proceedings of the 16th International Conference on Computational Linguistics (COLING-1996), pp. 1066-1069. Center for Sprogteknologi, Copenhagen, 1996.
7. M. Vasconcellos. "Cohesion and coherence in the presentation of machine translation products," In J. E. Alatis, ed., Georgetown University Round Table on Languages and Linguistics 1989, pp. 89-105, Washington, D.C., Georgetown University Press, 1989.
8. Y. Wilks. "The value of the monolingual component in MT evaluation and its role in the battelle," Report on SYSTRAN. Luxembourg CEC Memorandum, 1978.
9. V. G. Slype. "Critical study of methods for evaluating the quality of machine translation," Prepared for the Commission of European Communities Directorate General Scientific and Technical Information and Information Management, Report BR 19142, 1979.
10. M. A. K. Halliday and R. Hasan. Cohesion in English, London: Longman, 1976.
11. J. Martin. English Text: System and structure, Philadelphia: John Benjamins, 1992.
12. H. Saggion and A. Carvalho. "Text structure aiming at machine translation," XII Artificial Intelligence National Meeting - RNIA'95, Cuernavaca, Morelos, Mexico, 1995.
13. E. Comelles, J. Gimenez, L. Marquez, I. Castellon and V. Arranz. "Document-level automatic MT evaluation based on discourse representations," Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, 2010.
14. H. Kamp and U. Reyle. From Discourse to Logic: An Introduction to Model Theoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory, Dordrecht: Kluwer, 1993.
15. M. Przybocki, K. Peterson and S. Bronsart. "2008 NIST metrics for machine translation (MetricsMATR08) development data," Linguistic Data Consortium, Philadelphia, 2009.
16. W. Mann and S. Thompson. "Rhetorical structure theory: Toward a functional theory of text organization," Text, vol. 8(3), pp. 243-281, 1988.
17. C. Fellbaum. WordNet: An Electronic Lexical Database. Cambridge, MA: MIT Press, 1998.
18. Z. Wu and M. Palmer. "Verb semantics and lexical selection," Proceedings of the 32nd Annual Meeting of the Association for Computational Linguistics (ACL-1994). Las Cruces, New Mexico, 1994.
19. B. T.M. Wong. "Semantic evaluation of machine translation," Proceedings of the 7th International Conference on Language Resource and Evaluation (LREC 2010). Valletta, Malta, 2010.