Semantic evaluation of machine translation

Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010

Volumn , Issue , 2010, Pages 2884-2888

  Wong, Billy Tak Ming ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; KNOWLEDGE BASED SYSTEMS; LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; ONTOLOGY; SEMANTICS; TRANSLATION (LANGUAGES);

CORPUS-BASED MEASURES; EVALUATION METRICS; LATENT SEMANTIC ANALYSIS; LEXICAL SEMANTICS; LINGUISTIC FEATURES; MACHINE TRANSLATIONS; SEMANTIC EVALUATIONS; TRANSLATION QUALITY;

QUALITY CONTROL;

EID: 84883360678     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Babych, B. & Hartley, A. (2008). Sensitivity of Automated MT Evaluation Metrics on Higher Quality MT Output: BLEU vs Task-Based Evaluation Methods. The Sixth International Language Resources and Evaluation (LREC'08).
2. Banerjee, S. & Lavie, A. (2005). METEOR: an Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. ACL-2005: Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, University of Michigan, Ann Arbor, pages 65-72.
3. Banerjee, S. & Pedersen, T. (2002). An Adapted Lesk Algorithm for Word Sense Disambiguation Using WordNet. In Proceedings of the Fourth International Conference on Computational Linguistics and Intelligent Text Processing (CICLING-02). Mexico City.
4. Budanitsky, A. & Hirst, G. (2001). Semantic Distance in WordNet: An Experimental, Application-Oriented Evaluation of Five Measures. Workshop on WordNet and Other Lexical Resources, Second meeting of the North American Chapter of the Association for Computational Linguistics. Pittsburgh.
5. Budanitsky, A. & Hirst, G. (2006). Evaluating Word-Net-based Measures of Lexical Semantic Relatedness. Computational Linguistics. 32(1): 13-47.
6. Callison-Burch, C., Osborne, M. & Koehn, P. (2006). Re-evaluating the Role of BLEU in Machine Translation Research. 11th Conference of the European Chapter of the Association for Computational Linguistics. pages 249-256.
7. Callison-Burch, C., Fordyce, C., Koehn, P., Monz, C. & Schroeder, J. (2007). (Meta-) Evaluation of Machine Translation. In Proceedings of the Second Workshop on Statistical Machine Translation, pages 136-158.
8. Chan, Y.S. & Ng, H.T. (2008). MAXSIM: a Maximum Similarity Metric for Machine Translation Evaluation. In Proceedings of ACL-08:HLT, pages 55-62.
9. Hirst, G. & St-Onge, D. (1998). Lexical Chains as Representations of Context for the Detection and Correction of Malapropisms. In Christiane Fellbaum (ed.) WordNet: An Electronic Lexi cal Database. MIT Press, pages 305-332.
10. Jiang, J. J. & Conrath, D. W. (1997). Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy. In Proceedings of International Conference on Research in Computational Linguisti cs. Taiwan.
11. Landauer, T. K., Foltz, P. & Laham, D. (1998). Introduction to Latent Semantic Analysis. Discourse Processes 25.
12. Leacock, C. & Chodorow, M. (1998). Combining Local Context and WordNet Similarity for Word Sense Identification. In Christiane Fellbaum (ed.) WordNet: An Electronic Lexical Database. MIT Press, pages 265-283.
13. Lin, D. (1998). An Information-Theoretic Definition of Similarity. In Proceedings of the 15th International Conference on Machine Learning. Madison, WI.
14. Liu, P-Y., Zhao, T-J. & Yu, X-F. (2006). Application-Oriented Comparison and Evaluation of Six Semantic Similarity Measures Based on WordNet. In Proceedings of the Fifth International Conference on Machine Learning and Cybernetics. Dalian, pages 2605-2610.
15. Navigli, R. (2006). Meaningful Clustering of Senses Helps Boost Word Sense Disambiguation Performance. In Proceedings of the 44th Annual Meeting of the Association for Computational Linguistics joint with the 21st International Conference on Computational Linguistics (COLING-ACL 2006), Sydney, Australia, pages 105-112.
16. Papineni, K., Roukos, S., Ward, T. & Zhu, W.-J. (2001). Bleu: a Method for Automatic Evaluation of Machine Translation. IBM Research Report.
17. Przybocki, M., Peterson, K. & Bronsart, S. (2009). 2008 NIST Metrics for Machine Translation (Metrics-MATR08) Development Data. Linguistic Data Consortium, Philadelphia.
18. Pucher, M. (2005). Performance Evaluation of Word-Net-based Semantic Relatedness Measures for Word Prediction in Conversational Speech. In Proceedings of the International Workshop on Computational Semantics. Tilburg, Netherlands.
19. Reeder, F. (2006). Measuring MT Adequacy Using Latent Semantic Analysis. In Proceedings of the 7th Conference of the Association for Machine Translation of the Americas. Cambridge, Massachusetts, pages 176-184.
20. Resnik, P. (1995). Using Information Content to Evaluate Semantic Similarity. In Proceedings of the 14th International Joint Conference on Artificial Intelligence, Montreal, pages 448-453.
21. Snover, M., Madnani, N., Dorr, B. & Schwartz, R. (2009). Fluency, Adequacy, or HTER? Exploring Different Human Judgments with a Tunable MT Metric. In Proceedings of the Fourth Workshop on Statistical Machine Translation at the 12th Meeting of the European Chapter of the Association for Computational Li nguisti cs (EACL-2009), Athens, Greece.
22. Snow, R., Prakash, S., Jurafsky, D. & Ng, A.Y. (2007). Learning to Merge Word Senses. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), Prague, Czech Republic, pages 1005-1014.
23. Wong, B. & Kit, C. (2010). ATEC: Automatic Evaluation of Machine Translation via Word Choice and Word Order. Machine Translation, 23(2):141-155.
24. Wu, Z. & Palmer, M. (1994). Verb Semantics and Lexical Selection. In Proceedings of the 32nd Annual Meeting of the Association for Computational Linguistics. Las Cruces, New Mexico.