Predicting machine translation adequacy with document embeddings

10th Workshop on Statistical Machine Translation, WMT 2015 at the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP 2015 - Proceedings

Volumn , Issue , 2015, Pages 402-410

  Vela, Mihaela ^a   Tan, Liling ^a  

^a SAARLAND UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; EMBEDDINGS; FORECASTING; MACHINE TRANSLATION; NATURAL LANGUAGE PROCESSING SYSTEMS;

BAYESIAN; EMBEDDINGS; HUMAN JUDGMENTS; LANGUAGE INDEPENDENTS; MACHINE TRANSLATIONS; STATISTICAL MACHINE TRANSLATION; SYSTEM LEVELS;

SEMANTICS;

EID: 84994327891     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (46)

1. Eneko Agirre, Carmen Banea, Claire Cardie, Daniel Cer, Mona Diab, Aitor Gonzalez-Agirre, Weiwei Guo, Rada Mihalcea, German Rigau, and Janyce Wiebe. 2014. SemEval-2014 Task 10: Multilingual Semantic Textual Similarity. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), Dublin, Ireland, August.
2. Piyush Arora, Chris Hokamp, Jennifer Foster, and Gareth Jones. 2015. DCU: Using Distributional Semantics and Domain Adaptation for the Semantic Textual Similarity SemEval-2015 Task 2. In Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), pages 143-147, Denver, Colorado, June.
3. Alberto Barrón-Cedeño, Lluís Màrquez, Maria Fuentes, Horacio Rodriguez, and Jordi Turmo. 2013. UPC-CORE: What Can Machine Translation Evaluation Metrics and Wikipedia Do for Estimating Semantic Textual Similarity? In 2nd Joint Conference on Lexical and Computational Semantics (SEM), pages 143-147, Atlanta, Georgia, USA, June.
4. Antoine Bordes, Jason Weston, Ronan Collobert, and Yoshua Bengio. 2011. Learning Structured Embeddings of Knowledge Bases. In Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI).
5. Antoine Bordes, Xavier Glorot, Jason Weston, and Yoshua Bengio. 2012. Joint learning of words and meaning representations for open-text semantic parsing. In Proceedings of the 18th International Conference on Artificial Intelligence and Statistics, pages 127-135, La Palma, Canary Islands, April.
6. Samuel R. Bowman, Christopher Potts, and Christopher D. Manning. 2015. Learning DistributedWord Representations for Natural Logic Reasoning. In Proceedings of the Association for the Advancement of Artificial Intelligence Spring Symposium (AAAI), pages 10-13, March.
7. Chris Callison-Burch, Cameron Fordyce, Philipp Koehn, Christof Monz, and Josh Schroeder. 2007. (Meta-) Evaluation of Machine Translation. In Proceedings of the 2ndWorkshop on Statistical Machine Translation (WMT), pages 136-158.
8. Danqi Chen and Christopher Manning. 2014. A Fast and Accurate Dependency Parser using Neural Networks. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 740-750, Doha, Qatar, October.
9. Elisabet Comelles and Jordi Atserias. 2014. VERTa Participation in the WMT14 Metrics Task. In Proceedings of the 9th Workshop on Statistical Machine Translation (WMT), pages 368-375, Baltimore, Maryland, USA, June. Association for Computational Linguistics.
10. Michael Denkowski and Alon Lavie. 2014. Meteor Universal: Language Specific Translation Evaluation for Any Target Language. In Proceedings of the Workshop on Statistical Machine Translation (WMT).
11. George Doddington. 2002. Automatic Evaluation of Machine Translation Quality Using N-gram Co-Occurrence Statistics. In Proceedings of the 2nd International Conference on Human Language Technologies (HLT), pages 138-145.
12. Christian Federmann. 2012. Appraise: An Open-Source Toolkit for Manual Evaluation of Machine Translation Output. PBML, 98:25-35, 9.
13. Meritxell Gonzàlez, Alberto Barrón-Cedeño, and Lluís Màrquez. 2014. IPA and STOUT: Leveraging Linguistic and Source-based Features for Machine Translation Evaluation. In Proceedings of the 9th Workshop on Statistical Machine Translation (WMT), pages 394-401, Baltimore, Maryland, USA, June. Association for Computational Linguistics.
14. Ana Guerberof. 2009. Productivity and Quality in the Post-editing of Outputs from Translation Memories and Machine Translation. International Journal of Localization, 7(1).
15. Aaron L. F. Han, Derek F. Wong, and Lidia S. Chao. 2012. LEPOR: A Robust Evaluation Metric for Machine Translation with Augmented Factors. In Proceedings of COLING 2012: Posters, pages 441-450, Mumbai, India, December.
16. Pingping Huang and Baobao Chang. 2014. SSMT:A Machine Translation Evaluation View To Paragraphto-Sentence Semantic Similarity. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pages 585-589, Dublin, Ireland, August.
17. Eric H. Huang, Richard Socher, Christopher D. Manning, and Andrew Y. Ng. 2012. Improving word representations via global context and multiple word prototypes. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (ACL), pages 873-882.
18. Thomas K. Landauer and Susan T. Dutnais. 1997. A Solution to Platos Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. PSYCHOLOGICAL REVIEW, 104(2):211-240.
19. Vladimir Iosifovich Levenshtein. 1966. Binary Codes Capable of Correcting Deletions, Insertions and Reversals. Soviet Physics Doklady, 10(8):707-710.
20. Linguistics Data Consortium. 2005. Linguistic Data Annotation Specification: Assessment of Fluency and Adequacy in Translations.
21. Chi-Kiu Lo and Dekai Wu. 2011a. MEANT: An Inexpensive, High-accuracy, Semi-automatic Metric for Evaluating Translation Utility Based on Semantic Roles. In Proceedings of the 49th Annual Meeting of the Association of Computational Linguistics: Human Language Technologies (ACL-HLT), pages 220-229.
22. Chi-Kiu Lo and Dekai Wu. 2011b. SMT vs. AI redux: How Semantic Frames Evaluate MT More Accurately. In Proceedings of the 22nd International Joint Conference on Artificial Intelligence (IJCAI).
23. Chi-Kiu Lo and Dekai Wu. 2011c. Structured vs. Flat Semantic Role Representations for Machine Translation Evaluation. In Proceedings of the 5th Workshop on Syntax and Structure in Statistical Translation (SSST).
24. Chi-kiu Lo, Anand Karthik Tumuluru, and Dekai Wu. 2012. Fully Automatic Semantic MT Evaluation. In Proceedings of the 7th Workshop on Statistical Machine Translation (WMT), pages 243-252, Montréal, Canada, June. Association for Computational Linguistics.
25. Tucker Maney, Linda Sibert, Dennis Perzanowski, Kalyan Gupta, and Astrid Schmidt-Nielsen. 2012. Toward Determining the Comprehensibility of Machine Translations. In Proceedings of the 1st PITR, pages 1-7.
26. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient Estimation of Word Representations in Vector Space. arXiv, 1301.3781.
27. George A. Miller. 1995. WordNet: A Lexical Database for English. Communications of the ACM, 38(11):39-41, November.
28. Kishore Papineni, Salim Roukos, ToddWard, andWei-Jing Zhu. 2002. BLEU: A Method for Automatic Evaluation of Machine Translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), pages 311-318.
29. Mohammad Taher Pilehvar, David Jurgens, and Roberto Navigli. 2013. Align, Disambiguate and Walk: A Unified Approach for Measuring Semantic Similarity. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, pages 1341-1351, Sofia, Bulgaria, August.
30. Miguel Rios, Wilker Aziz, and Lucia Specia. 2012. UOW: Semantically Informed Text Similarity. In The 1st Joint Conference on Lexical and Computational Semantics (SEM), pages 673-678, Montréal, Canada, June.
31. Carolina Scarton, Marcos Zampieri, Mihaela Vela, Josef van Genabith, and Lucia Specia. 2015. Searching for Context: A Study on Document-Level Labels for Translation Quality Estimation. In Proceedings of the 18th Annual Conference of the European Association for Machine Translation (EAMT), pages 121-128, Antalya, Turkey, May.
32. Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006. A Study of Translation Edit Rate with Targeted Human Annotation. In Proceedings of the Association for Machine Translation in the Americas (AMTA), pages 223-231.
33. Matthew Snover, Nitin Madnani, Bonnie Dorr, and Richard Schwartz. 2009. Fluency, Adequacy, or HTER? Exploring Different Human Judgments with a Tunable MT Metric. In Proceedings of the 4th Workshop on Statistical Machine Translation (WMT), pages 259-268.
34. Md Arafat Sultan, Steven Bethard, and Tamara Sumner. 2015. DLS@CU: Sentence Similarity from Word Alignment and Semantic Vector Composition. In Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), pages 148-153, Denver, Colorado, June.
35. Liling Tan and Francis Bond. 2013. Xling: Matching query sentences to a parallel corpus using topic models for wsd. In Proceedings of the 7th International Workshop on Semantic Evaluation (SemEval 2013), pages 167-170, Atlanta, Georgia, USA, June.
36. Liling Tan, Rohit Gupta, and Josef van Genabith. 2015a. Usaar-wlv: Hypernym generation with deep neural nets. In Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), pages 932-937.
37. Liling Tan, Carolina Scarton, Lucia Specia, and Josef van Genabith. 2015b. USAAR-SHEFFIELD: Semantic Textual Similarity with Deep Regression and Machine Translation Evaluation Metrics. In Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), pages 85-89, Denver, Colorado, June.
38. Liling Tan. 2013. Examining CrosslingualWord Sense Disambiguation. Master's thesis, Nanyang Technological University.
39. Christoph Tillmann, Stephan Vogel, Hermann Ney, Alexander Zubiaga, and Hassan Sawaf. 1997. Accelerated DP Based Search For Statistical Translation. In Proceedings of the EUROSPEECH, pages 2667-2670.
40. Mihaela Vela and Josef van Genabith. 2015. Reassessing the WMT2013 Human Evaluation with Professional Translators Trainees. In Proceedings of the 18th Annual Conference of the European Association for Machine Translation (EAMT), pages 161-168, May.
41. Mihaela Vela, Anne-Kathrin Schumann, and Andrea Wurm. 2014a. Beyond Linguistic Equivalence. An Empirical Study of Translation Evaluation in a Translation Learner Corpus. In Proceedings of the EACL Workshop on Humans and Computer-assisted Translation (HaCat), pages 47-56, April.
42. Mihaela Vela, Anne-Kathrin Schumann, and Andrea Wurm. 2014b. Human Translation Evaluation and its Coverage by Automatic Scores. In Proceedings of the Language Resources and Evaluation Conference Workshop on Automatic and Manual Metrics for Operational Translation Evaluation (MTE), pages 20-30, May.
43. Radim Řehuřek and Petr Sojka. 2010. Software framework for topic modelling with large corpora. In Proceedings of Language Resources and Evaluation Conference, pages 46-50, Valletta, Malta.
44. Frane Šarić, Goran Glavaš, Mladen Karan, Jan Šnajder, and Bojana Dalbelo Bašić. 2012. TAKELAP: Systems for Measuring Semantic Text Similarity. In Proceedings of the 1st Joint Conference on Lexical and Computational Semantics (SEM), pages 441-448.
45. Sandra Weiss and Lars Ahrenberg. 2012. Error Profiling for Evaluation of Machine-translated Text: A Polish-English Case Study. In Proceedings of the 8th Language Resources and Evaluation Conference (LREC), pages 1764-1770.
46. Marcos Zampieri and Mihaela Vela. 2014. Quantifying the Influence of MT Output in the Translators Performance: A Case Study in Technical Translation. In Proceedings of the EACL Workshop on Humans and Computer-assisted Translation (HaCat), pages 93-98, April.