Document-level translation quality estimation: Exploring discourse and pseudo-references

Proceedings of the 17th Annual Conference of the European Association for Machine Translation, EAMT 2014

Volumn , Issue , 2014, Pages 101-108

  Scarton, Carolina ^a   Specia, Lucia ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTATIONAL LINGUISTICS; FORECASTING; LEARNING SYSTEMS; SUPERVISED LEARNING;

MACHINE TRANSLATIONS; PREDICTION MODEL; QUALITY ESTIMATION; QUALITY PREDICTION; SENTENCE BOUNDARIES; SENTENCE LEVEL; SUPERVISED MACHINE LEARNING; TRANSLATION QUALITY;

COMPUTER AIDED LANGUAGE TRANSLATION;

EID: 85000809677     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. Albrecht, Joshua S. and Rebecca Hwa. 2008. The Role of Pseudo References in MT Evaluation. In Proceedings of WMT 2008, pages 187-190, Columbus, OH.
2. Almaghout, Hala and Lucia Specia. 2013. A CCG-based Quality Estimation Metric for Statistical Machine Translation. In Proceedings of the XIV MT Summit, pages 223-230, Nice, France.
3. Avramidis, Eleftherios, Maja Popovic, David Vilar Torres, and Aljoscha Burchardt. 2011. Evaluate with confidence estimation: Machine ranking of translation outputs using grammatical features. In Proceedings of WMT 2011, pages 65-70, Edinburgh, UK.
4. Aziz, Wilker and Lucia Specia. 2011. Fully Automatic Compilation of a Portuguese-English Parallel Corpus for Statistical Machine Translation. In Proceedings of STIL 2011, Cuiabá, MT, Brazil.
5. Bach, Nguyen, Fei Huang, and Yaser Al-Onaizan. 2011. Goodness: A method for measuring machine translation confidence. In Proceedings of ACL 2011, pages 211-219, Portland, OR.
6. Banerjee, Satanjeev and Alon Lavie. 2005. METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. In Proceedings of the ACL 2005 Workshop on Intrinsic and Extrinsic Evaluation Measures for MT and/or Summarization, pages 65-72, Ann Arbor, MI.
7. Blatz, John, Erin Fitzgerald, George Foster, Simona Gandrabur, Cyril Goutte, Alex Kulesza, Alberto Sanchis, and Nicola Ueffing. 2004. Confidence Estimation for Machine Translation. In Proceedings of COLING 2004, pages 315-321, Geneva, Switzerland.
8. Bojar, Ondřej, Christian Buck, Chris Callison-Burch, Christian Federmann, Barry Haddow, Philipp Koehn, Christof Monz, Matt Post, Radu Soricut, and Lucia Specia. 2013. Findings of the 2013 Workshop on Statistical Machine Translation. In Proceedings of WMT 2013, pages 1-44, Sofia, Bulgaria.
9. Carpuat, Marine and Michel Simard. 2012. The trouble with SMT consistency. In Proceedings of WMT 2012, pages 442-449, Montréal, Canada.
10. Felice, Mariano and Lucia Specia. 2012. Linguistic features for quality estimation. In Proceedings of WMT 2012, pages 96-103, Montréal, Canada.
11. Giménez, Jesús and Lluís Màrquez. 2010. Asiya: An Open Toolkit for Automatic Machine Translation (Meta-)Evaluation. The Prague Bulletin of Mathematical Linguistics, 94:77-86.
12. Graesser, Arthur C., Danielle S. McNamara, Max M. Louwerse, and Zhiqiang Cai. 2004. Coh-Metrix: Analysis of text on cohesion and language. Behavior Research Methods, Instruments, and Computers, 36(2):193-202.
13. Hardmeier, Christian. 2011. Improving machine translation quality prediction with syntatic tree kernels. In Proceedings of EAMT 2011, pages 233-240, Leuven, Belgium.
14. Koehn, Philipp, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Bertoldi Nicola Federico, Marcello, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, and Evan Herbst. 2007. MOSES: Open source Toolkit for Statistical Machine Translation. In Proceedings of ACL 2007, demonstration session, Prague, Czech Republic.
15. Landauer, Thomas K., Peter W. Foltz, and Darrell Laham. 1998. An Introduction to Latent Semantic Analysis. Discourse Processes, 25(2-3):259-284.
16. Louis, Annie and Ani Nenkova. 2013. Automatically Assessing Machine Summary Content Without a Gold Standard. Computational Linguistics, 39(2):267-300.
17. Papineni, Kishore, Salim Roukos, Todd Ward, and Wei jing Zhu. 2002. BLEU: a Method for Automatic Evaluation of Machine Translation. In Proceedings of ACL 2002, pages 311-318, Philadelphia, PA.
18. Pighin, D and L Màrquez. 2011. Automatic projection of semantic structures: an application to pairwise translation ranking. In Proceedings of SSST-5, pages 1-9, Portland, OR.
19. Rubino, Raphael, José G. C. de Souza, Jennifer Foster, and Lucia Specia. 2013. Topic Models for Translation Quality Estimation for Gisting Purposes. In Proceedings of the XIV MT Summit, pages 295-302, Nice, France.
20. Shah, Kashif, Trevor Cohn, and Lucia Specia. 2013. An Investigation on the Effectiveness of Features for Translation Quality Estimation. In Proceedings of the XIV MT Summit, pages 167-174, Nice, France.
21. Snover, Matthew, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006. A study of Translation Edit Rate with Targeted Human Annotation. In Proceedings of AMTA 2006, pages 223-231, Cambridge, MA.
22. Soricut, Radu and Abdessamad Echihabi. 2010. TrustRank: Inducing Trust in Automatic Translations via Ranking. In Proceedings of the ACL 2010, pages 612-621, Uppsala, Sweden.
23. Soricut, Radu and Sushant Narsale. 2012. Combining Quality Prediction and System Selection for Improved Automatic Translation Output. In Proceedings of WMT 2012, pages 163-170, Montréal, Canada.
24. Soricut, Radu, Nguyen Bach, and Ziyuan Wang. 2012. The SDL Language Weaver Systems in the WMT12 Quality Estimation Shared Task. In Proceedings of WMT 2012, pages 145-151, Montréal, Canada.
25. Specia, Lucia, Marco Turchi, Nicola Cancedda, Marc Dymetman, and Nello Cristianini. 2009. Estimating the Sentence-Level Quality of Machine Translation Systems. In Proceedings of EAMT 2009, EAMT-2009, pages 28-37, Barcelona, Spain.
26. Specia, Lucia, Kashif Shah, Jose G.C. de Souza, and Trevor Cohn. 2013. QuEst - A translation quality estimation framework. In Proceedings of WMT 2013: System Demonstrations, ACL-2013, pages 79-84, Sofia, Bulgaria.
27. Wong, Billy T. M. and Chunyu Kit. 2012. Extending machine translation evaluation metrics with lexical cohesion to document level. In Proceedings of EMNLP-CONLL 2012, pages 1060-1068, Jeju Island, Korea.
28. Xiong, Deyi, Min Zhang, and Haizhou Li. 2010. Error detection of statistical machine translation using linguistic features. In Proceedings of ACL 2010, pages 604-611, Uppsala, Sweden.