Evaluate with Confidence Estimation: Machine ranking of translation outputs using grammatical features

WMT 2011 - 6thWorkshop on Statistical Machine Translation, Proceedings of the Workshop

Volumn , Issue , 2011, Pages 65-70

  Avramidis, Eleftherios ^a   Popovic, Maja ^a   Vilar, David ^a   Burchardt, Aljoscha ^a  

^a GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; SYNTACTICS; TRANSLATION (LANGUAGES);

CONFIDENCE ESTIMATION; EVALUATION METHODS; GOOD CORRELATIONS; LANGUAGE PAIRS; NO-REFERENCE; PILOT STUDIES; STATISTICAL CLASSIFIER;

CLASSIFICATION (OF INFORMATION);

EID: 84876802913     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. John Blatz, Erin Fitzgerald, George Foster, Simona Gandrabur, Cyril Goutte, Alex Kulesza, Alberto Sanchis, and Nicola Ueffing. 2004a. Confidence estimation for machine translation. In Proceedings of the 20th international conference on Computational Linguistics, COLING'04, Stroudsburg, PA, USA. Association for Computational Linguistics.
2. John Blatz, Erin Fitzgerald, George Foster, Simona Gandrabur, Cyril Goutte, Alex Kulesza, Alberto Sanchis, and Nicola Ueffing. 2004b. Confidence estimation for machine translation. In M. Rollins (Ed.), Mental Imagery. Yale University Press.
3. Chris Callison-Burch, Cameron Fordyce, Philipp Koehn, Christof Monz, and Josh Schroeder. 2008. Further meta-evaluation of machine translation. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 70-106, Columbus, Ohio, June. Association for Computational Linguistics.
4. Chris Callison-Burch, Philipp Koehn, Christof Monz, and Josh Schroeder. 2009. Findings of the 2009 Workshop on Statistical Machine Translation. In Proceedings of the Fourth Workshop on Statistical Machine Translation, pages 1-28, Athens, Greece, March. Association for Computational Linguistics.
5. Chris Callison-Burch, Philipp Koehn, Christof Monz, Kay Peterson, Mark Przybocki, and Omar Zaidan. 2010. Findings of the 2010 joint workshop on statistical machine translation and metrics for machine translation. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 17-53, Uppsala, Sweden, July. Association for Computational Linguistics. Revised August 2010.
6. William S. Cleveland. 1979. Robust locally weighted regression and smoothing scatterplots. Journal of the American statistical association, 74(368):829-836.
7. Janez Demšar, Blaz Zupan, Gregor Leban, and Tomaz Curk. 2004. Orange: From experimental machine learning to interactive data mining. In Principles of Data Mining and Knowledge Discovery, pages 537-539.
8. Dan Garrette and Ewan Klein. 2009. An extensible toolkit for computational semantics. In Proceedings of the Eighth International Conference on Computational Semantics, IWCS-8'09, pages 116-127, Stroudsburg, PA, USA. Association for Computational Linguistics.
9. Kenji Kira and Larry A. Rendell. 1992. The feature selection problem: traditional methods and a new algorithm. In Proceedings of the tenth national conference on Artificial intelligence, AAAI'92, pages 129-134. AAAI Press.
10. Tibor Kiss, Jan Strunk, Ruhr universität Bochum, and Ruhr universität Bochum. 2006. Unsupervised multilingual sentence boundary detection. In Proceedings of IICS-04, Guadalajara, Mexico and Springer LNCS 3473.
11. Igor Kononenko. 1994. Estimating attributes: analysis and extensions of relief. In Proceedings of the European conference on machine learning on Machine Learning, pages 171-182, Secaucus, NJ, USA. Springer-Verlag New York, Inc.
12. Slav Petrov and Dan Klein. 2007. Improved inference for unlexicalized parsing. In In HLT-NAACL'07.
13. Slav Petrov, Leon Barrett, Romain Thibaux, and Dan Klein. 2006. Learning accurate, compact, and interpretable tree annotation. In In ACL'06, pages 433-440.
14. Sylvain Raybaud and Kamel Smaili Caroline Lavecchia, David Langlois. 2009. Word-and sentence-level confidence measures for machine translation. In European Association of Machine Translation 2009.
15. Antti-Veikko Rosti, Necip Fazil Ayan, Bing Xiang, Spyros Matsoukas, Richard Schwartz, and Bonnie J. Dorr. 2007. Combining outputs from multiple machine translation systems. In Proceedings of the North American Chapter of the Association for Computational Linguistics Human Language Technologies, pages 228-235.
16. Lucia Specia, Marco Turchi, Zhuoran Wang, John Shawe-Taylor, and Craig Saunders. 2009. Improving the confidence of machine translation quality estimates. In Machine Translation Summit XII, Ottawa, Canada.
17. Lucia Specia, Dhwaj Raj, and Marco Turchi. 2010. Machine translation evaluation versus quality estimation. Machine Translation, 24:39-50, March.
18. Andreas Stolcke. 2002. Srilm-an extensible language modeling toolkit. In Proceedings of the 7th International Conference on Spoken Language Processing (ICSLP 2002, pages 901-904.
19. Nicola Ueffing and Hermann Ney. 2005. Word-level confidence estimation for machine translation using phrase-based translation models. Computational Linguistics, pages 763-770.