Machine learning methods for comparative and time-oriented Quality Estimation of Machine Translation output

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2013, Pages 329-336

  Avramidis, Eleftherios ^a   Popović, Maja ^a  

^a GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; REGRESSION ANALYSIS; SYNTACTICS;

BLACK BOXES; LOGISTICS REGRESSIONS; MACHINE LEARNING METHODS; MACHINE TRANSLATIONS; PAIRWISE CLASSIFIERS; POST-EDITING; QUALITY ESTIMATION; RANKING OF ALTERNATIVES; SENTENCE LEVEL; SUBTASK;

MACHINE TRANSLATION;

EID: 84992408160     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Avramidis, E. (2012). Comparative Quality Estimation: Automatic Sentence-Level Ranking of Multiple Machine Translation Outputs. In Proceedings of 24th International Conference on Computational Linguistics, pages 115-132, Mumbai, India. The COLING 2012 Organizing Committee.
2. Avramidis, E., Popovic, M., Vilar, D., and Burchardt, A. (2011). Evaluate with Confidence Estimation: Machine ranking of translation outputs using grammatical features. In Proceedings of the Sixth Workshop on Statistical Machine Translation, pages 65-70, Edinburgh, Scotland. Association for Computational Linguistics.
3. Basak, D., Pal, S., and Patranabis, D. C. (2007). Support vector regression. Neural Information Processing-Letters and Reviews, 11(10):203-224.
4. Callison-Burch, C., Koehn, P., Monz, C., Post, M., Soricut, R., and Specia, L. (2012). Findings of the 2012 Workshop on Statistical Machine Translation. In Proceedings of the Seventh Workshop on Statistical Machine Translation, pages 10-51, Montréal, Canada. Association for Computational Linguistics.
5. Callison-Burch, C., Koehn, P., Monz, C., and Zaidan, O. (2011). Findings of the 2011 Workshop on Statistical Machine Translation. In Proceedings of the Sixth Workshop on Statistical Machine Translation, pages 22-64, Edinburgh, Scotland. Association for Computational Linguistics.
6. Cameron, A. (1998). Regression analysis of count data. Cambridge University Press, Cambridge UK; New York NY USA.
7. Demšar, J., Zupan, B., Leban, G., and Curk, T. (2004). Orange: From Experimental Machine Learning to Interactive Data Mining. In Principles of Data Mining and Knowledge Discovery, pages 537-539.
8. Flom, P. L. and Cassell, D. L. (2007). Stopping stepwise: Why stepwise and similar selection methods are bad, and what you should use. In NorthEast SAS Users Group Inc 20th Annual Conference, Baltimore, Maryland. 2007.
9. Friedman, J. H. (1991). Multivariate Adaptive Regression Splines. The Annals of Statistics, 19(1):1-67.
10. Goodstadt, L. (2010). Ruffus: a lightweight Python library for computational pipelines. Bioinformatics, 26(21):2778-2779.
11. Hosmer, D. (1989). Applied logistic regression. Wiley, New York [u.a.], 8th edition.
12. Hunt, E., Martin, J., and Stone, P. (1966). Experiments in Induction. Academic Press, New York.
13. Järvelin, K. and Kekäläinen, J. (2002). Cumulated gain-based evaluation of IR techniques. ACM Trans. Inf. Syst., 20(4):422-446.
14. Kendall, M. G. (1938). A New Measure of Rank Correlation. Biometrika, 30(1-2):81-93.
15. Koehn, P. (2005). Europarl: A parallel corpus for statistical machine translation. Proceedings of the tenth Machine Translation Summit, 5:79-86.
16. Kononenko, I. (1994). Estimating attributes: analysis and extensions of RELIEF. In Proceedings of the European conference on machine learning on Machine Learning, pages 171-182, Secaucus, NJ, USA. Springer-Verlag New York, Inc.
17. Lavie, A. and Agarwal, A. (2007). METEOR: An Automatic Metric for MT Evaluation with High Levels of Correlation with Human Judgments. In Proceedings of the Second Workshop on Statistical Machine Translation, pages 228-231, Prague, Czech Republic. Association for Computational Linguistics.
18. Lin, C.-J., Weng, R. C., and Keerthi, S. S. (2007). Trust region Newton methods for large-scale logistic regression. In Proceedings of the 24th international conference on Machine learning - ICML'07, pages 561-568, New York, New York, USA. ACM Press.
19. Macháček, M.. and Ondřej, B. (2013). Results of the WMT13 Metrics Shared Task. In Proceedings of the 8th Workshop on Machine Translation, Sofia, Bulgaria. Association for Computational Linguistics.
20. Miller, A. (2002). Subset Selection in Regression. Chapman & Hall, London, 2nd edition.
21. Naber, D. (2003). A rule-based style and grammar checker. Technical report, Bielefeld University, Bielefeld, Germany.
22. Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J. (2002). BLEU: a Method for Automatic Evaluation of Machine Translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages 311-318, Philadelphia, Pennsylvania, USA. Association for Computational Linguistics.
23. Petrov, S., Barrett, L., Thibaux, R., and Klein, D. (2006). Learning Accurate, Compact, and Interpretable Tree Annotation. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 433-440, Sydney, Australia. Association for Computational Linguistics.
24. Petrov, S. and Klein, D. (2007). Improved inference for unlexicalized parsing. In Proceedings of the 2007 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Rochester, New York. Association for Computational Linguistics.
25. Robnik-Šikonja, M. and Kononenko, I. (2003). Theoretical and Empirical Analysis of ReliefF and RReliefF. Machine Learning, 53(1-2):23-69.
26. Soricut, R., Wang, Z., and Bach, N. (2012). The SDL Language Weaver Systems in the WMT12 Quality Estimation Shared Task. In Proceedings of the Seventh Workshop on Statistical Machine Translation, pages 145-151, Montréal, Canada. Association for Computational Linguistics.
27. Stolcke, A. (2002). SRILM - An Extensible Language Modeling Toolkit. In Proceedings of the Seventh International Conference on Spoken Language Processing, pages 901-904. ISCA.
28. Stone, M. and Brooks, R. J. (1990). Continuum regression: cross-validated sequentially constructed prediction embracing ordinary least squares, partial least squares and principal components regression. Journal of the Royal Statistical Society Series B Methodological, 52(2):237-269.
29. Taulé, M., Martí, A., and Recasens, M. (2008). An-Cora: Multilevel Annotated Corpora for Catalan and Spanish. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08), Marrakech, Morocco. European Language Resources Association (ELRA).
30. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Series B:267-288.
31. Voorhees, E. (1999). TREC-8 Question Answering Track Report. In 8th Text Retrieval Conference, pages 77-82, Gaithersburg, Maryland, USA.