Estimating the sentence-level quality of machine translation systems

Proceedings of the 13th Annual Conference of the European Association for Machine Translation, EAMT 2009

Volumn , Issue , 2009, Pages 28-35

  Specia, Lucia ^a   Cancedda, Nicola ^a   Dymetman, Marc ^a   Turchi, Marco ^b   Cristianini, Nello ^b  

^a XEROX RESEARCH CENTRE EUROPE   (France)

^b UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

LANGUAGE PAIRS; MACHINE TRANSLATION SYSTEMS; MT EVALUATIONS;

CONTENT BASED RETRIEVAL; EXPERIMENTS;

INFORMATION THEORY;

EID: 80053417434     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Albrecht, J. and R. Hwa. 2007a. A re-examination of machine learning approaches for sentence-level mt evaluation. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 880-887, Prague.
2. Albrecht, J. and R. Hwa. 2007b. Regression for sentence-level mt evaluation with pseudo references. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 296-303, Prague.
3. Blatz, J., E. Fitzgerald, G. Foster, S. Gandrabur, C. Goutte, A. Kulesza, A. Sanchis, and N. Ueffing. 2003. Confidence estimation for machine translation. Technical report, Johns Hopkins University, Baltimore.
4. Blatz, J., E. Fitzgerald, G. Foster, S. Gandrabur, C. Goutte, A. Kulesza, A. Sanchis, and N. Ueffing. 2004. Confidence estimation for machine translation. In Proceedings of the 20th Conference on Computational Linguistics, pages 315-321, Geneva.
5. Callison-Burch, C., C. Fordyce, P. Koehn, C. Monz, and J. Schroeder. 2008. Further meta-evaluation of machine translation. In Proceedings of the 3rd Workshop on Statistical Machine Translation, pages 70-106, Columbus.
6. Doddington, G. 2002. Automatic evaluation of machine translation quality using n-gram co-occurrence statistics. In Proceedings of the 2nd Conference on Human Language Technology Research, pages 138-145, San Diego.
7. Frenich, A. G., A. G. Jouan-Rimbaud, D. Massart, D. L. Kuttatharmmakul, S. Martinez Galera, and J. L. M. Martinez Vidal. 1995. Wavelength selection method for multicomponent spectrophotometric determinations using partial least squares. Analist, 120(12):2787-2792.
8. Gamon, M., A. Aue, and M. Smets. 2005. Sentence-level mt evaluation without reference translations: beyond language modeling. In Proceedings of the European Association for Machine Translation Conference, Budapest.
9. Gandrabur, S. and G. Foster. 2003. Confidence estimation for translation prediction. In Proceedings of the 7th Conference on Natural Language Learning, pages 95-102, Edmonton. 3
10. Giménez, J. and L. Màrquez. 2008. Heterogeneous automatic mt evaluation through non-parametric metric combinations. In Proceedings of the 3rd International Joint Conference on Natural Language Processing, pages 319-326, Hyderabad.
11. Jong, S De. 1993. Simpls: An alternative approach to partial least squares regression. Chemometrics and Intelligent Laboratory Systems, 18:251-263.
12. Kadri, Y. and J. Y. Nie. 2006. Improving query translation with confidence estimation for cross language information retrieval. In Proceedings of the 15th Conference on Information and Knowledge Management, pages 818-819, Arlington.
13. Koehn, P. and C. Monz. 2006. Manual and automatic evaluation of machine translation between european languages. In Proceedings of the Workshop on Statistical Machine Translation, pages 102-121, New York.
14. Koehn, P. 2004. Statistical significance tests for machine translation evaluation. In Conference on Empirical Methods in Natural Language Processing, Barcelona.
15. Kulesza, A. and A. Shieber. 2004. A learning approach to improving sentence-level mt evaluation. In Proceedings of the 10th International Conference on Theoretical and Methodological Issues in Machine Translation, Baltimore.
16. Papineni, K., S. Roukos, T. Ward, and W. Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, page 311318, Morristown.
17. Paul, M., A. Finch, and E. Sumita. 2007. Reducing human assessment of machine translation quality to binary classifiers. In Proceedings of the 11th Conference on Theoretical and Methodological Issues in Machine Translation, pages 154-162, Skovde.
18. Quirk, C. B. 2004. Training a sentence-level machine translation confidence measure. In Proceedings of the 4th Conference on Language Resources and Evaluation, pages 825-828, Lisbon.
19. Rosipal, R. and L. J. Trejo. 2001. Kernel partial least squares regression in reproducing kernel hilbert space. Machine Learning Research, 2:97-123.
20. Ueffing, N. and H. Ney. 2005. Application of word-level confidence measures in interactive statistical machine translation. In Proceedings of the 10th Conference of the European Association for Machine Translation, pages 262-270, Budapest.
21. Wold, S., A. Ruhe, H. Wold, and W. J. Dunn. 1984. The covariance problem in linear regression. the partial least squares (pls) approach to generalized inverses. SIAM Journal on Scientific Computing, 5:735-743.