Word-level confidence estimation for machine translation

Computational Linguistics

Volumn 33, Issue 1, 2007, Pages 9-40

  Ueffing, Nicola ^a,b   Ney, Hermann ^a,c  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b NATIONAL RESEARCH COUNCIL CANADA   (Canada)

^c Informatik VI   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER AIDED LANGUAGE TRANSLATION; PROBABILITY;

AUTOMATICALLY GENERATED; CONFIDENCE ESTIMATION; CONFIDENCE MEASURE; EXPERIMENTAL ASSESSMENT; MACHINE TRANSLATION SYSTEMS; MACHINE TRANSLATIONS; TRANSLATION SYSTEMS; WORD POSTERIOR PROBABILITY;

COMPUTATIONAL LINGUISTICS;

EID: 34047167453     PISSN: 08912017     EISSN: 15309312     Source Type: Journal    
DOI: 10.1162/coli.2007.33.1.9     Document Type: Article

References (39)

1. Akiba, Yasuhiro, Eiichiro Sumita, Hiromi Nakaiwa, Seiichi Yamamoto, and Hiroshi G. Okuno. 2004. Using a mixture of N-best lists from multiple MT systems in rank-sum-based confidence measure for MT outputs. In Proceedings of COLING '04: The 20th International Conference on Computational Linguistics, pages 322-328, Geneva, Switzerland.
2. Bertoldi, Nicola, Roldano Cattoni, Mauro Cettolo, and Marcello Federico. 2004. The ITC-irst statistical machine translation system for IWSLT-2004. In Proceedings of the International Workshop on Spoken Language Translation (IWSLT), pages 51-58, Kyoto, Japan.
3. Bisani, Maximilian and Hermann Ney. 2004. Bootstrap estimates for confidence intervals in ASR performance evaluation. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pages 409-412, Montreal, Canada.
4. Blatz, John, Erin Fitzgerald, George Foster, Simona Gandrabur, Cyril Goutte, Alex Kulesza, Alberto Sanchis, and Nicola Ueffing. 2003. Confidence estimation for machine translation. Final report, JHU/CLSP Summer Workshop. http://www.clsp.jhu.edu/ws2003/groups/estimate/.
5. Blatz, John, Erin Fitzgerald, George Foster, Simona Gandrabur, Cyril Goutte, Alex Kulesza, Alberto Sanchis, and Nicola Ueffing. 2004. Confidence estimation for machine translation. In Proceedings of COLING '04: The 20th International Conference on Computational Linguistics, pages 315-321, Geneva, Switzerland.
6. Brown, Peter F., Stephen A. Della Pietra, Vincent J. Della Pietra, and Robert L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2):263-311.
7. Chiang, David. 2005. A hierarchical phrase-based model for statistical machine translation. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL), pages 263-270, Ann Arbor, MI.
8. Duda, Richard O., Peter E. Hart, and David G. Stork. 2001. Pattern Classification and Scene Analysis. John Wiley & Sons, New York.
9. Gandrabur, Simona and George Foster. 2003. Confidence estimation for text prediction. In Proceedings of the Conference on Natural Language Learning (CoNLL), pages 95-102, Edmonton, Canada.
10. Jayaraman, Shyamsundar and Alon Lavie. 2005. Multi-engine machine translation guided by explicit word matching. In Proceedings of the 10th Annual Conference of the European Association for Machine Translation (EAMT), pages 143-152, Budapest, Hungary.
11. Jurafsky, Daniel and James H. Martin. 2000. Speech and Language Processing. Prentice Hall, Upper Saddle River, NJ.
12. Koehn, Philipp, Franz J. Och, and Daniel Marcu. 2003. Statistical phrase-based translation. In Proceedings of the Human Language Technology Conference (HLT/NAACL), pages 127-133, Edmonton, Canada.
13. Levenshtein, Vladimir 1.1966. Binary codes capable of correcting deletions, insertions and reversals. Soviet Physics Doklady, 10(8):707-710.
14. Ney, Hermann, Volker Steinbiss, Richard Zens, Evgeny Matusov, J. Gonzalez, Young-Suk Lee, Salim Roukos, Marcello Federico, Muntsin Kolss, and Rafael Banchs. 2005. TC-STAR deliverable no. D5: SLT progress report. Technical report, Integrated project TC-STAR (IST-2002-FP6-506738) funded by the European Commission. http://www.tc-star.org/.
15. Nießen, Sonja, Franz J. Och, Gregor Leusch, and Hermann Ney. 2000. An evaluation tool for machine translation: Fast evaluation for MT research. In Proceedings of the Second International Conference on Language Resources and Evaluation (LREC), pages 39-45, Athens, Greece.
16. NIST. 2002. Automatic evaluation of machine translation quality using N-gram co-occurrence statistics. http://nist.gov/speech/tests/mt/.
17. NIST. 2004. Machine translation evaluation Chinese-English, http://nist.gov/speech/tests/mt/.
18. Och, Franz J. 2003. Minimum error rate training in statistical machine translation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (ACL), pages 160-167, Sapporo, Japan.
19. Och, Franz J. and Hermann Ney. 2004. The alignment template approach to statistical machine translation. Computational Linguistics, 30(4):417-449.
20. Och, Franz J., Christoph Tillmann, and Hermann Ney. 1999. Improved alignment models for statistical machine translation. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora (EMNLP/VLC-99), pages 20-28, University of Maryland, College Park, MD.
21. Papineni, Kishore, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), pages 311-318, Philadelphia, PA.
22. Press, William H., Saul A. Teukolsky, William T. Vetterling, and Brian P. Flannery. 2002. Numerical Recipes in C++. Cambridge University Press, Cambridge, UK.
23. Quirk, Chris. 2004. Training a sentence-level machine translation confidence metric. In Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC), pages 825-828, Lisbon, Portugal.
24. Sanchis, Alberto. 2004. Estimación y aplicación de medidas de confianza en reconocimiento automático del habla. Ph.D. thesis, Departamento de Sistemas Informáticos y Computación, Universidad Politécnica de Valencia, Valencia, Spain.
25. Stolcke, Andreas. 2002. SRILM - an extensible language modeling toolkit. In Proceedings of the International Conference on Spoken Language Processing (ICSLP), volume 2, pages 901-904, Denver, CO.
26. TC-STAR. 2005. TC-STAR - Technology and corpora for speech to speech translation. Integrated project TC-STAR (IST-2002-FP6-506738) funded by the European Commission, http://www.tc-star.org/.
27. Tillmann, Christoph. 2003. A projection extension algorithm for statistical machine translation. In Proceedings of the Conference on Empirical Methods for Natural Language Processing (EMNLP), pages 1-8, Sapporo, Japan.
28. TransType2. 2005. TransType2 - Computer assisted translation. RTD project TransType2 (IST-2001-32091) funded by the European Commission. http://tt2.atosorigin.es/.
29. Ueffing, Nicola. 2006. Word Confidence Measures for Machine Translation. Ph.D. thesis, Computer Science Department, RWTH Aachen University, Aachen, Germany.
30. Ueffing, Nicola, Klaus Macherey, and Hermann Ney. 2003. Confidence measures for statistical machine translation. In Proceedings of the MT Summit IX, pages 394-401, New Orleans, LA.
31. Ueffing, Nicola and Hermann Ney. 2004. Bayes decision rule and confidence measures for statistical machine translation. In Proceedings of EsTAL - España for Natural Language Processing, pages 70-81, Alicante, Spain. Lecture Notes in Computer Science, Springer Verlag.
32. Ueffing, Nicola and Hermann Ney. 2005a. Application of word-level confidence measures in interactive statistical machine translation. In Proceedings of the 10th Annual Conference of the European Association for Machine Translation (EAMT), pages 262-270, Budapest, Hungary.
33. Ueffing, Nicola and Hermann Ney. 2005b. Word-level confidence estimation for machine translation using phrase-based translation models. In Proceedings of the Human Language Technology Conference (HLT/EMNLP), pages 763-770, Vancouver, Canada.
34. Ueffing, Nicola, Franz J. Och, and Hermann Ney. 2002. Generation of word graphs in statistical machine translation. In Proceedings of the Conference on Empirical Methods for Natural Language Processing (EMNLP), pages 156-163, Philadelphia, PA.
35. Vilar, David, Evgeny Matusov, Saša Hasan, Richard Zens, and Hermann Ney. 2005. Statistical machine translation of European parliamentary speeches. In Proceedings of the MT Summit X, pages 259-266, Phuket, Thailand.
36. Vogel, Stephan, Sanjika Hewavitharana, Muntsin Kolss, and Alex Waibel. 2004. The ISL statistical translation system for spoken language translation. In Proceedings of the International Workshop on Spoken Language Translation (IWSLT), pages 65-72, Kyoto, Japan.
37. Zens, Richard and Hermann Ney. 2004. Improvements in phrase-based statistical machine translation. In Proceedings of the Human Language Technology Conference (HLT/NAACL), pages 257-264, Boston, MA.
38. Zens, Richard and Hermann Ney. 2005. Word graphs for statistical machine translation. In 43rd Annual Meeting of the Association for Computational Linguistics: Proceedings of the Workshop on Building and Using Parallel Texts: Data-Driven Machine Translation and Beyond, pages 191-198, Ann Arbor, MI.
39. Zens, Richard and Hermann Ney. 2006. N-gram posterior probabilities for statistical machine translation. In Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics (HLT/NAACL): Proceedings of the Workshop on Statistical Machine Translation, pages 72-77, New York, NY.