Sentence-level MT evaluation without reference translations: Beyond language modeling

European Association for Machine Translation, EAMT 2005 - 10th Annual Conference

Volumn , Issue , 2005, Pages 103-111

  Gamon, Michael ^a   Aue, Anthony ^a   Smets, Martine ^a  

^a MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASS PROBABILITIES; LANGUAGE MODEL; LANGUAGE MODELING; LINGUISTIC FEATURES; MACHINE TRANSLATIONS; MT EVALUATIONS; SENTENCE LEVEL;

COMPUTATIONAL LINGUISTICS; INFORMATION THEORY;

QUALITY CONTROL;

EID: 79957935928     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. AKIBA, Yasuhiro Taro WATANABE and Eiichiro SUMITA (2002): Using Language and Translation Models to Select the Best among Outputs from Multiple {MT} systems. Proceedings of COLING 2002, pp 8-14.
2. BLATZ, John, Eric FITZGERALD, George FOSTER, Simona GANDRABUR, Cyril GOUTTE, Alex KULESZA, Alberto SANCHIS, Nicola UEFFING (2004): Confidence Estimation for Machine Translation. In Proceedings of COLING 2004, pp. 315-321.
3. BABYCH, Bogdan and Anthony HARTLEY (2004): Extending the BLEU MT Evaluation Method with Frequency Weightings. Proceedings of ACL 2004, pp. 621-628.
4. CALLISON-BURCH, Chris and Raymond S. FLOURNOY (2001): A Program for Automatically Selecting the Best Output from Multiple Machine Translation Engines. Proceedings of MT Summit VIII, pp63-66.
5. CORSTON-OLIVER, Simon, Michael GAMON, and Chris BROCKETT (2001): A Machine Learning Approach to the Automatic Evaluation of Machine Translation. Proceedings of ACL, pp. 140-147.
6. COUGHLIN, Deborah (2003): Correlating Automated and Human Assessments of Machine Translation Quality. Proceedings of MT Summit IX, pp. 63-70.
7. DODDINGTON, George. (2002). Automatic Evaluation of Machine Translation Quality Using N-Gram Co-Occurrence Statistics. In Proceeding of the Second International Conference on Human Language Technology. San Diego, CA, pp. 138-145.
8. DUNNING, Ted (1993): Accurate Methods for the Statistics of Surprise and Coincidence. Computational Linguistics 19: 61-74.
9. GAMON, Michael (2004): Linguistic Correlates of Style: Authorship Classification with Deep Linguistic Analysis Features. Proceedings of COLING 2004, pp. 611-617.
10. GOODMAN, Joshua (2000): A Bit of Progress in Language Modeling. Technical report, Microsoft Research.
11. HEIDORN, George E. (2002): Intelligent Writing Assistance. In R. Dale, H. Moisl, and H. Somers (eds.), A Handbook of Natural Language Processing: Techniques and Applications for the Processing of Language as Text, Marcel Dekker, New York.
12. KNESER, Reinhard and Hermann NEY (1995): Improved backing-off for m-gram language modeling. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, volume 1, pp 181-184.
13. KULESZA, Alex and Stuart M. SHIEBER (2004): A Learning Approach to Improving Sentence-Level MT Evaluation. In Proceedings of the 10th International Conference on Theoretical and Methodological Issues in Machine Translation.
14. LIN, Chin-Yew and Franz OCH (2004a): ORANGE: a Method for Evaluating Automatic Evaluation Metrics for Machine Translation. Proceedings of COLING 2004, pp. 501-507.
15. LIN, Chin-Yew and Franz OCH (2004b): Automatic Evaluation of Machine Translation Quality Using Longest Common Subsequence and Skip-Bigram Statistics. Proceedings of ACL 2004, pp. 606-613.
16. NOMOTO, Tadashi (2003): Predictive Models of Performance in Multi-Engine Machine Translation. Proceedings of MT Summit IX, pp 269-276.
17. PAPINENI, Kishore A., Salim ROUKOS, Todd WARD and Wei-Jing ZHU (2002): BLEU: A Method for Automatic Evaluation of Machine Translation. Proceedings of ACL 2002, pp 311-318.
18. PLATT, John (1999): Fast training of SVMs using sequential minimal optimization. In: B. Schoelkopf, C. Burges and A. Smola (eds.) Advances in Kernel Methods: Support Vector Learning, MIT Press, Cambridge, MA, pp. 185-208.
19. POWELL, M. J. D. (1964): An efficient method for finding the minimum of a function of several variables without calculating derivates. Computer Journal 7.
20. QUIRK, Christopher (2004): Training a Sentence-Level Machine Translation Confidence Measure. In Proceedings of LREC 2004, pp 525-828.
21. RICHARDSON, Steve (2004): Machine Translation of Online Product Support Articles Using a Data-Driven MT System. Proceedings of AMTA 2004, pp.246251.
22. SMETS, Martine, Michael GAMON, Jessie PINKHAM, Thomas REUTTER, and Martine PETTENARO (2003): High quality machine translation using a machine-learned sentence realization component. Proceedings of MT Summit IX, pp. 362-369.
23. SORICUT, Radu and Eric BRILL (2004): A Unified Framework for Automatic Evaluation using N-gram Co-Occurrence Statistics. Proceedings of ACL 2004, pp. 613-620.