Towards Fairer Evaluations of Commercial MT Systems on Basic Travel Expressions Corpora

2004 International Workshop on Spoken Language Translation, IWSLT 2004

Volumn , Issue , 2004, Pages 21-26

  Blanchon, Hervé ^a   Boitet, Christian ^a   Brunet Manquat, Francis ^a   Tomokiyo, Mutsuko ^a   Hamon, Agnès ^b   Hung, Vo Trung ^a   Bey, Youcef ^a  

^a Laboratoire CLIPS   (France)

^b UNIVERSITÉ RENNES 2   (France)

Author keywords

[No Author keywords available]

Indexed keywords

DATA TRACKS; FIRST SYSTEMS; LANGUAGE PAIRS; PERFORMANCE; SETTING PARAMETERS; TWO WAYS;

TRANSLATION (LANGUAGES);

EID: 33847253436     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. Boitet, C. (2003) Machine Translation. in Ralston, A., Reilly, E. and Hemmendinger, D. (ed.), Encyclopedia of Computer Science. John Willey & Sons. 10 p.
2. Doddington, G. (2002) Automatic Evaluation of Machine Translation Quality Using N-gram Co-Occurrence Statistics. Proc. HLT 2002. San Diego, California. March 24-27, 2002. vol. 1/1: pp. 128-132 (note book proceedings).
3. Leusch, G., Ueffing, N., et al. (2003) A Novel StringtoString Distance Measure with Application to Machine Translation Evaluation. Proc. MT Summit IX. New Orleans, U.S.A. September 23-27, 2003. 8 p.
4. Levenshtein, V. I. (1966) Binary codes capable of correcting deletion, insertions and reversals. in Soviet Physics Doklady. vol. 10(8): pp. 707-710.
5. Pinkham, J. and Smets, M. (2002) Traduction automatique ancrée dans l'analyse linguistique. Proc. TALN'02. Nancy, France. 24-27 juin 2002. vol. 1/2: pp. 287-296.
6. Siegel, S. and Castellan, N. J. (1988) Nonparametric Statistics for the Behavioral Sciences; 2nd ed. McGrawHill. New-York. 400 p.
7. Takezawa, T., Sumita, E., et al. (2002) Towards a Broad-coverage Bilingual Corpus for Speech Translation of Travel Conversation in the Real World. Proc. LREC-2002. Las Palmas, Spain. May 29-31, 2002. vol. 1/3: pp. 147-152.
8. Tomás, J., Mas, J. À., et al. (2003) A Quantitative Method for Machine Translation Evaluation. Proc. EACL 2003 - Workshop on Evaluation Initiatives in Natural Language Processing: are evaluation methods, metrics and resouces reusable? Budapest, Hungary. April 14, 2003. vol. 1/1: 8 p.
9. Turian, J. P., Shen, L., et al. (2003) Evaluation of Machine Translation and its Evaluation. Proc. MT Summit IX. New Orleans, U.S.A. September 23-27, 2003. pp. 386-393.