Overview of the IWSLT 2009 Evaluation Campaign

2009 International Workshop on Spoken Language Translation, IWSLT 2009

Volumn , Issue , 2009, Pages 1-18

  Paul, Michael ^a  

^a NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; SPEECH TRANSMISSION; TRANSLATION (LANGUAGES); WELL TESTING;

AUTOMATIC EVALUATION; HUMAN DIALOGUES; INTERNATIONAL WORKSHOPS; MACHINE TRANSLATION SYSTEMS; MOTHER TONGUES; RESEARCH GROUPS; SPEECH DATA; SPOKEN LANGUAGE TRANSLATION; TASK-ORIENTED; TURKISHS;

SPEECH RECOGNITION;

EID: 85133177201     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. M. Paul, “Overview of the IWSLT 2008 evaluation campaign,” in Proc. of IWSLT, Hawaii, USA, 2008, pp. 1-17.
2. C. Callison-Burch, C. Fordyce, P. Koehn, C. Monz, and J. Schroeder, “(Meta-) Evaluation of Machine Translation,” in Proceedings of the Second Workshop on SMT. Prague, Czech Republic: Association for Computational Linguistics, June 2007, pp. 136-158. [Online]. Available: http://www.aclweb.org/anthology/W/W07/W07-0718
3. J. S. White, T. O'Connell, and F. O'Mara, “The ARPA MT evaluation methodologies: evolution, lessons, and future approaches,” in Proc of the AMTA, 1994, pp. 193-205.
4. G. Kikui, S. Yamamoto, T. Takezawa, and E. Sumita, “Comparative study on corpora for speech translation,” IEEE Transactions on Audio, Speech and Language Processing, vol. 14(5), pp. 1674-1682, 2006.
5. J. Blatz, E. Fitzgerald, G. Foster, S. Gandrabur, C. Goutte, A. Kulesza, A. Sanchis, and N. Ueffing, “Confidence estimation for statistical machine translation,” in Final Report of the JHU Summer Workshop, 2003.
6. J. R. Landis and G. G. Koch, “The measurement of observer agreement for categorical data,” Biometrics, vol. 33 (1), pp. 159-174, 1977.
7. K. Papineni, S. Roukos, T. Ward, and W. Zhu, “BLEU: a method for automatic evaluation of machine translation,” in Proc. of the 40th ACL, Philadelphia, USA, 2002, pp. 311-318.
8. G. Doddington, “Automatic evaluation of machine translation quality using n-gram co-occurrence statistics,” in Proc. of the HLT 2002, San Diego, USA, 2002, pp. 257-258.
9. A. Lavie and A. Agarwal, “METEOR: An automatic metric for mt evaluation with high levels of correlation with human judgments,” in Proceedings of Workshop on SMT at the 45th Annual Meeting of the Association of Computational Linguistics, Prague, Czech Republic, 2007, pp. 228-231.
10. J. P. Turian, L. Shen, and I. D. Melamed, “Evaluation of machine translation and its evaluation,” in Proc. of the MT Summmit IX, New Orleans, USA, 2003, pp. 386-393.
11. S. Niessen, F. J. Och, G. Leusch, and H. Ney, “An evaluation tool for machine translation: Fast evaluation for machine translation research,” in Proc. of the 2nd LREC, Athens, Greece, 2000, pp. 39-45.
12. F. J. Och, “Minimum error rate training in smt,” in Proc. of the 41st ACL, Sapporo, Japan, 2003, pp. 160-167.
13. M. Snover, B. Dorr, R. Schwartz, L. Micciulla, and J. Makhoul, “A study of translation edit rate with targeted human annotation,” in Proc. of the AMTA, Cambridge and USA, 2006, pp. 223-231.
14. Y. Zhang, S. Vogel, and A. Waibel, “Interpreting Bleu/NIST Scores: How Much Improvement do We Need to Have a Better System?” in Proc of the LREC, 2004, pp. 2051-2054.
15. S. Köprü, “AppTek Turkish-English Machine Translation System Description for IWSLT 2009,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 19-23.
16. M. R. Costa-Jussà and R. E. Banchs, “Barcelona Media SMT system description for the IWSLT 2009: introducing source context information,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 24-28.
17. Y. Ma, T. Okita, O. Çetinoglu, J. Du, and A. Way, “Low-Resource Machine Translation Using MaTrEx: The DCU Machine Translation System for IWSLT 2009,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 29-36.
18. N. Bertoldi, A. Bisazza, M. Cettolo, G. Sanchis-Trilles, and M. Federico, “FBK @ IWSLT-2009,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 37-44.
19. Y. Lepage, A. Lardilleux, and J. Gosme, “The GREYC Translation Memory for the IWSLT 2009 Evaluation Campaign: one step beyond translation memory,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 45-49.
20. 2R's Machine Translation System for IWSLT 2009,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 50-54.
21. H. Mi, Y. Liu, T. Xia, X. Xiao, Y. Feng, J. Xie, H. Xiong, Z. Tu, D. Zheng, Y. Lu, and Q. Liu, “The ICT SMT Systems for the IWSLT 2009,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 55-59.
22. F. Bougares, L. Besacier, and H. Blanchon, “LIG approach for IWSLT09: Using Multiple Morphological Segmenters for Spoken Language Translation of Arabic,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 60-64.
23. H. Schwenk, L. Barrault, Y. Estève, and P. Lambert, “LIUM's SMT Systems for IWSLT 2009,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 65-70.
24. W. Shen, B. Delaney, A. Aminzadeh, T. Anderson, and R. Slyh, “The MIT-LL/AFRL IWSLT-2009 System,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 71-78.
25. M. Utiyama, H. Yamamoto, and E. Sumita, “Two methods for stabilizing MERT: NICT at IWSLT 2009,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 79-82.
26. M. Li, J. Zhang, Y. Zhou, and C. Zong, “The CASIA SMT System for IWSLT 2009,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 83-90.
27. P. Nakov, C. Liu, W. Lu, and H. T. Ng, “The NUS SMT System for IWSLT 2009,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 91-98.
28. X. Wu, T. Matsuzaki, N. Okazaki, Y. Miyao, and J. Tsujii, “The UOT System: Improve String-to-Tree Translation Using Head-Driven Phrasal Structure Grammar and Predicate-Argument Structures,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 99-106.
29. J. Murakami, M. Tokuhisa, and S. Ikehara, “Statistical Machine Translation adding Pattern-based Machine translation in Chinese-English Translation,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 107-112.
30. C. Mermer, H. Kaya, and M. U. Doǧan, “The TÜBITAK-UEKAE SMT System for IWSLT 2009,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 113-117.
31. G. Gascó and J. A. Sánchez, “UPV Translation System for IWSLT 2009,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 118-123.
32. M. Yang, A. Axelrod, K. Duh, and K. Kirchhoff, “The University of Washington Machine Translation System for IWSLT 2009,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 124-128.
33. A. Bisazza and M. Federico, “Morphological Pre-Processing for Turkish to English SMT,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 129-135.
34. M. Cmejrek, B. Zhou, and B. Xiang, “Enriching SCFG Rules Directly From Efficient Bilingual Chart Parsing,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 136-143.
35. K. Hayashi, T. Watanabe, H. Tsukada, and H. Isozaki, “Structural Support Vector Machines for Log-Linear Approach in SMT,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 144-151.
36. H. Hoang, P. Koehn, and A. Lopez, “A Unified Framework for Phrase-Based, Hierarchical, and Syntax-Based SMT,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 152-159.
37. G. Sanchis-Trilles, M. Cettolo, N. Bertoldi, and M. Federico, “Online Language Model Adaptation for Spoken Dialog Translation,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 160-167.
38. C. Hori, S. Sakti, M. Paul, N. Kimura, Y. Ashikari, R. Isotani, E. Sumita, and S. Nakamura, “Network-based Speech-to-Speech Translation,” in Proc. of IWSLT, Tokyo, Japan, 2009, p. 168.