Overview of the IWSLT04 Evaluation Campaign

2004 International Workshop on Spoken Language Translation, IWSLT 2004

Volumn , Issue , 2004, Pages 1-12

  Akiba, Yasuhiro ^a   Federico, Marcello ^b   Kando, Noriko ^c   Nakaiwa, Hiromi ^a   Paul, Michael ^a   Tsujii, Jun'ichi ^d  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^b ITC IRST   (Italy)

^c JFLI   (Japan)

^d UNIVERSITY OF TOKYO   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

'CURRENT; EVALUATION METHODOLOGIES; MACHINE TRANSLATION EVALUATIONS; SPEECH TRANSLATION;

COMPUTATIONAL LINGUISTICS;

EID: 32144437415     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. M. Paul, H. Nakaiwa, and M. Federico, “Towards innovative evaluation methodologies for speech translation,” in Working Notes of the NTCIR-4 2004 Meeting, Supplement Volume 2, Tokyo, Japan, 2004, pp. 17-21.
2. G. Kikui, E. Sumita, T. Takezawa, and S. Yamamoto, “Creating corpora for speech-to-speech translation,” in Proc. of the EUROSPEECH03, Geneve, Switzerland, 2003, pp. 381-384.
3. J. S. White, T. O'Connell, and F. O'Mara, “The ARPA MT evaluation methodologies: evolution, lessons, and future approaches,” in Proc of the AMTA, 1994, pp. 193-205.
4. Linguistic Data Annotation Specification: Assessment of Fluency and Adequacy in Chinese-English Translations Revision 1.0, Linguistic Data Consortium, 2002, http://www.ldc.upenn.edu/Projects/TIDES/Translation/TransAssess02.pdf.
5. S. Niessen, F. J. Och, G. Leusch, and H. Ney, “An evaluation tool for machine translation: Fast evaluation for machine translation research,” in Proc. of the 2nd LREC, Athens, Greece, 2000, pp. 39-45.
6. F. J. Och, “Minimum error rate training in statistical machine translation,” in Proc. of the 41st ACL, Sapporo, Japan, 2003, pp. 160-167.
7. K. Papineni, S. Roukos, T. Ward, and W. Zhu, “BLEU: a method for automatic evaluation of machine translation,” in Proc. of the 40th ACL, Philadelphia, USA, 2002, pp. 311-318.
8. G. Doddington, “Automatic evaluation of machine translation quality using n-gram co-occurrence statistics,” in Proc. of the HLT 2002, San Diego, USA, 2002, pp. 257-258.
9. J. P. Turian, L. Shen, and I. D. Melamed, “Evaluation of machine translation and its evaluation,” in Proc. of the MT Summmit IX, New Orleans, USA, 2003, pp. 386-393.
10. E. Sumita, Y. Akiba, T. Doi, A. Finch, K. Imamura, H. Okuma, M. Paul, M. Shimohata, and T. Watanabe, “EBMT, SMT, Hybrid and More: ATR spoken language translation system,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 13-20.
11. M. Yang, T. Zhao, H. Liu, X. Shi, and H. Jiang, “Auto word alignment based Chinese-English EBMT,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 27-29.
12. P. Langlais, M. Carl, and O. Streiter, “Experimenting with phrase-based statistical translation within the IWSLT 2004 Chinese-to-English Shared Translation Task,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 31-38.
13. Y.-S. Lee and S. Roukos, “IBM spoken language translation system evaluation,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 39-46.
14. N. Bertoldi, R. Cattoni, M. Cettolo, and M. Federico, “The ITC-irst statistical machine translation system for IWSLT-2004,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 51-58.
15. E. Ettelaie, K. Knight, D. Marcu, D. S. Munteanu, F. J. Och, I. Thayer, and Q. Tipu, “The ISI/USC MT system,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, p. 59.
16. S. Vogel, S. Hewavitharana, M. Kolss, and A. Waibel, “The ISL statistical translation system for spoken language translation,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 65-72.
17. O. Bender, R. Zens, E. Matusov, and H. Ney, “Alignment templates: the RWTH SMT system”,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 79-84.
18. A. D. GISPERT and J. B. MARINO, “TALP: Xgrambased spoken language translation system,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 85-90.
19. H. Blanchon, C. Boitet, F. Brunet-Manquat, M. Tomokiyo, A. Hamon, V. T. Hung, and Y. Bey, “Towards fairer evaluations of commercial MT systems on Basic Travel Expressions Corpora,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 21-26.
20. H. Hou, D. Deng, G. Zou, H. Yu, Y. Liu, D. Xiong, and Q. Liu, “An EBMT system based on word alignment,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 47-49.
21. J. Reichert and A. Waibel, “The ISL EDTRL system,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 61-64.
22. Y. Zuo, Y. Zhou, and C. Zong, “Multi-engine based Chinese-to-English translation system,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 73-77.
23. E. Aramaki and S. Kurohashi, “Example-based machine translation using structual translation examples,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 91-94.