Overview of the IWSLT 2007 Evaluation Campaign

2007 International Workshop on Spoken Language Translation, IWSLT 2007

Volumn , Issue , 2007, Pages 1-12

  Fordyce, Cameron S ^a  

^a Center for the Evaluation of Language and Communication Technologies (CELCT)   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH;

AUTOMATIC EVALUATION; ENGLISH LANGUAGES; HUMAN EVALUATION; IN-BUILDINGS; INPUT DATAS; INTERNATIONAL WORKSHOPS; LANGUAGE PAIRS; SPOKEN LANGUAGE TRANSLATION; SPOKEN LANGUAGES; SPONTANEOUS SPEECH;

TRANSLATION (LANGUAGES);

EID: 85037529064     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (40)

1. M. Paul, “Overview of the IWSLT 2006 Evaluation Campaign,” in Proc. of the International Workshop of Spoken Language Translation, Kyoto, Japan, 2006, pp.1-15 .
2. Y. Akiba, M. Federico, N. Kando, H. Nakaiwa, M. Paul, and J. Tsujii, “Overview of the IWSLT04 evaluation campaign,” in Proc. of the International Workshop on Spoken Language Translation, Kyoto, Japan, 2004, pp. 1-12.
3. M. Eck and C. Hori, “Overview of the IWSLT 2005 evaluation campaign,” in Proc. of the International Workshop on Spoken Language Translation, Pittsburgh, USA, 2005, pp. 11-32.
4. T. Takezawa, E. Sumita, F. Sugaya, H. Yamamoto, and S. Yamamoto. “Toward a Broad-coverage Bilingual Corpus for Speech Translation of Travel Conversation in the Real World” in Proc. of LREC 2002, Las Palmas, Spain, 2002.
5. R. Cattoni, M. Danieli, V. Sandrini, C. Soria, “ADAM: the SI-TAL Corpus of Annotated Dialogues”, in Proc. of LREC 2002, Las Palmas, Spain, 2002.
6. K. Papineni, S. Roukos, T. Ward, and W. Zhu, "BLEU: a method for automatic evaluation of machine translation," in Proc. of the 40th ACL, Philadelphia, USA, 2002, pp. 311–318.
7. C. Callison-Burch, C. Fordyce, P. Koehn, C. Monz, and J. Schroeder, “(Meta-) Evaluation of Machine Translation,” in Proc. of the Second Workshop on Statistical Machine Translation, Prague, 2007, pp. 136-158.
8. LDC. 2005. Linguistic data annotation specification: Assessment of fluency and adequacy in translations. Revision 1.5.
9. D. Jones, W Shen, N. Granoien, M. Herzog, and C. Weinstein, “Measuring translation quality by testing English speakers with a new defense language proficiency test for Arabic,” in Proc. of the 2005 International Conference on Intelligence Analysis, McLean, VA, 2005.
10. P. Koehn and C. Monz, “Manual and automatic evaluation of machine translation between European language,” in Proc. of NAACL 2006 Workshop on Statistical Machine Translation, New York, 2006.
11. J. Blatz, E. Fitzgerald, G. Foster, S. Gandrabur, C. Goutte, A. Kulesza, A. Sanchis, and N. Ueffing, "Confidence estimation for machine translation," in CLSP Summer Workshop Final Report WS2003, Johns Hopkins University, 2003.
12. D. Coughlin, “Correlating automated and human assessments of machine translation quality,” in Proc. Of MT Summit IX, New Orleans, 2003.
13. G. Doddington, “Automatic evaluation of machine translation quality using n-grams co-occurence statistics,” in Human Language Technology: Notebook Proceedings, San Diego, 2002, pp. 128-132.
14. J. Carletta, “Assessing Agreement on classification tasks: The kappa statistic,” in Computational Linguistics, 22(2):249-254, 1996.
15. J. R. Landis and G. G. Koch, “The measurement of observer agreement for categorical data,” Biometrics, 33:159-174, 1977.
16. A. Finch, E. Denoual, H. Okuma, M. Paul, H. Yamamoto, K. Yasuda, R. Zhang and E. Sumita, "The NICT/ATR Speech Translation System for IWSLT 2007"," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
17. Z. He, Haitao Mi, Y. Liu, W. Luo, Y. Huang, Z. Ren, Y. Lu and Q. Liu, "The ICT Statistical Machine Translation Systems for IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
18. Y. Zhou, Y. He and C. Zong, "The CASIA Phrase-Based Statistical Machine Translation System for IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
19. Y. Chen, X. Shi and C. Zhou, "The XMU SMT System for IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
20. L. Besacier, M. Amar and L. Viet-Bac, "The LIG Arabic / English Speech Translation System at IWSLT 07," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
21. J. Murakami, M. Tokuhisa and S. Ikehara, "Statistic Machine Translation using Large J/E Parallel Corpus and Long Phrase Tables," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
22. A. Patry, P. Langlais and F. Béchet, "MISTRAL: A Lattice Translation System for IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
23. Y. Yves and A. Lardilleux, "The GREYC Machine Translation System for the IWSLT 2007 Evaluation Campaign," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
24. B. Chen, J. Sun, H. Jiang, M. Zhang and A. Ti Aw, "I2R Chinese-English Translation System for IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
25. N. Bertoldi, M. Cettolo, R. Cattoni and M. Federico, "FBK @ IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
26. W. Chao and Z. Li, "NUDT Machine Translation System for IWSLT2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
27. P. Lambert, M. Costa-jussà, J. Crego, M. Khalilov, J. Giménez, J. Mariño, R. Banchs, J. Fonollosa and H. Schwenk, "The TALP Ngram-based SMT System for IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
28. J. Schroeder and P. Koehn, "The University of Edinburgh System Description for IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
29. H. Hassan, Y. Ma and A. Way, "MaTrEx: the DCU Machine Translation System for IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
30. A. Mauser, D. Vilar, G. Leusch, Y. Zhang and H. Ney, "The RWTH Machine Translation System for IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
31. J. Graça, D. Caseiro and L. Coheur, "The INESC-ID IWSLT07 SMT System," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
32. W. Shen, B. Delaney, T. Anderson and R. Slyh, "The MIT-LL/AFRL IWSLT-2007 MT System," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
33. T. Watanabe, J. Suzuki, K. Sudoh, H. Tsukada and H. Isozaki, "Larger Feature Set Approach for Machine Translation in IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
34. K. Kirchhoff, "The University of Washington Machine Translation System for the IWSLT 2007 Competition," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
35. I. Lane, A. Zollmann, T. Linh Nguyen, N. Bach, A. Venugopal, S. Vogel, K. Rottmann, Y. Zhang and A. Waibel, "The CMU-UKA Statistical Machine Translation Systems for IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
36. Y. Lepage and A. Lardilleux, "The GREYC Machine Translation System for the IWSLT 2007 Evaluation Campaign," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
37. Y. Shen, C. Lo, M. Carpuat and D. Wu, "HKUST Statistical Machine Translation Experiments for IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
38. V. Alabau, A. Sanchis and F. Casacuberta, "Using Word Posterior Probabilities in Lattice Translation," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
39. C. Mermer, H. Kaya and M. Ugur Dogan, "The TUBITAK-UEKAE Statistical Machine Translation System for IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.
40. C. Dyer, "The University of Maryland Translation System for IWSLT 2007," Proc. of the International Workshop on Spoken Language Translation, Trento, 2007.