Overview of the IWSLT 2010 Evaluation Campaign

2010 International Workshop on Spoken Language Translation, IWSLT 2010

Volumn , Issue , 2010, Pages 3-27

  Paul, Michael ^a   Federico, Marcello ^b   Stüker, Sebastian ^c  

^a NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

^b FONDAZIONE BRUNO KESSLER   (Italy)

^c KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; SPEECH COMMUNICATION; SPEECH RECOGNITION; SPEECH TRANSMISSION; TRANSLATION (LANGUAGES);

AUTOMATIC EVALUATION; AUTOMATIC SPEECH RECOGNITION; COMMUNICATION MODALITIES; INTERNATIONAL WORKSHOPS; SEMANTIC CONTEXT; SPOKEN DIALOGUE; SPOKEN LANGUAGE TRANSLATION; SPOKEN LANGUAGES; SUBJECTIVE EVALUATIONS; TURKISHS;

SEMANTICS;

EID: 80052206377     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (43)

1. M. Paul, “Overview of the IWSLT 2009 Evaluation Campaign,” in Proc. of IWSLT, Tokyo, Japan, 2009, pp. 1–18.
2. E. Matusov, G. Leusch, O. Bender, and H. Ney, “Evaluating Machine Translation Output with Automatic Sentence Segmentation,” in Proc. of IWSLT, Pittsburgh, PA, 2005, pp. 148–154.
3. A. Stolcke, “Srilm: an extensible language modeling toolkit,” in Proceedings of the International Conference on Spoken Language Processing, Denver (Colorado), 2002.
4. S. Matsuda, T. Jitsuhiro, K. Markov, and S. Nakamura, “ATR Parallel Decoding Based Speech Recognition System Robust to Noise and Speaking Styles,” IEEE Transactions on Information and Systems, vol. E89-D(3), pp. 989–997, 2006.
5. C. Callison-Burch, C. Fordyce, P. Koehn, C. Monz, and J. Schroeder, “(Meta-) Evaluation of Machine Translation,” in Proc. of the Second Workshop on SMT. Prague, Czech Republic: ACL, 2007, pp. 136–158.
6. J. Blatz, E. Fitzgerald, G. Foster, S. Gandrabur, C. Goutte, A. Kulesza, A. Sanchis, and N. Ueffing, “Confidence estimation for statistical machine translation,” in Final Report of the JHU Summer Workshop, 2003.
7. J. S. White, T. O’Connell, and F. O’Mara, “The ARPA MT evaluation methodologies: evolution, lessons, and future approaches,” in Proc of the AMTA, 1994, pp. 193–205.
8. J. R. Landis and G. G. Koch, “The measurement of observer agreement for categorical data,” Biometrics, vol. 33 (1), pp. 159–174, 1977.
9. K. Papineni, S. Roukos, T. Ward, and W. Zhu, “BLEU: a method for automatic evaluation of machine translation,” in Proc. of the 40th ACL, Philadelphia, USA, 2002, pp. 311–318.
10. G. Doddington, “Automatic evaluation of machine translation quality using n-gram co-occurrence statistics,” in Proc. of the HLT 2002, San Diego, USA, 2002, pp. 257–258.
11. A. Lavie and A. Agarwal, “METEOR: An automatic metric for mt evaluation with high levels of correlation with human judgments,” in Proc. of ACL Workshop on SMT, Prague, Czech Republic, 2007, pp. 228–231.
12. J. P. Turian, L. Shen, and I. D. Melamed, “Evaluation of machine translation and its evaluation,” in Proc. of the MT Summmit IX, New Orleans, USA, 2003, pp. 386–393.
13. S. Niessen, F. J. Och, G. Leusch, and H. Ney, “An evaluation tool for machine translation: Fast evaluation for machine translation research,” in Proc. of the 2nd LREC, Athens, Greece, 2000, pp. 39–45.
14. F. J. Och, “Minimum error rate training in smt,” in Proc. of the 41st ACL, Sapporo, Japan, 2003, pp. 160–167.
15. M. Snover, B. Dorr, R. Schwartz, L. Micciulla, and J. Makhoul, “A study of translation edit rate with targeted human annotation,” in Proc. of the AMTA, Cambridge and USA, 2006, pp. 223–231.
16. Y. Zhang, S. Vogel, and A. Waibel, “Interpreting Bleu/NIST Scores: How Much Improvement do We Need to Have a Better System?” in Proc of the LREC, 2004, pp. 2051–2054.
17. E. Matusov and S. Köprü, “AppTek’s APT Machine Translation System for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 29–36.
18. H. Almaghout, J. Jiang, and A. Way, “The DCU Machine Translation Systems for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 37–44.
19. F. Zamora-Martinez, M. J. Castro-Bleda, and H. Schwenk, “N-gram-based Machine Translation enhanced with Neural Networks for the French-English BTEC-IWSLT’10 task,” in Proc. of IWSLT, Paris, France, 2010, pp. 45–52.
20. A. Bisazza, I. Klasinas, M. Cettolo, and M. Federico, “FBK @ IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 53–58.
21. J. Gosme, W. Mekki, F. Debili, Y. Lepage, and N. Lucas, “The GREYC/LLACAN Machine Translation Systems for the IWSLT 2010 Campaign,” in Proc. of IWSLT, Paris, France, 2010, pp. 59–65.
22. 2R Machine Translation System for IWSLT 2010,” in Proc. ofIWSLT, Paris, France, 2010, pp. 67–72.
23. H. Xiong, J. Xie, H. Yu, K. Liu, W. Luo, H. Mi, Y. Liu, Y. Lü, and Q. Liu, “The ICT Statistical Machine Translation Systems for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 73–79.
24. W. Ling, T. Luís, J. Graça, L. Coheur, and I. Trancoso, “The INESC-ID Machine Translation System for the IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 81–84.
25. G. Gascó, V. Alabau, J. Andrés-Ferrer, J. González-Rubio, M.-A. Rocha, G. Sanchis-Trilles, F. Casacuberta, J. González, and J.-A. Sánchez, “ITI-UPV system description for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 85–92.
26. J. Niehues, M. Mediani, T. Herrmann, M. Heck, C. Herff, and A. Waibel, “The KIT Translation system for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 93–98.
27. L. Besacier, H. Afli, T. N. D. Do, H. Blanchon, and M. Potet, “LIG Statistical Machine Translation Systems for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 99–104.
28. A. Allauzen, J. M. Crego, I. D. El-Kahlout, H.-S. Le, G. Wisniewski, and F. Yvon, “LIMSI @ IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 105–112.
29. A. Rousseau, L. Barrault, P. Deléglise, and Y. Estève, “LIUM’s Statistical Machine Translation System for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 113–117.
30. I. T. Khemakhem, S. Jamoussi, and A. B. Hamadou, “The MIRACL Arabic-English Statistical Machine Translation System for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 119–125.
31. W. Shen, T. Anderson, R. Slyh, and A. R. Aminzadeh, “The MIT/LL-AFRL IWSLT-2010 MT System,” in Proc. of IWSLT, Paris, France, 2010, pp. 127–134.
32. C.-H. Li, N. Duan, Y. Zhao, S. Liu, L. Cui, M.-Y. Hwang, A. Axelrod, J. Gao, Y. Zhang, and L. Deng, “The MSRA Machine Translation System for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 135–138.
33. C.-L. Goh, T. Watanabe, M. Paul, A. Finch, and E. Sumita, “The NICT Translation System for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 139–146.
34. K. Sudoh, K. Duh, and H. Tsukada, “NTT Statistical Machine Translation System for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 147–152.
35. H. Na and J.-H. Lee, “The POSTECH’s Statistical Machine Translation System for the IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 153–156.
36. S. Yahyaei and C. Monz, “The QMUL System Description for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 157–162.
37. S. Mansour, S. Peitz, D. Vilar, J. Wuebker, and H. Ney, “The RWTH Aachen Machine Translation system for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 163–168.
38. K. Bar and N. Dershowitz, “Tel Aviv University’s System Description for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 169–174.
39. J. Murakami, T. Nishimura, and M. Tokuhisa, “Statistical Pattern-Based Machine Translation with Statistical French-English Machine Translation,” in Proc. of IWSLT, Paris, France, 2010, pp. 175–182.
40. C. Mermer, H. Kaya, and M. U. Doǧan, “The TÜBİTAK-UEKAE Statistical Machine Translation System for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 183–188.
41. C. Henríquez, M. R. Costa-jussá, V. Daudaravicius, R. E. Banchs, and J. Marino, “UPC-BMIC-VDU system description for the IWSLT 2010: testing several collocation segmentations in a phrase-based SMT system,” in Proc. of IWSLT, Paris, France, 2010, pp. 189–195.
42. M. Khalilov and K. Sima’an, “The ILLC-UvA SMT System for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 197–203.
43. S. Martzoukos and C. Monz, “The UvA System Description for IWSLT 2010,” in Proc. of IWSLT, Paris, France, 2010, pp. 205–208.