Findings of the 2010 Joint Workshop on Statistical Machine Translation and Metrics for Machine Translation

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2010, Pages 17-53

  Callison Burch, Chris ^a   Koehn, Philipp ^b   Monz, Christof ^c   Peterson, Kay ^d   Przybocki, Mark ^d   Zaidan, Omar F ^a  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

^c UNIVERSITY OF AMSTERDAM   (Netherlands)

^d NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION;

AUTOMATIC METRICS; HUMAN JUDGMENTS; LARGE-SCALES; MACHINE TRANSLATION SYSTEMS; MACHINE TRANSLATIONS; MECHANICAL TURKS; STATISTICAL MACHINE TRANSLATION; SYSTEM COMBINATION; TRANSLATION QUALITY;

MACHINE TRANSLATION;

EID: 84926313951     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (58)

1. Alexandre Allauzen, Josep M. Crego, lknur Durgar El-Kahlout, and Francois Yvon. 2010. Limsi’s statistical translation systems for wmt’10. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 29–34, Uppsala, Sweden, July. Association for Computational Linguistics.
2. Loïc Barrault. 2010. Many: Open source mt system combination at wmt’10. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 252–256, Uppsala, Sweden, July. Association for Computational Linguistics.
3. Ergun Bicici and S. Serdar Kozat. 2010. Adaptive model weighting and transductive regression for predicting best system combinations. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 257–262, Uppsala, Sweden, July. Association for Computational Linguistics.
4. Ergun Bicici and Deniz Yuret. 2010. L1 regularized regression for reranking and system combination in machine translation. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 263–270, Uppsala, Sweden, July. Association for Computational Linguistics.
5. Alexandra Birch and Miles Osborne. 2010. Lrscore for evaluating lexical and reordering quality in mt. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 302–307, Uppsala, Sweden, July. Association for Computational Linguistics.
6. Ondrej Bojar and Kamil Kos. 2010. 2010 failures in english-czech phrase-based mt. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 35–41, Uppsala, Sweden, July. Association for Computational Linguistics.
7. Chris Callison-Burch and Mark Dredze. 2010. Creating speech and language data with amazons mechanical turk. In Proceedings NAACL-2010 Workshop on Creating Speech and Language Data With Amazons Mechanical Turk, Los Angeles.
8. Chris Callison-Burch, Cameron Fordyce, Philipp Koehn, Christof Monz, and Josh Schroeder. 2007. (Meta-) evaluation of machine translation. In Proceedings of the Second Workshop on Statistical Machine Translation (WMT07), Prague, Czech Republic.
9. Chris Callison-Burch, Cameron Fordyce, Philipp Koehn, Christof Monz, and Josh Schroeder. 2008. Further meta-evaluation of machine translation. In Proceedings of the Third Workshop on Statistical Machine Translation (WMT08), Colmbus, Ohio.
10. Chris Callison-Burch,, Philipp Koehn, Christof Monz, and Josh Schroeder. 2009. Findings of the findings of the 2009 workshop on statistical machine translation. In Proceedings of the Fourth Workshop on Statistical Machine Translation (WMT09), Athens, Greece.
11. Chris Callison-Burch. 2009. Fast, cheap, and creative: Evaluating translation quality using amazon’s mechanical turk. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing (EMNLP-2009), Singapore.
12. Elisabet Comelles, Jesus Gimenez, Lluis Marquez, Irene Castellon, and Victoria Arranz. 2010. Document-level automatic mt evaluation based on discourse representations. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 308–313, Uppsala, Sweden, July. Association for Computational Linguistics.
13. Hui Cong, Zhao Hai, Lu Bao-Liang, and Song Yan. 2010. An empirical study on development set selection strategy for machine translation learning. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 42–46, Uppsala, Sweden, July. Association for Computational Linguistics.
14. Michael Denkowski and Alon Lavie. 2010. Meteor-next and the meteor paraphrase tables: Improved evaluation support for five target languages. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 314–317, Uppsala, Sweden, July. Association for Computational Linguistics.
15. Marcus Dobrinkat, Tero Tapiovaara, Jaakko Väyrynen, and Kimmo Kettunen. 2010. Normalized compression distance based measures for metricsmatr 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 318–323, Uppsala, Sweden, July. Association for Computational Linguistics.
16. Jinhua Du, Pavel Pecina, and Andy Way. 2010. An augmented three-pass system combination framework: Dcu combination system for wmt 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 271–276, Uppsala, Sweden, July. Association for Computational Linguistics.
17. Vladimir Eidelman, Chris Dyer, and Philip Resnik. 2010. The university of maryland statistical machine translation system for the fifth workshop on machine translation. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 47–51, Uppsala, Sweden, July. Association for Computational Linguistics.
18. Christian Federmann, Andreas Eisele, Yu Chen, Sabine Hunsicker, Jia Xu, and Hans Uszkoreit. 2010. Further experiments with shallow hybrid mt systems. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 52–56, Uppsala, Sweden, July. Association for Computational Linguistics.
19. Jesús González-Rubio, Germán Sanchis-Trilles, Joan-Andreu Sánchez, Jesús Andrés-Ferrer, Guillem Gascó, Pascual Martínez-Gómez, Martha-Alicia Rocha, and Francisco Casacuberta. 2010. The upvprhlt combination system for wmt 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 277–281, Uppsala, Sweden, July. Association for Computational Linguistics.
20. Greg Hanneman, Jonathan Clark, and Alon Lavie. 2010. Improved features and grammar selection for syntax-based mt. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 57–62, Uppsala, Sweden, July. Association for Computational Linguistics.
21. Christian Hardmeier, Arianna Bisazza, and Marcello Federico. 2010. Fbk at wmt 2010: Word lattices for morphological reduction and chunk-based reordering. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 63–67, Uppsala, Sweden, July. Association for Computational Linguistics.
22. Yifan He, Jinhua Du, Andy Way, and Josef van Genabith. 2010. The dcu dependency-based metric in wmt-metricsmatr 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 324–328, Uppsala, Sweden, July. Association for Computational Linguistics.
23. Kenneth Heafield and Alon Lavie. 2010. Cmu multiengine machine translation for wmt 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 68–73, Uppsala, Sweden, July. Association for Computational Linguistics.
24. Carmen Heger, Joern Wuebker, Matthias Huck, Gregor Leusch, Saab Mansour, Daniel Stein, and Hermann Ney. 2010. The rwth aachen machine translation system for wmt 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 74–78, Uppsala, Sweden, July. Association for Computational Linguistics.
25. Carlos A. Henríquez Q., Marta Ruiz Costa-jussà, Vidas Daudaravicius, Rafael E. Banchs, and José B. Mariño. 2010. Using collocation segmentation to augment the phrase table. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 79–83, Uppsala, Sweden, July. Association for Computational Linguistics.
26. Almut Silja Hildebrand and Stephan Vogel. 2010. Cmu system combination via hypothesis selection for wmt’10. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 282–285, Uppsala, Sweden, July. Association for Computational Linguistics.
27. Stéphane Huet, Julien Bourdaillet, Alexandre Patry, and Philippe Langlais. 2010. The rali machine translation system for wmt 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 84–90, Uppsala, Sweden, July. Association for Computational Linguistics.
28. Michael Jellinghaus, Alexandros Poulis, and David Kolovratník. 2010. Exodus - exploring smt for eu institutions. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 91–95, Uppsala, Sweden, July. Association for Computational Linguistics.
29. Philipp Koehn and Christof Monz. 2006. Manual and automatic evaluation of machine translation between European languages. In Proceedings of NAACL 2006 Workshop on Statistical Machine Translation, New York, New York.
30. Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, and Evan Herbst. 2007. Moses: Open source toolkit for statistical machine translation. In Proceedings of the ACL-2007 Demo and Poster Sessions, Prague, Czech Republic.
31. Philipp Koehn, Barry Haddow, Philip Williams, and Hieu Hoang. 2010. More linguistic annotation for statistical machine translation. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 96–101, Uppsala, Sweden, July. Association for Computational Linguistics.
32. Patrik Lambert, Sadaf Abdul-Rauf, and Holger Schwenk. 2010. Lium smt machine translation system for wmt 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 102–107, Uppsala, Sweden, July. Association for Computational Linguistics.
33. J. Richard Landis and Gary G. Koch. 1977. The measurement of observer agreement for categorical data. Biometrics, 33:159–174.
34. Samuel Larkin, Boxing Chen, George Foster, Ulrich Germann, Eric Joanis, Howard Johnson, and Roland Kuhn. 2010. Lessons from nrcs portage system at wmt 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 108–113, Uppsala, Sweden, July. Association for Computational Linguistics.
35. Gregor Leusch and Hermann Ney. 2010. The rwth system combination system for wmt 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 290–295, Uppsala, Sweden, July. Association for Computational Linguistics.
36. Zhifei Li, Chris Callison-Burch, Chris Dyer, Juri Ganitkevitch, Sanjeev Khudanpur, Lane Schwartz, Wren Thornton, Jonathan Weese, and Omar Zaidan. 2009. Joshua: An open source toolkit for parsing-based machine translation. In Proceedings of the Fourth Workshop on Statistical Machine Translation, Athens, Greece, March.
37. Zhifei Li, Chris Callison-Burch, Chris Dyer, Juri Ganitkevitch, Ann Irvine, Sanjeev Khudanpur, Lane Schwartz, Wren Thornton, Ziyuan Wang, Jonathan Weese, and Omar Zaidan. 2010. Joshua 2.0: A toolkit for parsing-based machine translation with syntax, semirings, discriminative training and other goodies. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 114–118, Uppsala, Sweden, July. Association for Computational Linguistics.
38. Chang Liu, Daniel Dahlmeier, and Hwee Tou Ng. 2010. Tesla: Translation evaluation of sentences with linear-programming-based analysis. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 329–334, Uppsala, Sweden, July. Association for Computational Linguistics.
39. Sushant Narsale. 2010. Jhu system combination scheme for wmt 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 286–289, Uppsala, Sweden, July. Association for Computational Linguistics.
40. Jan Niehues, Teresa Herrmann, Mohammed Mediani, and Alex Waibel. 2010. The karlsruhe institute for technology translation system for the acl-wmt 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 119–123, Uppsala, Sweden, July. Association for Computational Linguistics.
41. NIST. 2008. Evaluation plan for gale go/no-go phase 3 / phase 3.5 translation evaluations. June 18, 2008.
42. Sergio Penkale, Rejwanul Haque, Sandipan Dandapat, Pratyush Banerjee, Ankit K. Srivastava, Jinhua Du, Pavel Pecina, Sudip Kumar Naskar, Mikel L. Forcada, and Andy Way. 2010. Matrex: The dcu mt system for wmt 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 124–129, Uppsala, Sweden, July. Association for Computational Linguistics.
43. Aaron Phillips. 2010. The cunei machine translation platform for wmt’10. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 130–135, Uppsala, Sweden, July. Association for Computational Linguistics.
44. Juan Pino, Gonzalo Iglesias, Adrià de Gispert, Graeme Blackwood, Jamie Brunning, and William Byrne. 2010. The cued hifst system for the wmt10 translation shared task. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 136–141, Uppsala, Sweden, July. Association for Computational Linguistics.
45. Marion Potet, Laurent Besacier, and Hervé Blanchon. 2010. The lig machine translation system for wmt 2010. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 142–147, Uppsala, Sweden, July. Association for Computational Linguistics.
46. Mark Przybocki, Kay Peterson, and Sebastian Bronsart. 2008. Official results of the NIST 2008 “Metrics for MAchine TRanslation” challenge (MetricsMATR08). In AMTA-2008 workshop on Metrics for Machine Translation, Honolulu, Hawaii.
47. Antti-Veikko Rosti, Bing Zhang, Spyros Matsoukas, and Richard Schwartz. 2010. Bbn system description for wmt10 system combination task. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 296–301, Uppsala, Sweden, July. Association for Computational Linguistics.
48. Markus Saers, Joakim Nivre, and Dekai Wu. 2010. Linear inversion transduction grammar alignments as a second translation path. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 148–152, Uppsala, Sweden, July. Association for Computational Linguistics.
49. Germán Sanchis-Trilles, Jesús Andrés-Ferrer, Guillem Gascó, Jesús González-Rubio, Pascual Martínez-Gómez, Martha-Alicia Rocha, Joan-Andreu Sánchez, and Francisco Casacuberta. 2010. Upv-prhlt english–spanish system for wmt10. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 153–157, Uppsala, Sweden, July. Association for Computational Linguistics.
50. Baskaran Sankaran, Ajeet Grewal, and Anoop Sarkar. 2010. Incremental decoding for phrase-based statistical machine translation. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 197–204, Uppsala, Sweden, July. Association for Computational Linguistics.
51. Lane Schwartz. 2010. Reproducible results in parsing-based machine translation: The jhu shared task submission. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 158–163, Uppsala, Sweden, July. Association for Computational Linguistics.
52. Sara Stymne, Maria Holmqvist, and Lars Ahrenberg. 2010. Vs and oovs: Two problems for translation between german and english. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 164–169, Uppsala, Sweden, July. Association for Computational Linguistics.
53. Jörg Tiedemann. 2010. To cache or not to cache? experiments with adaptive models in statistical machine translation. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 170–175, Uppsala, Sweden, July. Association for Computational Linguistics.
54. Sami Virpioja, Jaakko Väyrynen, Andre Mansikkaniemi, and Mikko Kurimo. 2010. Applying morphological decompositions to statistical machine translation. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 176–181, Uppsala, Sweden, July. Association for Computational Linguistics.
55. Zdeněk Žabokrtský, Martin Popel, and David Mareček. 2010. Maximum entropy translation model in dependency-based mt framework. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 182–187, Uppsala, Sweden, July. Association for Computational Linguistics.
56. Billy Wong and Chunyu Kit. 2010. The parameter-optimized atec metric for mt evaluation. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 335–339, Uppsala, Sweden, July. Association for Computational Linguistics.
57. Francisco Zamora-Martinez and Germán Sanchis-Trilles. 2010. Uch-upv english–spanish system for wmt10. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 188–192, Uppsala, Sweden, July. Association for Computational Linguistics.
58. Daniel Zeman. 2010. Hierarchical phrase-based mt at the charles university for the wmt 2010 shared task. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, pages 193–196, Uppsala, Sweden, July. Association for Computational Linguistics.