E-rating Machine Translation

WMT 2011 - 6thWorkshop on Statistical Machine Translation, Proceedings of the Workshop

Volumn , Issue , 2011, Pages 108-115

  Parton, Kristen ^a   Tetreault, Joel ^b   Madnani, Nitin ^b   Chodorow, Martin ^c  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b EDUCATIONAL TESTING SERVICE   (United States)

^c CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATED ESSAY SCORING; EVALUATION METRICS; LEVEL CORRELATION; MACHINE TRANSLATIONS; MT EVALUATIONS; SENTENCE LEVEL; WRITING PROFICIENCIES;

MACHINE TRANSLATION;

EID: 84876808991     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Joshua Albrecht and Rebecca Hwa. 2007a. A Reexamination of Machine Learning Approaches for Sentence-Level MT Evaluation. In Proceedings of ACL.
2. Joshua Albrecht and Rebecca Hwa. 2007b. Regression for Sentence-Level MT Evaluation with Pseudo References. In Proceedings of ACL.
3. Yigal Attali and Jill Burstein. 2006. Automated essay scoring with e-rater v.2.0. Journal of Technology, Learning, and Assessment, 4(3).
4. John Bitchener, Stuart Young, and Denise Cameron. 2005. The effect of different types of corrective feedback on esl student writing. Journal of Second Language Writing.
5. Chris Callison-Burch, Philipp Koehn, Christof Monz, Kay Peterson, Mark Przybocki, and Omar F. Zaidan. 2010. Findings of the 2010 joint workshop on statistical machine translation and metrics for machine translation. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, WMT'10, pages 17-53, Stroudsburg, PA, USA. Association for Computational Linguistics.
6. Ben Carterette. 2009. On rank correlation and the distance between rankings. In Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval, SIGIR'09, pages 436-443, New York, NY, USA. ACM.
7. Martin Chodorow and Claudia Leacock. 2000. An unsupervised method for detecting grammatical errors. In Proceedings of the Conference of the North American Chapter of the Association of Computational Linguistics (NAACL), pages 140-147.
8. Simon Corston-Oliver, Michael Gamon, and Chris Brockett. 2001. A Machine Learning Approach to the Automatic Evaluation of Machine Translation. In Proceedings of the 39th Annual Meeting on Association for Computational Linguistics, pages 148-155.
9. Kevin Duh. 2008. Ranking vs. regression in machine translation evaluation. In Proceedings of the Third Workshop on Statistical Machine Translation, StatMT '08, pages 191-194, Stroudsburg, PA, USA. Association for Computational Linguistics.
10. Atsushi Fujii, Masao Utiyama, Mikio Yamamoto, and Takehito Utsuro. 2009. Evaluating Effects of Machine Translation Accuracy on Cross-lingual Patent Retrieval. In Proceedings of SIGIR, pages 674-675.
11. Yoko Futagi, Paul Deane, Martin Chodorow, and Joel Tetreault. 2008. A computational approach to detecting collocation errors in the writing of non-native speakers of English. Computer Assisted Language Learning, 21:353-367.
12. Michael Gamon, Anthony Aue, and Martine Smets. 2005. Sentence-level MT Evaluation Without Reference Translations: Beyond Language Modeling. In Proceedings of the European Association for Machine Translation (EAMT).
13. Na-Rae Han, Martin Chodorow, and Claudia Leacock. 2006. Detecting errors in English article usage by non-native speakers. Natural Language Engineering, 12(2):115-129.
14. Thorsten Joachims. 2006. Training linear SVMs in linear time. In ACM SIGKDD International Conference On Knowledge Discovery and Data Mining (KDD), pages 217-226.
15. Douglas Jones, Martha Herzog, Hussny Ibrahim, Arvind Jairam, Wade Shen, Edward Gibson, and Michael Emonts. 2007. ILR-Based MT Comprehension Test with Multi-Level Questions. In HLT-NAACL (Short Papers), pages 77-80.
16. Alex Kulesza and Stuart M. Shieber. 2004. A Learning Approach to Improving Sentence-level MT Evaluation. In Proceedings of the 10th International Conference on Theoretical and Methodological Issues in Machine Translation (TMI).
17. Alon Lavie and Michael J. Denkowski. 2009. The meteor metric for automatic evaluation of machine translation. Machine Translation, 23:105-115, September.
18. Claudia Leacock, Martin Chodorow, Michael Gamon, and Joel Tetreault. 2010. Automated Grammatical Error Detection for Language Learners. Morgan & Claypool Publishers.
19. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, ACL'02, pages 311-318, Stroudsburg, PA, USA. Association for Computational Linguistics.
20. Kristen Parton, Kathleen R. McKeown, Bob Coyne, Mona T. Diab, Ralph Grishman, Dilek Hakkani-Tür, Mary Harper, Heng Ji, Wei Yun Ma, Adam Meyers, Sara Stolbach, Ang Sun, Gokhan Tur, Wei Xu, and Sibel Yaman. 2009. Who, What, When, Where, Why? Comparing Multiple Approaches to the Cross-Lingual 5W Task. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pages 423-431.
21. Kay Peterson and Mark Przybocki. 2010. Nist 2010 metrics for machine translation evaluation (metricsmatr10) official release of results. http://www.itl.nist.gov/iad/mig/tests/metricsmatr/2010/results.
22. Mark Przybocki, Kay Peterson, Sébastien Bronsart, and Gregory Sanders. 2009. The nist 2008 metrics for machine translation challenge-overview, methodology, metrics, and results. Machine Translation, 23:71-103, September.
23. Christopher Quirk. 2004. Training a Sentence-level Machine Translation Confidence Measure. In Proceedings of LREC.
24. Sidney Siegel and N. John Castellan. 1988. Nonparametric statistics for the behavioral sciences. McGrawHill, 2 edition.
25. Matthew Snover, Nitin Madnani, Bonnie J. Dorr, and Richard Schwartz. 2009. Fluency, adequacy, or hter?: exploring different human judgments with a tunable mt metric. In Proceedings of the Fourth Workshop on Statistical Machine Translation, StatMT'09, pages 259-268, Stroudsburg, PA, USA. Association for Computational Linguistics.
26. Joel Tetreault and Martin Chodorow. 2008. The ups and downs of preposition error detection in ESL writing. In Proceedings of the 22nd International Conference on Computational Linguistics (COLING), pages 865-872.
27. David Vilar, Jia Xu, Luis Fernando D'Haro, and Hermann Ney. 2006. Error analysis of machine translation output. In International Conference on Language Resources and Evaluation, pages 697-702, Genoa, Italy, May.