Evaluation of machine translation errors in English and Iraqi Arabic

Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010

Volumn , Issue , 2010, Pages 729-735

  Condon, Sherri ^a   Parvaz, Dan ^a   Aberdeen, John ^a   Doran, Christy ^a   Freeman, Andrew ^a   Awad, Marwan ^a  

^a MITRE CORPORATION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; TRANSLATION (LANGUAGES);

DISCOURSE CONTEXT; HIGH FREQUENCY HF; HUMAN ANNOTATIONS; MACHINE TRANSLATIONS; MULTI-WORD EXPRESSIONS; TRANSLATION SYSTEMS; VERY LOW FREQUENCY; WORD ORDER ERRORS;

ERRORS;

EID: 85000903441     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Banerjee, S. and Lavie, A. (2005). METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. In Proceedings of the ACL 2005 Workshop on Intrinsic and Extrinsic Evaluation Measures for MT and/or Summarization, pp. 65-73.
2. Condon, S., Sanders, G., Parvaz, D., Rubenstein, A., Doran, C, Aberdeen, J., and Oshika, B. (2009). Normalization for Automated Metrics: English and Arabic Speech Translation. Proceedings of MT Summit XII.
3. Llitjós, A., Carbonell, J., and Lavie, A. (2005). A framework for interactive and automatic refinement of transfer-based machine translation. In Proc. Of the 10th Annual Conf. of the European Association for Machine Translation (EAMT), Budapest, Hungary, May.
4. NIST. (2007). Post Editing Guidelines for GALE Machine Translation Evaluation Version 3.0.2. http://projects.ldc.upenn.edu/gale/Translation/Editors/GALEposteditguidelines-3.0.2.pdf
5. NIST. (2008). MTPostEditor-V1.2.0.jar. V1.2.2 available at Linguistic Data Consortium (LDC). GALE: Machine Translation Post-Editing Resource page for current post-editors.
6. http://projects.ldc.upenn.edu/gale/Translation/Editors/
7. Popović, M. and Ney, H. (2007). Word Error Rates: Decomposition over POS Classes and Applications for Error Analysis. In Proceedings of the Second Workshop on Statistical Machine Translation, pp. 48-55.
8. Przybocki, M., Peterson, K., and Bronsart, S. (2008). Official results of the NIST 2008 "Metrics for MAchine TRanslation" Challenge (MetricsMATR08), http://nist.gov/speech/tests/metricsmatr/2008/results/
9. Sanders, G., Bronsart, S., Condon, S., and Schlenoff, C. (2008). Odds of successful transfer of low-level concepts: A key metric for bidirectional speech-to-speech machine translation in DARPA's TRANSTAC program. Proceedings of LREC 2008.
10. Snover, M, Dorr, B., Schwartz, R., Micciula, L., and Makhoul, J. (2006). A Study of Translation Error Rate with Targeted Human Annotation. Proceedings of AMTA 2006, pp. 223-231.
11. Tillmann, C, Vogel, S., Ney, H., Zubiaga, A., and Sawaf, H. (1997). Accelerated DP Based Search for Statistical Translation. In European Conference on Speech Communication and Technology, pp. 2667-2670.
12. Vilar, D., Xu, J., D'Haro, L., and Ney, H. (2006). Error Analysis of Statistical Machine Translation Output. In Proc. of the Fifth Int. Conf. on Language Resources and Evaluation (LREC), pp. 697-702.
13. Weiss, B., Schlenoff, C, Sanders, G., Steves, M., Condon, S., Phillips, J., and Parvaz, D. (2008). Performance Evaluation of Speech Translation Systems. Proceedings of LREC 2008.