Linguistic-based evaluation criteria to identify statistical machine translation errors

EAMT 2010 - 14th Annual Conference of the European Association for Machine Translation

Volumn , Issue , 2010, Pages

  Farrús, Mireia ^a   Costa Jussà, Marta R ^b   Mariño, José B ^a   Fonollosa, José A R ^a  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

^b Barcelona Media Innovation Center   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

EVALUATION CRITERIA; EXPERT KNOWLEDGE; HUMAN EVALUATION; MACHINE TRANSLATION EVALUATIONS; PERCEPTUAL EVALUATION; STATISTICAL MACHINE TRANSLATION; TRANSLATION SYSTEMS;

ERRORS; INFORMATION THEORY; LINGUISTICS; SEMANTICS;

QUALITY CONTROL;

EID: 84857517537     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Bangalore, Srinivas, and Giuseppe Riccardi. 2001. Finite-state models for lexical reordering in spoken language translation. Proceedings of the ICSLP, 4:422-425, Beijing, China.
2. Callison-Burch, Chris, Philipp Koehn, Christof Monz and Josh Schroeder. 2009. Findings of the 2009 Workshop on Statistical Machine Translation. Proceedings of the Fourth Workshop on Statistical Machine Translation, 1-28, Athens, Greece.
3. Casacuberta, Francisco. 2001. Finite-state transducers for speech-input translation. Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop, 375-380, Trento, Italy.
4. Chen, Stanley F., and Joshua Goodman. 1998. An empirical study of smoothing techniques for language modeling. Technical Report TR-10-98, Harvard University.
5. Doddington, George. 2002. Automatic evaluation of machine translation quality using n-gram cooccurrence statistics. Proceedings of the HLTNAACL, 138-145, San Diego.
6. Farrús, Mireia, Marta R. Costa-jussà, Marc Poch, Adolfo Hernández, and José B. Mariño. 2009. Improving a Catalan-Spanish Statistical Translation System using Proceedings of the EAMT, 52-57, Barcelona.
7. Flanagan, Mary A. 2002. Error classification for MT evaluation. Proceedings of the AMTA Conference, 65-72, Columbia, Maryland.
8. de Gispert, Adrià, and José B. Mariño. 2002. Using Xgrams for speech-to-speech translation. Proceedings of the ICSLP, 1885-1888, Denver, Colorado.
9. Mariño, José B., Rafael E. Banchs, Josep M. Crego, Josep M., Adrià de Gispert, Patrick Lambert, José A.R. Fonollosa and Marta R. Costa-jussà. 2006. Ngram Based Machine Translation. Computational Linguistics, 32:4:527-549.
10. McCowan, Iain, Darren Moore, John Dines, Daniel Gatica-Perez, Mike Flynn, Pierre Wellner and Hervé Bourlard. 2004. On the Use of Information Retrieval Measures for Speech Recognition Evaluation. Technical Report of the IDIAP, 73, Martigny, Switzerland.
11. Niessen, Sonja, and Hermann Ney. 2000. Improving SMT quality with morpho-syntactic analysis. Proceedings of the International conference on Computational Linguistics, Saarbrücken, Germany.
12. Och, Franz Josef. 2003. Minimum Error Rate Training in Statistical Machine Translation. Proceedings of the 41st Meeting of the Association for Computational Linguistics, 160-167, Sapporo, Japan.
13. Papineni, Kishore, Salim Roukos, ToddWard, andWeijing Zhu. 2002. BLEU: A method for automatic evaluation of machine translation. Proceedings of the 40th Meeting of the Association for Computational Linguistics, 311-318, Philadelphia, Pennsylvania.
14. Popović, Maja, and Hermann Ney. 2004. Towards the Use of Word Stems and Suffixes for Statistical Machine Translation. Proceedings of International Conference on Language Resources and Evaluation, Lisbon, Portugal.
15. Popović, Maja and Hermann Ney. 2006. POS-based Word Reorderings for Statistical Machine Translation. Proceedings of International Conference on Language Resources and Evaluation, Genoa, Italy.
16. Popović, Maja, Adrià de Gispert, Deepa Gupta, Patrick Lambert, Hermann Ney, José B. Mariño and Rafael E. Banchs. 2006. Morpho-syntactic Information for Automatic Error Analysis of Statistical Machine Translation Output. Proceedings of the HLT/NAACL Workshop on Statistical Machine Translation, New York.
17. Snover, Matthew, and Bonnie Dorr. 2006. A Study of Translation Edit Rate with Targeted Human Annotation. Proceedings of the AMTA, Boston, USA.
18. Vidal, Enrique. 1997. Finite-state speech-to-speech translation. Proceedings of the ICASSP, 111-114, Munich, Germany.
19. Vilar, David, Jia Xu, Luis Fernando D'Haro, and Hermann Ney. 2006. Error analysis of statistical machine translation output. Proceedings of the LREC, Genoa, Italy.