Semantic translation error rate for evaluating translation systems

2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007, Proceedings

Volumn , Issue , 2007, Pages 390-395

  Subramanian, Krishna ^a   Stallard, Dave ^a   Prasad, Rohit ^a   Saleem, Shirin ^a   Natarajan, Prem ^a  

^a BBN TECHNOLOGIES   (United States)

Author keywords

Automated metric; Statistical machine translation

Indexed keywords

ALIGNMENT; COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; ERRORS; SEMANTICS;

AUTOMATED METRIC; ERROR RATE; HUMAN JUDGMENTS; MACHINE TRANSLATION SYSTEMS; SEMANTIC TRANSLATIONS; STATISTICAL MACHINE TRANSLATION; STATISTICAL PROPERTIES; TRANSLATION SYSTEMS;

SPEECH RECOGNITION;

EID: 44849110905     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/asru.2007.4430144     Document Type: Conference Paper

References (10)

1. Snover, M., Dorr, B., Schwartz, R., Micciulla, L., and Makhoul, J., "A Study of Translation Edit Rate with Targeted Human Annotation," Proceedings of Association for Machine Translation in the Americas, 2006.
2. Banerjee, S. and Lavie, A., "METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments," Proceedings of ACL, 2005.
3. Koehn, P., Och, F., and Marcu, D., "Statistical Phrase-Based Translation," Proc. of the HLT and NAACL Conference, 2003.
4. Zhou, B., Dechelotte, D., and Gao, Y., "Two-way Speech-to-Speech Translation on Handheld Devices," Int. Conf. of Spoken Language Processing (ICSLP), Korea, Oct. 2004.
5. Kathol, A., Precoda, K., Vergyri, D., Wang, W., and Riehemann, S., "Speech translation for low-resource languages: the case of Pashto," Proc. INTERSPEECH-2005, 2273-2276, Lisbon, Portugal, 2006.
6. Stallard, D., Choi. F, Krstovski, K., Natarajan, P., Prasad, R., Saleem, S., "A Hybrid Phrase-based/Statistical Speech Translation System," Proc. of Interspeech, Pittsburgh, PA, 2006.
7. Papineni, K., Roukos, S., Ward, T., and Zhu, W., "BLEU: A method for automatic evaluation of machine translation," Proceedings of ACL, 311-318, 2002.
8. Barnett, V., "Sample Survey principles and methods," Hodder Publisher, 1991.
9. Jones, K., and Willet, P., "Readings in Information Retrieval," San Francisco: Morgan Kaufmann, 1997.
10. Fellbaum, C., "WordNet: An Electronic Lexical Database," The MIT Press, Cambridge, MA, 1998.