Applications of automatic evaluation methods to measuring a capability of speech translation system

10th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2003

Volumn , Issue , 2003, Pages 371-378

  Yasuda, Keiji ^a,b   Sugaya, Fumiaki ^c   Takezawa, Toshiyuki ^a   Yamamoto, Seiichi ^a   Yanagida, Masuzo ^b  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^b DOSHISHA UNIVERSITY   (Japan)

^c KDDI R AND D LABORATORIES INC   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC EVALUATION; EVALUATION METHODS; EVALUATION RESULTS; INTERNATIONAL COMMUNICATION; OBJECTIVE EVALUATION; PAIRED COMPARISON METHOD; SPEECH TRANSLATION; SPEECH TRANSLATION SYSTEMS; SYSTEM CAPABILITIES; TRANSLATION PAIRED COMPARISON;

TRANSLATION (LANGUAGES);

EID: 85118296338     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. NIST. 2002. Automatic Evaluation of Machine Translation Quality Using N-gram Co-Occurence Statistics. http://www.nist goy/speech/tests/mt/mt2001/resource/.
2. K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), pages 311-318.
3. K.-Y. Su, M.-W. Wu, and J.-S. Chang. 1992. A new quantitative quality measure for machine translation systems. In Proceedings of the 14th International Conference on Computational Linguistics(COLING), pages 433-439.
4. F. Sugaya, T. Takezawa, A. Yokoo, and S. Yamamoto. 1999. End-to-end evaluation in ATR-MATRIX: speech translation system between English and Japanese. In Proceedings of Eurospeech, pages 2431-2434.
5. F. Sugaya, T. Takezawa, A. Yokoo, Y. Sagisaka, and S. Yamamoto. 2000. Evaluation of the atr-matrix speech translation system with a paired comparison method between the system and humans. In Proceedings of International Conference on Spoken Language Processing (ICSLP), pages 1105-1108.
6. T. Takezawa, T. Morimoto, Y. Sagisaka, N. Campbell, H. Iida, F. Sugaya, A. Yokoo, and S. Yamamoto. 1998. A Japanese-to-English speech translation system: ATR-MATRIX. In Proceedings of International Conference on Spoken Language Processing (ICSLP), pages 2779-2782.
7. T. Takezawa, F. Sugaya, A. Yokoo, and S. Yamamoto. 1999. A new evaluation method for speech translation systems and a case study on ATR-MATRIX from Japanese to English. In Proceeding of Machine Translation Summit (MT Summit), pages 299-307.
8. T. Takezawa. 1999. Building a bilingual travel conversation database for speech translation research. In Proceedings of the 2nd International Workshop on East-Asian Language Resources and Evaluation - Oriental COCOSDA Workshop '99 -, pages 17-20.
9. TOEIC. 2002. Test of English for International Communication. http://www.toeic. com/.