Automatic evaluation method for machine translation using noun-phrase chunking

ACL 2010 - 48th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference

Volumn , Issue , 2010, Pages 108-117

  Echizen Ya, Hiroshi ^a   Araki, Kenji ^b  

^a HOKKAI GAKUEN UNIVERSITY   (Japan)

^b HOKKAIDO UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC EVALUATION; EVALUATION EXPERIMENTS; HUMAN JUDGMENTS; MACHINE TRANSLATION SYSTEMS; MACHINE TRANSLATIONS; NOUN PHRASE;

COMPUTATIONAL LINGUISTICS;

COMPUTER AIDED LANGUAGE TRANSLATION;

EID: 84859985749     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. In Proc. of ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, 65-72.
2. Deborah Coughlin. 2003. Correlating Automated and Human Assessments of Machine Translation Quality. In Proc. of MT Summit IX, 63-70.
3. Hiroshi Echizen-ya and Kenji Araki. 2007. Automatic Evaluation of Machine Translation based on Recursive Acquisition of an Intuitive Common Parts Continuum. In Proc. of MT Summit XII, 151-158.
4. Hiroshi Echizen-ya, Terumasa Ehara, Sayori Shimohata, Atsushi Fujii, Masao Utiyama, Mikio Yamamoto, Takehito Utsuro and Noriko Kando. 2009. Meta-Evaluation of Automatic Evaluation Methods for Machine Translation using Patent Translation Data in NTCIR-7. In Proc. of the 3rd Workshop on Patent Translation, 9-16.
5. Terumasa Ehara. 2007. Rule Based Machine Translation Combined with Statistical Post Editor for Japanese to English Patent Translation. In Proc. of MT Summit XII Workshop on Patent Translation, 13-18.
6. Atsushi Fujii, Masao Utiyama, Mikio Yamamoto and Takehito Utsuro. 2008. Overview of the Patent Translation Task at the NTCIR-7 Workshop. In Proc. of 7th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-lingual Information Access, 389-400.
7. Gregor Leusch, Nicola Ueffing and Hermann Ney. 2003. A Novel String-to-String Distance Measure with Applications to Machine Translation Evaluation. In Proc. of MT Summit IX, 240-247.
8. Chin-Yew Lin and Franz Josef Och. 2004. Automatic Evaluation of Machine Translation Quality Using Longest Common Subsequence and Skip-Bigram Statistics. In Proc. of ACL'04, 606-613.
9. Dennis N. Mehay and Chris Brew. 2007. BLEUÂTRE: Flattening Syntactic Dependencies for MT Evaluation. In Proc. of MT Summit XII, 122-131.
10. Andrew Mutton, Mark Dras, Stephen Wan and Robert Dale. 2007. GLEU: Automatic Evaluation of Sentence-Level Fluency. In Proc. of ACL'07, 344-351.
11. NIST. 2002. Automatic Evaluation of Machine Translation Quality Using N-gram Co-Occurrence Statistics. http://www.nist.gov/speech/tests/mt/doc/ngram- study.pdf.
12. Takashi Oyamada, Hiroshi Echizen-ya and Kenji Araki. 2010. Automatic Evaluation of Machine Translation Using both Words Information and Comprehensive Phrases Information. In IPSJ SIG Technical Report, Vol.2010-NL-195, No. 3 (in Japanese).
13. Kishore Papineni, Salim Roukos, Todd Ward and Wei-Jing Zhu. 2002. BLEU: a Method for Automatic Evaluation of Machine Translation. In Proc. of ACL'02, 311-318.
14. Michael Pozar and Eugene Charniak. 2006. Bllip: An Improved Evaluation Metric for Machine Translation. Brown University Master Thesis.
15. Fei Sha and Fernando Pereira. 2003. Shallow Parsing with Conditional Random Fields. In Proc. of HLT-NAACL 2003, 134-141.
16. Keh-Yih Su, Ming-Wen Wu and Jing-Shin Chang. 1992. A New Quantitative Quality Measure for Machine Translation Systems. In Proc. of GOLING' 92, 433-439.
17. Masao Utiyama and Hitoshi Isahara. 2003. Reliable Measures for Aligning Japanese-English News Articles and Sentences. In Proc. of the ACL'03, pp.72-79.