Improving phrase-based statistical machine translation with morphosyntactic transformation

Machine Translation

Volumn 20, Issue 3, 2006, Pages 147-166

  Nguyen, Thai Phuong ^a   Shimazu, Akira ^a  

^a JAPAN ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

BLEU score; Morphological transformation; Pharaoh decoder; Phrase based statistical MT; Preprocessing; Reordering; Syntactic transformation

Indexed keywords

COMPUTATIONAL LINGUISTICS; CONTEXT FREE GRAMMARS; RESOURCE ALLOCATION; STATISTICAL METHODS; WORD PROCESSING;

BLEU SCORE; MORPHOLOGICAL TRANSFORMATION; PHARAOH DECODERS; PHRASE-BASED STATISTICAL MT; SYNTACTIC TRANSFORMATION;

MATHEMATICAL TRANSFORMATIONS;

EID: 34848858938     PISSN: 09226567     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10590-007-9022-1     Document Type: Article

References (34)

1. Al-Qnaizan Y, Curin J, Jahr M, Knight K, Lafferty J, Melamed D, Och F-J, Purdy D, Smith NA, Yarowsky D (1999) Statistical machine translation. Final Report, JHU Summer Workshop 1999, Johns Hopkins University, Baltimore, MD
2. Bikel DM (2004) Intricacies of Collins' parsing model. Comput Ling 30:479-511
3. Brown PF, Della Pietra SA, Della Pietra VJ, Mercer RL (1993) The mathematics of statistical machine translation. Comput Ling 22:39-69
4. Charniak E (2000) A maximum-entropy-inspired parser. In: 1st Meeting of the North American Chapter of the Association for Computational Linguistics, Seattle, Washington, pp 132-139
5. Charniak E, Knight K, Yamada K (2003) Syntax-based language models for statistical machine translation. In: Summit MT IX: Proceedings of the Ninth Machine Translation Summit, New Orleans, USA, pp 40-46
6. Chiang D (2005) A hierarchical phrase-based model for statistical machine translation. In: 43rd Annual Meeting of the Association for Computational Linguistics, Ann Arbor, Michigan, pp 263-270
7. Collins M (1999) Head-driven statistical models for natural language parsing. PhD thesis, University of Pennsylvania, Philadelphia, PA
8. Collins M, Koehn P, Kučerová I (2005) Clause restructuring for statistical machine translation. In: 43rd Annual Meeting of the Association for Computational Linguistics, Ann Arbor, Michigan, pp 531-540
9. Ding Y, Palmer M (2005) Machine translation using probabilistic synchronous dependency insertion grammars. In: 43rd Annual Meeting of the Association for Computational Linguistics, Ann Arbor, Michigan, pp 541-548
10. Fox H (2002) Phrasal cohesion and statistical machine translation. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing, (EMNLP-02), Philadelphia PA, pp 304-311
11. Goldwater S, McClosky D (2005) Improving statistical MT through morphological analysis. In: Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, Vancouver BC, pp 676-683
12. Johnson M (2002) A simple pattern-matching algorithm for recovering empty nodes and their antecedents. In: 40th Annual Meeting of the Association for Computational Linguistics, Philadelphia, Pennsylvania, pp 136-143
13. Klein D, Manning CD (2003) Accurate unlexicalized parsing. In: 41st Annual Meeting of the Association for Computational Linguistics, Sapporo, Japan, pp 423-430
14. Knight K, Graehl J (2005) An overview of probabilistic tree transducers for natural language processing. In: Gelbukh AF (ed) Computational linguistics and intelligent text processing, 6th international conference CICLing 2005, Mexico City, Mexico. Springer, Berlin, Germany, pp 1-24
15. Koehn P (2004) Pharaoh: A beam search decoder for phrase-based statistical machine translation models. In: Frederking RE, Taylor KB (eds) Machine translation: From real users to research, 6th Conference of the Association for Machine Translation of the Americas, AMTA 2004, Washington DC. Springer, Berlin, pp 115-124
16. Koehn P, Och FJ, Marcu D (2003) Statistical phrase-based translation. In: HLT-NAACL: Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, Edmonton, Alberta, Canada, pp 127-133
17. Lee Y-S (2004) Morphological analysis for statistical machine translation. In: HLT-NAACL 2004 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, Boston, Massachusetts, Companion Volume: Short Papers, Student Research Workshop, Demonstrations, Tutorials Abstracts pp 57-60
18. Lehmann EL (1986) Testing statistical hypotheses. 2. Springer, Berlin, Germany
19. Marcu D, Wong W (2002) A phrase-based, joint probability model for statistical machine translation. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing, (EMNLP-02), Philadelphia PA, pp 133-139
20. Marcus MP, Santorini B, Marcinkiewicz MA (1993) Building a large annotated corpus of English: the Penn TreeBank. Comput Ling 19:313-330
21. Melamed ID (2004) Statistical machine translation by parsing. In: 42nd Annual Meeting of the Association for Computational Linguistics, Barcelona, Spain, pp 653-660
22. Nguyen TP, Nguyen VV, Le AC (2003) Vietnamese word segmentation using Hidden Markov Model. In: Proceedings of International Workshop for Computer, Information, and Communication Technologies in Korea and Vietnam., Hanoi, Vietnam, pp 13-17
23. Nguyen TP, Shimazu A (2006) Improving phrase-based SMT widi morpho-syntactic analysis and transformation. In: AMTA 2006, Proceedings of the 7th Conference of the Association for Machine Translation of the Americas: Visions for the future of machine translation, Cambridge, Massachusetts, pp 138-147
24. Niessen S, Ney H (2004) Statistical machine translation with scarce resources using morpho-syntactic information. Comput Ling 30:181-204
25. Och FJ, Gildea D, Khudanpur S, Sarkar A, Yamada K, Fraser A, Kumar S, Shen L, Smith D, Eng K, Jain V, Jin Z, Radev D (2004) A smorgasbord of features for statistical machine translation. In: HLT-NAACL 2004 Human Language Technology Conference of the North American chapter of the Association for Computational Linguistics, Boston, Massachusetts, pp 161-168
26. Och FJ, Ney H (2000) Improved statistical alignment models. In: 38th Annual meeting of the association for computational linguistics, Hong Kong, China, pp 440-447
27. Och FJ, Ney H (2004) The alignment template approach to statistical machine translation. Comput Ling 30:417-449
28. Papineni KA, Roukos S, Ward T, Zhu WJ (2001) Bleu: a method for automatic evaluation of machine translation. Technical report RC22176 (W0.109-022), IBM Research Division, Thomas J. Watson Research Center, Yorktown Heights, NY
29. Pham NH, Nguyen LM, Le AC, Nguyen PT, Nguyen VV (2003) LVT: An English-Vietnamese machine translation system. In : First National Conference on Fundamental and Applied Research in Information Technology FAIR-03, Hanoi, Vietnam., pp 173-180
30. Quirk C, Menezes A, Cherry C (2005) Dependency treelet translation: Syntactically informed phrasal. SMT. In: 43rd Annual Meeting of the Association for Computational Linguistics, Ann Arbor, Michigan, pp 271-279
31. Shen L, Sarkar A, Och FJ (2004) Discriminative reranking for machine translation. In: HLT-NAACL 2004 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, Boston, Massachusetts, pp 177-184
32. Stolcke A (2002) SRILM-An extensible language modeling toolkit. In: International Conference on Spoken Language Processing, Denver, Colorado, pp 901-904
33. Xia F, McCord M (2004) Improving a statistical MT system, with automatically learned rewrite patterns. In: 20th International Conference on Computational Linguistics, Geneva, Switzerland, pp 508-514
34. Yamada K, Knight K (2001) A syntax-based statistical translation model. In: Association for Computational Linguistics 39th Annual Meeting and 10th Conference of the European Chapter, Toulouse, France, pp 523-529