Given bilingual terminology in statistical machine translation: MWE-sensitive word alignment and hierarchical Pitman-Yor process-based translation model smoothing

Proceedings of the 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24

Volumn , Issue , 2011, Pages 269-274

  Okita, Tsuyoshi ^a   Way, Andy ^a  

^a DUBLIN CITY UNIVERSITY   (Ireland)

Author keywords

[No Author keywords available]

Indexed keywords

MULTI-WORD; STATISTICAL MACHINE TRANSLATION; TEST CORPUS; TRAINING CORPUS; TRANSLATION MODELS; WORD ALIGNMENT;

ARTIFICIAL INTELLIGENCE; INFORMATION THEORY; LINGUISTICS; SPEECH TRANSMISSION;

TERMINOLOGY;

EID: 80052406399     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Bannard, C., and Callison-Burch, C. 2005. Paraphrasing with biingual parallel corpora. Proceedings of the 43nd Annual Meeting of the Association for Computational Linguistics (ACL 2005) 597-604.
2. Brown, F.; Pietra, V.; Pietra, A.; ; and Mercer, R. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, Vol. 19, Issue 2 263-311.
3. Callison-Burch, C.; Koehn, P.; and Osborne, M. 2006. Improved statistical machine translation using paraphrases. In Proceedings of the North American Chapter of the Association for Computationa Linguistics (NAACL 2006) 17-24.
4. Chiang, D. 2005. A hierarchical phrase-based model for statistical machine translation. In Proceedings of the 43th Annual Meeting of the Association for Computational Linguistics (ACL-05) 263-270.
5. Finkel, J. R.; Grenager, T.; and Manning, C. 2005. Incorporating non-local information into information extraction systems by gibbs sampling. Proceedings of the 43nd Annual Meeting of the Association for Computational Linguistics (ACL 2005) 363-370.
6. Foster, G.; Kuhn, R.; and Johnson, H. 2006. Phrasetable smoothing for statistical machine translation. In Proceedings of the Empirical Methods in Natural Language Processing (EMNLP 2006) 53-61.
7. Fujii, A.; Utiyama, M.; Yamamoto, M.; Utsuro, T.; Ehara, T.; Echizen-ya, H.; and Shimohata, S. 2010. Overview of the patent translation task at the NTCIR-8 workshop. In Proceedings ofthe 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-lingual Information Access 293-302.
8. Goldwater, S.; Griffiths, T. L.; and Johnson, M. 2006. Contextual dependencies in unsupervised word segmentation. In Proceedings of Conference on Computational Linguistics / Association for Computational Linguistics (COLING-ACL06) 673-680.
9. Koehn, P., and Hoang, H. 2007. Factored translation models. In Proceedings of the Empirical Methods in Natural Language Processing (EMNLP 2007) 868-876.
10. Koehn, P.; Hoang, H.; Birch, A.; Callison-Burch, C.; Federico, M.; Bertoldi, N.; Cowan, B.; Shen, W.; Moran, C.; Zens, R.; Dyer, C.; Bojar, O.; Constantin, A.; and Herbst, E. 2007. Moses: Open source toolkit for Statistical Machine Translation. In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics Companion Volume Proceedings of the Demo and Poster Sessions 177-180.
11. Koehn, P.; Och, F.; and Marcu, D. 2003. Statistical phrase-based translation. In Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computationa Linguistics (HLT/NAACL 2003) 115-124.
12. Koehn, P. 2010. Statistical machine translation. Cambridge University Press. Cambridge. UK.
13. Kudo, T., and Matsumoto, Y. 2003. Fast methods for kernel-based text analysis. In Proceedings ofthe Annual Meeting of the Association for Computational Linguistics (ACL 2003) 24-31.
14. Kupiec, J. 1993. An algorithm for finding noun phrase correspondences in bilingual corpora. In Proceedings of the 31st Annual Meeting of Association for Computational Linguistics 17-22.
15. Marcu, D., and Wong, W. 2002. A phrase-based, joint probability model for statistical machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP-2002) 133-139.
16. Mochihashi, D.; Yamada, T.; and Ueda, N. 2009. Bayesian unsupervised word segmentation with nested pitman-yor language modeling. In Proceedings of Joint Conference of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing (ACL-IJCNLP 2009) 100-108.
17. Och, F., and Ney, H. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics 29(1):19-51.
18. Och, F. 2003. Minimum Error Rate Training in Statistical Machine Translation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics 160-167.
19. Okita, T., and Way, A. 2010. Pitman-Yor process-based language model for Machine Translation. International Journal on Asian Language Processing 21(2):57-70.
20. Okita, T.; Guerra, A. M.; Graham, Y.; and Way, A. 2010. Multi-Word Expression-sensitive word alignment. In Proceedings of the Fourth International Workshop On Cross Lingual Information Access (CLIA2010, collocated with COLING2010) 26-34.
21. Okita, T.; Graham, Y.; and Way, A. 2010. Gap between theory and practice: Noise sensitive word alignment in machine translation. In Journal of Machine Learning Research Workshop and Conference Proceedings Volume 11: Workshop on Applications of Pattern Analysis (WAPA2010) 119-126.
22. Okita, T. 2009. Data cleaning for word alignment. In Proceedings of Joint Conference of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing (ACL-IJCNLP 2009) Student Research Workshop 72-80.
23. Pitman, J. 1995. Exchangeable and partially exchangeable random partitions. Probability Theory and Related Fields 102:145-158.
24. Stolcke, A. 2002. SRILM - An extensible language modeling toolkit. In Proceedings of the International Conference on Spoken Language Processing 901-904.
25. Sumita, E. 2000. Lexical transfer using a vector-space model. In Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics (ACL 2000) 425-431.
26. Teh, Y. W. 2006. A hierarchical Bayesian language model based on Pitman-Yor processes. In Proceedings of Joint Conference of the 44th Annual Meeting of the Association for Computational Linguistics 985-992.
27. Zhao, S., and Wang, H. 2010. Paraphrases and applications. Coling 2010: Paraphrases and Applications-Tutorial notes 1-87.