Joint tokenization and translation

Coling 2010 - 23rd International Conference on Computational Linguistics, Proceedings of the Conference

Volumn 2, Issue , 2010, Pages 1200-1208

  Xiao, Xinyan ^a   Liu, Yang ^a   Hwang, Young Sook ^b   Liu, Qun ^a   Lin, Shouxun ^a  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^b HILab Convergence Technology Center   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ATOMIC UNITS; NATURAL LANGUAGES; TOKENIZATION; TOKENIZER; TRANSLATION SYSTEMS;

COMPUTATIONAL LINGUISTICS; DECODING;

TRANSLATION (LANGUAGES);

EID: 78651429125     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. Chang, Pi-Chuan, Michel Galley, and Christopher D. Manning. 2008. Optimizing Chinese word segmentation for machine translation performance. In the Third Workshop on SMT.
2. Chiang, David. 2007. Hierarchical phrase-based translation. Computational Linguistics, 33(2):201- 228.
3. Chung, Tagyoung and Daniel Gildea. 2009. Unsupervised tokenization for machine translation. In Proc. EMNLP 2009.
4. Dyer, Christopher, Smaranda Muresan, and Philip Resnik. 2008. Generalizing word lattice translation. In Proc. ACL 2008.
5. Dyer, Chris. 2009. Using a maximum entropy model to build segmentation lattices for mt. In Proc. NAACL 2009.
6. Galley, Michel, Jonathan Graehl, Kevin Knight, Daniel Marcu, Steve DeNeefe, Wei Wang, and Ignacio Thayer. 2006. Scalable inference and training of context-rich syntactic translation models. In Proc. ACL 2006.
7. Huihsin, Tseng, Pichuan Chang, Galen Andrew, Daniel Jurafsky, and Christopher Manning. 2005. A conditional random field word segmenter. In Fourth SIGHAN Workshop.
8. Jiang, Wenbin, Liang Huang, Qun Liu, and Yajuan Lü. 2008. A cascaded linear model for joint chinese word segmentation and part-of-speech tagging. In Proc. ACL 2008.
9. Koehn, Philipp, Franz Josef Och, and Daniel Marcu. 2003. Statistical phrase-based translation. In Proc. HLT-NAACL 2003.
10. Koehn, Philipp. 2004. Statistical significance tests for machine translation evaluation. In Proc. EMNLP 2004.
11. Liu, Yang and Qun Liu. 2010. Joint parsing and translation. In Proc. Coling 2010.
12. Liu, Yang, Qun Liu, and Shouxun Lin. 2006. Treeto- string alignment template for statistical machine translation. In Proc. ACL 2006.
13. Ma, Yanjun, Nicolas Stroppa, and Andy Way. 2007. Bootstrapping word alignment via word packing. In Proc. ACL 2007.
14. Mi, Haitao, Liang Huang, and Qun Liu. 2008. Forestbased translation. In Proc. of ACL 2008.
15. Ng, Hwee Tou and Jin Kiat Low. 2004. Chinese partof- speech tagging: One-at-a-time or all-at-once? word-based or character-based? In Proc. EMNLP 2004.
16. Och, Franz J. and Hermann Ney. 2002. Discriminative training andmaximumentropymodels for statistical machine translation. In Proc. ACL 2002.
17. Och, Franz Josef and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1):19-51. (Pubitemid 37049767)
18. Och, Franz Josef. 2003. Minimum error rate training in statistical machine translation. In Proc. ACL 2003.
19. Oflazer, Kemal. 2008. Statistical machine translation into a morphologically complex language. In Proc. CICL 2008.
20. Papineni, Kishore, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proc. ACL 2002.
21. Shen, Libin, Xu Jinxi, andWeischedel Ralph. 2008. A new string-to-dependencymachine translation algorithm with a target dependency language model. In Proc. ACL 2008.
22. Snyder, Benjamin and Regina Barzilay. 2008. Unsupervised multilingual learning for morphological segmentation. In Proc. ACL 2008.
23. Stolcke, Andreas. 2002. Srilm - an extensible language modeling toolkit.
24. Xu, Jia, Evgeny Matusov, Richard Zens, and Hermann Ney. 2005. Integrated chinese word segmentation in statistical machine translation. In Proc. IWSLT2005.
25. Xu, Jia, Jianfeng Gao, Kristina Toutanova, and Hermann Ney. 2008. Bayesian semi-supervised chinese word segmentation for statistical machine translation. In Proc. Coling 2008.
26. Xue, Nianwen and Libin Shen. 2003. Chinese word segmentation as LMR tagging. In SIGHAN Workshop.
27. Zhang, Hua-Ping, Hong-Kui Yu, De-Yi Xiong, and Qun Liu. 2003. Hhmm-based chinese lexical analyzer ictclas. In the Second SIGHAN Workshop.
28. Zhang, Ruiqiang, Keiji Yasuda, and Eiichiro Sumita. 2008. Improved statistical machine translation by multiple Chinese word segmentation. In the Third Workshop on SMT.
29. Zhang, Le. 2004. Maximum entropy modeling toolkit for python and c++.