Optimizing Chinese word segmentation for machine translation performance

3rd Workshop on Statistical Machine Translation, WMT 2008 at the Annual Meeting of the Association for Computational Linguistics, ACL 2008

Volumn , Issue , 2008, Pages 224-232

  Chang, Pi Chuan ^a   Galley, Michel ^a   Manning, Christopher D ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER AIDED LANGUAGE TRANSLATION; IMAGE SEGMENTATION; MACHINE TRANSLATION; NATURAL LANGUAGE PROCESSING SYSTEMS;

CHINESE WORD SEGMENTATION; MACHINE TRANSLATIONS; PERFORMANCE; PROPER NOUNS; SEGMENTER;

COMPUTATIONAL LINGUISTICS;

EID: 85120053800     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. Jianfeng Gao, Mu Li, Andi Wu, and Chang-Ning Huang. 2005. Chinese word segmentation and named entity recognition: A pragmatic approach. Computational Linguistics.
2. Nizar Habash and Fatiha Sadat. 2006. Arabic preprocessing schemes for statistical machine translation. In Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers, pages 49-52, New York City, USA, June. Association for Computational Linguistics.
3. Vera Hollink, Jaap Kamps, Christof Monz, and Maarten de Rijke. 2004. Monolingual document retrieval for European languages. Information Retrieval, 7(1).
4. Philipp Koehn and Kevin Knight. 2003. Empirical methods for compound splitting. In EACL'03: Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics, pages 187-193. Association for Computational Linguistics.
5. Philipp Koehn, Franz Josef Och, and Daniel Marcu. 2003. Statistical phrase-based translation. In Proc. of NAACL-HLT.
6. John Lafferty, Andrew McCallum, and Fernando Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. 18th International Conf. on Machine Learning.
7. Gina-Anne Levow. 2006. The third international Chinese language processing bakeoff: Word segmentation and named entity recognition. In Proc. of the Fifth SIGHAN Workshop on Chinese Language Processing, July.
8. Einat Minkov, Richard Wang, Anthony Tomasic, and William Cohen. 2006. NER systems that suit user's preferences: Adjusting the recall-precision trade-off for entity extraction. In Proc. of NAACL-HLT, Companion Volume: Short Papers, New York City, USA, June.
9. Hwee Tou Ng and Jin Kiat Low. 2004. Chinese part-of-speech tagging: One-at-a-time or all-at-once? Word-based or character-based? In Proc. of EMNLP.
10. Franz Josef Och and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1).
11. Franz Josef Och. 2003. Minimum error rate training for statistical machine translation. In ACL.
12. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2001. BLEU: a method for automatic evaluation of machine translation. In ACL.
13. Fuchun Peng, Xiangji Huang, Dale Schuurmans, and Nick Cercone. 2002. Investigating the relationship between word segmentation performance and retrieval performance in Chinese IR. In Proc. of the 19th International Conference on Computational Linguistics.
14. Fuchun Peng, Fangfang Feng, and Andrew McCallum. 2004. Chinese segmentation and new word detection using conditional random fields. In Proc. of COLING.
15. Yanxin Shi and Mengqiu Wang. 2007. A dual-layer CRFs based joint decoding method for cascaded segmentation and labeling tasks. In IJCAI.
16. Huihsin Tseng, Pichuan Chang, Galen Andrew, Daniel Jurafsky, and Christopher Manning. 2005. A conditional random field word segmenter for Sighan bakeoff 2005. In Proc. of the Fourth SIGHAN Workshop on Chinese Language Processing.
17. Jia Xu, Richard Zens, and Hermann Ney. 2004. Do we need Chinese word segmentation for statistical machine translation. In Proc. of the Third SIGHAN Workshop on Chinese Language Learning.
18. Nianwen Xue, Fei Xia, Fu dong Chiou, and Martha Palmer. 2005. Building a large annotated Chinese corpus: the Penn Chinese treebank. Journal of Natural Language Engineering, 11(2).