A character-based joint model for chinese word segmentation

Coling 2010 - 23rd International Conference on Computational Linguistics, Proceedings of the Conference

Volumn 2, Issue , 2010, Pages 1173-1181

  Wang, Kun ^a   Zong, Chengqing ^a   Su, Keh Yih ^b  

^a INSTITUTE OF AUTOMATION   (China)

^b Behavior Design Corporation   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CHINESE WORD SEGMENTATION; DISCRIMINATIVE MODELS; F-SCORE; GENERATIVE MODEL; JOINT MODELS; RELATIVE ERRORS;

COMPUTATIONAL LINGUISTICS;

EID: 80053417765     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Masayuki Asahara, Kenta Fukuoka, Ai Azuma, Chooi-Ling Goh, Yotaro Watanabe, Yuji Ma-tsumoto and Takashi Tsuzuki, 2005. Combination of machine learning methods for optimum Chinese word segmentation. In Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, pages 134-137, Jeju, Korea.
2. Christopher M. Bishop, 2006. Pattern recognition and machine learning. New York: Springer.
3. Stanley F. Chen and Joshua Goodman, 1998. An empirical study of smoothing techniques for lan-guage modeling. Technical Report TR-10-98, Harvard University Center for Research in Computing Technology.
4. Michael Collins, 2002. Discriminative training methods for hidden markov models: theory and experiments with perceptron algorithms. In Proceedings of EMNLP, pages 1-8, Philadelphia.
5. Thomas Emerson, 2005. The second international Chinese word segmentation bakeoff. In Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, pages 123-133.
6. Jianfeng Gao, Mu Li and Chang-Ning Huang, 2003. Improved Source-Channel Models for Chinese Word Segmentation. In Proceedings of ACL, pages 272-279.
7. Wenbin Jiang, Liang Huang, Qun Liu and Yajuan Lu, 2008. A Cascaded Linear Model for Joint Chinese Word Segmentation and Part-of-Speech Tagging. In Proceedings of ACL, pages 897-904.
8. John Lafferty, Andrew McCallum and Fernando Pereira, 2001. Conditional Random Fields: Prob-abilistic Models for Segmenting and Labeling Sequence Data. In Proceedings of ICML, pages 282-289.
9. Hwee Tou Ng and Jin Kiat Low, 2004. Chinese part-of-speech tagging: one-at-a-time or all-at- once? word-based or character-based. In Proceedings of EMNLP, pages 277-284.
10. Fuchun Peng, Fangfang Feng and Andrew McCallum, 2004. Chinese segmentation and new word detection using conditional random fields. In Proceedings of COLING, pages 562-568.
11. Adwait Ratnaparkhi, 1998. Maximum entropy models for natural language ambiguity resolution. University of Pennsylvania.
12. Andreas Stolcke, 2002. SRILM-an extensible language modeling toolkit. In Proceedings of the International Conference on Spoken Language Processing, pages 311-318.
13. Kristina Toutanova, 2006. Competitive generative models with structure learning for NLP classifi-cation tasks. In Proceedings of EMNLP, pages 576-584, Sydney, Australia.
14. Huihsin Tseng, Pichuan Chang, Galen Andrew, Daniel Jurafsky and Christopher Manning, 2005. A Conditional Random Field Word Segmenter for Sighan Bakeoff 2005. In Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, pages 168-171.
15. Kun Wang, Chengqing Zong and Keh-Yih Su, 2009. Which is more suitable for Chinese word seg-mentation, the generative model or the discriminative one? In Proceedings of PACLIC, pages 827-834, Hong Kong, China.
16. Ying Xiong, Jie Zhu, Hao Huang and Haihua Xu, 2009. Minimum tag error for discriminative training of conditional random fields. Information Sciences, 179 (1-2). pages 169-179.
17. Nianwen Xue, 2003. Chinese Word Segmentation as Character Tagging. Computational Linguistics and Chinese Language Processing, 8 (1). pages 29-48.
18. Huaping Zhang, Hongkui Yu, Deyi Xiong and Qun Liu, 2003. HHMM-based Chinese lexical analyzer ICTCLAS. In Proceedings of the Second SIGHAN Workshop on Chinese Language Processing, pages 184-187.
19. Ruiqiang Zhang, Genichiro Kikui and Eiichiro Sumita, 2006. Subword-based Tagging for Con-fidence-dependent Chinese Word Segmentation. In Proceedings of the COLING/ACL, pages 961968, Sydney, Australia.
20. Ying Zhang, Stephan Vogel and Alex Waibel, 2004. Interpreting BLEU/NIST scores: How much im-provement do we need to have a better system. In Proceedings of LREC, pages 2051-2054.
21. Yue Zhang and Stephen Clark, 2007. Chinese Segmentation with a Word-Based Perceptron Algo-rithm. In Proceedings of ACL, pages 840-847, Prague, Czech Republic.