Which is essential for Chinese word segmentation: Character versusword

PACLIC 20 - Proceedings of the 20th Pacific Asia Conference on Language, Information and Computation

Volumn , Issue , 2006, Pages 1-12

  Huang, Chang Ning ^a   Zhao, Hai ^a  

^a MICROSOFT RESEARCH ASIA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CHARACTER-BASED METHODS; CHINESE WORD SEGMENTATION; EMPIRICAL COMPARISON; EMPIRICAL STUDIES; STATISTICAL FEATURES; TRAINING CORPUS;

INFORMATION SYSTEMS;

COMPUTATIONAL METHODS;

EID: 84863682960     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Article

References (22)

1. Richard Sproat, Chilin Shih, William Gale, and Nancy Chang. 1996. A stochastic finite-state word-segmentation algorithm for Chinese. Computational Linguistics, Vol. 22(3):377-404.
2. Jianfeng Gao, Mu Li, Andi Wu and Chang-Ning Huang. 2005. Chinese Word Segmentation and Named Entity Recognition: A Pragmatic Approach. Computational Linguistics, Vol. 31(4): 531-574.
3. Richard Sproat and Thomas Emerson. 2003. The First International Chinese Word Segmentation Bakeoff. Proceedings of the Second SIGHAN Workshop on Chinese Language Processing, 133-143. Sapporo, Japan.
4. Thomas Emerson. 2005. The Second International Chinese Word Segmentation Bakeoff. Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, 123-133. Jeju Island, Korea.
5. Gina-Anne Levow. 2006. The Third International Chinese Language Processing Bakeoff: Word Segmentation and Named Entity Recognition. Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, 108-117. Sidney, Australia.
6. Nianwen Xue. 2003. Chinese Word Segmentation as Character Tagging. Computational Linguistics and Chinese Language Processing, Vol. 8(1): 29-48.
7. Jin Kiat Low, Hwee Tou Ng and Wenyuan Guo 2005. A Maximum Entropy Approach to Chinese Word Segmentation. Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, 161-164. Jeju Island, Korea.
8. Huihsin Tseng, Pichuan Chang, Galen Andrew, Daniel Jurafsky, Christopher Manning. 2005. A Conditional Random Field Word Segmenter for Sighan Bakeoff 2005. Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, 168-171. Jeju Island, Korea.
9. Chooi-Ling Goh, Masayuku Asahara and Yuji Matsumoto. 2005. Chinese Word Segmentatin by Classification of Characters. Computational Linguistics and Chinese Language Processing, Vol. 10(3): 381-396.
10. Ruiqiang Zhang, Genichiro Kikui and Eiichiro Sumita. 2006. Subword-based tagging by Conditional Random Fields for Chinese Word Segmentation. Proceedings of Human Language Technology Conference/North American chapter of the Association for Computational Linguistics annual meeting (HLT/NAACL-2006), 193-196. New York.
11. Ruiqiang Zhang, Genichiro Kikui and Eiichiro Sumita. 2006. Subword-based tagging for Confidence dependent Chinese word segmentation. Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (COLING/ACL 2006), 961-968. Sidney, Australia.
12. Nianwen Xue and S. P. Converse. 2002. Combining Classifiers for Chinese Word Segmentation. Proceedings of the First SIGHAN Workshop on Chinese Language Processing, 57-63. Taipei, Taiwan.
13. Nianwen Xue and Libin Shen. 2003. ChineseWord Segmentation as LMR Tagging. In Proceedings of the Second SIGHAN Workshop on Chinese Language Processing, in conjunction with ACL'03, 176-179. Sapporo, Japan
14. Hai Zhao, Chang-Ning Huang and Mu Li. 2006. An Improved Chinese Word Segmentation System with Conditional Random Field. Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, 108-117. Sidney,Australia.
15. Xinhao Wang, Xiaojun Lin, Dianhai Yu, Hao Tian and Xihong Wu. 2006. Chinese Word Segmentation with Maximum Entropy and N-gram Language Model. Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, 108-117. Sidney, Australia.
16. Aaron J. Jacobs and Yuk Wah Wong. 2006. Maximum Entropy Word Segmentation of Chinese Text. Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, 108-117. Sidney, Australia.
17. Richard Tzong-Han Tsai, Hsieh-Chuan Hung, Cheng-Lung Sung, Hong-Jie Dai and Wen-Lian Hsu. 2006. On Closed Task of Chinese Word Segmentation: An Improved CRF Model Coupled with Character Clustering and Automatically Generated Template Matching. Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, 108-117. Sidney, Australia.
18. Wu Liu, Heng Li, Yuan Dong, Nan He, Haitao Luo and Haila Wang. 2006. France Telecom R&D Beijing Word Segmenter for Sighan Bakeoff 2006. Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, 108-117. Sidney, Australia.
19. Fuchun Peng, Fangfang Feng and Andrew McCallum. 2004. Chinese Segmentation and New Word Detection Using Conditional Random Fields. In COLING 2004, 562-568. August 23-27, 2004, Geneva, Switzerland.
20. John Lafferty, A. McCallum and F. Pereira. 2001. Conditional Random Field: Probabilistic Models for Segmenting and Labeling Sequence Data. In Proceedings of the Eighteenth International Conference on Machine Learning, 282-289. Williams College, Williamstown, MA, USA, June 28-July 01, 2001.
21. Percy Liang. 2005. Semi-supervised learning for natural language. Master's thesis, Massachusetts Institute of Technology.
22. Galen Andrew. 2006. A Hybrid Markov/Semi-Markov Conditional Random Field for Sequence Segmentation. Proceedings of the 2006 conference on Empirical Methods in Natural Language Processing (EMNLP-2006), 465-472. Sidney, Australia, July 2006.