Effective tag set selection in Chinese word segmentation via conditional random field modeling

PACLIC 20 - Proceedings of the 20th Pacific Asia Conference on Language, Information and Computation

Volumn , Issue , 2006, Pages 87-94

  Zhao, Hai ^a,b   Huang, Chang Ning ^b   Li, Mu ^b   Lu, Bao Liang ^a  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CHINESE WORD SEGMENTATION; CONDITIONAL RANDOM FIELD; EMPIRICAL COMPARISON; FEATURE TEMPLATE; STATE-OF-THE-ART PERFORMANCE; TAGGING PROBLEM; COMPARISON STUDY; PERFORMANCE; RANDOM FIELD MODEL; RANDOM FIELDS; TEMPLATE SELECTION;

COMPUTATIONAL METHODS; INFORMATION SYSTEMS; COMPUTATIONAL LINGUISTICS;

RANDOM PROCESSES;

EID: 38049001432     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Article

References (11)

1. Jianfeng Gao, Mu Li, Andi Wu and Chang-Ning Huang. 2005. Chinese Word Segmentation and Named Entity Recognition: A Pragmatic Approach. Computational Linguistics, Vol. 31(4): 531-574.
2. Nianwen Xue. 2003. Chinese Word Segmentation as Character Tagging. Computational Linguistics and Chinese Language Processing, Vol. 8(1): 29-48.
3. Nianwen Xue and Libin Shen. 2003. Chinese Word Segmentation as LMR Tagging. In Proceedings of the Second SIGHAN Workshop on Chinese Language Processing, in conjunction with ACL'03, 176-179. Sapporo, Japan.
4. Richard Sproat and Thomas Emerson. 2003. The First International Chinese Word Segmentation Bakeoff. Proceedings of the Second SIGHAN Workshop on Chinese Language Processing, 133-143. Sapporo, Japan.
5. Thomas Emerson. 2005. The Second International Chinese Word Segmentation Bakeoff. Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, 123-133. Jeju Island, Korea.
6. Jin Kiat Low, Hwee Tou Ng and Wenyuan Guo 2005. A Maximum Entropy Approach to Chinese Word Segmentation. Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, 161-164. Jeju Island, Korea.
7. Huihsin Tseng, Pichuan Chang, Galen Andrew, Daniel Jurafsky, Christopher Manning. 2005. A Conditional Random Field Word Segmenter for Sighan Bakeoff 2005. Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, 168-171. Jeju Island, Korea.
8. Fuchun Peng, Fangfang Feng and Andrew McCallum. 2004. Chinese Segmentation and New Word Detection Using Conditional Random Fields. In COLING 2004, 562-568. Geneva, Switzerland, August 23-27, 2004.
9. John Lafferty, A. McCallum and F. Pereira. 2001. Conditional Random Field: Probabilistic Models for Segmenting and Labeling Sequence Data. In Proceedings of the Eighteenth International Conference on Machine Learning, 282-289. June 28-July 01, 2001.
10. Adwait Ratnaparkhi. 1996. A Maximum Entropy Part-of-speech Tagger. In Proceedings of the Empirical Method in Natural Language Processing Conference, 133-142. University of Pennsylvania.
11. Hai Zhao, Chang-Ning Huang and Mu Li. 2006. An Improved Chinese Word Segmentation System with Conditional Random Field. Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, 108-117. Sidney, Australia.