The character-based CRF segmenter of MSRA&NEU for the 4th Bakeoff

SIGHAN 2008 - 6th SIGHAN Workshop on Chinese Language Processing, co-located with 3rd International Joint Conference on Natural Language Processing, IJCNLP 2008

Volumn , Issue , 2008, Pages 98-101

  Wang, Zhenxing ^a,b   Huang, Changning ^b   Zhu, Jingbo ^a  

^a NORTHEASTERN UNIVERSITY   (China)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; IMAGE SEGMENTATION;

CHINESE LANGUAGE PROCESSING; CHINESE WORD SEGMENTER; OUTOF-VOCABULARY WORDS (OOV); PERFORMANCE; POST-PROCESSING; RANDOM FIELD MODEL; SEGMENTER; WORD SEGMENTATION;

RANDOM PROCESSES;

EID: 70350717618     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. John Lafferty, Andrew McCallum, and Fernando Pereira. 2001. Conditional random fields: probabilistic models for segmenting and labeling sequence data. In Proceedings of ICML-2001, pages 591-598.
2. Gina-Anne Levow. 2006. The Third International Chinese Language Processing Bakeoff: Word Segmentation and Named Entity Recognition. In Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, pages 108-117, Sydney: July.
3. Jin Kiat Low, Hwee Tou Ng, and Wenyuan Guo. 2005. A Maximum Entropy Approach to Chinese Word Segmentation. In Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, pages 161-164, Jeju Island, Korea.
4. Zhiyong Luo, Rou Song, 2004. “An integrated method for Chinese unknown word extraction”, In Proceedings of Third SIGHAN Workshop on Chinese Language Processing, pages 148-154. Barcelona, Spain.
5. Fuchun Peng, Fangfang Feng, and Andrew McCallum. 2004. Chinese segmentation and new word detection using conditional random fields. In COLING 2004, pages 562-568. Geneva, Switzerland.
6. Huihsin Tseng, Pichuan Chang et al. 2005. A Conditional Random Field Word Segmenter for SIGHAN Bakeoff 2005. In Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, pages 168-171, Jeju Island, Korea.
7. Zhenxing Wang, Changning Huang and Jingbo Zhu. 2008. Which Performs Better on In-Vocabulary Word Segmentation: Based on Word or Character? In Proceeding of the Sixth Sighan Workshop on Chinese Language Processing. To be published.
8. Neinwen Xue and Susan P. Converse. 2002. Combining Classifiers for Chinese Word Segmentation. In Proceedings of the First SIGHAN Workshop on Chinese Language Processing, pages 63-70, Taipei, Taiwan.
9. Ruiqiang Zhang, Genichiro Kikui and Eiichiro Sumita. 2006. Subword-based Tagging by Conditional Random Fields for Chinese Word Segmentation. In Proceedings of the Human Language Technology Conference of the NAACL, Companion volume, pages 193-196. New York, USA.
10. Hai Zhao, Changning Huang et al. 2006. Effective Tag Set Selection in Chinese Word Segmentation via Conditional Random Field Modeling. In Proceedings of PACLIC-20. pages 87-94. Wuhan, China, Novemeber.