Which performs better on in-vocabulary word segmentation: Based on word or character?

SIGHAN 2008 - 6th SIGHAN Workshop on Chinese Language Processing, co-located with 3rd International Joint Conference on Natural Language Processing, IJCNLP 2008

Volumn , Issue , 2008, Pages 61-68

  Wang, Zhenxing ^a,b   Huang, Changning ^b   Zhu, Jingbo ^a  

^a NORTHEASTERN UNIVERSITY   (China)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CHINESE WORD SEGMENTATION; COMBINATION METHOD; CONFIDENCE MEASURE; EVALUATION METRICS; OUTOF-VOCABULARY WORDS (OOV); PERFORMANCE; RESEARCH FIELDS; SEGMENTATION RESULTS; SEGMENTER; WORD SEGMENTATION;

COMPUTATIONAL LINGUISTICS;

EID: 85120164129     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. Thomas Emerson. 2005. The Second International Chinese Word Segmentation Bakeoff. In Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, pages 123-133, Jeju Island, Korea:
2. Chooi-Ling Goh, Masayuku Asahara and Yuji Matsumoto. 2005. Chinese Word Segmentatin by Classification of Characters. Computational Linguistics and Chinese Language Processing, Vol. 10(3): pages 381-396.
3. Gina-Anne Levow. 2006. The Third International Chinese Language Processing Bakeoff: Word Segmentation and Named Entity Recognition. In Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, pages 108-117, Sydney: July.
4. Jin Kiat Low, Hwee Tou Ng, and Wenyuan Guo. 2005. A Maximum Entropy Approach to Chinese Word Segmentation. In Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, pages 161-164, Jeju Island, Korea.
5. Fuchun Peng, Fangfang Feng, and Andrew McCallum. 2004. Chinese segmentation and new word detection using conditional random fields. In COLING 2004, pages 562-568. Geneva, Switzerland.
6. Richard Sproat and Thomas Emerson. 2003. The First International Chinese Word Segmentation Bakeoff. In Proceedings of the Second SIGHAN Workshop on Chinese Language Processing, pages 133-143, Sapporo, Japan: July 11-12
7. Huihsin Tseng, Pichuan Chang et al. 2005. A Conditional Random Field Word Segmenter for SIGHAN Bakeoff 2005. In Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, pages 168-171, Jeju Island, Korea.
8. Neinwen Xue and Susan P. Converse. 2002. Combining Classifiers for Chinese Word Segmentation. In Proceedings of the First SIGHAN Workshop on Chinese Language Processing, pages 63-70, Taipei, Taiwan.
9. Ruiqiang Zhang, Genichiro Kikui and Eiichiro Sumita. 2006a. Subword-based Tagging by Conditional Random Fields for Chinese Word Segmentation. In Proceedings of the Human Language Technology Conference of the NAACL, Companion volume, pages 193-196. New York, USA.
10. Ruiqiang Zhang, Genichiro Kikui and Eiichiro Sumita. 2006b. Subword-based Tagging for Confidence-dependent Chinese Word Segmentaion. In Proceedings of the COLING/ACL, Main Conference Poster Sessions, pages 961-968. Sydney, Australia.
11. Yue Zhang and Stephen Clark. 2007. Chinese Segmentation with a Word-Based Perceptron Algorithm. In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics, pages 840-847. Prague, Czech Republic.
12. Hai Zhao, Changning Huang et al. 2006. Effective Tag Set Selection in Chinese Word Segmentation via Conditional Random Field Modeling. In Proceedings of PACLIC-20. pages 87-94. Wuhan, China, Novemeber.