Pruning false unknown words to improve chinese word segmentation

Proceedings of the 18th Pacific Asia Conference on Language, Information and Computation, PACLIC 2004

Volumn , Issue , 2004, Pages 139-149

  Goh, Chooi Ling ^a   Asahara, Masayuki ^a   Matsumoto, Yuji ^a  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

CHINESE WORD SEGMENTATION; SEGMENTATION ACCURACY;

COMPUTATIONAL LINGUISTICS;

EID: 74349108680     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. Asahara, Masayuki, Chooi-Ling Goh, Xiaojie Wang, and Yuji Matsumoto. 2003. Combining Segmenter and Chunker for Chinese Word Segmentation. In Proceedings of Second SIGHAN Workshop, pages 144–147.
2. Fu, Guohong and K.K. Luke. 2003. An Integrated Approach for Chinese Word Segmentation. In Proceedings of PACLIC 17.
3. Fu, Guohong and K.K. Luke. 2004. Chinese Unknown Word Identification Using Class-based LM. In Proceedings of IJCNLP, pages 262–269.
4. Goh, Chooi-Ling, Masayuki Asahara, and Yuji Matsumoto. 2004. Chinese Word Segmentation by Classification of Characters. In Proceedings of Third SIGHAN Workshop.
5. Ma, Wei-Yun and Keh-Jiann Chen. 2003. A Bottom-up Merging Algorithm for Chinese Unknown Word Extraction. In Proceedings of Second SIGHAN Workshop, pages 31–38.
6. Nakagawa, Tetsuji. 2004. Chinese and Japanese Word Segmentation Using Word-Level and Character-Level Information. In Proceedings of COLING, pages 466–472.
7. Nie, Jian-Yun, Marie-Louise Hannan, and Wanying Jin. 1995. Unknown Word Detection and Segmentation of Chinese Using Statistical and Heuristic Knowledge. Communications of COLIPS, Vol.5:47–57.
8. Peng, Fuchun, Fangfang Feng, and Andrew McCallum. 2004. Chinese Segmentation and New Word Detection using Conditional Random Felds. In Proceedings of COLING, pages 562–568.
9. Shen, Dayang, Maosong Sun, and Changning Huang. 1998. The application & implementation of local statistics in Chinese unknown word identification. Communications of COLIPS, Vol.8.
10. Sproat, Richard and Thomas Emerson. 2003. The First International Chinese Word Segmentation Bakeoff. In Proceedings of Second SIGHAN Workshop, pages 133–143.
11. Xue, Nianwen and Susan P. Converse. 2002. Combining Classifiers for Chinese Word Segmentation. In Proceedings of First SIGHAN Workshop, pages 57–63.
12. Zhang, Hua-Ping, Hong-Kui Yu, De-Yi Xiong, and Qun Liu. 2003. HHMM-based Chinese Lexical Analyzer ICTCLAS. In Proceedings of Second SIGHAN Workshop, pages 184–187.