Unsupervised segmentation helps supervised learning of character tagging for word segmentation and named entity recognition

SIGHAN 2008 - 6th SIGHAN Workshop on Chinese Language Processing, co-located with 3rd International Joint Conference on Natural Language Processing, IJCNLP 2008

Volumn , Issue , 2008, Pages 106-111

  Zhao, Hai ^a   Kit, Chunyu ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS;

CHINESE WORD SEGMENTATION; FEATURE TEMPLATE; NAMED ENTITY RECOGNITION; UNSUPERVISED SEGMENTATION; WORD SEGMENTATION;

MACHINE LEARNING;

EID: 84871054273     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Jing-Shin Chang and Keh-Yih Su. 1997. An unsupervised iterative method for Chinese new lexicon extraction. Computational Linguistics and Chinese Language Processing, 2(2):97-148.
2. Wenliang Chen, Yujie Zhang, and Hitoshi Isahara. 2006. Chinese named entity recognition with conditional random fields. In SIGHAN-5, pages 118-121, Sydney, Australia, July 22-23.
3. Thomas Emerson. 2005. The second international Chinese word segmentation bakeoff. In SIGHAN-4, pages 123-133, Jeju Island, Korea, October 14-15.
4. Haodi Feng, Kang Chen, Xiaotie Deng, and Weimin Zheng. 2004a. Accessor variety criteria for Chinese word extraction. Computational Linguistics, 30(1):75-93.
5. Haodi Feng, Kang Chen, Chunyu Kit, and Xiaotie Deng. 2004b. Unsupervised segmentation of Chinese corpus using accessor variety. In First International Joint Conference on Natural Language Processing (IJCNLP-04), pages 255-261, Sanya, Hainan Island, China, March 22-24.
6. Also in K. Y. Su, J. Tsujii, J. H. Lee & O. Y. Kwong (eds.), Natural Language Processing - IJCNLP 2004, LNAI 3248, pages 694-703. Springer.
7. Zellig Sabbetai Harris. 1955. From phoneme to morpheme. Language, 31(2):190-222.
8. Zellig Sabbetai Harris. 1970. Morpheme boundaries within words. In Papers in Structural and Transformational Linguistics, page 68õ77.
9. Jin Hu Huang and David Powers. 2003. Chinese word segmentation based on contextual entropy. In Dong Hong Ji and Kim-Ten Lua, editors, PACLIC - 17, pages 152-158, Sentosa, Singapore, October, 1-3. COLIPS Publication.
10. Zhihui Jin and Kumiko Tanaka-Ishii. 2006. Unsupervised segmentation of Chinese text by use of branching entropy. In COLING/ACL-2006, pages 428-435, Sidney, Australia, July 17-21.
11. Chunyu Kit and Yorick Wilks. 1998. The virtual corpus approach to deriving n-gram statistics from large scale corpora. In Changning Huang, editor, Proceedings of 1998 International Conference on Chinese Information Processing Conference, pages 223-229, Beijing, Nov. 18-20.
12. Chunyu Kit and Yorick Wilks. 1999. Unsupervised learning of word boundary with description length gain. In M. Osborne and E. T. K. Sang, editors, CoNLL-99, pages 1-6, Bergen, Norway.
13. Chunyu Kit and Hai Zhao. 2007. Improving Chinese word segmentation with description length gain. In 2007 International Conference on Artificial Intelligence (ICAI'07), Las Vegas, June 25-28.
14. John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In ICML'2001, pages 282-289, San Francisco, CA.
15. Gina-Anne Levow. 2006. The third international Chinese language processing bakeoff: Word segmentation and named entity recognition. In SIGHAN-5, pages 108-117, Sydney, Australia, July 22-23.
16. Jin Kiat Low, Hwee Tou Ng, and Wenyuan Guo. 2005. A maximum entropy approach to Chinese word segmentation. In SIGHAN-4, pages 161-164, Jeju Island, Korea, October 14-15.
17. Udi Manber and Gene Myers. 1993. Suffix arrays: A new method for on-line string searches. SIAM Journal on Computing, 22(5):935-948.
18. Gordon E. Moore. 1965. Cramming more components onto integrated circuits. Electronics, 3(8), April 19.
19. Richard Sproat and Thomas Emerson. 2003. The first international Chinese word segmentation bakeoff. In SIGHAN-2, pages 133-143, Sapporo, Japan.
20. Richard Tzong-Han Tsai, Hsieh-Chuan Hung, Cheng-Lung Sung, Hong-Jie Dai, and Wen-Lian Hsu. 2006. On closed task of Chinese word segmentation: An improved CRF model coupled with character clustering and automatically generated template matching. In SIGHAN-5, pages 108-117, Sydney, Australia, July 22-23.
21. Cheng-Huang Tung and His-Jian Lee. 1994. Identification of unknown words from corpus. Computational Proceedings of Chinese and Oriental Languages, 8:131-145.
22. Nianwen Xue. 2003. Chinese word segmentation as character tagging. Computational Linguistics and Chinese Language Processing, 8(1):29-48.
23. Suxiang Zhang, Ying Qin, Juan Wen, and Xiaojie Wang. 2006. Word segmentation and named entity recognition for SIGHAN Bakeoff3. In SIGHAN-5, pages 158-161, Sydney, Australia, July 22-23.
24. Hai Zhao and Chunyu Kit. 2007. Incorporating global information into supervised learning for Chinese word segmentation. In PACLING-2007, pages 66-74, Melbourne, Australia, September 19-21.
25. Hai Zhao, Chang-Ning Huang, and Mu Li. 2006a. An improved Chinese word segmentation system with conditional random field. In SIGHAN-5, pages 162-165, Sydney, Australia, July 22-23.
26. Hai Zhao, Chang-Ning Huang, Mu Li, and Bao-Liang Lu. 2006b. Effective tag set selection in Chinese word segmentation via conditional random field modeling. In PACLIC-20, pages 87-94, Wuhan, China, November 1-3.