Adaptive Chinese word segmentation

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2004, Pages 462-469

  Gao, Jianfeng ^a   Wu, Andi ^a   Li, Mu ^a   Huang, Chang Ning ^a   Li, Hongqiao ^b   Xia, Xinsong ^c   Qin, Haowei ^d  

^a MICROSOFT RESEARCH   (United States)

^b BEIJING INSTITUTE OF TECHNOLOGY   (China)

^c PEKING UNIVERSITY   (China)

^d SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS;

CHINESE WORD SEGMENTATION; CHINESE WORD SEGMENTATION SYSTEMS; DIFFERENT DOMAINS; DOMAIN SPECIFIC; LINEAR MODELING; STATISTICAL FRAMEWORK; TRAINING DATA; TRANSFORMATION-BASED LEARNING; UNIFIED APPROACH; WORD SEGMENTATION;

COMPUTATIONAL LINGUISTICS;

EID: 85149144117     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Brill, Eric. 1995. Transformation-based error-driven learning and natural language processing: a case study in Part-of-Speech tagging. In: Computational Linguistics, 21(4).
2. Collins, Michael and Nigel Duffy. 2001. Convolution kernels for natural language. In: Advances in Neural Information Processing Systems (NLPS 14).
3. Collins, Michael. 2002. Parameter estimation for statistical parsing models: theory and practice of distribution-free methods. To appear.
4. Della Pietra, S., Della Pietra, V., and Lafferty, J. 1997. Inducing features of random fields. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, 19, 380-393.
5. Duda, Richard O, Hart, Peter E. and Stork, David G. 2001. Pattern classification. John Wiley & Sons, Inc.
6. Gao, Jianfeng and Kai-Fu Lee. 2000. Distribution based pruning of backoff language models. In: ACL2000.
7. Gao, Jianfeng, Mu Li and Chang-Ning Huang. 2003. Improved source-channel model for Chinese word segmentation. In: ACL2003.
8. Katz, S. M. 1996. Distribution of content words and phrases in text and language modeling, In: Natural Language Engineering, 1996(2): 15-59
9. Li, Hongqiao, Chang-Ning Huang, Jianfeng Gao and Xiaozhong Fan. 2004. The use of SVM for Chinese new word identification. In: IJCNLP2004.
10. Manning, C. D. and H. Schütze, 1999. Foundations of Statistical Natural Language Processing. The MIT Press.
11. Mitchell, Tom M. 1997. Machine learning. The McGraw-Hill Companies, Inc.
12. Och, Franz. 2003. Minimum error rate training in statistical machine translation. In: ACL2003.
13. Palmer, D. 1997. A trainable rule-based algorithm for word segmentation. In: ACL '97.
14. Rosenfeld, R., S. F. Chen and X. Zhu. 2001. Whole sentence exponential language models: a vehicle for linguistic statistical integration. In: Computer Speech and Language, 15 (1).
15. Sproat, Richard and Chilin Shih. 2002. Corpus-based methods in Chinese morphology and phonology. In: COLING 2002.
16. Sproat, Richard and Tom Emerson. 2003. The first international Chinese word segmentation bakeoff. In: SIGHAN 2003.
17. Uchimoto, K., S. Sekine and H. Isahara. 2001. The unknown word problem: a morphological analysis of Japanese using maximum entropy aided by a dictionary. In: EMNLP2001.
18. Wu, Andi and Zixin Jiang. 2000. Statistically-enhanced new word identification in a rule-based Chinese system. In: Proc of the 2rd ACL Chinese Processing Workshop.
19. Wu, Andi. 2003. Customizable segmentation of morphologically derived words in Chinese. In: International Journal of Computational Linguistics and Chinese Language Processing, 8(1): 1-27.
20. Wu, Zimin and Gwyneth Tseng. 1993. Chinese text segmentation for text retrieval achievements and problems. In: JASIS, 44(9): 532-542.