A local generative model for Chinese word segmentation

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6458 LNCS, Issue , 2010, Pages 420-431

  Zhang, Kaixu ^a   Sun, Maosong ^a   Xue, Ping ^b  

^a TSINGHUA UNIVERSITY   (China)

^b BOEING COMPANY   (United States)

Author keywords

Chinese word segmentation; natural language processing; probability model

Indexed keywords

CHINESE WORD SEGMENTATION; DISCRIMINATIVE MODELS; GENERATIVE MODEL; GIBBS SAMPLING; LANGUAGE MODEL; LEARNING PROCESS; NATURAL LANGUAGE PROCESSING; PROBABILITY MODEL; STATE-OF-THE-ART METHODS; PROBABILITY MODELING;

COMPUTATIONAL LINGUISTICS; INFRARED DEVICES; LEARNING ALGORITHMS; NATURAL LANGUAGE PROCESSING SYSTEMS; UNSUPERVISED LEARNING; INFORMATION RETRIEVAL;

INFORMATION RETRIEVAL; COMPUTATIONAL LINGUISTICS;

EID: 78650887178     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-17187-1_41     Document Type: Conference Paper

References (13)

1. Xue, N.: Chinese word segmentation as character tagging. Computational Linguistics and Chinese Language Processing 8, 29-48 (2003)
2. Peng, F., Feng, F., McCallum, A.: Chinese segmentation and new word detection using conditional random fields. In: COLING 2004, vol. 1, pp. 562-568 (2004)
3. Gao, J., Li, M., Wu, A., Huang, C.: Chinese word segmentation and named entity recognition: A pragmatic approach. Computational Linguistics 31, 531-574 (2005)
4. Kruengkrai, C., Uchimoto, K., Kazama, J., Wang, Y., Torisawa, K., Isahara, H.: An Error-Driven Word-Character Hybrid Model for Joint Chinese Word Segmentation and POS Tagging. In: 47th Annual Meeting of the ACL, vol. 1, pp. 513-521 (2009)
5. Goldwater, S., Griffiths, T., Johnson, M.: Contextual Dependencies in Unsupervised Word Segmentation. In: 21th Annual Meeting of the ACL, vol. 1, pp. 673-680 (2006)
6. Mochihashi, D., Yamada, T., Ueda, N.: Bayesian unsupervised word segmentation with nested Pitman-Yor language modeling. In: 47th Annual Meeting of the ACL, vol. 1, pp. 100-108 (2009)
7. Sun, M., Shen, D., Tsou, B.: Chinese word segmentation without using lexicon and hand-crafted training data. In: Proceedings of the 17th International Conference on Computational Linguistics, vol. 2, pp. 1265-1271 (1998)
8. Huang, C., Šimon, P., Hsieh, S., Prévot, L.: Rethinking Chinese word segmentation: tokenization, character classification, or wordbreak identification. In: 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, vol. 1, pp. 69-72 (2007)
9. Liu, Y., Wang, B., Ding, F., Xu, S.: Information retrieval oriented word segmentation based on character associative strength ranking. In: The Conference on EMNLP, vol. 1, pp. 1061-1069 (2008)
10. Emerson, T.: The second international chinese word segmentation bakeoff. In: The Fourth SIGHAN Workshop on Chinese Language Processing, vol. 1, pp. 123-133 (2005)
11. Li, Z., Sun, M.: Punctuation as implicit annotations for Chinese word segmentation. Computational Linguistics 35, 505-512 (2009)
12. Teh, Y.: A Bayesian interpretation of interpolated Kneser-Ney. Technical Report (2006)
13. Bishop, C.: Pattern recognition and machine learning. Springer, Heidelberg (2006)