Chinese word segmentation without using dictionary based on unsupervised learning strategy

Jisuanji Xuebao/Chinese Journal of Computers

Volumn 27, Issue 6, 2004, Pages 736-742

  Sun, Mao Song ^a   Xiao, Ming ^a   Tsou, B K ^b  

^a TSINGHUA UNIVERSITY   (China)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Bigram of Chinese characters; Chinese word segmentation; Combination of mutual information and t test; Unsupervised learning

Indexed keywords

ALGORITHMS; COMPUTER APPLICATIONS;

BIGRAM OF CHINESE CHARACTERS; CHINESE WORD SEGMENTATION; UNSUPERVISED LEARNING;

WORD PROCESSING;

EID: 3142751938     PISSN: 02544164     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (7)

1. Sproat R., Shih C. L.. A statistical method for finding word boundaries in Chinese text. Computer Processing of Chinese and Oriental Languages, 1993, 4(4): 249-336
2. Sun Mao-Song, Shen Da-Yang, Tsou B K. Chinese word segmentation without using lexicon and hand-crafted training data, In: Proceedings of the 36th Annual Meeting of Association of Computational Linguistics and the 17th International Conference on Computational Linguistics, Montreal, Canada, 1998, 1265-1271
3. Sun Mao-Song, Huang Chang-Ning, Tsou B K, Shen Da-Yang, Lu Fang. Using character bigram for ambiguity resolution in Chinese word segmentation. Computer Research and Development, 1997, 34(5): 332-339 (in Chinese)
4. Huang Xun-Jing, Wu Li-De. Word segmentation without using handcrafted dictionary based on machine learning. Pattern Recognition and Artificial Intelligence, 1996, 6(4): 297-303 (in Chinese)
5. Nie J. Y., Jin W. Y.. A hybrid approach to unknown word detection and segmentation of Chinese. In: Proceedings of International Conference on Chinese Computing, Singapore, 1994, 405-412
6. Liu Ting, Wu Yan. Chinese word segmentation system based on the hybrid of string frequencies and word matching. Journal of Chinese Information Processing, 1998, 12(1): 17-25 (in Chinese)
7. Church K. W., Gale W., Hanks P., Hindle D.. Using statistics in lexical analysis. In: Zernik U. ed.. Lexical Acquisition: Exploiting On-line Resources to Build a Lexicon. Hillsdale NJ: Lawrence Erlbaum Associates, 1991, 115-164