Segmenting Chinese unknown words by heuristic method

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2911, Issue , 2003, Pages 510-520

  Yang, Christopher C ^a   Li, K W ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

DIGITAL LIBRARIES; IMAGE SEGMENTATION; NATURAL LANGUAGE PROCESSING SYSTEMS; TEXT PROCESSING;

CHINESE SEGMENTATION; CHINESE TEXT SEGMENTATION; CHINESE UNKNOWN WORDS; ERRORS OF COMMISSIONS; OUT OF VOCABULARY WORDS; SEGMENTATION AMBIGUITIES; STATISTICAL APPROACH; WORD IDENTIFICATION;

HEURISTIC METHODS;

EID: 0346955705     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-24594-0_52     Document Type: Article

References (10)

1. Chen, K. and Bai, M., "Unknown Word Detection for Chinese by a Corpus-base Learning Method," Computational Linguistics and Chinese Language Processing, vol.3, no.1, February, 1998, pp.27-44.
2. Chien, L.F., "Fast and quasi-natural language search for gigabits of Chinese texts," Research and Development in Information Retrieval, ACM-SIGIR, Seattle, 1995, pp.112-120.
3. Dai, Y., Khoo, C. S. G. and Loh, T. E., "A New Statistical Formula for Chinese Text Segmentation Incorporating Contextual Information," ACM SIGIR, 1999.
4. Khoo, C. S. G., Dai, Y., and Loh, T. E., "Using Statistical and Contextual Information to Identify Two-and Three-Character Words in Chinese Text," Journal of the American Society for Information Science and Technology, 53(3), pp.365-377, 2002.
5. Lai, Yu-sheng and Wu, Chung-hsien, "Unknown Word and Phrase Extraction Using a Phrase-Like-Unit-Based Likelihood Ratio", International Journal of Computer Processing of Oriental Languages, Vol. 13, No. 1, 2000, pp.83-95.
6. Meknavin, S., Charoenpornsawat, P., Kijsirikul, B., "Feature-based Thai Word Segmentation," Natural Language Processing Pacific Rim Symposium (NLPRS'97), 1997
7. Sproat, R. and Shih, C, "A Statistical Method for Finding Word Boundaries in Chinese Text," Computer Processing of Chinese and Oriental Languages, 4, 1990, pp.336-351.
8. Wu, Zimin and Tseng, Gwyneth, "ACTS: An Automatic Chinese Text Segmentation System for Full Text Retrieval," Journal of The American Society for Information Science, 46(2):83-96, 1995.
9. C. C. Yang, J. Luk, S. Yung, and J. Yen, "Combination and Boundary Detection Approach for Chinese Indexing," Journal of the American Society for Information Science, Special Topic Issue on Digital Libraries, vol.51, no.4, March, 2000, pp.340-351.
10. Yeh, C.L. and Lee, H. J., "Rule-based Word Identification for Mandarin Chinese Sentences -A Unification Approach," Computer Processing of Chinese and Oriental Languages, vol.5, no.2, pp.97-118, 1991.