Error analysis of Chinese text segmentation using statistical approach

Proceedings of the ACM IEEE International Conference on Digital Libraries, JCDL 2004

Volumn , Issue , 2004, Pages 256-257

  Yang, Christopher C ^a   Li, K W ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Indexing; Multilingual processing; Text Segmentation

Indexed keywords

BOUNDARY DETECTION; CHINESE TEXT; MULTILINGUAL PROCESSING; TEXT SEGMENTATION;

BOUNDARY CONDITIONS; COMPUTATIONAL LINGUISTICS; ERROR ANALYSIS; HEURISTIC METHODS; INDEXING (OF INFORMATION); STATISTICAL METHODS;

TEXT PROCESSING;

EID: 4944220726     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (5)

1. Chen, K. and Bai, M. Unknown word detection for Chinese by a corpus-base learning method. Computational Linguistics and Chinese Language Processing, vol.3, no.1, February, 27-44, 1998.
2. Khoo, C. S. G., Dai, Y., and Loh, T. E. Using statistical and contextual information to identify two-and three-character words in Chinese text. Journal of the American Society for Information Science and Technology, 53(3), 365-377, (2002).
3. Yang, C. C., Luk, J., Yung, S., and Yen, J. Combination and boundary detection approach for Chinese indexing. Journal of the American Society for Information Science, Special Topic Issue on Digital Libraries, 51(4), March, 340-351, 2000.
4. Yang, C. C. and Li, K. W. Segmenting Chinese Unknown Words by Heuristic Method, Proceedings of the International Conference on Asia Digital Libraries, Malayasia, December 8-11, 2003.
5. Yeh, C.L. and Lee, H. J. Rule-based word identification for mandarin Chinese sentences - a unification approach. Computer Processing of Chinese and Oriental Languages, 5(2), 1991, 97-118.