Chinese word segmentation without using lexicon and hand-crafted training data

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn 2, Issue , 1998, Pages 1265-1271

  Maosong, Sun ^a   Dayang, Shen ^b   Tsou, Benjamin K ^c  

^a TSINGHUA UNIVERSITY   (China)

^b SHANTOU UNIVERSITY   (China)

^c CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; IMAGE SEGMENTATION;

CHINESE CORPUS; CHINESE TEXT; CHINESE WORD SEGMENTATION; LINGUISTIC RESOURCES; MUTUAL INFORMATIONS; NLP SYSTEMS; SEGMENTATION ACCURACY; SEGMENTER; STATISTICAL DATAS; TRAINING DATA;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84872841506     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. Liang N.Y., "CDWS: An Automatic Word Segmentation System for Written Chinese Texts", Journal of Chinese Information Processing, Vol. 1, No.2, 1987 (in Chinese)
2. Fan C.K.Tsai W.H.. "Automatic Word Identification in Chinese Sentences by the Relaxation Technique", Computer Processing of Chinese & Oriental Languages, Vol.4, No.l, 1988
3. Yao T.S., Zhang G.P., Wu Y.M., "A Rule-based Chinese Word Segmentation System", Journal of Chinese Information Processing, Vol.4, No.l, 1990 (in Chinese)
4. Church K.W., Hanks P., Hindle D., "Using Statistics in Lexical Analysis", In Lexical Acquisition: Exploiting On-line Resources to Build a Lexicon, edited by U. Zernik, Hillsdale, N.J.:Erlbaum, 1991
5. Chan K.J., Liu S.H., "Word Identification for Mandarin Chinese Sentences", Proc. ofCOLING-92. Nantes. 1992
6. Sun M.S., Lai B.Y., Lun S., Sun C.F., "Some Issues on Statistical Approach to Chinese Word Identification", Proc. of the 3rd International Conference on Chinese Information Processing, Beijing, 1992
7. Sproat R., Shih C.L., "A Statistical Method for Finding Word Boundaries in Chinese Text", Computer Processing of Chinese and Oriental Languages, No.4, 1993
8. Sproat R. et al, "A Stochastic Finite-State Word Segmentation Algorithm for Chinese", Proc. of the 32nd Annual Meeting of ACL, New Mexico, 1994
9. Palmer D.D., "A Trainable Rule-based Algorithm for Word Segmentation", Proc. of the 35th Annual Meeting of ACL and 8th Conference of the European Chapter of ACL, Madrid, 1997
10. Sun M.S., Shen D.Y., Huang C.N., "CSeg&Tagl.O: A Practical Word Segmenter and POS Tagger for Chinese Texts", Proc. ofthe 6th ANLP, Washington D.C., 1997