Rethinking Chinese word segmentation: Tokenization, character classification, or wordbreak identification

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2007, Pages 69-72

  Huang, Chu Ren ^a   Šimon, Petr ^a   Hsieh, Shu Kai ^b   Prévot, Laurent ^c  

^a INSTITUTE OF LINGUISTICS   (Taiwan)

^b DoFLAL NIU   (Taiwan)

^c CNRS UPS 846   (France)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS;

CHARACTER BOUNDARIES; CHARACTER CLASSIFICATION; CHINESE CHARACTERS; CHINESE WORD SEGMENTATION; HUMAN COGNITION; LEXICAL KNOWLEDGE; ROBUST SEGMENTATION; SEGMENTATION METHODS; TOKENIZATION; WORD SEGMENTATION;

CLASSIFICATION (OF INFORMATION);

EID: 85118786219     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. Academia Sinica Balanced Corpus of Modern Chinese. http://www.sinica.edu.tw/SinicaCorpus/
2. Chen K.J and Liu S.H. 1992. Word Identification for Mandarin Chinese sentences. Proceedings of the 14th conference on Computational Linguistics, p.101-107, France.
3. Chiang,T.-H., J.-S. Chang, M.-Y. Lin and K.-Y. Su. 1996. Statistical Word Segmentation. In C.-R. Huang, K.-J. Chen and B.K. T’sou (eds.): Journal of Chinese Linguistics, Monograph Series, Number 9, Readings in Chinese Natural Language Processing, pp. 147-173.
4. Gao, J. and A. Wu and Mu Li and C.-N.Huang and H. Li and X. Xia and H. Qin. 2004. Adaptive Chinese Word Segmentation. In Proceedings of ACL-2004.
5. Meng, H. and C. W. Ip. 1999. An Analytical Study of Transformational Tagging for Chinese Text. In. Proceedings of ROCLING XII. 101-122. Taipei
6. Ruggieri S. 2004. YaDT: Yet another Decision Tree builder. Proceedings of the 16th International Conference on Tools with Artificial Intelligence (ICTAI 2004): 260-265. IEEE Press, November 2004.
7. Richard Sproat and Thomas Emerson. 2003. The First International Chinese Word Segmentation Bakeoff. Proceedings of the Second SIGHAN Workshop on Chinese Language Processing, Sapporo, Japan, July 2003.
8. Xue, N. 2003. Chinese Word Segmentation as Character Tagging. Computational Linguistics and Chinese Language Processing. 8(1): 29-48
9. Redington, M. and N. Chater and C. Huang and L. Chang and K. Chen. 1995. The Universality of Simple Distributional Methods: Identifying Syntactic Categories in Mandarin Chinese. Presented at the Proceedings of the International Conference on Cognitive Science and Natural Language Processing. Dublin City University.