Splitting-merging model of Chinese word tokenization and segmentation

Natural Language Engineering

Volumn 4, Issue 4, 1998, Pages 309-324

  Yao, Yuan ^a   Lua, Kim Ten ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84937180101     PISSN: 13513249     EISSN: 14698110     Source Type: Journal    
DOI: 10.1017/S1351324998002058     Document Type: Article

References (17)

1. Bai, S. H. (1995) An integrated model of Chinese word segmentation and part of speech tagging. In Advances and Applications on Computational Linguistics, L. W. Chen and Q. Yuan (eds.), pp. 56–61. Tsinghua University Press.
2. Chen, K. J. and Liu, S. H. (1992) Word identification for mandarin Chinese sentences. Proceedings 14th International Conference on Computational Linguistics (COLING-92), Nantes, France, pp. 101–107.
3. Chiang, T. H., Chang, J. S., Lin, M. Y. and Su, K. Y. (1992) Statistical models for word segmentation and unknown word resolution. Proceedings ROC Computational Linguistics Conference (.ROCLING) V, Taiwan, pp. 123–146.
4. Garside, R. G., Leech, G. N. and Sampson, G. R. (1987) The Computational Analysis of English: A Corpus-based Approach. London: Longman.
5. Guo, J. (1996) Critical tokenization and its properties. Submitted. (Online available at URL: http://sunzi.iss.nus.sg:1996/guojin/papers/)
6. Guo, J. (1996) Profile tokenization and its properties. Submitted. (Online available at URL: http://sunzi.iss.nus.sg:1996/guojin/papers/)
7. Jie, C. Y., Liu, Y. and Liang, N. Y. (1991) On the methods of Chinese automatic segmentation. Journal of Chinese Information Processing 3 (1): 1–9.
8. Liang, N. Y. (1986) On computer automatic word segmentation of written Chinese. Journal of Chinese Information Processing 1 (1).
9. Nie, J. Y., Jin, W. Y. and Hannan, M. L. (1994) A hybrid approach to unknown word detection and segmentation of Chinese. Proceedings of International Conference on Chinese Computing 1994 (ICCC-94), Singapore, pp. 326–335.
10. Pachunke, T., Mertineit, O., Wothke, K. and Schmidt, R. (1992) Broad coverage automatic morphological segmentation of German words. Proceedings 14th International Conference on Computational Linguistics (COLING-92), Nantes, France, pp. 1218–1222.
11. Sun, M. S. and T'sou, B. (1995) Ambiguity resolution in Chinese word segmentation. Proceedings 10th Pacific Asia Conference on Language, Information and Computation (.PACLIC-95), Hong Kong, pp. 121–126.
12. Webster, J. J. and Kit, C-Y. (1992) Tokenization as the initial phase in NLP. Proceedings 14th International Conference on Computational Linguistics (COLING-92), Nantes, France, pp. 1106–1110.
13. Wu, M. W. and Su, K. Y. (1993) Corpus-based automatic compound extraction with mutual information and relative frequency count. Proceedings ROC Computational Linguistics Conference (ROCLING) VI, Taiwan, pp. 207–216.
14. Yeh, C. L. and Lee, H. J. (1991) Rule-based word identification for mandarin Chinese sentences - a unification approach. Computer Processing of Chinese and Oriental Languages 5 (2): 97–118.
15. Yosiyuki, K., Takenobu, T. and Hozumi, T. (1992) Analysis of Japanese compound nouns using collocation information. Proceedings 14th International Conference on Computational Linguistics (COLING-92), Nantes, France, pp. 865–869.
16. Yun, B. H., Lee, H. and Rim, H. C. (1995) Analysis of Korean compound nouns using statistical information. Proceedings 1995 International Conference on Computer Processing of Oriental Language (ICCPOL-95), Honolulu, Hawaii, pp. 76–79.
17. Chinese Knowledge Information Processing Group (CKIP) (1995). Technical Report 95–02, Institute of Information Science, Academia Sinica, Taiwan.