Chinese and Japanese word segmentation using word-level and character-level information

COLING 2004 - Proceedings of the 20th International Conference on Computational Linguistics

Volumn , Issue , 2004, Pages

  Nakagawa, Tetsuji ^a  

^a OKI ELECTRIC INDUSTRY CO   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

CHARACTER LEVEL; HYBRID METHOD; OVERALL ACCURACIES; WORD LEVEL; WORD SEGMENTATION;

COMPUTATIONAL LINGUISTICS;

EID: 85119101524     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Masayuki Asahara and Yuji Matsumoto. 2000. Extended Models and Tools for High-performance Part-of-Speech Tagger. In Proceedings of the 18th International Conference on Computational Linguistics, pages 21-27.
2. Masayuki Asahara, Chooi Ling Goh, Xiaojie Wang, and Yuji Matsumoto. 2003. Combining Segmenter and Chunker for Chinese Word Segmentation. In Proceedings of the 2nd SIGHAN Workshop on Chinese Language Processing, pages 144-147.
3. Adam L. Berger, Stephen A. Della Pietra, and Vincent J. Della Pietra. 1996. A Maximum Entropy Approach to Natural Language Processing. Computational Linguistics, 22(1):39-71.
4. Thorsten Brants. 2000. TnT - A Statistical Part-of-Speech Tagger. In Proceedings of ANLP-NAACL 2000, pages 224-231.
5. Eugene Charniak, Curtis Hendrickson, Neil Jacobson, and Mike Perkowitz. 1993. Equations for Part-of-Speech Tagging. In Proceedings of the Eleventh National Conference on Artificial Intelligence, pages 784-789.
6. J. Darroch and D. Ratcliff. 1972. Generalized iterative scaling for log-linear models. The annuals of Mathematical Statistics, 43(5):1470-1480.
7. Sadao Kurohashi and Makoto Nagao. 1998. Japanese Morphological Analysis System JUMAN version 3.61. Department of Informatics, Kyoto University. (in Japanese).
8. Yuji Matsumoto and Masayuki Asahara. 2001. IPADIC User's Manual version 2.2.4. Nara Institute of Science and Technology. (in Japanese).
9. Yuji Matsumoto, Akira Kitauchi, Tatsuo Yamashita, Yoshitaka Hirano, Hiroshi Matsuda, Kazuma Takaoka, and Masayuki Asahara. 2001. Morphological Analysis System ChaSen version 2.2.8 Manual. Nara Institute of Science and Technology.
10. Masaki Nagata. 1999. A Part of Speech Estimation Method for Japanese Unknown Words using a Statistical Model of Morphology and Context. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics, pages 227-284.
11. Lawrence R. Rabiner and Biing-Hwang Juang. 1993. Fundamentals of Speech Recognition. PTR Prentice-Hall.
12. Lance Ramshaw and Mitch Marcus. 1995. Text Chunking using Transformation-Based Learning. In Proceedings of the 3rd Workwhop on Very Large Corpora, pages 88-94.
13. Erik F. Tjong Kim Sang and Jorn Veenstra. 1999. Representing Text Chunks. In Proceedings of 9th Conference of the European Chapter of the Association for Computational Linguistics, pages 173-179.
14. Satoshi Sekine, Ralph Grishman, and Hiroyuki Shinnou. 1998. A Decision Tree Method for Finding and Classifying Names in Japanese Texts. In Proceedings of the 6th Workshop on Very Large Corpora, pages 171-177.
15. Richard Sproat and Thomas Emerson. 2003. The First International Chinese Word Segmentation Bakeoff. In Proceedings of the Second SIGHAN Workshop on Chinese Language Processing, pages 133-143.
16. Richard Sproat, Chilin Shih, William Gale, and Nancy Chang. 1996. A Stochastic Finite-State Word-Segmentation Algorithm for Chinese. Computational Linguistics, 22(3):377-404.
17. Kiyotaka Uchimoto, Satoshi Sekine, and Hitoshi Isahara. 2001. The Unknown Word Problem: a Morphological Analysis of Japanese Using Maximum Entropy Aided by a Dictionary. In Proceedings of the 2001 Conference on Empirical Methods in Natural Language Processing, pages 91-99.
18. Nianwen Xue. 2003. Chinese Word Segmentation as Character Tagging. International Journal of Computational Linguistics and Chinese, 8(1):29-48.
19. Tatsumi Yoshida, Kiyonori Ohtake, and Kazuhide Yamamoto. 2003. Performance Evaluation of Chinese Analyzers with Support Vector Machines. Journal of Natural Language Processing, 10(1):109-131. (in Japanese).