Mostly-unsupervised statistical segmentation of Japanese: Applications to Kanji

1st Meeting of the North American Chapter of the Association for Computational Linguistics, NAACL 2000 - co-located with 6th Applied Natural Language Processing Conference, ANLP 2000 - Proceedings

Volumn , Issue , 2000, Pages 241-248

  Ando, Rie Kubota ^a   Lee, Lillian ^a  

^a Department of Computer Science and School of Operations Research and Information Engineering   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DELIMITERS; ERROR METRICES; JAPANESE TEXT; MORPHOLOGICAL ANALYZER; PERFORMANCE; SEGMENTATION ALGORITHMS; SEGMENTED DATA; STATISTICAL SEGMENTATION; TRAINING DATA; WORD SEGMENTATION;

EID: 26444473118     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Rie Ando and Lillian Lee. 1999. Unsupervised statistical segmentation of Japanese kanji strings. Technical Report TR99-1756, Cornell University.
2. Takeshi Fuchi and Shinichiro Takagi. 1998. Japanese morphological analyzer using word cooccurrence - JTAG. In Proc. of COLING-ACL '98, pages 409-413.
3. Pascale Fung. 1998. Extracting key terms from Chinese and Japanese texts. Computer Processing of Oriental Languages, 12 (1).
4. Ralph Grishman, Catherine Macleod, and John Sterling. 1992. Evaluating parsing strategies using standardized parse files. In Proc. of the 3rd ANLP, pages 156-161.
5. Akinori Ito and Kasaki Kohda. 1995. Language modeling by string pattern N-gram for Japanese speech recognition. In Proc. of ICASSP.
6. Hideki Kashioka, Yasuhiro Kawata, Yumiko Kinjo, Andrew Finch, and Ezra W. Black. 1998. Use of mutual information based character clusters in dictionary-less morphological analysis of Japanese. In Proc. of COLING-ACL '98, pages 658-662.
7. Sadao Kurohashi and Makoto Nagao. 1998. Japanese morphological analysis system JUMAN version 3.6 manual. In Japanese.
8. Udi Manber and Gene Myers. 1993. Suffix arrays: A new method for on-line string searches. SIAM Journal on Computing, 22 (5) :935-948.
9. T. Matsukawa, Scott Miller, and Ralph Weischedel. 1993. Example-based correction of word segmentation and part of speech labelling. In Proc. of the HLT Workshop, pages 227-32.
10. Yuji Matsumoto and Makoto Nagao. 1994. Improvements of Japanese morphological analyzer JUMAN. In Proc. of the International Workshop on Shamble Natural Language Resources, pages 22-28.
11. Yuji Matsumoto, Akira Kitauchi, Tatsuo Yamashita, Yoshitaka Hirano, Osamu Imaichi, and Tomoaki Imamura. 1997. Japanese morphological analysis system ChaSen manual. Technical Report NAIST-IS-TR97007, Nara Institute of Science and Technology. In Japanese.
12. Shinsuke Mori and Makoto Nagao. 1998. Unknown word extraction from corpora using ngram statistics. Journal of the Information Processing Society of Japan, 39 (7) :2093-2100. In Japanese.
13. Makoto Nagao and Shinsuke Mori. 1994. A new method of N-gram statistics for large number of n and automatic extraction of words and phrases from large text data of Japanese. In Proc. of the 15th COLING, pages 611-615.
14. Masaaki Nagata. 1994. A stochastic Japanese morphological analyzer using a forward-DP backward-A* n-best search algorithm. In Proc. of the 15th COLING, pages 201-207.
15. Masaaki Nagata. 1996a. Automatic extraction of new words from Japanese texts using generalized forward-backward search. In Proc. of the Conference on Empirical Methods in Natural Language Processing, pages 48-59.
16. Masaaki Nagata. 1996b. Context-based spelling correction for Japanese OCR. In Proc. of the 16th COLING, pages 806-811.
17. Masaaki Nagata. 1997. A self-organizing Japanese word segmenter using heuristic word identification and re-estimation. In Proc. of the 5th Workshop on Very Large Corpora, pages 203-215.
18. David Palmer. 1997. A trainable rule-based algorithm for word segmentation. In Proc. of the 35th ACU8th EACL, pages 321-328.
19. Constantine P. Papageorgiou. 1994. Japanese word segmentation by hidden Markov model. In Proc. of the HLT Workshop, pages 283-288.
20. Richard Sproat and Chilin Shih. 1990. A statistical method for finding word boundaries in Chinese text. Computer Processing of Chinese and Oriental Languages, 4:336-351.
21. Richard Sproat, Chilin Shih, William Gale, and Nancy Chang. 1996. A stochastic finite-sate word-segmentation algorithm for Chinese. Computational Linguistics, 22 (3).
22. Maosong Sun, Dayang Shen, and Benjamin K. Tsou. 1998. Chinese word segmentation without using lexicon and hand-crafted training data. In Proc. of COLING-ACL '98, pages 1265-1271.
23. Koichi Takeda and Tetsunosuke Fujisaki. 1987. Automatic decomposition of kanji compound words using stochastic estimation. Journal of the Information Processing Society of Japan, 28 (9) :952-961. In Japanese.
24. Kouichi Takeuchi and Yuji Matsumoto. 1995. HMM parameter learning for Japanese morphological analyzer. In Proc. of the 10th Pacific Asia Conference on Language, Information and Computation (PACLING), pages 163-172.
25. Virginia Teller and Eleanor Olds Batchelder. 1994. A probabilistic algorithm for segmenting nonkanji Japanese strings. In Proc. of the 12th AAAI, pages 742-747.
26. Laura Mayfield Tomokiyo and Klaus Ries. 1997. What makes a word: learning base units in Japanese for speech recognition. In Proc. of the ACL Special Interest Group in Natural Language Learning (CoNLL97), pages 60-69.
27. Zimin Wu and Gwyneth Tseng. 1993. Chinese text segmentation for text retrieval: Achievements and problems. Journal of the American Society for Information Science, 44 (9) :532-542.
28. Dekai Wu. 1998. A position statement on Chinese segmentation. http://www.cs.ust.hk/~dekai/-papers/segmentation.html. Presented at the Chinese Language Processing Workshop, University of Pennsylvania.
29. Mikio Yamamoto. 1996. A re-estimation method for stochastic language modeling from ambiguous observations. In Proc. of the 4th Workshop on Very Large Corpora, pages 155-167.
30. J. Yamron, J. Baker, P. Bamberg, H. Chevalier, T. Dietzel, J. Elder, F. Kampmann, M. Mandel, L. Manganaro, T. Margolis, and E. Steele. 1993. LTNGSTAT: An interactive, machine-aided translation system. In Proc. of the HLT Workshop, pages 191-195.