Joint ChineseWord segmentation and POS tagging using an error-driven Word-character hybrid model

IEICE Transactions on Information and Systems

Volumn E92-D, Issue 12, 2009, Pages 2298-2305

  Kruengkrai, Canasai ^a,b   Uchimoto, Kiyotaka ^a   Kazama, Jun'ichi ^a   Wang, Yiou ^a   Torisawa, Kentaro ^a   Isahara, Hitoshi ^a,b  

^a KOBE UNIVERSITY   (Japan)

^b NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

Author keywords

Error driven; POS tagging; Word segmentation; Wordcharacter hybrid model

Indexed keywords

ERRORS;

CHINESE WORD SEGMENTATION; HYBRID MODEL; MODEL-BASED OPC; PENN CHINESE TREEBANK; POS TAGGING; STATE-OF-THE-ART APPROACH; TRAINING CORPUS; WORD SEGMENTATION;

COMPUTATIONAL LINGUISTICS;

EID: 77950274996     PISSN: 09168532     EISSN: 17451361     Source Type: Journal    
DOI: 10.1587/transinf.E92.D.2298     Document Type: Article

References (25)

1. H. Ng and J. Low, "Chinese part-of-speech tagging: One-at-a-time or all-at-once? word-based or character-based?," Proc. EMNLP, pp.277-284, 2004.
2. T. Nakagawa and K. Uchimoto, "A hybrid approach to word segmentation and pos tagging," Proc. ACL Demo and Poster Sessions, 2007.
3. Y. Zhang and S. Clark, "Joint word segmentation and pos tagging on a single perceptron," Proc. ACL, 2008.
4. W. Jiang, L. Huang, Q. Liu, and Y. Lü, "A cascaded linear model for joint chinese word segmentation and part-of-speech tagging," Proc. ACL, 2008.
5. W. Jiang, H. Mi, and Q. Liu, "Word lattice reranking for chinese word segmentation and part-of-speech tagging," Proc. COLING, 2008.
6. T. Nakagawa, "Chinese and Japanese word segmentation using word-level and character-level information," Proc. COLING, pp.466-472, 2004.
7. K. Crammer, Online Learning of Complex Categorial Problems, Hebrew Univeristy of Jerusalem, PhD Thesis, 2004.
8. K. Crammer, R. McDonald, and F. Pereira, "Scalable large-margin online learning for structured classification," NIPS Workshop on Learning With Structured Outputs, 2005.
9. R. McDonald, Discriminative Training and Spanning Tree Algorithms for Dependency Parsing, University of Pennsylvania, PhD Thesis, 2006.
10. F. Xia, M. Palmer, N. Xue, M.E. Okurowski, J. Kovarik, F. dong Chiou, and S. Huang, "Developing guidelines and ensuring consistency for chinese text annotation," Proc. LREC, 2000.
11. M. Asahara, Corpus-based Japanese morphological analysis, Nara Institute of Science and Technology, Doctor's Thesis, 2003.
12. H. Baayen and R. Sproat, "Estimating lexical priors for lowfrequency morphologically ambiguous forms," Computational Linguistics, vol.22, no.2, pp.155-166, 1996.
13. A. Ratnaparkhi, "A maximum entropy model for part-of-speech tagging," Proc. EMNLP, pp.133-142, 1996.
14. M. Nagata, "A part of speech estimation method for japanese unknown words using a statistical model of morphology and context," Proc. ACL, pp.277-284, 1999.
15. S.A.Z. Yair Censor, Parallel Optimization: Theory, Algorithms, and Applications, Oxford University Press, 1997.
16. M. Nagata, "A stochastic japanese morphological analyzer using a forward-DP backward-A* n-best search algorithm," Proc. 15th International Conference on Computational Linguistics, pp.201-207, 1994.
17. M. Collins, "Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms," Proc. EMNLP, pp.1-8, 2002.
18. R. McDonald, F. Pereira, K. Ribarow, and J. Hajic, "Nonprojective dependency parsing using spanning tree algorithms," Proc. HLT/EMNLP, pp.523-530, 2005.
19. R. Sproat and T. Emerson, "The first international chinese word segmentation bakeoff," Proc. 2nd SIGHAN Workshop on Chinese Language Processing, pp.133-143, 2003.
20. Y. Shi and M.Wang, "A dual-layer crfs based joint decoding method for cascaded segmentation and labeling tasks," Proc. IJCAI, 2007.
21. Z. Dong and Q. Dong, Hownet and the Computation of Meaning, World Scientific, 2006.
22. K. Uchimoto, S. Sekine, and H. Isahara, "The unknown word problem: A morphological analysis of japanese using maximum entropy aided by a dictionary," Proc. EMNLP, pp.91-99, 2001.
23. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," Proc. ICML, pp.282-289, 2001.
24. T. Kudo, K. Yamamoto, and Y. Matsumoto, "Applying conditional random fields to japanese morphological analysis," Proc. EMNLP, pp.230-237, 2004.
25. E. Brill, "Transformation-based error-driven learning and natural language processing: A case study in part-of-speech tagging," Computational Linguistics, vol.21, no.4, pp.543-565, 1995.