An error-drivenword-character hybrid model for joint Chinese word segmentation and POS Tagging

ACL-IJCNLP 2009 - Joint Conf. of the 47th Annual Meeting of the Association for Computational Linguistics and 4th Int. Joint Conf. on Natural Language Processing of the AFNLP, Proceedings of the Conf.

Volumn , Issue , 2009, Pages 513-521

  Kruengkrai, Canasai ^a,b   Uchimoto, Kiyotaka ^b   Kazama, Jun'ichi ^b   Wang, Yiou ^b   Torisawa, Kentaro ^b   Isahara, Hitoshi ^a,b  

^a KOBE UNIVERSITY   (Japan)

^b NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ERRORS; NATURAL LANGUAGE PROCESSING SYSTEMS;

CHINESE WORD SEGMENTATION; HYBRID MODEL; MODEL-BASED OPC; PENN CHINESE TREEBANK; POS TAGGING; TRAINING CORPUS;

COMPUTATIONAL LINGUISTICS;

EID: 84859895892     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1687878.1687951     Document Type: Conference Paper

References (26)

1. Masayuki Asahara. 2003. Corpus-based Japanese morphological analysis. Nara Institute of Science and Technology, Doctor's Thesis.
2. Harald Baayen and Richard Sproat. 1996. Estimating lexical priors for low-frequency morphologically ambiguous forms. Computational Linguistics, 22(2):155-166.
3. Eric Brill. 1995. Transformation-based error-driven learning and natural language processing: A case study in part-of-speech tagging. Computational Linguistics, 21(4):543-565.
4. Michael Collins. 2002. Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. In Proceedings of EMNLP, pages 1-8.
5. Koby Crammer, Ryan McDonald, and Fernando Pereira. 2005. Scalable large-margin online learning for structured classification. In NIPS Workshop on Learning With Structured Outputs.
6. Koby Crammer. 2004. Online Learning of Complex Categorial Problems. Hebrew Univeristy of Jerusalem, PhD Thesis.
7. Zhendong Dong and Qiang Dong. 2006. Hownet and the Computation of Meaning. World Scientific.
8. Kuzman Ganchev, Koby Crammer, Fernando Pereira, Gideon Mann, Kedar Bellare, Andrew McCallum, Steven Carroll, Yang Jin, and Peter White. 2007. Penn/umass/chop biocreative ii systems. In Proceedingsof the Second BioCreative Challenge EvaluationWorkshop.
9. Wenbin Jiang, Liang Huang, Qun Liu, and Yajuan Lü. 2008a. A cascaded linear model for joint chinese word segmentation and part-of-speech tagging. In Proceedings of ACL.
10. Wenbin Jiang, Haitao Mi, and Qun Liu. 2008b. Word lattice reranking for chinese word segmentation and part-of-speech tagging. In Proceedings of COLING.
11. Taku Kudo, Kaoru Yamamoto, and Yuji Matsumoto. 2004. Applying conditional random fields to japanese morphological analysis. In Proceedings of EMNLP, pages 230-237.
12. John Lafferty, Andrew McCallum, and Fernando Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of ICML, pages 282-289.
13. Ryan McDonald, Femando Pereira, Kiril Ribarow, and Jan Hajic. 2005. Non-projective dependency parsing using spanning tree algorithms. In Proceedings of HLT/EMNLP, pages 523-530.
14. Ryan McDonald. 2006. Discriminative Training and Spanning Tree Algorithms for Dependency Parsing. University of Pennsylvania, PhD Thesis.
15. Masaki Nagata. 1994. A stochastic japanese morphological analyzer using a forward-DP backward-A* n-best search algorithm. In Proceedings of the 15th International Conference on Computational Linguistics, pages 201-207.
16. Masaki Nagata. 1999. A part of speech estimation method for japanese unknown words using a statistical model of morphology and context. In Proceedings of ACL, pages 277-284.
17. Tetsuji Nakagawa and Kiyotaka Uchimoto. 2007. A hybrid approach to word segmentation and pos tagging. In Proceedings of ACL Demo and Poster Sessions.
18. Tetsuji Nakagawa. 2004. Chinese and japanese word segmentation using word-level and character-level information. In Proceedings of COLING, pages 466-472.
19. Hwee Tou Ng and Jin Kiat Low. 2004. Chinese partof- speech tagging: One-at-a-time or all-at-once? word-based or character-based? In Proceedings of EMNLP, pages 277-284.
20. Adwait Ratnaparkhi. 1996. A maximum entropy model for part-of-speech tagging. In Proceedings of EMNLP, pages 133-142.
21. Yanxin Shi and Mengqiu Wang. 2007. A dual-layer crfs based joint decoding method for cascaded segmentation and labeling tasks. In Proceedings of IJCAI.
22. Richard Sproat and Thomas Emerson. 2003. The first international chinese word segmentation bakeoff. In Proceedings of the 2nd SIGHAN Workshop on Chinese Language Processing, pages 133-143.
23. Kiyotaka Uchimoto, Satoshi Sekine, and Hitoshi Isahara. 2001. The unknown word problem: a morphological analysis of japanese using maximum entropy aided by a dictionary. In Proceedings of EMNLP, pages 91-99.
24. Fei Xia, Martha Palmer, Nianwen Xue, Mary Ellen Okurowski, John Kovarik, Fu dong Chiou, and Shizhe Huang. 2000. Developing guidelines and ensuring consistency for chinese text annotation. In Proceedings of LREC.
25. Stavros A. Zenios Yair Censor. 1997. Parallel Optimization: Theory, Algorithms, and Applications. Oxford University Press.
26. Yue Zhang and Stephen Clark. 2008. Joint word segmentation and pos tagging on a single perceptron. In Proceedings of ACL.