Word Segmentation on Chinese Mirco-Blog Data with a Linear-Time Incremental Model

CLP 2012 - 2nd CIPS-SIGHAN Joint Conference on Chinese Language Processing

Volumn , Issue , 2012, Pages 41-46

  Zhang, Kaixu ^a   Sun, Maosong ^b   Zhou, Changle ^a  

^a XIAMEN UNIVERSITY   (China)

^b TSINGHUA UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS;

CHINESE LANGUAGE PROCESSING; F-SCORE; FEATURE WORDS; INCREMENTAL MODELS; LINEAR TIME; MICRO-BLOG; PERFORMANCE; RICH FEATURES; WORD SEGMENTATION;

BLOGS;

EID: 84893077932     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. M. Asahara, K. Fukuoka, A. Azuma, C. L. Goh, Y. Watanabe, Y. Matsumoto, and T. Tsuzuki. 2005. Combination of machine learning methods for optimum chinese word segmentation. In Proc. Fourth SIGHAN Workshop on Chinese Language Processing, pages 134–137.
2. A. Chen, Y. Zhou, A. Zhang, and G. Sun. 2005. Unigram language model for chinese word segmentation. In Proceedings of the 4th SIGHAN Workshop on Chinese Language Processing, pages 138–141.
3. Michael Collins and Brian Roark. 2004. Incremental parsing with the perceptron algorithm. In Proceedings of the 42nd Meeting of the Association for Computational Linguistics (ACL’04), Main Volume, pages 111–118, Barcelona, Spain, July.
4. Michael Collins. 2002. Discriminative training methods for hidden markov models: theory and experiments with perceptron algorithms. pages 1–8.
5. Thomas Emerson. 2005. The second international chinese word segmentation bakeoff. In Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, pages 123–133. Jeju Island, Korea.
6. Liang Huang and Kenji Sagae. 2010. Dynamic programming for linear-time incremental parsing. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 1077–1086, Uppsala, Sweden, July. Association for Computational Linguistics.
7. Wenbin Jiang, Liang Huang, and Qun Liu. 2009. Automatic adaptation of annotation standards: Chinese word segmentation and POS tagging - a case study. In Proceedings of the 47th ACL, pages 522–530, Suntec, Singapore, August. Association for Computational Linguistics.
8. Xu Sun, Houfeng Wang, and Wenjie Li. 2012. Fast online training with frequency-adaptive learning rates for chinese word segmentation and new word detection. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 253–262, Jeju Island, Korea, July. Association for Computational Linguistics.
9. Weiwei Sun. 2011. A stacked sub-word model for joint chinese word segmentation and part-of-speech tagging. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 1385–1394, Portland, Oregon, USA, June. Association for Computational Linguistics.
10. H. Tseng, P. Chang, G. Andrew, D. Jurafsky, and C. Manning. 2005. A conditional random field word segmenter for sighan bakeoff 2005. In Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, pages 168–171. Jeju Island, Korea.
11. Kun Wang, Chengqing Zong, and Keh-Yih Su. 2010. A character-based joint model for chinese word segmentation. In Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), pages 1173–1181, Beijing, China, August. Coling 2010 Organizing Committee.
12. Y. Zhang and S. Clark. 2011. Syntactic processing using the generalized perceptron and beam search. Computational Linguistics, (Early Access):1–47.
13. Kaixu Zhang, Ruining Wang, Ping Xue, and Maosong Sun. 2011. Extract chinese unknown words from a large-scale corpus using morphological and distributional evidences. In Proceedings of 5th International Joint Conference on Natural Language Processing, pages 837–845, Chiang Mai, Thailand, November. Asian Federation of Natural Language Processing.
14. Kaixu Zhang. 2012. Study on Chinese Word Segmentation and Part-of-Speech Tagging with Compact Representations. Ph.D. thesis, Tsinghua University.
15. H. Zhao, C. N. Huang, and M. Li. 2006. An improved chinese word segmentation system with conditional random field. In Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, pages 162–165. Sydney: July.