Word-based and character-basedword segmentation models: Comparison and combination

Coling 2010 - 23rd International Conference on Computational Linguistics, Proceedings of the Conference

Volumn 2, Issue , 2010, Pages 1211-1219

  Sun, Weiwei ^a  

^a SAARLAND UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CHARACTER-BASED MODELS; CHINESE WORD SEGMENTATION; COMPARATIVE ANALYSIS; DATA SETS; DIFFERENT DISTRIBUTIONS; SEGMENTATION ACCURACY; SEGMENTATION ERROR; SEGMENTER; WORD-BASED MODEL;

COMPUTATIONAL LINGUISTICS;

EID: 80053248414     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Galen Andrew. 2006. A hybrid markov/semimarkov conditional random field for sequence segmentation. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, pages 465-472. Association for Computational Linguistics, Sydney, Australia.
2. Leo Breiman. 1996. Bagging predictors. Machine Learning, 24(2):123-140. (Pubitemid 126724382)
3. Keh-Jiann Chen and Shing-Huan Liu. 1992. Word identification for mandarin Chinese sentences. In Proceedings of the 14th conference on Computational linguistics, pages 101-107. Association for Computational Linguistics, Morristown, NJ, USA.
4. Koby Crammer, Ofer Dekel, Joseph Keshet, Shai Shalev-Shwartz, and Yoram Singer. 2006. Online passive-aggressive algorithms. JOURNAL OF MACHINE LEARNING RESEARCH, 7:551-585. (Pubitemid 43668115)
5. Thomas Emerson. 2005. The second international Chinese word segmentation bakeoff. In In Proceedings of the Second SIGHAN Workshop on Chinese Language Processing, pages 123-133.
6. Wenbin Jiang, Liang Huang, and Qun Liu. 2009. Automatic adaptation of annotation standards: Chinese word segmentation and pos tagging - a case study. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pages 522-530. Association for Computational Linguistics, Suntec, Singapore.
7. Percy Liang, Hal Daumé, III, and Dan Klein. 2008. Structure compilation: trading structure for features. In ICML'08: Proceedings of the 25th international conference on Machine learning, pages 592-599. ACM, New York, NY, USA.
8. L. A. Ramshaw and M. P. Marcus. 1995. Text chunking using transformation-based learning. In Proceedings of the 3rd ACL/SIGDAT Workshop on Very Large Corpora, Cambridge, Massachusetts, USA, pages 82-94.
9. Sunita Sarawagi and William W. Cohen. 2004. Semi-markov conditional random fields for information extraction. In In Advances in Neural Information Processing Systems 17, pages 1185-1192.
10. Weiwei Sun, Zhifang Sui, Meng Wang, and Xin Wang. 2009a. Chinese semantic role labeling with shallow parsing. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pages 1475- 1483. Association for Computational Linguistics, Singapore.
11. Xu Sun, Yaozhong Zhang, Takuya Matsuzaki, Yoshimasa Tsuruoka, and Jun'ichi Tsujii. 2009b. A discriminative latent variable Chinese segmenter with hybrid word/character information. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 56-64. Association for Computational Linguistics, Boulder, Colorado.
12. Huihsin Tseng. 2005. A conditional random field word segmenter. In In Fourth SIGHAN Workshop on Chinese Language Processing.
13. Nianwen Xue. 2003. Chinese word segmentation as character tagging. In International Journal of Computational Linguistics and Chinese Language Processing.
14. Ruiqiang Zhang, Genichiro Kikui, and Eiichiro Sumita. 2006. Subword-based tagging by conditional random fields for Chinese word segmentation. In Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers, pages 193- 196. Association for Computational Linguistics, New York City, USA.
15. Yue Zhang and Stephen Clark. 2007. Chinese segmentation with a word-based perceptron algorithm. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 840-847. Association for Computational Linguistics, Prague, Czech Republic.