Domain adaptation for CRF-based Chinese word segmentation using free annotations

EMNLP 2014 - 2014 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference

Volumn , Issue , 2014, Pages 864-874

  Liu, Yijia ^a,b   Zhang, Yue ^a   Che, Wanxiang ^b   Liu, Ting ^b   Wu, Fan ^a  

^a SINGAPORE UNIVERSITY OF TECHNOLOGY AND DESIGN   (Singapore)

^b HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS;

CHINESE WORD SEGMENTATION; CRF MODELS; DIFFERENT DOMAINS; DOMAIN ADAPTATION; SUPERVISED METHODS; UNIFIED FORM;

COMPUTATIONAL LINGUISTICS;

EID: 84926032795     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/v1/d14-1093     Document Type: Conference Paper

References (27)

1. Leonard E Baum and Ted Petrie. 1966. Statistical inference for probabilistic functions of finite state markov chains. The annals of mathematical statistics, pages 1554-1563.
2. Ĺeon Bottou. 1991. Stochastic gradient learning in neural networks. In Proceedings of Neuro-Nîmes 91, Nimes, France. EC2.
3. Michael Collins. 2002. Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. In Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing, pages 1-8. Association for Computational Linguistics, July.
4. Jianfeng Gao, Mu Li, Andi Wu, and Chang-Ning Huang. 2005. Chinese word segmentation and named entity recognition: A pragmatic approach. Comput. Linguist., 31(4):531-574, December.
5. Dan Garrette and Jason Baldridge. 2012. Typesupervised hidden markov models for part-of-speech tagging with incomplete tag dictionaries. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 821- 831, Jeju Island, Korea, July. Association for Computational Linguistics.
6. Wenbin Jiang, Liang Huang, and Qun Liu. 2009. Automatic adaptation of annotation standards: Chinese word segmentation and pos tagging - A case study. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pages 522-530, Suntec, Singapore, August. Association for Computational Linguistics.
7. Wenbin Jiang, Meng Sun, Yajuan Lü, Yating Yang, and Qun Liu. 2013. Discriminative learning with natural annotations: Word segmentation as a case study. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 761-769, Sofia, Bulgaria, August. Association for Computational Linguistics.
8. John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the Eighteenth International Conference on Machine Learning, ICML '01, pages 282-289, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
9. Zhongguo Li and Maosong Sun. 2009. Punctuation as implicit annotations for chinese word segmentation. Comput. Linguist., 35(4):505-512, December.
10. D. C. Liu and J. Nocedal. 1989. On the limited memory bfgs method for large scale optimization. Math. Program., 45(3):503-528, December.
11. Yang Liu and Yue Zhang. 2012. Unsupervised domain adaptation for joint segmentation and POS-tagging. In Proceedings of COLING 2012: Posters, pages 745-754, Mumbai, India, December. The COLING 2012 Organizing Committee.
12. Gideon S. Mann and Andrew McCallum. 2008. Generalized expectation criteria for semi-supervised learning of conditional random fields. In Proceedings of ACL-08: HLT, pages 870-878, Columbus, Ohio, June. Association for Computational Linguistics.
13. Yanxin Shi and Mengqiu Wang. 2007. A dual-layer crfs based joint decoding method for cascaded segmentation and labeling tasks. In Proceedings of the 20th International Joint Conference on Artifical Intelligence, IJCAI'07, pages 1707-1712, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
14. Yan Song, Prescott Klassen, Fei Xia, and Chunyu Kit. 2012. Entropy-based training data selection for domain adaptation. In Proceedings of COLING 2012:Posters, pages 1191-1200, Mumbai, India, December. The COLING 2012 Organizing Committee.
15. Weiwei Sun and Jia Xu. 2011. Enhancing chinese word segmentation using unlabeled data. In Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pages 970- 979, Edinburgh, Scotland, UK., July. Association for Computational Linguistics.
16. Jun Suzuki and Hideki Isozaki. 2008. Semi-supervised sequential labeling and segmentation using gigaword scale unlabeled data. In Proceedings of ACL- 08: HLT, pages 665-673, Columbus, Ohio, June. Association for Computational Linguistics.
17. Huihsin Tseng. 2005. A conditional random field word segmenter. In In Fourth SIGHAN Workshop on Chinese Language Processing.
18. Yuta Tsuboi, Hisashi Kashima, Shinsuke Mori, Hiroki Oda, and Yuji Matsumoto. 2008. Training conditional random fields using incomplete annotations. In Proceedings of the 22nd International Conference on Computational Linguistics (Coling 2008), pages 897-904, Manchester, UK, August. Coling 2008 Organizing Committee.
19. Yiou Wang, Jun'ichi Kazama, Yoshimasa Tsuruoka, Wenliang Chen, Yujie Zhang, and Kentaro Torisawa. 2011. Improving chinese word segmentation and pos tagging with semi-supervised methods using large auto-analyzed data. In Proceedings of 5th International Joint Conference on Natural Language Processing, pages 309-317, Chiang Mai, Thailand, November. Asian Federation of Natural Language Processing.
20. Pak-kwong Wong and Chorkin Chan. 1996. Chinese word segmentation based on maximum matching and word binding force. In Proceedings of the 16th Conference on Computational Linguistics - Volume 1, COLING '96, pages 200-203, Stroudsburg, PA, USA. Association for Computational Linguistics.
21. Zimin Wu and Gwyneth Tseng. 1993. Chinese text segmentation for text retrieval: Achievements and problems. J. Am. Soc. Inf. Sci., 44(9):532-542, October.
22. Nianwen Xue and Libin Shen. 2003. Chinese word segmentation as lmr tagging. In Proceedings of the Second SIGHAN Workshop on Chinese Language Processing - Volume 17, SIGHAN '03, pages 176- 179, Stroudsburg, PA, USA. Association for Computational Linguistics.
23. Shiwen Yu, Jianming Lu, Xuefeng Zhu, Huiming Duan, Shiyong Kang, Honglin Sun, Hui Wang, Qiang Zhao, and Weidong Zhan. 2001. Processing norms of modern chinese corpus. Technical report.
24. Yue Zhang and Stephen Clark. 2007. Chinese segmentation with a word-based perceptron algorithm. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 840- 847, Prague, Czech Republic, June. Association for Computational Linguistics.
25. Meishan Zhang, Yue Zhang, Wanxiang Che, and Ting Liu. 2014. Type-supervised domain adaptation for joint segmentation and pos-tagging. In Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pages 588-597, Gothenburg, Sweden, April. Association for Computational Linguistics.
26. Hai Zhao and Chunyu Kit. 2008. An empirical comparison of goodness measures for unsupervised chinese word segmentation with a unified framework. In In: The Third International Joint Conference on Natural Language Processing (IJCNLP-2008).
27. Hai Zhao, Chang-Ning Huang, Mu Li, and Bao-Liang Lu. 2010. A unified character-based tagging framework for chinese word segmentation. 9(2):5:1-5:32, .