Semi-supervised chinese word segmentation using partial-label learning with conditional random fields

EMNLP 2014 - 2014 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference

Volumn , Issue , 2014, Pages 90-98

  Yang, Fan ^a   Vozila, Paul ^a  

^a NUANCE COMMUNICATIONS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; CONSTRAINED OPTIMIZATION; COST FUNCTIONS; RANDOM PROCESSES;

CHINESE WORD SEGMENTATION; CONDITIONAL RANDOM FIELD; CONSTRAINED SPACE; DOMAIN ADAPTATION; F MEASURE; SEMI-SUPERVISED; WEB DATA; WIKIPEDIA;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84926040777     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/v1/d14-1010     Document Type: Conference Paper

References (20)

1. Hal Daumé III. 2007. Frustratingly easy domain adaptation. In Annual meetingassociation for computational linguistics, pages 256-263. Association for Computational Linguistics.
2. Wenbin Jiang, Meng Sun, Yajuan Lv, Yating Yang, and Qun Liu. 2013. Discriminative learning with natural annotations: Word segmentation as a case study. In Proceedings of The 51st Annual Meeting of the Association for Computational Linguistics, pages 761-769.
3. Feng Jiao, Shaojun Wang, Chi-Hoon Lee, Russell Greiner, and Dale Schuurmans. 2006. Semisupervised conditional random fields for improved sequence segmentation and labeling. In Proceedings of the 21st International Conference on Com- putational Linguistics and the 44th Annual Meeting of the Association for Computational Linguistics, ACL-44, pages 209-216.
4. John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the Eighteenth International Conference on Machine Learning, pages 282-289, San Francisco, CA, USA.
5. Thomas Lavergne, Olivier Cappé, and François Yvon. 2010. Practical very large scale CRFs. In Proceedings the 48th Annual Meeting of the Association for Computational Linguistics (ACL), pages 504-513. Association for Computational Linguistics, July.
6. Zhongguo Li and Maosong Sun. 2009. Punctuation as implicit annotations for Chinese word segmentation. Computational Linguistics, 35:505-512.
7. Percy Liang. 2005. Semi-supervised learning for natural language. Master's thesis, MASSACHUSETTS INSTITUTE OF TECHNOLOGY, May.
8. D. C. Liu and J. Nocedal. 1989. On the limited memory bfgs method for large scale optimization. Mathematical Programming, 45(3):503-528, December.
9. Jin Kiat Low, Hwee Tou Ng, and Wenyuan Guo. 2005. A maximum entropy approach to chinese word segmentation. In Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, pages 161-164, San Francisco, CA, USA.
10. Gideon S. Mann and Andrew McCallum. 2007. Efficient computation of entropy gradient for semisupervised conditional random fields. In Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers, NAACL-Short '07, pages 109-112.
11. Weiwei Sun and Jia Xu. 2011. Enhancing chinese word segmentation using unlabeled data. In Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pages 970- 979, Edinburgh, Scotland, UK., July.
12. Xu Sun, Yaozhong Zhang, Takuya Matsuzaki, Yoshimasa Tsuruoka, and Jun'ichi Tsujii. 2009. A discriminative latent variable Chinese segmenter with hybrid word/character information. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 56-64.
13. Weiwei Sun. 2010. Word-based and character-based word segmentation models: comparison and combination. In Proceedings of the 23rd International Conference on Computational Linguistics: Posters, pages 1211-1219.
14. Oscar Täckström, Dipanjan Das, Slav Petrov, Ryan McDonald, and Joakim Nivre. 2013. Token and type constraints for cross-lingual part-of-speech tagging. Transactions of the Association for Computational Linguistics, 1:1-12.
15. Yiou Wang, Jun'ichi Kazama, Yoshimasa Tsuruoka, Wenliang Chen, Yujie Zhang, and Kentaro Torisawa. 2011. Improving chinese word segmentation and POS tagging with semi-supervised methods using large auto-analyzed data. In Proceedings of the 5th International Joint Conference on Natural Language Processing, pages 309-317.
16. Nianwen Xue. 2003. Chinese word segmentation as character tagging. Computational Linguistics and Chinese Language Processing, pages 29-48.
17. Fan Yang and Paul Vozila. 2013. An empirical study of semi-supervised Chinese word segmentation using co-training. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 1191-1200, Seattle, Washington, USA, October. Association for Computational Linguistics.
18. Xiaodong Zeng, Derek F. Wong, Lidia S. Chao, and Isabel Trancoso. 2013a. Co-regularizing characterbased and word-based models for semi-supervised chinese word segmentation. In Proceedings of The 51st Annual Meeting of the Association for Computational Linguistics, pages 171-176.
19. Xiaodong Zeng, Derek F. Wong, Lidia S. Chao, and Isabel Trancoso. 2013b. Graph-based semisupervised model for joint chinese word segmentation and part-of-speech tagging. In Proceedings of The 51st Annual Meeting of the Association for Computational Linguistics, pages 770-779.
20. Longkai Zhang, Houfeng Wang, Xu Sun, and Mairgup Mansur. 2013. Exploring representations from unlabeled data with co-training for Chinese word segmentation. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 311-321, Seattle, Washington, USA, October. Association for Computational Linguistics.