Synthetic word parsing improves Chinese word segmentation

ACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference

Volumn 2, Issue , 2015, Pages 262-267

  Cheng, Fei ^a   Duh, Kevin ^a   Matsumoto, Yuji ^a  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS; LINGUISTICS;

CHINESE WORD SEGMENTATION; FINE GRAINED; OUT OF VOCABULARY WORDS; SUB WORDS; WORD SEGMENTATION; INTERNAL STRUCTURE;

COMPUTATIONAL LINGUISTICS;

EID: 84944071280     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/v1/p15-2043     Document Type: Conference Paper

References (15)

1. Fei Cheng, Kevin Duh, and Yuji Matsumoto. 2014. Parsing Chinese synthetic words with a character-based dependency model. In Proceedings of the Ninth International Conference on Language Re-sources and Evaluation (LREC'14), Reykjavik, Ice-land, may. European Language Resources Associa-tion (ELRA)
2. Thomas Emerson. 2005. The second international Chi-nese word segmentation bakeoff. In Proceedings of the fourth SIGHAN workshop on Chinese language Processing, volume 133
3. Chooi-Ling Goh, Masayuki Asahara, and Yuji Mat-sumoto. 2006. Machine learning-based methods to Chinese unknown word detection and pos tag guess-ing. Journal of Chinese Language and Computing, 16(4): 185-206
4. Zhongguo Li and Maosong Sun. 2009. Punctuation as implicit annotations for Chinese word segmentation. Computational Linguistics, 35(4):505-512
5. Zhongguo Li and Guodong Zhou. 2012. Unified de-pendency parsing of Chinese morphological and syn-tactic structures. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Lan-guage Processing and Computational Natural Lan-guage Learning, pages 1445-1454. Association for Computational Linguistics
6. Ryan McDonald. 2006. Discriminative learning and spanning tree algorithms for dependency parsing. Ph.D. thesis, PhD Thesis. University of Pennsylva-nia
7. Richard Sproat and Thomas Emerson. 2003. The first international Chinese word segmentation bake-off. In Proceedings of the second SIGHAN work-shop on Chinese language processing-Volume 17, pages 133-143. Association for Computational Lin-guistics
8. Weiwei Sun and Jia Xu. 2011. Enhancing Chinese word segmentation using unlabeled data. In Pro-ceedings of the Conference on Empirical Methods in Natural Language Processing, pages 970-979. As-sociation for Computational Linguistics
9. Xu Sun, Yaozhong Zhang, Takuya Matsuzaki, Yoshi-Masa Tsuruoka, and Jun'ichi Tsujii. 2009. A dis-criminative latent variable Chinese segmenter with hybrid word/character information. In Proceedings of Human Language Technologies: The 2009 An-nual Conference of the North American Chapter of the Association for Computational Linguistics, pages 56-64. Association for Computational Lin-guistics
10. Xu Sun, Houfeng Wang, and Wenjie Li. 2012. Fast on-line training with frequency-adaptive learning rates for Chinese word segmentation and new word de-tection. In Proceedings of the 50th Annual Meet-ing of the Association for Computational Linguis-tics: Long Papers-Volume 1, pages 253-262. Asso-ciation for Computational Linguistics
11. Weiwei Sun. 2011. A stacked sub-word model for joint Chinese word segmentation and part-of-speech tagging. In Proceedings of the 49th An-nual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, pages 1385-1394. Association for Computational Linguistics
12. Huihsin Tseng, Pichuan Chang, Galen Andrew, Daniel Jurafsky, and Christopher Manning. 2005. A condi-tional random field word segmenter for sighan bake-off 2005. In Proceedings of the fourth SIGHAN workshop on Chinese language Processing, volume 171
13. Nianwen Xue. 2003. Chinese word segmentation as character tagging. Computational Linguistics and Chinese Language Processing, 8(1):29-18
14. Yue Zhang and Stephen Clark. 2007. Chinese seg-mentation with a word-based perceptron algorithm. In ANNUAL MEETING-ASSOCIATION FOR COM-PUTATIONAL LINGUISTICS, volume 45, page 840
15. Longkai Zhang, Houfeng Wang, Xu Sun, and Mairgup Mansur. 2013. Exploring representations from un-labeled data with co-training for Chinese word seg-mentation. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Pro-cessing, pages 311-321, Seattle, Washington, USA, October. Association for Computational Linguistics