A transition-based model for joint segmentation, POS-tagging and normalization

Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing

Volumn , Issue , 2015, Pages 1837-1846

  Qian, Tao ^a,c   Zhang, Yue ^b   Zhang, Meishan ^b   Ren, Yafeng ^a   Ji, Donghong ^a  

^a WUHAN UNIVERSITY   (China)

^b SINGAPORE UNIVERSITY OF TECHNOLOGY AND DESIGN   (Singapore)

^c HUBEI UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS;

ERROR REDUCTION; JOINT MODELING; JOINT SEGMENTATION; SEGMENTATION ACCURACY; TEXT CORPORA; TEXT NORMALIZATIONS; TRADITIONAL APPROACHES; WORD SEGMENTATION;

COMPUTATIONAL LINGUISTICS;

EID: 84959905712     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/d15-1211     Document Type: Conference Paper

References (33)

1. AiTi Aw, Min Zhang, Juan Xiao, and Jian Su. 2006. A phrase-based statistical model for sms text normalization. In Proceedings of the COLING/ACL, pages 33-40.
2. Xinchi Chen, Xipeng Qiu, Chenxi Zhu, and Xuanjing Huang. 2015. Gated recursive neural network for Chinese word segmentation. In Proceedings of the 53rd ACL, pages 1744-1753, July.
3. Danish Contractor, Tanveer A Faruquie, and L. Venkata Subramaniam. 2010. Unsupervised cleansing of noisy text. In Proceedings of the 23rd COLING, pages 189-196.
4. Paul Cook and Suzanne Stevenson. 2009. An unsupervised model for text message normalization. In Proceedings of the workshop on computational approaches to linguistic creativity, pages 71-78.
5. Huiming Duan, Zhifang Sui, Ye Tian, and Wenjie Li. 2012. The cips-sighan clp 2012 Chinese word segmentation on microblog corpora bakeoff. In Proceedings of the Second CIPS-SIGHAN Joint Conference on Chinese Language Processing, Tianjin, China, pages 35-40.
6. Jennifer Foster, Özlem Çetinoglu, Joachim Wagner, Joseph Le Roux, Stephen Hogan, Joakim Nivre, Deirdre Hogan, and Josef Van Genabith. 2011. # hardtoparse: Pos tagging and parsing the twitterverse. In AAAI 2011 Workshop on Analyzing Microtext, pages 20-25.
7. Kevin Gimpel, Nathan Schneider, Brendan O'Connor, Dipanjan Das, Daniel Mills, Jacob Eisenstein, Michael Heilman, Dani Yogatama, Jeffrey Flanigan, and Noah A Smith. 2011. Part-of-speech tagging for twitter: Annotation, features, and experiments. In Proceedings of the 49th ACL, pages 42-47.
8. Stephan Gouws, Donald Metzler, Congxing Cai, and EduardHovy. 2011. Contextual bearing on linguistic variation in social media. In Proceedings of the Workshop on Languages in Social Media, pages 20-29.
9. Bo Han and Timothy Baldwin. 2011. Lexical normalisation of short text messages: Makn sens a# twitter. In Proceedings of the 49th ACL, pages 368-378.
10. Bo Han, Paul Cook, and Timothy Baldwin. 2012. Automatically constructing a normalisation dictionary for microblogs. In Proceedings of the 2012 EMNLP, pages 421-432.
11. Wenbin Jiang, Liang Huang, Qun Liu, and Yajuan Lü. 2008. A cascaded linear model for joint Chinese word segmentation and part-of-speech tagging. In Proceedings of ACL-08: HLT, pages 897-904.
12. Nobuhiro Kaji and Masaru Kitsuregawa. 2014. Accurate word segmentation and pos tagging for japanese microblogs: Corpus annotation and joint modeling with lexical normalization. In Proceedings of the 2014 EMNLP), pages 99-109, October.
13. Canasai Kruengkrai, Kiyotaka Uchimoto, Jun'ichi Kazama, Yiou Wang, Kentaro Torisawa, and Hitoshi Isahara. 2009. An error-driven word-character hybrid model for joint Chinese word segmentation and pos tagging. In Proceedings of the Joint Conference of the 47th ACL and the 4th AFNLP, pages 513-521.
14. Karen Kukich. 1992. Techniques for automatically correcting words in text. ACM Computing Surveys (CSUR), 24(4):377-439.
15. Chen Li and Yang Liu. 2012. Normalization of text messages using character- and phone-based machine translation approaches. In Thirteenth Annual Conference of the International Speech Communication Association.
16. Zhifei Li and David Yarowsky. 2008. Mining and modeling relations between formal and informal Chinese phrases from web corpora. In Proceedings of the 2008 EMNLP, pages 1031-1040.
17. Wenzhe Pei, Tao Ge, and Baobao Chang. 2014. Maxmargin tensor neural network for Chinese word segmentation. In Proceedings of the 52nd ACL, pages 293-303, June.
18. Deana L Pennell and Yang Liu. 2014. Normalization of informal text. Computer Speech & Language, 28(1):256-277.
19. Xian Qian and Yang Liu. 2012. Joint Chinese word segmentation, pos tagging and parsing. In Proceedings of the 2012 EMNLP, pages 501-511, July.
20. Cagil Sonmez and Arzucan Ozgur. 2014. A graphbased approach for contextual text normalization. In Proceedings of the 2014EMNLP, pages 313-324.
21. Aobo Wang and Min-Yen Kan. 2013. Mining informal language from Chinese microtext: Joint word recognition and segmentation. In ACL (1), pages 731-741.
22. Aobo Wang, Tao Chen, and Min-Yen Kan. 2012. Retweeting from a linguistic perspective. In Proceedings of the second workshop on language in social media, pages 46-55.
23. Aobo Wang, Min-Yen Kan, Daniel Andrade, Takashi Onishi, and Kai Ishikawa. 2013. Chinese informal word normalization: an experimental study. In Proceedings of UCNLP, pages 127-135.
24. Kam-Fai Wong and Yunqing Xia. 2008. Normalization of Chinese chat language. Language Resources and Evaluation, 42(2):219-242.
25. Yunqing Xia, Kam-Fai Wong, and Wei Gao. 2005. Nil is not nothing: Recognition of Chinese network informal language expressions. In 4th SIGHAN Workshop on Chinese Language Processing at IJCNLP, volume 5.
26. Yi Yang and Jacob Eisenstein. 2013. A log-linear model for unsupervised text normalization. In EMNLP, pages 61-72.
27. Yue Zhang and Stephen Clark. 2007. Chinese segmentation with a word-based perceptron algorithm. In Proceedings of the 45th ACL, pages 840-847, June.
28. Yue Zhang and Stephen Clark. 2010. A fast decoder for joint word segmentation and pos-tagging using a single discriminative model. In Proceedings of the 2010 EMNLP, pages 843-852.
29. Yue Zhang and Stephen Clark. 2011. Syntactic processing using the generalized perceptron and beam search. Computational Linguistics, 37(1):105-151.
30. Longkai Zhang, Houfeng Wang, Xu Sun, and Mairgup Mansur. 2013. Exploring representations from unlabeled data with co-training for Chinese word segmentation. In Proceedings of the 2013 EMNLP, pages 311-321, October.
31. Meishan Zhang, Yue Zhang, Wanxiang Che, and Ting Liu. 2014a. Character-level Chinese dependency parsing. In Proceedings of the 52nd ACL, pages 1326-1336, June.
32. Meishan Zhang, Yue Zhang, Wanxiang Che, and Ting Liu. 2014b. Type-supervised domain adaptation for joint segmentation and pos-tagging. In Proceedings of the 14th EACL, pages 588-597.
33. Qi Zhang, Huan Chen, and Xuanjing Huang. 2014c. Chinese-english mixed text normalization. In Proceedings of the 7th ACM international conference on Web search and data mining, pages 433-442. ACM.