Chinese Informal Word Normalization: an Experimental Study

6th International Joint Conference on Natural Language Processing, IJCNLP 2013 - Proceedings of the Main Conference

Volumn , Issue , 2013, Pages 127-135

  Wang, Aobo ^a   Kan, Min Yen ^a   Andrade, Daniel ^b   Onishi, Takashi ^b   Ishikawa, Kai ^b  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b NEC CORPORATION   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION MODELS; LINGUISTIC PHENOMENA; NORMALISATION; NOVEL METHODS; RULE BASED; STATE OF THE ART; STATISTICAL FEATURES;

EID: 84926026888     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Aditya Bhargava and Grzegorz Kondrak. 2011. How do you pronounce your name?: improving g2p with transliterations. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1, pages 399–408.
2. Thorsten Brants and Alex Franz. 2006. The google web 1t 5-gram corpus version 1.1. LDC2006T13.
3. Peter F Brown, John Cocke, Stephen A Della Pietra, Vincent J Della Pietra, Fredrick Jelinek, John D Lafferty, Robert L Mercer, and Paul S Roossin. 1990. A statistical approach to machine translation. Computational linguistics, pages 79–85.
4. Jing-Shin Chang and Wei-Lun Teng. 2006. Mining atomic chinese abbreviations with a probabilistic single character recovery model. Language Resources and Evaluation, pages 367–374.
5. A. Cui, L. Yang, D. Hou, M.Y. Kan, Y. Liu, M. Zhang, and S. Ma. 2012. PrEV: Preservation Explorer and Vault for Web 2.0 User-Generated Content. Theory and Practice of Digital Libraries, pages 101–112.
6. Stephan Gouws, Donald Metzler, Congxing Cai, and Eduard Hovy. 2011. Contextual Bearing on Linguistic Variation in Social Media. In Proceedings of the Workshop on Language in Social Media, pages 20–29.
7. Mark Hall, Eibe Frank, Geoffrey Holmes, Bernhard Pfahringer, Peter Reutemann, and Ian H. Witten. 2009. The weka data mining software: an update. SIGKDD Explor. Newsl., pages 10–18.
8. Bo Han, Paul Cook, and Timothy Baldwin. 2012. Automatically Constructing a Normalisation Dictionary for Microblogs. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 421–432.
9. Z. Li and D. Yarowsky. 2008a. Mining and modeling relations between formal and informal Chinese phrases from web corpora. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 1031–1040.
10. Zhifei Li and David Yarowsky. 2008b. Unsupervised translation induction for chinese abbreviations using monolingual corpora. In Proceedings of ACL, pages 425–433.
11. Serguei Pakhomov. 2002. Semi-supervised maximum entropy based approach to acronym and abbreviation normalization in medical texts. In Proceedings of the 40th annual meeting on association for computational linguistics, pages 160–167.
12. Youngja Park and Roy J Byrd. 2001. Hybrid text mining for finding abbreviations and their definitions. In Proceedings of the 2001 conference on empirical methods in natural language processing, pages 126–133.
13. Adam Pauls and Dan Klein. 2011. Faster and smaller n-gram language models. In Proceedings of the 49th annual meeting of the Association for Computational Linguistics: Human Language Technologies, pages 258–267.
14. Aobo Wang and Min-Yen Kan. 2013. Mining informal language from chinese microtext: Joint word recognition and segmentation. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 731–741.
15. A. Wang, C.D.V. Hoang, and M.Y. Kan. 2010. Perspectives on crowdsourcing annotations for natural language processing, journal = Language Resources and Evaluation. pages 1–23.
16. Aobo Wang, Tao Chen, and Min-Yen Kan. 2012. Re-tweeting From A Linguistic Perspective. In Proceedings of the Second Workshop on Language in Social Media, pages 46–55.
17. K.F. Wong and Y. Xia. 2008. Normalization of Chinese Chat Language. Language Resources and Evaluation, pages 219–242.
18. Jian-Cheng Wu and Jason S Chang. 2007. Learning to find english to chinese transliterations on the web. In Proc. of EMNLP-CoNLL, pages 996–1004.
19. Y. Xia, K.F. Wong, and W. Gao. 2005. NIL Is Not Nothing: Recognition of Chinese Network Informal Language Expressions. In 4th SIGHAN Workshop on Chinese Language Processing, volume 5.
20. Yunqing Xia, Kam-Fai Wong, and Wenjie Li. 2006. A phonetic-based approach to chinese chat text normalization. In Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics, pages 993–1000.
21. Min Zhang, Xiangyu Duan, Vladimir Pervouchine, and Haizhou Li. 2010. Machine transliteration: leveraging on third languages. In Proceedings of the 23rd International Conference on Computational Linguistics: Posters, pages 1444–1452.