Lexical normalisation of short text messages: Makn sens a #Twitter

ACL-HLT 2011 - Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies

Volumn 1, Issue , 2011, Pages 368-378

  Han, Bo ^a   Baldwin, Timothy ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

DATA SETS; NORMALISATION; OUT-OF-VOCABULARY WORDS; REAL TIME; STATE-OF-THE-ART PERFORMANCE; TEXT MESSAGES; WORD SIMILARITY;

COMPUTATIONAL LINGUISTICS; TELEPHONE SYSTEMS;

SOCIAL NETWORKING (ONLINE);

EID: 84856325125     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. AiTi Aw, Min Zhang, Juan Xiao, and Jian Su. 2006. A phrase-based statistical model for SMS text normalization. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 33-40, Sydney, Australia.
2. Timothy Baldwin and Marco Lui. 2010. Language identification: The long and the short of the matter. In HLT '10: Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 229-237, Los Angeles, USA.
3. Richard Beaufort, Sophie Roekhaut, Louise-Amélie Cougnon, and Cédrick Fairon. 2010. A hybrid rule/model-based finite-state framework for normalizing SMS messages. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 770-779, Uppsala, Sweden.
4. Eric Brill and Robert C. Moore. 2000. An improved error model for noisy channel spelling correction. In ACL '00: Proceedings of the 38th Annual Meeting on Association for Computational Linguistics, pages 286-293, Hong Kong.
5. Kevin Burton, Akshay Java, and Ian Soboroff. 2009. The ICWSM 2009 Spinn3r Dataset. In Proceedings of the Third Annual Conference on Weblogs and Social Media, San Jose, USA.
6. Monojit Choudhury, Rahul Saraf, Vijit Jain, Animesh Mukherjee, Sudeshna Sarkar, and Anupam Basu. 2007. Investigation and modeling of the structure of texting language. International Journal on Document Analysis and Recognition, 10:157-174. (Pubitemid 350268962)
7. Paul Cook and Suzanne Stevenson. 2009. An unsupervised model for text message normalization. In CALC '09: Proceedings of the Workshop on Computational Approaches to Linguistic Creativity, pages 71-78, Boulder, USA.
8. Marie-Catherine de Marneffe, Bill MacCartney, and Christopher D. Manning. 2006. Generating typed dependency parses from phrase structure parses. In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC 2006), Genoa, Italy.
9. Rong-En Fan, Kai-Wei Chang, Cho-Jui Hsieh, Xiang-Rui Wang, and Chih-Jen Lin. 2008. LIBLINEAR: A library for large linear classification. Journal of Machine Learning Research, 9:1871-1874.
10. Graeme Hirst and Alexander Budanitsky. 2005. Correcting real-word spelling errors by restoring lexical cohesion. Natural Language Engineering, 11:87-111. (Pubitemid 40555947)
11. Yijue How and Min-Yen Kan. 2005. Optimizing predictive text entry for short message service on mobile phones. In Human Computer Interfaces International (HCII 05), Las Vegas, USA.
12. Emi Izumi, Kiyotaka Uchimoto, Toyomi Saiga, Thepchai Supnithi, and Hitoshi Isahara. 2003. Automatic error detection in the Japanese learners' English spoken data. In Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 2, pages 145-148, Sapporo, Japan.
13. Joseph Kaufmann and Jugal Kalita. 2010. Syntactic normalization of Twitter messages. In International Conference on Natural Language Processing, Kharagpur, India.
14. Dan Klein and Christopher D. Manning. 2003. Fast exact inference with a factored model for natural language parsing. In Advances in Neural Information Processing Systems 15 (NIPS 2002), pages 3-10, Whistler, Canada.
15. Catherine Kobus, Franois Yvon, and Graldine Damnati. 2008. Transcrire les SMS comme on reconnat la parole. In Actes de la Confrence sur le Traitement Automatique des Langues (TALN'08), pages 128-138.
16. Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondřej Bojar, Alexandra Constantin, and Evan Herbst. 2007. Moses: open source toolkit for statistical machine translation. In Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, pages 177-180, Prague, Czech Republic.
17. Kishore Papineni, Salim Roukos, Todd Ward, and Wei- Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, pages 311-318, Philadelphia, USA.
18. James L. Peterson. 1980. Computer programs for detecting and correcting spelling errors. Commun. ACM, 23:676-687, December.
19. Lawrence Philips. 2000. The double metaphone search algorithm. C/C++ Users Journal, 18:38-43.
20. Lawrence R. Rabiner. 1989. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2):257-286.
21. Alan Ritter, Colin Cherry, and Bill Dolan. 2010. Unsupervised modeling of Twitter conversations. In HLT '10: Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 172-180, Los Angeles, USA.
22. Claude Elwood Shannon. 1948. A mathematical theory of communication. Bell System Technical Journal, 27:379-423, 623-656.
23. Richard Sproat, Alan W. Black, Stanley Chen, Shankar Kumar, Mari Ostendorf, and Christopher Richards. 2001. Normalization of non-standard words. Computer Speech and Language, 15(3):287-333.
24. Andreas Stolcke. 2002. Srilm - an extensible language modeling toolkit. In International Conference on Spoken Language Processing, pages 901-904, Denver, USA.
25. Guihua Sun, Gao Cong, Xiaohua Liu, Chin-Yew Lin, and Ming Zhou. 2007. Mining sequential patterns and tree patterns to detect erroneous sentences. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 81-88, Prague, Czech Republic.
26. Kristina Toutanova and Robert C. Moore. 2002. Pronunciation modeling for improved spelling correction. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, ACL '02, pages 144-151, Philadelphia, USA.
27. Twitter. 2010. Big goals, big game, big records. http://blog.twitter.com/ 2010/06/big-goals-big-game-big-records.html. Retrieved 4 August 2010.
28. Wilson Wong, Wei Liu, and Mohammed Bennamoun. 2006. Integrated scoring for spelling error correction, abbreviation expansion and case restoration in dirty text. In Proceedings of the Fifth Australasian Conference on Data Mining and Analytics, pages 83-89, Sydney, Australia.
29. Alexander Yeh. 2000. More accurate tests for the statistical significance of result differences. In Proceedings of the 18th Conference on Computational Linguistics - Volume 2, COLING '00, pages 947-953, Saarbrücken, Germany.