Normalizing microtext

AAAI Workshop - Technical Report

Volumn WS-11-05, Issue , 2011, Pages 74-79

  Xue, Zhenzhen ^a   Yin, Dawei ^a   Davison, Brian D ^a  

^a Lehigh University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER MEDIATED COMMUNICATION; CONTEXTUAL FACTORS; DATA SETS; NATURAL LANGUAGE PROCESSING; NEW FORMS; SMS MESSAGES; SOURCE CHANNELS; WRITTEN TEXTS;

COMPUTATIONAL LINGUISTICS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 80054919470     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Aw, A.; Zhang, M.; Xiao, J.; and Su, J. 2006. A phrase-based statistical model for SMS text normalization. In Proc. of the COL-ING/ACL on Main conference poster sessions, 33-40.
2. Bartlett, S.; Kondrak, G.; and Cherry, C. 2008. Automatic syllabification with structured SVMs for letter-to-phoneme conversion. In Proc. of ACL-08: HLT, 568-576.
3. Beaufort, R.; Roekhaut, S.; Cougnon, L.-A.; and Fairon, C. 2010. A hybrid rule/model-based finite-state framework for normalizing sms messages. In Proc. of the 48th Annual Meeting of the Association for Computational Linguistics, ACL '10, 770-779.
4. Brill, E., and Moore, R. C. 2000. An improved error model for noisy channel spelling correction. In Proc. of the 38th Annual Meeting on Association for Computational Linguistics, ACL '00, 286-293.
5. Choudhury, M.; Saraf, R.; Jain, V.; Mukherjee, A.; Sarkar, S.; and Basu, A. 2007. Investigation and modeling of the structure of texting language. Int. J. Doc. Anal. Recognit. 10:157-174. (Pubitemid 350268962)
6. Cook, P., and Stevenson, S. 2009. An unsupervised model for text message normalization. In Proc. of the Workshop on Computational Approaches to Linguistic Creativity, CALC '09, 71-78.
7. Corvey, W. J.; Vieweg, S.; Rood, T.; and Palmer, M. 2010. Twitter in mass emergency: what NLP techniques can contribute. In Proc. of the NAACL HLT 2010 Workshop on Computational Linguistics in a World of Social Media, WSA '10, 23-24.
8. Damerau, F. J. 1964. A technique for computer detection and correction of spelling errors. Commun. ACM 7:171-176.
9. Ellen, J. 2011. All about microtext: A working definition and a survey of current microtext research within artificial intelligence and natural language processing. In Proc. of the Third International Conference on Agents and Artificial Intelligence.
10. Golding, A., and Roth, D. 1996. Applying winnow to context-sensitive spelling correction. 182-190.
11. Han, B., and Baldwin, T. 2011. Lexical normalisation of short text messages: Makn sens a # twitter. In Proc. of the 49th Annual Meeting on Association for Computational Linguistics, ACL '11. To appear.
12. Jiampojamarn, S.; Cherry, C.; and Kondrak, G. 2008. Joint processing and discriminative training for letter-to-phoneme conversion. In Proc. ACL, 905-913.
13. Kobus, C.; Yvon, F.; and Damnati, G. 2008. Normalizing SMS: are two metaphors better than one? In Proc. of the 22nd International Conference on Computational Linguistics - Volume 1, COL-ING '08, 441-448.
14. Koehn, P.; Hoang, H.; Birch, A.; Callison-Burch, C.; Federico, M.; Bertoldi, N.; Cowan, B.; Shen, W.; Moran, C.; Zens, R.; Dyer, C.; Bojar, O.; Constantin, A.; and Herbst, E. 2007. Moses: open source toolkit for statistical machine translation. In Proc. of the 45th Annual Meeting of the ACL on Interactive Foster and Demonstration Sessions, ACL '07, 177-180.
15. Kothari, G.; Negi, S.; Faruquie, T. A.; Chakaravarthy, V. T.; and Subramaniam, L. V. 2009. SMS based interface for FAQ retrieval. In Proc. of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2, ACL-IJCNLP '09, 852-860.
16. Levenshtein, V. 1966. Binary Codes Capable of Correcting Deletions, Insertions and Reversals. Soviet Physics Doklady 10:707.
17. Mangu, L., and Brill, E. 1997. Automatic rule acquisition for spelling correction. In Proc. of the 14th International Conference on Machine Learning, 734-741.
18. Murnane, W. 2010. Improving Accuracy of Named Entity Recognition on Social Media Data. Master's thesis, University of Maryland.
19. Rama, T.; Singh, A. K.; and Kolachina, S. 2009. Modeling letter-to-phoneme conversion as a phrase based statistical machine translation problem with minimum error rate training. In NAACL '09: Proc. of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Associationfor Computational Linguistics, Companion Volume: Student Research Workshop and Doctoral Consortium, 90-95.
20. Sproat, R.; Black, A. W.; Chen, S.; Kumar, S.; Ostendorf, M.; and Richards, C. 2001. Normalization of non-standard words. Computer Speech and Language 15(3):287-333.
21. Toutanova, K., and Moore, R. C. 2002. Pronunciation modeling for improved spelling correction. In Proc. of the 40th Annual Meeting of the Association for Computational Linguistics, ACL '02, 144-151.
22. van den Bosch, A., and Canisius, S. 2006. Improved morphophonological sequence processing with constraint satisfaction inference. In Proc. of the Eighth Meeting of the ACL Special Interest Group on Computational Phonology and Morphology, SIGPHON '06, 41-49.
23. Wang, K.; Thrasher, C.; Viegas, E.; Li, X.; and Hsu, B.-j. P. 2010. An overview of Microsoft web N-gram corpus and applications. In Proceedings of the NAACL HLT 2010 Demonstration Session, HLT-DEMO '10, 45-48. Stroudsburg, PA, USA: Association for Computational Linguistics.