An Unsupervised Model for Text Message Normalization

NAACL HLT 2009 - Computational Approaches to Linguistic Creativity, Proceedings of the Workshop

Volumn , Issue , 2009, Pages 71-78

  Cook, Paul ^a   Stevenson, Suzanne ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; TEXT MESSAGING;

CELL PHONE; CREATIVES; FORMATION PROCESS; NOISY CHANNEL MODELS; NORMALISATION; TEST SETS; TEXT-MESSAGING; TEXTING; WORD FORMATIONS;

STATISTICAL TESTS;

EID: 85189173535     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. John Algeo, editor. 1991. Fifty Years Among the New Words. Cambridge University Press, Cambridge.
2. AiTi Aw, Min Zhang, Juan Xiao, and Jian Su. 2006. A phrase-based statistical model for SMS text normalization. In Proc. of the COLING/ACL 2006 Main Conference Poster Sessions, pages 33–40. Sydney.
3. R.H. Baayen, R. Piepenbrock, and L. Gulikers. 1995. The CELEX Lexical Database (release 2). Linguistic Data Consortium, University of Pennsylvania.
4. Thorsten Brants and Alex Franz. 2006. Web 1T 5-gram Corpus version 1.1.
5. Eric Brill and Robert C. Moore. 2000. An improved error model for noisy channel spelling correction. In Proceedings of ACL 2000, pages 286–293. Hong Kong.
6. Monojit Choudhury, Rahul Saraf, Vijit Jain, Animesh Mukherjee, Sudeshna Sarkar, and Anupam Basu. 2007. Investigation and modeling of the structure of texting language. International Journal of Document Analysis and Recognition, 10(3/4):157–174.
7. Cédrick Fairon and Sébastien Paumier. 2006. A translated corpus of 30,000 French SMS. In Proceedings of LREC 2006. Genoa, Italy.
8. Rebecca E. Grinter and Margery A. Eldridge. 2001. y do tngrs luv 2 txt msg. In Proceedings of the 7th European Conf. on Computer-Supported Cooperative Work (ECSCW’01), pages 219–238. Bonn, Germany.
9. Sittichai Jiampojamarn, Gregorz Kondrak, and Tarek Sherif. 2007. Applying many-to-many alignments and hidden markov models to letter-to-phoneme conversion. In Proc. of NAACL-HLT 2007, pages 372–379. Rochester, NY.
10. Catherine Kobus, François Yvon, and Géraldine Damnati. 2008. Normalizing SMS: are two metaphors better than one? In Proc. of the 22nd Int. Conf. on Computational Linguistics, pp. 441–448. Manchester.
11. Charles W. Kreidler. 1979. Creating new words by shortening. English Linguistics, 13:24–36.
12. Rich Ling and Naomi S. Baron. 2007. Text messaging and IM: Linguistic comparison of American college data. Journal of Language and Social Psychology, 26:291–98.
13. Eric Mays, Fred J. Damerau, and Robert L. Mercer. 1991. Context based spelling correction. Information Processing and Management, 27(5):517–522.
14. Richard Sproat, Alan W. Black, Stanley Chen, Shankar Kumar, Mari Ostendorf, and Christopher Richards. 2001. Normalization of non-standard words. Computer Speech and Language, 15:287–333.
15. Crispin Thurlow. 2003. Generation txt? The sociolinguistics of young people’s text-messaging. Discourse Analysis Online, 1(1).
16. Kristina Toutanova and Robert C. Moore. 2002. Pronunciation modeling for improved spelling correction. In Proc. of ACL 2002, pages 144–151. Philadelphia.