Toward text message normalization: Modeling abbreviation generation

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2011, Pages 5364-5367

  Pennell, Deana ^a   Liu, Yang ^a  

^a UNIVERSITY OF TEXAS AT DALLAS   (United States)

Author keywords

abbreviation modeling; noisy text processing; text normalization; twitter

Indexed keywords

ABBREVIATION MODELING; ENGLISH WORD; KNOWLEDGE SOURCES; LANGUAGE MODEL; NOISY TEXT PROCESSING; STATISTICAL CLASSIFIER; TEXT MESSAGES; TEXT NORMALIZATION; TWITTER;

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL LINGUISTICS; SIGNAL PROCESSING; TEXT PROCESSING; WORD PROCESSING;

SPEECH COMMUNICATION;

EID: 80051649509     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2011.5947570     Document Type: Conference Paper

References (11)

1. AiTi Aw, Min Zhang, Juan Xian, and Jian Su, "A phrase-based statistical model for SMS text normalization," in COLING/ACL, Sydney, Australia, 2006, pp. 33-40.
2. Richard Sproat, Alan Black, Stanley Chen, Shankar Kumar, Mari Ostendorf, and Christopher Richards, "Normalization of non-standard words," Computer Speech and Language, vol. 15, no. 3, pp. 287-333, 2001.
3. Karen Kukich, "Technique for automatically correcting words in text," ACM Computing Surveys, vol. 24, no. 4, pp. 377-439, 1992.
4. Kristina Toutanova and Robert C. Moore, "Pronunciation modeling for improved spelling correction," in ACL, Philadelphia, Pennsylvania, 2002, pp. 144-151.
5. Srinivas Bangalore, Vanessa Murdock, and Giuseppe Riccardi, "Bootstrapping bilingual data using consensus translation for a multilingual instant messaging system," in 19th International Conference on Computational Linguistics, Taipei, Taiwan, 2002, pp. 1-7.
6. Catherine Kobus, François Yvon, and Géraldine Damnati, "Normalizing SMS: Are two metaphors better than one?," in 22nd International Conference on Computational Linguistics, Manchester, UK, 2008, pp. 441-448.
7. Monojit Choudhury, Rahul Saraf, Vijit Jain, Animesh Mukherjee, Sudeshna Sarkar, and Anupam Basu, "Investigation and modeling of the structure of texting language," International Journal of Document Analysis and Recognition, vol. 10, pp. 157-174, 2007.
8. Paul Cook and Suzanne Stevenson, "An unsupervised model for text message normalization," in NAACL HLT Workshop on Computational Approaches to Linguistic Creativity, Boulder, CO, 2009, pp. 71-78.
9. Dong Yang, Yi cheng Pan, and Sadaoki Furui, "Automatic chinese abbreviation generation using conditional random field," in NAACL-HLT, Boulder, Colorado, 2009, pp. 273-276.
10. Deana Pennell and Yang Liu, "Normalization of text messages for text-to-speech," in ICASSP, Dallas, Texas, USA, 2010, pp. 4842-4845.
11. Saša Petrovic, Miles Osborne, and Victor Lavrenko, "The edinburgh twitter corpus," in NAACL-HLT Workshop on Computational Linguistics in a World of Social Media, Los Angeles, California, USA, 2010, pp. 25-26.