Normalizing SMS: Are two metaphors better than one?

Coling 2008 - 22nd International Conference on Computational Linguistics, Proceedings of the Conference

Volumn 1, Issue , 2008, Pages 441-448

  Kobus, Catherine ^a   Yvon, François ^b   Damnati, Géraldine ^a  

^a ORANGE LABS   (France)

^b UNIVERSITÉ PARIS SACLAY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC NORMALIZATION; AUTOMATIC SPEECH RECOGNITION; COMPARATIVE STUDIES; MACHINE TRANSLATIONS; SMS MESSAGES; TEST SETS; WORD ERROR RATE; WRITTEN TEXTS;

COMPUTATIONAL LINGUISTICS;

SPEECH RECOGNITION;

EID: 77953572696     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Allauzen, Cyril, Mehryar Mohri, and Brian Roark. 2005. The design principles and algorithms of a weighted grammar library. International Journal of Foundations of Computer Science, 16(3):403-421.
2. Anis, Jacques. 2001. Parlez-vous texto? Guide des nouveaux langages du réseau. Éditions du Cherche Midi.
3. Aw, Aiti, Min Zhang, Juan Xiao, and Jian Su. 2006. A phrase-based statistical model for SMS text normalization. In Proceedings of COLING/ACL, pages 33-40.
4. Brill, Eric and Robert C. Moore. 2000. An improved error model for noisy channel spelling correction. In Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics, pages 286-293, Hong Kong.
5. Brown, Peter F., John Cocke, Stephen Delia Pietra, Vincent J. Delia Pietra, Frederick Jelinek, John D. Lafferty, Robert L. Mercer, and Paul S. Roossin. 1990. A statistical approach to machine translation. Journal of Natural Language Engineering, 16(2):79-85.
6. Choudhury, Monojit, Rahul Saraf, Vijit Jain, Sudeshna Sarkar, and Anupam Basu. 2007. Investigation and modeling of the structure of texting language. In Proceedings of the IJCAI Workshop on 'Analytics for Noisy Unstructured Text Data", pages 63-70, Hyderabad, India.
7. Church, Kenneth W. and William Gale. 1991. Probability scoring for spelling correction. Statistics and Computing, 1:91-103.
8. Crystal, David. 2001. Language and the Internet. Cambridge University Press.
9. Fairon, Cédrick and Sébastien Paumier. 2006. A translated corpus of 30,000 French SMS. In Proceedings of LREC 2006, Genoa, Italy.
10. Fairon, Cédrick, Jean René Klein, and Sébastien Paumier. 2006. Le langage SMS. UCL Presses Universitaires de Louvain.
11. Guimier de Neef, Émilie, Arnaud Debeurme, and Jungyeul Park. 2007. TILT correcteur de SMS: évaluation et bilan quantitatif. In Actes de TALN, pages 123-132, Toulouse, France.
12. Hocq, S. 2006. étude des sms en français: constitution et exploitation d'un corpus aligné sms-langue standard. Technical report, Université Aix-Marseille.
13. Jansche, Martin. 2003. Inference of string mappings for language technology. Ph.D. thesis, Ohio State University.
14. Kobus, Catherine, François Yvon, and Géraldine Damnati. 2008. Transcrire les SMS comme on reconnaît la parole. In Actes de la Conférence sur le Traitement Automatique des Langues (TALN'08), pages 128-138, Avignon, France.
15. Koehn, Philipp, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, and Evan Herbst. 2007. Moses: Open source toolkit for statistical machine translation. In Proc. Annual Meeting of the Association for Computational Linguistics (ACL), demonstration session, Prague, Czech Republic.
16. Michel Simard, Alexandre Deslauriers. 2001. Real-time automatic insertion of accents in French text. Natural Language Engineering, 7(2):143-165.
17. Mohri, Mehryar and Michael Riley. 1998. Network optimisation for large vocabulary speech recognition. Speech Communication, 25(3): 1-12.
18. Mohri, Mehryar, Fernando Pereira, and Michael Riley. 1998. A rational design for a weighted finite-state transducer library. Lecture Notes in Computer Science, (1438).
19. Och, Franz Josef and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1):19-51.
20. Papineni, Kishore, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2001. Bleu: a method for automatic evaluation of machine translation. Technical Report RC22176 (W0109-022), IBM Research Division, Thomas J. Watson Research Center.
21. Stolcke, Andreas. 2002. Srilm - an extensible language modeling toolkit. In Proceedings of the International Conference on Spoken Langage Processing (ICSLP), volume 2, pages 901-904, Denver, CO.
22. Toutanova, Kristina and Robert Moore. 2002. Pronunciation modeling for improved spelling correction. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages 144-151, Philadelphia, PA.
23. Véronis, Jean and Émilie Guimier de Neef. 2006. Le traitement des nouvelles formes de communication écrite. In Sabah, Gérard, editor, Compréhension automatique des langues et interaction, pages 227-248. Paris: Hermès Science.