Normalizing tweets with edit scripts and recurrent neural embeddings

52nd Annual Meeting of the Association for Computational Linguistics, ACL 2014 - Proceedings of the Conference

Volumn 2, Issue , 2014, Pages 680-686

  Chrupała, Grzegorz ^a  

^a TILBURG UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; RECURRENT NEURAL NETWORKS;

CHARACTER LEVEL; LANGUAGE ANALYSIS; LEXICAL RESOURCES; MODEL-BASED OPC; SIMPLE RECURRENT NETWORKS; STATE OF THE ART; TEXT NORMALIZATIONS; WORD ERROR RATE;

EMBEDDINGS;

EID: 84906933200     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/v1/p14-2111     Document Type: Conference Paper

References (25)

1. Iñaki Alegria, Nora Aranberri, Víctor Fresno, Pablo Gamallo, Lluis Padró, Iñaki San Vicente, Jordi Turmo, and Arkaitz Zubiaga. 2013. Introducción a la tarea compartida Tweet-Norm 2013: Normalización léxica de tuits en español. In Workshop on Tweet Normalization at SEPLN (Tweet-Norm), pages 36-45.
2. Monojit Choudhury, Rahul Saraf, Vijit Jain, Animesh Mukherjee, Sudeshna Sarkar, and Anupam Basu. 2007. Investigation and modeling of the structure of texting language. International Journal of Document Analysis and Recognition (IJDAR), 10(3- 4):157-174.
3. Grzegorz Chrupała. 2013. Text segmentation with character-level text embeddings. In ICML Workshop on Deep Learning for Audio, Speech and Language Processing.
4. Grzegorz Chrupała, Georgiana Dinu, and Josef Van Genabith. 2008. Learning morphology withMorfette. In Proceedings of the 6th edition of the Language Resources and Evaluation Conference.
5. Orphée de Clercq, Bart Desmet, Sarah Schulz, Els Lefever, and Véronique Hoste. 2013. Normalization of Dutch user-generated content. In 9th International Conference on Recent Advances in Natural Language Processing (RANLP-2013), pages 179- 188. INCOMA Ltd.
6. Markus Dreyer, Jason R Smith, and Jason Eisner. 2008. Latent-variable modeling of string transductions with finite-state methods. In Proceedings of the conference on empirical methods in natural language processing, pages 1080-1089. Association for Computational Linguistics.
7. Jeffrey L Elman. 1990. Finding structure in time. Cognitive science, 14(2):179-211.
8. Jeffrey L Elman. 1991. Distributed representations, simple recurrent networks, and grammatical structure. Machine learning, 7(2-3):195-225.
9. Kilian Evang, Valerio Basile, Grzegorz Chrupała, and Johan Bos. 2013. Elephant: Sequence labeling for word and sentence segmentation. In Empirical Methods in Natural Language Processing.
10. Stephan Gouws, Dirk Hovy, and Donald Metzler. 2011. Unsupervised mining of lexical variants from noisy text. In Proceedings of the First workshop on Unsupervised Learning in NLP, pages 82-90. Association for Computational Linguistics.
11. Alex Graves. 2012. Sequence transduction with recurrent neural networks. arXiv:1211.3711.
12. Bo Han and Timothy Baldwin. 2011. Lexical normalisation of short text messages: Makn sens a# twitter. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, pages 368-378. Association for Computational Linguistics.
13. Bo Han, Paul Cook, and Timothy Baldwin. 2012. Automatically constructing a normalisation dictionary for microblogs. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 421-432. Association for Computational Linguistics.
14. Max Kaufmann and Jugal Kalita. 2010. Syntactic normalization of Twitter messages. In International conference on natural language processing, Kharagpur, India.
15. John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional Random Fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the Eighteenth International Conference on Machine Learning, ICML '01, pages 282-289. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
16. Thomas Lavergne, Olivier Cappé, and François Yvon. 2010. Practical very large scale CRFs. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 504-513. Association for Computational Linguistics.
17. Fei Liu, FuliangWeng, and Xiao Jiang. 2012. A broadcoverage normalization system for social media language. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers-Volume 1, pages 1035-1044. Association for Computational Linguistics.
18. Fei Liu, Fuliang Weng, Bingqing Wang, and Yang Liu. 2011. Insertion, deletion, or substitution?: normalizing text messages without pre-categorization nor supervision. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers- Volume 2, pages 71-76. Association for Computational Linguistics.
19. Tomáš Mikolov. 2012a. Recurrent neural network language models. http://rnnlm.org.
20. Tomáš Mikolov. 2012b. Statistical language models based on neural networks. Ph.D. thesis, Brno University of Technology.
21. Tomáš Mikolov, Martin Karafiát, Lukáš Burget, Jan Černocký, and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In Interspeech, pages 1045-1048.
22. Webb Miller and Eugene W Myers. 1985. A file comparison program. Software: Practice and Experience, 15(11):1025-1040.
23. Eugene W Myers. 1986. An O(ND) difference algorithm and its variations. Algorithmica, 1(1-4):251-266.
24. Ilya Sutskever, James Martens, and Geoffrey E Hinton. 2011. Generating text with recurrent neural networks. In Proceedings of the 28th International Conference on Machine Learning (ICML-11), pages 1017-1024.
25. Zhenzhen Xue, Dawei Yin, and Brian D Davison. 2011. Normalizing microtext. In Proceedings of the AAAI- 11 Workshop on Analyzing Microtext, pages 74-79.