A modular approach for lexical normalization applied to Spanish tweets

Expert Systems with Applications

Volumn 42, Issue 10, 2015, Pages 4743-4754

  Cotelo, J M ^a   Cruz, F L ^a   Troyano, J A ^a   Ortega, F J ^a  

^a UNIVERSITY OF SEVILLE   (Spain)

Author keywords

Domain adaptation; Text normalization; Twitter

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS;

DOMAIN ADAPTATION; MODULAR APPROACH; MODULAR ARCHITECTURES; NATURAL LANGUAGE PROCESSING; OUT OF VOCABULARY WORDS; SOCIAL MEDIA PLATFORMS; TEXT NORMALIZATIONS; TWITTER;

SOCIAL NETWORKING (ONLINE);

EID: 84923820457     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2015.02.003     Document Type: Article

References (24)

1. Ageno, A.; Comas, P. R.; Padró, L.; & Turmo, J. (2013). The talp-upc approach to tweet-norm 2013. In Proceedings of the tweet normalization workshop at SEPLN 2013. Sociedad Española para el Procesamiento del Lenguaje Natural.
2. Conover, M.; Ratkiewicz, J.; Francisco, M.; Gonçalves, B.; Menczer, F.; & Flammini, A. (2011). Political polarization on twitter. In ICWSM.
3. M.R. Costa-Jussa, and R.E. Banchs Automatic normalization of short texts by combining statistical and rule-based techniques Language Resources and Evaluation 47 2013 179 193
4. J.M. Cotelo, F.L. Cruz, and J.A. Troyano Dynamic topic-related tweet retrieval Journal of the Association for Information Science and Technology 65 2014 513 523
5. Eisenstein, J. (2013). What to do about bad language on the internet. In Proceedings of NAACL-HLT (pp. 359-369).
6. Gamallo, P.; García, M.; & Pichel, J. R. (2013). A method to lexical normalisation of tweets. In Proceedings of the tweet normalization workshop at SEPLN 2013. Sociedad Española para el Procesamiento del Lenguaje Natural.
7. M. Ghiassi, J. Skinner, and D. Zimbra Twitter brand sentiment analysis: A hybrid system using n-gram analysis and dynamic artificial neural network Expert Systems with Applications 40 2013 6266 6282
8. B. Han, and T. Baldwin Lexical normalisation of short text messages: Makn sens a #twitter Proceedings of the 49th annual meeting of the association for computational linguistics: Human language technologies HLT '11 Vol. 1 2011 Association for Computational Linguistics Stroudsburg, PA, USA 368 378
9. B. Han, P. Cook, and T. Baldwin Automatically constructing a normalisation dictionary for microblogs Proceedings of the 2012 joint conference on empirical methods in natural language processing and computational natural language learning 2012 Association for Computational Linguistics 421 432
10. B. Han, P. Cook, and T. Baldwin Lexical normalization for social media text ACM Transactions on Intelligent Systems and Technology 4 2013 5:1 5:27
11. I. Himelboim, S. McCreery, and M. Smith Birds of a feather tweet together: Integrating network and content analyses to examine cross-ideology exposure on twitter Journal of Computer-Mediated Communication 18 2013 40 60
12. K. Ikeda, G. Hattori, C. Ono, H. Asoh, and T. Higashino Twitter user profiling based on text and community mining for market analysis Knowledge-Based Systems 51 2013 35 47
13. S. Jabeen, S. Shah, and A. Latif Named entity recognition and normalization in tweets towards text summarization 2013 Eighth international conference on digital information management (ICDIM) 2013 IEEE 223 227
14. E. Kontopoulos, C. Berberidis, T. Dergiades, and N. Bassiliades Ontology-based sentiment analysis of twitter posts Expert Systems with Applications 40 2013 4065 4074
15. J. Martinez-Romo, and L. Araujo Detecting malicious tweets in trending topics using a statistical analysis of language Expert Systems with Applications 40 2013 2992 3000
16. M.M. Mostafa More than words: Social networks' text mining for consumer brand sentiments Expert Systems with Applications 40 2013 4241 4251
17. Pennell, D.; & Liu, Y. (2011). A character-level machine translation approach for normalizationof sms abbreviations. In IJCNLP (pp. 974-982).
18. Phi-Long (2012). Python 3.3+ implementation of the language guessing module made by Jacob R. Rideout for KDE.
19. Porta, J.; & Sancho, J.L. (2013). Word normalization in twitter using finite-state transducers. In Proceedings of the tweet normalization workshop at SEPLN 2013. Sociedad Española para el Procesamiento del Lenguaje Natural.
20. K. Schulz, and S. Mihov Fast string correction with levenshtein-automata International Journal of Document Analysis and Recognition 5 2002 67 85
21. C.E. Shannon A mathematical theory of communication Bell System Technical Journal 4 1948 379 423
22. Sidarenka, U.; Scheffler, T.; & Stede, M. (2013). Rule-based normalization of german twitter messages. In Proceedings of the GSCL Workshop Verarbeitung und Annotation von Sprachdaten aus Genres internetbasierter Kommunikation.
23. A. Tumasjan, T.O. Sprenger, P.G. Sandner, and I.M. Welpe Predicting elections with twitter: What 140 characters reveal about political sentiment ICWSM 10 2010 178 185
24. Yang, Y.; & Eisenstein, J. (2013). A log-linear model for unsupervised text normalization. In EMNLP (pp. 61-72).