On stopwords, filtering and data sparsity for sentiment analysis of twitter

Proceedings of the 9th International Conference on Language Resources and Evaluation, LREC 2014

Volumn , Issue , 2014, Pages 810-817

  Saif, Hassan ^a   Fernandez, Miriam ^a   He, Yulan ^b   Alani, Harith ^a  

^a OPEN UNIVERSITY   (United Kingdom)

^b ASTON UNIVERSITY   (United Kingdom)

Author keywords

Data Sparsity; Sentiment Analysis; Stopwords

Indexed keywords

DATA MINING; SOCIAL NETWORKING (ONLINE);

CLASSIFICATION PERFORMANCE; DATA SPARSITY; DYNAMIC GENERATION; IDENTIFICATION METHOD; OPTIMAL METHODS; SENTIMENT ANALYSIS; SENTIMENT CLASSIFICATION; STOPWORDS;

CLASSIFICATION (OF INFORMATION);

EID: 84950312870     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Asiaee T, A., Tepper, M., Banerjee, A., and Sapiro, G. (2012). If you are happy and you know it⋯ tweet. In Proceedings of the 21st ACM international conference on Information and knowledge management, pages 1602-1606. ACM.
2. Ayral, H. and Yavuz, S. (2011). An automated domain specific stop word generation method for natural language text classification. In Innovations in Intelligent Systems and Applications (INISTA), 2011 International Symposium on, pages 500-503. IEEE.
3. Bakliwal, A., Arora, P., Madhappan, S., Kapre, N., Singh, M., and Varma, V. (2012). Mining sentiments from tweets. Proceedings of the WASSA, 12.
4. Cover, T. M. and Thomas, J. A. (2012). Elements of information theory. John Wiley & Sons.
5. Forman, G. (2003). An extensive empirical study of feature selection metrics for text classification. The Journal of machine learning research, 3:1289-1305.
6. Fox, C. (1992). Information retrieval data structures and algorithms. Lexical Analysis and Stoplists, pages 102-130.
7. Gokulakrishnan, B., Priyanthan, P., Ragavan, T., Prasath, N., and Perera, A. (2012). Opinion mining and sentiment analysis on a twitter data stream. In Advances in ICT for Emerging Regions (ICTer), 2012 International Conference on, pages 182-188. IEEE.
8. Hu, X., Tang, J., Gao, H., and Liu, H. (2013a). Unsuper-vised sentiment analysis with emotional signals. In Proceedings of the 22nd international conference on World Wide Web, pages 607-618. International World Wide Web Conferences Steering Committee.
9. Hu, X., Tang, L., Tang, J., and Liu, H. (2013b). Exploiting social relations for sentiment analysis in microblogging. In Proceedings of the sixth ACM international conference on Web search and data mining, pages 537-546. ACM.
10. Kouloumpis, E., Wilson, T., and Moore, J. (2011). Twitter sentiment analysis: The good the bad and the omg! In Proceedings of the ICWSM, Barcelona, Spain.
11. Lo, R. T.-W., He, B., and Ounis, I. (2005). Automatically building a stopword list for an information retrieval system. In Journal on Digital Information Management: Special Issue on the 5th Dutch-Belgian Information Retrieval Workshop (DIR)..
12. Luhn, H. P. (1957). A statistical approach to mechanized encoding and searching of literary information. IBM Journal of research and development, 1(4):309-317.
13. Makrehchi, M. and Kamel, M. S. (2008). Automatic extraction of domain-specific stopwords from labeled documents. In Advances in information retrieval, pages 222-233. Springer.
14. Martínez-Cámara, E., Montejo-Ráez, A., Martín-Valdivia, M., and Urena-López, L. (2013). Sinai: Machine learning and emotion of the crowd for sentiment analysis in microblogs. In In Proceedings of the seventh international workshop on Semantic Evaluation Exercises (SemEval-2013), Atlanta, Georgia, USA, June 2013.
15. Nakov, P., Rosenthal, S., Kozareva, Z., Stoyanov, V., Ritter, A., and Wilson, T. (2013). Semeval-2013 task 2: Sentiment analysis in twitter. In Proceedings of the 7th International Workshop on Semantic Evaluation. Association for Computational Linguistics.
16. Pak, A. and Paroubek, P. (2010). Twitter as a corpus for sentiment analysis and opinion mining. In Proceedings of LREC 2010, Valletta, Malta.
17. Phan, X.-H., Nguyen, L.-M., and Horiguchi, S. (2008). Learning to classify short and sparse text & web with hidden topics from large-scale data collections. In Proceedings of the 17th international conference on World Wide Web, pages 91-100. ACM.
18. Rijsbergen, C. J. V. (1979). Information Retrieval. Butterworth-Heinemann, Newton, MA, USA, 2nd edition.
19. Saif, H., He, Y., and Alani, H. (2012a). Alleviating data sparsity for twitter sentiment analysis. In Proceedings, 2nd Workshop on Making Sense of Microposts (#MSM2012) in conjunction with www 2012, Layon, France.
20. Saif, H., He, Y., and Alani, H. (2012b). Semantic sentiment analysis of twitter. In Proceedings of the 11th international conference on The Semantic Web, Boston, MA.
21. ∗IA Conference, Turin, Italy.
22. Shamma, D., Kennedy, L., and Churchill, E. (2009). Tweet the debates: understanding community annotation of un-collected sources. In Proceedings of the first SIGMM workshop on Social media, pages 3-10. ACM.
23. Silva, C. and Ribeiro, B. (2003). The importance of stop word removal on recall values in text categorization. In Neural Networks, 2003. Proceedings of the International Joint Conference on, Volume 3, pages 1661-1666. IEEE.
24. Sinka, M. P. and Corne, D. (2003a). Evolving better sto-plists for document clustering and web intelligence. In HIS, pages 1015-1023.
25. Sinka, M. P. and Corne, D. W. (2003b). Towards modernised and web-specific stoplists for web document analysis. In Web Intelligence, 2003. WI 2003. Proceedings. IEEE/WIC International Conference on. IEEE.
26. Speriosu, M., Sudan, N., Upadhyay, S., and Baldridge, J. (2011). Twitter polarity classification with label propagation over lexical links and the follower graph. In Proceedings of the EMNLP First workshop on Unsupervised Learning in NLP, Edinburgh, Scotland.
27. Trumbach, C. C. and Payne, D. (2007). Identifying synonymous concepts in preparation for technology mining. Journal of Information Science, 33(6):660-677.
28. Xu, Y., and Jones., G. J., Li, J., Wang, B., and Sun, C. (2007). A study on mutual information-based feature selection for text categorization. Journal of Computational Information Systems, 3(3):1007-1012.
29. Yang, Y. (1995). Noise reduction in a statistical approach to text categorization. In Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, pages 256-263. ACM.
30. Zhang, L., Jia, Y., Zhou, B., and Han, Y. (2012). Microblog-ging sentiment analysis using emotional vector. In Cloud and Green Computing (CGC), 2012 Second International Conference on, pages 430-433. IEEE.
31. Zipf, G. K. (1949). Human behavior and the principle of least effort.