Enhancing deep learning sentiment analysis with ensemble techniques in social applications

Expert Systems with Applications

Volumn 77, Issue , 2017, Pages 236-246

  Araque, Oscar ^a   Corcuera Platas, Ignacio ^a   Sánchez Rada, J Fernando ^a   Iglesias, Carlos A ^a  

^a UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

Author keywords

Deep learning; Ensemble; Machine learning; Natural language processing; Sentiment analysis

Indexed keywords

ARTIFICIAL INTELLIGENCE; DATA MINING; EXTRACTION; FEATURE EXTRACTION; LEARNING ALGORITHMS; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS;

AUTOMATIC FEATURE EXTRACTION; ENSEMBLE; FEATURE-BASED TECHNIQUES; LEARNING TECHNIQUES; NATURAL LANGUAGE PROCESSING; PREDICTIVE CAPABILITIES; SENTIMENT ANALYSIS; SOCIAL APPLICATIONS;

DEEP LEARNING;

EID: 85012146253     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2017.02.002     Document Type: Article

References (72)

1. Agarwal, A., Xie, B., Vovsha, I., Rambow, O., Passonneau, R., Sentiment analysis of twitter data. Proceedings of the workshop on languages in social media, 2011, Association for Computational Linguistics, 30–38.
2. Alpaydin, E., Introduction to machine learning. 2014, MIT press.
3. Aue, A., Gamon, M., Customizing sentiment classifiers to new domains: A case study. Proceedings of recent advances in natural language processing (RANLP), vol. 1, 2005 2–1.
4. Bengio, Y., Learning deep architectures for ai. Foundations and Trends® in Machine Learning 2 (2009), 1–127.
5. Cambria, E., Affective computing and sentiment analysis. IEEE Intelligent Systems 31 (2016), 102–107.
6. Chen, M., Weinberger, K.Q., Sha, F., Bengio, Y., Marginalized denoising auto-encoders for nonlinear representations. ICML, 2014, 1476–1484.
7. Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P., Natural language processing (almost) from scratch. The Journal of Machine Learning Research 12 (2011), 2493–2537.
8. De Smedt, T., Daelemans, W., Pattern for python. The Journal of Machine Learning Research 13 (2012), 2063–2067.
9. Demšar, J., Statistical comparisons of classifiers over multiple data sets. The Journal of Machine Learning Research 7 (2006), 1–30.
10. Ding, X., Liu, B., Yu, P.S., A holistic lexicon-based approach to opinion mining. Proceedings of the 2008 international conference on web search and data mining WSDM ‘08, 2008, ACM, New York, NY, USA, 231–240, 10.1145/1341531.1341561.
11. Esuli, A., Sebastiani, F., Sentiwordnet: A publicly available lexical resource for opinion mining. Proceedings of LREC, 6, 2006, Citeseer, 417–422.
12. Fersini, E., Messina, E., Pozzi, F., Sentiment analysis: Bayesian ensemble learning. Decision Support Systems 68 (2014), 26–38, 10.1016/j.dss.2014.10.004 http://www.sciencedirect.com/science/article/pii/S0167923614002498.
13. Fersini, E., Messina, E., Pozzi, F., Expressive signals in social media languages to improve polarity detection. Information Processing & Management 52 (2016), 20–35.
14. Gimpel, K., Schneider, N., O'Connor, B., Das, D., Mills, D., Eisenstein, J., et al. Part-of-speech tagging for twitter: Annotation, features, and experiments. Proceedings of the 49th annual meeting of the association for computational linguistics: Human language technologies: Short papers - volume 2 HLT ‘11, 2011, Association for Computational Linguistics, Stroudsburg, PA, USA, 42–47 http://dl.acm.org/citation.cfm?id=2002736.2002747.
15. Go, A., Bhayani, R., Huang, L., Twitter sentiment classification using distant supervision. CS224N Project Report, Stanford, 1, 2009, 12.
16. Hutto, C., Vader sentiment github repository. 2015 https://github.com/cjhutto/vaderSentiment. Accessed on May 30, 2016.
17. Kathuria, P., Sentiment wsd github repository. 2015 https://github.com/kevincobain2000/sentiment_classifier/. Accessed on May 30, 2016.
18. Kim, J., Yoo, J.-B., Lim, H., Qiu, H., Kozareva, Z., Galstyan, A., Sentiment prediction using collaborative filtering. ICWSM, 2013.
19. Kim, Y., Convolutional neural networks for sentence classification. 2014 arXiv preprint arXiv:1408.5882.
20. Kiritchenko, S., Zhu, X., Mohammad, S.M., Sentiment analysis of short informal texts. Journal of Artificial Intelligence Research, 2014, 723–762.
21. Kouloumpis, E., Wilson, T., Moore, J.D., Twitter sentiment analysis: The good the bad and the omg!. Icwsm 11 (2011), 538–541.
22. Le, Q.V., Mikolov, T., Distributed representations of sentences and documents. ICML, vol. 14, 2014, 1188–1196.
23. Li, C., Xu, B., Wu, G., He, S., Tian, G., Zhou, Y., Parallel recursive deep model for sentiment analysis. Cao, T., Lim, E.-P., Zhou, Z.-H., Ho, T.-B., Cheung, D., Motoda, H., (eds.) Advances in knowledge discovery and data mining Lecture Notes in Computer Science, Vol. 9078, 2015, Springer International Publishing, 15–26, 10.1007/978-3-319-18032-8_2 http://dx.doi.org/10.1007/978-3-319-18032-8_2.
24. Lin, Y., Wang, X., Li, Y., Zhou, A., Integrating the optimal classifier set for sentiment analysis. Social Network Analysis and Mining 5 (2015), 1–13.
25. Liu, B., Sentiment analysis: Mining opinions, sentiments, and emotions. 2015, Cambridge University Press.
26. Loria, S., Textblob documentation page. 2016 https://textblob.readthedocs.org/en/dev/index.html. Accessed on May 30, 2016.
27. Maas, A.L., Daly, R.E., Pham, P.T., Huang, D., Ng, A.Y., Potts, C., Learning word vectors for sentiment analysis. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, 2011, Association for Computational Linguistics, 142–150.
28. Maclin, R., Opitz, D., An empirical evaluation of bagging and boosting. AAAI/IAAI 1997 (1997), 546–551.
29. Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S.J., McClosky, D., The stanford CoreNLP natural language processing toolkit. Association for computational linguistics (ACL) system demonstrations, 2014, 55–60 http://www.aclweb.org/anthology/P/P14/P14-5010.
30. Melville, P., Gryc, W., Lawrence, R.D., Sentiment analysis of blogs by combining lexical knowledge with text classification. Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining KDD ‘09, 2009, ACM, New York, NY, USA, 1275–1284, 10.1145/1557019.1557156 http://doi.acm.org/10.1145/1557019.1557156.
31. Melville, P., Shah, N., Mihalkova, L., Mooney, R.J., Experiments on ensembles with missing and noisy data. Roli, F., Kittler, J., Windeatt, T., (eds.) Multiple classifier systems: 5th international workshop, MCS 2004, Cagliari, Italy, june 9–11, 2004. proceedings, 2004, Springer Berlin Heidelberg, Berlin, Heidelberg, 293–302, 10.1007/978-3-540-25966-4_29 http://dx.doi.org/10.1007/978-3-540-25966-4_29.
32. Mesnil, G., Mikolov, T., Ranzato, M., Bengio, Y., Ensemble of generative and discriminative techniques for sentiment analysis of movie reviews. arXiv preprint arXiv:1412.5335, 2014.
33. Mikolov, T., Chen, K., Corrado, G., Dean, J., Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781, 2013.
34. Mikolov, T., Yih, W.-t., Zweig, G., Linguistic regularities in continuous space word representations. HLT-NAACL, 2013, 746–751.
35. Mohammad, S.M., Kiritchenko, S., Zhu, X., Nrc-canada: Building the state-of-the-art in sentiment analysis of tweets. CoRR, abs/1308.6242, 2013 http://arxiv.org/abs/1308.6242.
36. Narayanan, V., Arora, I., Bhatia, A., Fast and accurate sentiment classification using an enhanced naive bayes model. CoRR, abs/1305.6143, 2013 http://arxiv.org/abs/1305.6143.
37. Nasukawa, T., Yi, J., Sentiment analysis: Capturing favorability using natural language processing. Proceedings of the 2nd international conference on Knowledge capture, 2003, ACM, 70–77.
38. Pablos, A.G., Cuadros, M., Rigau, G., A comparison of domain-based word polarity estimation using different word embeddings. Chair), N.C.C., Choukri, K., Declerck, T., Goggi, S., Grobelnik, M., Maegaard, B., Mariani, J., Mazo, H., Moreno, A., Odijk, J., Piperidis, S., (eds.) Proceedings of the tenth international conference on language resources and evaluation (LREC 2016), 2016, European Language Resources Association (ELRA), Paris, France.
39. Pak, A., Paroubek, P., Twitter as a corpus for sentiment analysis and opinion mining. LREc, vol. 10, 2010, 1320–1326.
40. Pang, B., Lee, L., Vaithyanathan, S., Thumbs up?: sentiment classification using machine learning techniques. Proceedings of the ACL-02 conference on empirical methods in natural language processing-Volume 10, 2002, Association for Computational Linguistics, 79–86.
41. Pennington, J., Socher, R., Manning, C.D., Glove: Global vectors for word representation. EMNLP, vol. 14, 2014, 1532–1543.
42. Perez-Rosas, V., Banea, C., Mihalcea, R., Learning sentiment lexicons in spanish. LREC, vol. 12, 2012, 73.
43. Polanyi, L., Zaenen, A., Computing attitude and affect in text: Theory and applications. chapter Contextual Valence Shifters, 2006, Springer Netherlands, Dordrecht, 1–10) http://dx.doi.org/10.1007/1-4020-4102-0_1.
44. Prusa, J., Khoshgoftaar, T., Dittman, D., Using ensemble learners to improve classifier performance on tweet sentiment data. Information reuse and integration (IRI), 2015 IEEE international conference on, 2015, 252–257, 10.1109/IRI.2015.49.
45. Qiu, G., Liu, B., Bu, J., Chen, C., Expanding domain sentiment lexicon through double propagation. IJCAI, vol. 9, 2009, 1199–1204.
46. Read, J., Using emoticons to reduce dependency in machine learning techniques for sentiment classification. Proceedings of the ACL student research workshop, 2005, Association for Computational Linguistics, 43–48.
47. Řehůřek, R., Sojka, P., Software framework for topic modelling with large corpora. Proceedings of the LREC 2010 workshop on new challenges for NLP frameworks, 2010, ELRA, Valletta, Malta, 45–50 http://is.muni.cz/publication/884893/en.
48. Rokach, L., Ensemble methods for classifiers. Maimon, O., Rokach, L., (eds.) Data mining and knowledge discovery handbook, 2005, Springer US, 957–980 http://dx.doi.org/10.1007/0-387-25465-X_45.
49. Rosenthal, S., Semeval 2014 task 9 description. 2014 http://alt.qcri.org/semeval2014/task9/. Accessed on May 30, 2016.
50. Saif, H., Fernandez, M., He, Y., Alani, H., Evaluation datasets for twitter sentiment analysis: a survey and a new dataset, the sts-gold. 2013.
51. Sehgal, V., Song, C., Sops: Stock prediction using web sentiment. Data mining workshops, 2007. ICDM workshops 2007. seventh IEEE international conference on, 2007, 21–26, 10.1109/ICDMW.2007.100.
52. Severyn, A., Moschitti, A., Twitter sentiment analysis with deep convolutional neural networks. Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2015, ACM, 959–962.
53. Sharma, A., Dey, S., A comparative study of feature selection and machine learning techniques for sentiment analysis. Proceedings of the 2012 ACM Research in Applied Computation Symposium, 2012, ACM, 1–7.
54. Shirani-Mehr, H., Applications of deep learning to sentiment analysis of movie reviews. 2012.
55. da Silva, N.F., Hruschka, E.R., Hruschka, E.R., Tweet sentiment analysis with classifier ensembles. Decision Support Systems 66 (2014), 170–179.
56. Socher, R., Perelygin, A., Wu, J.Y., Chuang, J., Manning, C.D., Ng, A.Y., Recursive deep models for semantic compositionality over a sentiment treebank. Proceedings of the conference on empirical methods in natural language processing (EMNLP), 1631, 2013, Citeseer, 1642.
57. Su, Z., Xu, H., Zhang, D., Xu, Y., Chinese sentiment classification using a neural network tool word2vec. Multisensor fusion and information integration for intelligent systems (MFI), 2014 international conference on, 2014, 1–6, 10.1109/MFI.2014.6997687.
58. Taboada, M., Brooke, J., Tofiloski, M., Voll, K., Stede, M., Lexicon-based methods for sentiment analysis. Computational linguistics 37 (2011), 267–307.
59. Tang, D., Wei, F., Qin, B., Liu, T., Zhou, M., Coooolll: A deep learning system for twitter sentiment classification. Proceedings of the 8th international workshop on semantic evaluation (semeval 2014), 2014, 208–212.
60. Tang, D., Wei, F., Yang, N., Zhou, M., Liu, T., Qin, B., Learning sentiment-specific word embedding for twitter sentiment classification. ACL (1), 2014, 1555–1565.
61. Turney, P.D., Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews. Proceedings of the 40th annual meeting on association for computational linguistics, 2002, Association for Computational Linguistics, 417–424.
62. Vo, D.-T., Zhang, Y., Target-dependent twitter sentiment classification with rich automatic features. Proceedings of the twenty-fourth international joint conference on artificial intelligence (IJCAI 2015), 2015, 1347–1353.
63. Wang, G., Sun, J., Ma, J., Xu, K., Gu, J., Sentiment classification: The contribution of ensemble learning. Decision support systems 57 (2014), 77–93.
64. Wang, S., Manning, C.D., Baselines and bigrams: Simple, good sentiment and topic classification. Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers-Volume 2, 2012, Association for Computational Linguistics, 90–94.
65. Whitehead, M., Yaeger, L., Sentiment mining using ensemble classification models. Innovations and advances in computer sciences and engineering, 2010, Springer, 509–514.
66. Wilson, T., Wiebe, J., Hoffmann, P., Recognizing contextual polarity: An exploration of features for phrase-level sentiment analysis. Computational linguistics 35 (2009), 399–433.
67. Xia, R., Zong, C., Exploring the use of word relation features for sentiment classification. Proceedings of the 23rd international conference on computational linguistics: Posters COLING ‘10, 2010, Association for Computational Linguistics, Stroudsburg, PA, USA, 1336–1344 http://dl.acm.org/citation.cfm?id=1944566.1944719.
68. Xia, R., Zong, C., A pos-based ensemble model for cross-domain sentiment classification. IJCNLP, 2011, Citeseer, 614–622.
69. Xia, R., Zong, C., Li, S., Ensemble of feature sets and classification algorithms for sentiment classification. Information Sciences 181 (2011), 1138–1152, 10.1016/j.ins.2010.11.023 http://www.sciencedirect.com/science/article/pii/S0020025510005682.
70. Zhang, D., Xu, H., Su, Z., Xu, Y., Chinese comments sentiment classification based on word2vec and svm perf. Expert Systems with Applications 42 (2015), 1857–1863.
71. Zhang, K., Cheng, Y., Xie, Y., Honbo, D., Agrawal, A., Palsetia, D., et al. Ses: Sentiment elicitation system for social media data. Data mining workshops (ICDMW), 2011 IEEE 11th international conference on, 2011, IEEE, 129–136.
72. Zhang, P., He, Z., Using data-driven feature enrichment of text representation and ensemble technique for sentence-level polarity classification. Journal of Information Science 41 (2015), 531–549.