A character-based convolutional neural network for language-agnostic Twitter sentiment analysis

Proceedings of the International Joint Conference on Neural Networks

Volumn 2017-May, Issue , 2017, Pages 2384-2391

  Wehrmann, Joonatas ^a   Becker, Willian ^a   Cagnini, Henry E L ^a   Barros, Rodrigo C ^a  

^a PONTIFICAL CATHOLIC UNIVERSITY OF RIO GRANDE DO SUL   (Brazil)

Author keywords

Character based Embedding; Convolutional Neural Networks; Deep Learning; Sentiment Analysis; Twitter

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; CONVOLUTION; DATA MINING; DEEP LEARNING; DEEP NEURAL NETWORKS; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; NEURAL NETWORKS; SOCIAL NETWORKING (ONLINE);

CHARACTER-BASED EMBEDDING; CONVOLUTIONAL NEURAL NETWORK; MACHINE TRANSLATIONS; NEURAL ARCHITECTURES; SENTIMENT ANALYSIS; SENTIMENT CLASSIFICATION; TRANSLATION PROCESS; TWITTER;

TRANSLATION (LANGUAGES);

EID: 85029793143     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2017.7966145     Document Type: Conference Paper

References (39)

1. E. Mart'nez-C'amara, M. T. Mart'n-Valdivia, L. A. Urena-L'opez, and A. R. Montejo-R'aez, "Sentiment analysis in twitter, " Natural Language Engineering, vol. 20, no. 01, pp. 1-28, 2014.
2. J. S. Olsson, D. W. Oard, and J. Hajic, "Cross-language text classification, " in Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, 2005, pp. 645-646.
3. B. Fortuna and J. Shawe-Taylor, "The use of machine translation tools for cross-lingual text mining, " in Proceedings of the ICML Workshop on Learning with Multiple Views, 2005.
4. C. Banea, R. Mihalcea, J. Wiebe, and S. Hassan, "Multilingual subjectivity analysis using machine translation, " in Proceedings of the Conference on Empirical Methods in Natural Language Processing, 2008, pp. 127-135.
5. J. G. Shanahan, G. Grefenstette, Y. Qu, and D. A. Evans, "Mining multilingual opinions through classification and translation, " in Proceedings of AAAI Spring Symposium on Exploring Attitude and Affect in Text, 2004.
6. G. Zhou, Z. Zeng, J. X. Huang, and T. He, "Transfer learning for cross-lingual sentiment classification with weakly shared deep neural networks, " in Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. ACM, 2016, pp. 245-254.
7. X. Tang and X. Wan, "Learning bilingual embedding model for crosslanguage sentiment classification, " in Web Intelligence (WI) and Intelligent Agent Technologies (IAT), 2014 IEEE/WIC/ACM International Joint Conferences on, vol. 2. IEEE, 2014, pp. 134-141.
8. Y. Guo and M. Xiao, "Cross language text classification via subspace co-regularized multi-view learning, " arXiv preprint arXiv: 1206. 6481, 2012.
9. K. Duh, A. Fujino, and M. Nagata, "Is machine translation ripe for cross-lingual sentiment classification" in Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers-Volume 2. Association for Computational Linguistics, 2011, pp. 429-433.
10. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin, "A neural probabilistic language model, " JMLR, vol. 3, no. Feb, pp. 1137-1155, 2003.
11. R. Socher, A. Perelygin, J. Y. Wu, J. Chuang, C. D. Manning, A. Y. Ng, and C. Potts, "Recursive deep models for semantic compositionality over a sentiment treebank, " in Proceedings of the conference on empirical methods in natural language processing (EMNLP), vol. 1631, 2013, p. 1642.
12. R. Collobert and J. Weston, "A unified architecture for natural language processing: Deep neural networks with multitask learning, " in Proceedings of the 25th international conference on Machine learning, 2008, pp. 160-167.
13. J. Lee, K. Cho, and T. Hofmann, "Fully character-level neural machine translation without explicit segmentation, " arXiv preprint arXiv: 1610. 03017, 2016.
14. X. Zhang, J. Zhao, and Y. LeCun, "Character-level convolutional networks for text classification, " in Advances in Neural Information Processing Systems, 2015, pp. 649-657.
15. X. Zhang and Y. LeCun, "Text understanding from scratch, " arXiv preprint arXiv: 1502. 01710, 2015.
16. D. Tang, B. Qin, and T. Liu, "Document modeling with gated recurrent neural network for sentiment classification, " in Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015, pp. 1422-1432.
17. R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu, and P. Kuksa, "Natural language processing (almost) from scratch, " Journal of Machine Learning Research, vol. 12, no. Aug, pp. 2493-2537, 2011.
18. H. Zhou, L. Chen, F. Shi, and D. Huang, "Learning bilingual sentiment word embeddings for cross-language sentiment classification. " ACL, 2015.
19. D. Maynard and A. Funk, "Automatic detection of political opinions in tweets, " in Extended Semantic Web Conference, 2011, pp. 88-99.
20. W. Medhat, A. Hassan, and H. Korashy, "Sentiment analysis algorithms and applications: A survey, " Ain Shams Engineering Journal, vol. 5, no. 4, pp. 1093-1113, 2014.
21. M. Gamon, A. Aue, S. Corston-Oliver, and E. Ringger, "Pulse: Mining customer opinions from free text, " in International Symposium on Intelligent Data Analysis, 2005, pp. 121-132.
22. B. Pang and L. Lee, "A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts, " in Proceedings of the 42nd annual meeting on Association for Computational Linguistics, 2004, p. 271.
23. L. Shi, R. Mihalcea, and M. Tian, "Cross language text classification by model translation and semi-supervised learning, " in Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, 2010, pp. 1057-1067.
24. R. Mihalcea, C. Banea, and J. M. Wiebe, "Learning multilingual subjective language via cross-lingual projections, " 2007.
25. X. Zhou, X. Wan, and J. Xiao, "Attention-based lstm network for crosslingual sentiment classification. "
26. -, "Cross-lingual sentiment classification with bilingual document representation learning. "
27. H. Pham, M.-T. Luong, and C. D. Manning, "Learning distributed representations for multilingual text sequences, " in Proceedings of NAACL-HLT, 2015, pp. 88-94.
28. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean, "Distributed representations of words and phrases and their compositionality, " in Advances in neural information processing systems, 2013, pp. 3111-3119.
29. K. Dave, S. Lawrence, and D. M. Pennock, "Mining the peanut gallery: Opinion extraction and semantic classification of product reviews, " in Proceedings of the 12th international conference on World Wide Web, 2003, pp. 519-528.
30. J. Wiebe, T. Wilson, R. Bruce, M. Bell, and M. Martin, "Learning subjective language, " Computational linguistics, vol. 30, no. 3, pp. 277-308, 2004.
31. A. Abbasi, H. Chen, and A. Salem, "Sentiment analysis in multiple languages: Feature selection for opinion classification in web forums, " ACM Transactions on Information Systems (TOIS), vol. 26, no. 3, p. 12, 2008.
32. C. N. dos Santos and M. Gatti, "Deep convolutional neural networks for sentiment analysis of short texts. " in COLING, 2014, pp. 69-78.
33. S. Hochreiter and J. Schmidhuber, "Long short-term memory, " Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997.
34. Y. Kim, "Convolutional neural networks for sentence classification, " arXiv preprint arXiv: 1408. 5882, 2014.
35. I. Mozetic, M. Grcar, and J. Smailovi'c, "Multilingual twitter sentiment classification: The role of human annotators, " PloS one, vol. 11, no. 5, p. e0155036, 2016.
36. V. Vapnik and C. Cortes, "Support vector networks, " Machine Learning, vol. 20, p. 273, 1995.
37. V. Vapnik, "An overview of statistical learning theory, " IEEE Transactions on Neural Networks, vol. 10, pp. 988-999, 1999.
38. K. He, X. Zhang, S. Ren, and J. Sun, "Delving deep into rectifiers: Surpassing human-level performance on imagenet classification, " in Proceedings of the IEEE International Conference on Computer Vision, 2015, pp. 1026-1034.
39. K. Simonyan, A. Vedaldi, and A. Zisserman, "Deep inside convolutional networks: Visualising image classification models and saliency maps, " arXiv preprint arXiv: 1312. 6034, 2013.