Three Convolutional Neural Network-based models for learning Sentiment Word Vectors towards sentiment analysis

Proceedings of the International Joint Conference on Neural Networks

Volumn 2016-October, Issue , 2016, Pages 3172-3179

  Lan, Man ^a,b   Zhang, Zhihua ^a   Lu, Yue ^a,b   Wu, Ju ^c  

^a EAST CHINA NORMAL UNIVERSITY   (China)

^b Shanghai Key Laboratory of Multidimensional Information Processing   (China)

^c INSTITUTE OF FORENSIC SCIENCE   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CONVOLUTION; DATA MINING; NATURAL LANGUAGE PROCESSING SYSTEMS; NEURAL NETWORKS; SEMANTICS; SYNTACTICS;

BENCHMARK DATASETS; CONVOLUTIONAL NEURAL NETWORK; NAMED ENTITY RECOGNITION; NATURAL LANGUAGE PROCESSING; SEMANTIC INFORMATION; SENTIMENT ANALYSIS; SYNTACTIC INFORMATION; WORD REPRESENTATIONS;

VECTORS;

EID: 85007165427     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2016.7727604     Document Type: Conference Paper

References (44)

1. B. Liu, "Sentiment analysis and opinion mining", Synthesis Lectures on Human Language Technologies, vol. 5, no. 1, pp. 1-167, 2012.
2. S. M. Mohammad, S. Kiritchenko, and X. Zhu, "Nrc-canada: Building the state-of-the-art in sentiment analysis of tweets", in Proceedings of the Second Joint Conference on Lexical and Computational Semantics, 2013.
3. J. Turian, L. Ratinov, and Y. Bengio, "Word representations: a simple and general method for semi-supervised learning", in ACL. Association for Computational Linguistics, 2010, pp. 384-394.
4. Y. Bengio, R. Ducharme, P. Vincent, and C. Janvin, "A neural probabilistic language model", The Journal of Machine Learning Research, vol. 3, pp. 1137-1155, 2003.
5. T. Mikolov, K. Chen, G. Corrado, and J. Dean, "Efficient estimation of word representations in vector space", arXiv preprint arXiv:1301.3781, 2013.
6. R. Rěhuřěk, P. Sojka et al., "Software framework for topic modelling with large corpora", in Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks, 2010, pp. 45-50.
7. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent dirichlet allocation", the Journal of Machine Learning Research, vol. 3, pp. 993-1022, 2003.
8. R. Collobert, "Deep learning for efficient discriminative parsing", in International Conference on Artificial Intelligence and Statistics, no. EPFL-CONF-192374, 2011.
9. R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu, and P. Kuksa, "Natural language processing (almost) from scratch", The Journal of Machine Learning Research, vol. 12, pp. 2493-2537, 2011.
10. Y. Kim, "Convolutional neural networks for sentence classification", in Proceedings of the 2014 EMNLP. Doha, Qatar: Association for Computational Linguistics, October 2014, pp. 1746-1751.
11. Y. Goldberg and O. Levy, "word2vec explained: deriving mikolov et al.'s negative-sampling word-embedding method", arXiv preprint arXiv:1402.3722, 2014.
12. Q. V. Le and T. Mikolov, "Distributed representations of sentences and documents", arXiv preprint arXiv:1405.4053, 2014.
13. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning representations by back-propagating errors", Cognitive modeling, vol. 5, 1988.
14. A. Go, R. Bhayani, and L. Huang, "Twitter sentiment classification using distant supervision", CS224N Project Report, Stanford, pp. 1-12, 2009.
15. O. Owoputi, B. O'Connor, C. Dyer, K. Gimpel, N. Schneider, and N. A. Smith, "Improved part-of-speech tagging for online conversational text with word clusters." in NAACL, 2013, pp. 380-390.
16. P. J. Stone, D. C. Dunphy, and M. S. Smith, "The general inquirer: A computer approach to content analysis", American Sociological Review, no. 4, 1966.
17. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg et al., "Scikit-learn: Machine learning in Python", The Journal of Machine Learning Research, vol. 12, pp. 2825-2830, 2011.
18. B. Pang, L. Lee, and S. Vaithyanathan, "Thumbs up?: sentiment classification using machine learning techniques", in EMNLP. Association for Computational Linguistics, 2002, pp. 79-86.
19. D. Tang, F. Wei, N. Yang, M. Zhou, T. Liu, and B. Qin, "Learning sentiment-specific word embedding for twitter sentiment classification", in ACL, 2014, pp. 1555-1565.
20. C. N. dos Santos and M. Gatti, "Deep convolutional neural networks for sentiment analysis of short texts", in Proceedings of the International Conference on Computational Linguistics, 2014.
21. N. Kalchbrenner, E. Grefenstette, and P. Blunsom, "A convolutional neural network for modelling sentences", in ACL. Baltimore, Maryland: Association for Computational Linguistics, June 2014, pp. 655-665.
22. R. Socher, J. Pennington, E. H. Huang, A. Y. Ng, and C. D. Manning, "Semi-supervised recursive autoencoders for predicting sentiment distributions", in EMNLP. Association for Computational Linguistics, 2011, pp. 151-161.
23. R. Socher, A. Perelygin, J. Y. Wu, J. Chuang, C. D. Manning, A. Y. Ng, and C. Potts, "Recursive deep models for semantic compositionality over a sentiment treebank", in EMNLP, vol. 1631. Citeseer, 2013, p. 1642.
24. L. Dong, F. Wei, C. Tan, D. Tang, M. Zhou, and K. Xu, "Adaptive recursive neural network for target-dependent twitter sentiment classification", in ACL, 2014, pp. 49-54.
25. P. Nakov, S. Rosenthal, Z. Kozareva, V. Stoyanov, A. Ritter, and T. Wilson, "SemEval-2013 Task 2: Sentiment analysis in Twitter", in Second Joint Conference on Lexical and Computational Semantics, June 2013.
26. T. Nasukawa and J. Yi, "Sentiment analysis: Capturing favorability using natural language processing", in Proceedings of the International Conference on Knowledge Capture. ACM, 2003, pp. 70-77.
27. S.-M. Kim and E. Hovy, "Determining the sentiment of opinions", in Proceedings of the International Conference on Computational Linguistics. Association for Computational Linguistics, 2004, p. 1367.
28. M. Taboada, J. Brooke, M. Tofiloski, K. Voll, and M. Stede, "Lexiconbased methods for sentiment analysis", Computational linguistics, vol. 37, no. 2, pp. 267-307, 2011.
29. M. Hu and B. Liu, "Mining and summarizing customer reviews", in Proceedings of the ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 2004, pp. 168-177.
30. S. Wang and C. D. Manning, "Baselines and bigrams: Simple, good sentiment and topic classification", in ACL. Association for Computational Linguistics, 2012, pp. 90-94.
31. M. Marchetti-Bowick and N. Chambers, "Learning for microblogs with distant supervision: Political forecasting with twitter", in Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 2012, pp. 603-612.
32. K. Zhang, H. Xu, J. Tang, and J. Li, "Keyword extraction using support vector machine", in Advances in Web-Age Information Management. Springer, 2006, pp. 85-96.
33. H. C. Wu, R. W. P. Luk, K. F. Wong, and K. L. Kwok, "Interpreting tf-idf term weights as making relevance decisions", ACM Transactions on Information Systems, vol. 26, no. 3, p. 13, 2008.
34. A. Aizawa, "An information-theoretic perspective of tf-idf measures", Information Processing & Management, vol. 39, no. 1, pp. 45-65, 2003.
35. S. T. Dumais, "Latent semantic analysis", Annual review of information science and technology, vol. 38, no. 1, pp. 188-230, 2004.
36. T. Mikolov, W. T. Yih, and G. Zweig, "Linguistic regularities in continuous spaceword representations", NAACL, 2013.
37. J. Boyd-Graber and P. Resnik, "Holistic sentiment analysis across languages: Multilingual supervised latent dirichlet allocation", in EMNLP. Association for Computational Linguistics, 2010, pp. 45-55.
38. J. Pennington, R. Socher, and C. Manning, "Glove: Global vectors for word representation", in EMNLP, October 2014.
39. S. C. A. P, S. Lauly, H. Larochelle, M. M. Khapra, B. Ravindran, V. Raykar, and A. Saha, "An autoencoder approach to learning bilingual word representations", Advances in Neural Information Processing Systems, vol. 3, pp. 1853-1861, 2014.
40. W. Y. Zou, R. Socher, D. Cer, and C. D. Manning, "Bilingual word embeddings for phrase-based machine translation", in EMNLP, October 2013.
41. A. L. Maas, R. E. Daly, P. T. Pham, D. Huang, A. Y. Ng, and C. Potts, "Learning word vectors for sentiment analysis", in ACL. Association for Computational Linguistics, 2011, pp. 142-150.
42. A. Lu, W. Wang, M. Bansal, K. Gimpel, and K. Livescu, "Deep multilingual correlation for improved word embeddings", in NAACL, May-June 2015.
43. H. Zhou, L. Chen, F. Shi, and D. Huang, "Learning bilingual sentiment word embeddings for cross-language sentiment classification", in ACL, July 2015.
44. S. Rothe and H. Schütze, "Autoextend: Extending word embeddings to embeddings for synsets and lexemes", in ACL, July 2015.