Predicting polarities of tweets by composing word embeddings with long short-Term memory

ACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference

Volumn 1, Issue , 2015, Pages 1343-1353

  Wang, Xin ^a   Liu, Yuanchao ^a   Sun, Chengjie ^a   Wang, Baoxun ^b   Wang, Xiaolong ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b MICROSOFT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN; COMPUTATIONAL LINGUISTICS; MEMORY ARCHITECTURE; NATURAL LANGUAGE PROCESSING SYSTEMS; NETWORK ARCHITECTURE;

BAG OF WORDS; DATA DRIVEN TECHNIQUE; FEATURE ENGINEERINGS; MEMORY BLOCKS; NEURAL MODELING; PROPOSED ARCHITECTURES; RECURRENT NETWORKS; SPECIAL FUNCTIONS;

LONG SHORT-TERM MEMORY;

EID: 84943794421     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/v1/p15-1130     Document Type: Conference Paper

References (37)

1. Yoshua Bengio, Patrice Simard, and Paolo Frasconi. 1994. Learning long-Term dependencies with gradient descent is difficult. Neural Networks, IEEE Transactions on, 5(2):157-166.
2. Yoshua Bengio, Réjean Ducharme, Pascal Vincent, and Christian Jauvin. 2003. A neural probabilistic language model. Journal of Machine Learning Research, 3:1137-1155.
3. Pedro Henrique Calais Guerra, Adriano Veloso, Wagner Meira Jr, and Virgílio Almeida. 2011. From bias to opinion: a transfer-learning approach to realtime sentiment analysis. In Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 150-158. ACM.
4. Grzegorz Chrupała. 2014. Normalizing tweets with edit scripts and recurrent neural embeddings. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 680-686, Baltimore, Maryland, June. Association for Computational Linguistics.
5. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. The Journal of Machine Learning Research, 12:2493-2537.
6. Jeffrey L Elman. 1990. Finding structure in time. Cognitive science, 14(2):179-211.
7. Felix Gers. 2001. Long Short-Term Memory in Recurrent Neural Networks. Ph.D. Thesis, Ph. D. Thesis, Ecole Polytechnique Federale de Lausanne.
8. Alec Go, Richa Bhayani, and Lei Huang. 2009. Twitter sentiment classification using distant supervision. CS224N Project Report, Stanford, pages 1-12.
9. Alex Graves. 2010. Rnnlib: A recurrent neural network library for sequence learning problems. http://sourceforge.net/projects/rnnl.
10. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-Term memory. Neural computation, 9(8):1735-1780.
11. Minqing Hu and Bing Liu. 2004. Mining and summarizing customer reviews. In Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 04, pages 168-177, New York, NY, USA. ACM.
12. Xia Hu, Jiliang Tang, Huiji Gao, and Huan Liu. 2013a. Unsupervised sentiment analysis with emotional signals. In Proceedings of the 22nd international conference on World Wide Web, pages 607-618. International World Wide Web Conferences Steering Committee.
13. Xia Hu, Lei Tang, Jiliang Tang, and Huan Liu. 2013b. Exploiting social relations for sentiment analysis in microblogging. In Proceedings of the sixth ACM international conference on Web search and data mining, pages 537-546. ACM.
14. Eric H Huang, Richard Socher, Christopher D Manning, and Andrew Y Ng. 2012. Improving word representations via global context and multiple word prototypes. In Proceedings of the 50th AnnualMeeting of the Association for Computational Linguistics: Long Papers-Volume 1, pages 873-882. Association for Computational Linguistics.
15. Ozan Irsoy and Claire Cardie. 2014. Opinion mining with deep recurrent neural networks. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 720-728.
16. Nal Kalchbrenner, Edward Grefenstette, and Phil Blunsom. 2014. A convolutional neural network for modelling sentences. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, June.
17. Igor Labutov and Hod Lipson. 2013. Re-embedding words. In Proceedings of the 51th Annual Meeting of the Association for Computational Linguistics, pages 489-493. Association for Computational Linguistics.
18. Hsiang Hui Lek and Danny CC Poo. 2013. Aspectbased twitter sentiment classification. In Tools with Artificial Intelligence (ICTAI), 2013 IEEE 25th International Conference on, pages 366-373. IEEE.
19. Kun-Lin Liu, Wu-Jun Li, and Minyi Guo. 2012. Emoticon smoothed language models for twitter sentiment analysis. In AAAI.
20. Andrew L Maas, Raymond E Daly, Peter T Pham, Dan Huang, Andrew Y Ng, and Christopher Potts. 2011. Learning word vectors for sentiment analysis. In Proceedings of the 49th AnnualMeeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, pages 142-150.
21. Tomas Mikolov, Martin Karafiát, Lukas Burget, Jan Cernocky;, and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In INTERSPEECH, pages 1045-1048.
22. Preslav Nakov, Zornitsa Kozareva, Alan Ritter, Sara Rosenthal, Veselin Stoyanov, and Theresa Wilson. 2013. Semeval-2013 task 2: Sentiment analysis in twitter. In Proceedings of the International Workshop on Semantic Evaluation, SemEval, volume 13.
23. Bo Pang, Lillian Lee, and Shivakumar Vaithyanathan. 2002. Thumbs up?: sentiment classification using machine learning techniques. In Proceedings of the ACL-02 conference on Empirical methods in natural language processing-Volume 10, pages 79-86. Association for Computational Linguistics.
24. Razvan Pascanu, Tomas Mikolov, and Yoshua Bengio. 2013. On the difficulty of training recurrent neural networks. In Proceedings of The 30th International Conference on Machine Learning, pages 1310-1318.
25. Hassan Saif, Yulan He, and Harith Alani. 2012a. Alleviating data sparsity for twitter sentiment analysis. Making Sense of Microposts (# MSM2012).
26. Hassan Saif, Yulan He, and Harith Alani. 2012b. Semantic sentiment analysis of twitter. In The Semantic Web-ISWC 2012, pages 508-524. Springer.
27. Richard Socher, Jeffrey Pennington, Eric H Huang, Andrew Y Ng, and Christopher D Manning. 2011. Semi-supervised recursive autoencoders for predicting sentiment distributions. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 151-161. Association for Computational Linguistics.
28. Richard Socher, Alex Perelygin, Jean Y Wu, Jason Chuang, Christopher D Manning, Andrew Y Ng, and Christopher Potts. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1631-1642.
29. Michael Speriosu, Nikita Sudan, Sid Upadhyay, and Jason Baldridge. 2011. Twitter polarity classification with label propagation over lexical links and the follower graph. In Proceedings of the First workshop on Unsupervised Learning in NLP, pages 53-63. Association for Computational Linguistics.
30. Kai Sheng Tai, Richard Socher, and Christopher D. Manning. 2015. Improved semantic representations from tree-structured long short-Term memory networks. arXiv preprint arXiv:1503.00075.
31. Chenhao Tan, Lillian Lee, Jie Tang, Long Jiang, Ming Zhou, and Ping Li. 2011. User-level sentiment analysis incorporating social networks. In Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 1397-1405. ACM.
32. Duyu Tang, Furu Wei, Nan Yang, Ming Zhou, Ting Liu, and Bing Qin. 2014. Learning sentimentspecific word embedding for twitter sentiment classification. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, pages 1555-1565.
33. Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: a simple and general method for semi-supervised learning. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 384-394. Association for Computational Linguistics.
34. Svitlana Volkova, Theresa Wilson, and David Yarowsky. 2013. Exploring sentiment in social media: Bootstrapping subjectivity clues from multilingual twitter streams. In Association for Computational Linguistics (ACL).
35. Paul J Werbos. 1990. Backpropagation through time: what it does and how to do it. Proceedings of the IEEE, 78(10):1550-1560.
36. Ainur Yessenalina and Claire Cardie. 2011. Compositional matrix-space models for sentiment analysis. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 172-182. Association for Computational Linguistics.
37. Xingxing Zhang and Mirella Lapata. 2014. Chinese poetry generation with recurrent neural networks. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 670-680.