Attention-based LSTM for aspect-level sentiment classification

EMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings

Volumn , Issue , 2016, Pages 606-615

  Wang, Yequan ^a   Huang, Minlie ^a   Zhao, Li ^a,b   Zhu, Xiaoyan ^a  

^a TSINGHUA UNIVERSITY   (China)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); SENTIMENT ANALYSIS;

ATTENTION MECHANISMS; FINE GRAINED; SENTIMENT CLASSIFICATION; SHORT TERM MEMORY; STATE-OF-THE-ART PERFORMANCE;

LONG SHORT-TERM MEMORY;

EID: 85072824815     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/d16-1058     Document Type: Conference Paper

References (31)

1. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv_preprint arXiv:1409.0473.
2. Frédéric Bastien, Pascal Lamblin, Razvan Pascanu, James Bergstra, Ian Goodfellow, Arnaud Bergeron, Nicolas Bouchard, David Warde-Farley, and Yoshua Bengio. 2012. Theano: new features and speed improvements. arXiv_preprint_arXiv:1211.5590.
3. Jeffrey Dean, Greg Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Mark Mao, Andrew Senior, Paul Tucker, Ke Yang, Quoc V Le, et al. 2012. Large scale distributed deep networks. In Advances_in_Neural Information_Processing_Systems, pages 1223-1231.
4. Wankun Deng, Yongbo Wang, Zexian Liu, Han Cheng, and Yu Xue. 2014. Hemi: a toolkit for illustrating heatmaps. PloS_one, 9(11):e111988.
5. Li Dong, Furu Wei, Chuanqi Tan, Duyu Tang, Ming Zhou, and Ke Xu. 2014. Adaptive recursive neural network for target-dependent twitter sentiment classification. In ACL_(2), pages 49-54.
6. John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive subgradient methods for online learning and stochastic optimization. The_Journal_of_Machine Learning_Research, 12:2121-2159.
7. David Golub and Xiaodong He. 2016. Character-level question answering with attention. arXiv_preprint arXiv:1604.00727.
8. Karl Moritz Hermann, Tomas Kocisky, Edward Grefenstette, Lasse Espeholt, Will Kay, Mustafa Suleyman, and Phil Blunsom. 2015. Teaching machines to read and comprehend. In Advances_in_Neural_Information Processing_Systems, pages 1684-1692.
9. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural_computation, 9(8):1735-1780.
10. Nobuhiro Kaji and Masaru Kitsuregawa. 2007. Building lexicon for sentiment analysis from massive collection of html documents. In EMNLP-CoNLL, pages 1075-1083.
11. Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, and Chris Dyer. 2016. Neural architectures for named entity recognition. arXiv_preprint_arXiv:1603.01360.
12. Bing Liu. 2012. Sentiment analysis and opinion mining. Synthesis_lectures_on_human_language_technologies, 5(1):1-167.
13. Tomas Mikolov, Martin Karafiát, Lukas Burget, Jan Cernocky, ` and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In INTERSPEECH, volume 2, page 3.
14. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances_in_Neural_Information_Processing Systems, pages 3111- 3119.
15. Volodymyr Mnih, Nicolas Heess, Alex Graves, et al. 2014. Recurrent models of visual attention. In Advances_in_Neural_Information_Processing_Systems, pages 2204-2212.
16. Saif M Mohammad, Svetlana Kiritchenko, and Xiaodan Zhu. 2013. Nrc-canada: Building the state-of-the-art in sentiment analysis of tweets. arXiv_preprint arXiv:1308.6242.
17. Tony Mullen and Nigel Collier. 2004. Sentiment analysis using support vector machines with diverse information sources. In EMNLP, volume 4, pages 412-418.
18. Tetsuya Nasukawa and Jeonghee Yi. 2003. Sentiment analysis: Capturing favorability using natural language processing. In Proceedings_of_the_2nd international_conference_on_Knowledge_capture, pages 70-77. ACM.
19. Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. Proceedings_of_the_Empiricial_Methods in_Natural_Language_Processing_(EMNLP_2014), 12:1532-1543.
20. Veronica Perez-Rosas, Carmen Banea, and Rada Mihalcea. 2012. Learning sentiment lexicons in spanish. In LREC, volume 12, page 73.
21. Maria Pontiki, Dimitris Galanis, John Pavlopoulos, Harris Papageorgiou, Ion Androutsopoulos, and Suresh Manandhar. 2014. Semeval-2014 task 4: Aspect based sentiment analysis. In Proceedings_of_the 8th_international_workshop_on_semantic_evaluation (SemEval_2014), pages 27-35.
22. Qiao Qian, Bo Tian, Minlie Huang, Yang Liu, Xuan Zhu, and Xiaoyan Zhu. 2015. Learning tag embeddings and tag-specific composition functions in recursive neural network. In Proceedings_of_the_53rd Annual_Meeting_of_the_Association_for_Computational Linguistics_and_the_7th_International_Joint_Conference on_Natural_Language_Processing, volume 1, pages 1365-1374.
23. Delip Rao and Deepak Ravichandran. 2009. Semi-supervised polarity lexicon induction. In Proceedings of_the_12th_Conference_of_the_European_Chapter_of the_Association_for_Computational_Linguistics, pages 675-682. Association for Computational Linguistics.
24. Tim Rocktäschel, Edward Grefenstette, Karl Moritz Hermann, Tomáš Kocisky, ` and Phil Blunsom. 2015. Reasoning about entailment with neural attention. arXiv preprint_arXiv:1509.06664.
25. Alexander M Rush, Sumit Chopra, and Jason Weston. 2015. A neural attention model for abstractive sentence summarization. arXiv_preprint arXiv:1509.00685.
26. Richard Socher, Jeffrey Pennington, Eric H Huang, Andrew Y Ng, and Christopher D Manning. 2011. Semi-supervised recursive autoencoders for predicting sentiment distributions. In Proceedings_of the_Conference_on_Empirical_Methods_in_Natural Language_Processing, pages 151-161. Association for Computational Linguistics.
27. Richard Socher, Alex Perelygin, Jean Y Wu, Jason Chuang, Christopher D Manning, Andrew Y Ng, and Christopher Potts. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In EMNLP, volume 1631, page 1642. Citeseer.
28. Kai Sheng Tai, Richard Socher, and Christopher D Manning. 2015. Improved semantic representations from tree-structured long short-term memory networks. arXiv_preprint_arXiv:1503.00075.
29. Duyu Tang, Bing Qin, Xiaocheng Feng, and Ting Liu. 2015a. Target-dependent sentiment classification with long short term memory. arXiv_preprint arXiv:1512.01100.
30. Duyu Tang, Bing Qin, and Ting Liu. 2015b. Document modeling with gated recurrent neural network for sentiment classification. In Proceedings_of_the 2015_Conference_on_Empirical_Methods_in_Natural Language_Processing, pages 1422-1432.
31. Wenpeng Yin, Hinrich Schütze, Bing Xiang, and Bowen Zhou. 2015. Abcnn: Attention-based convolutional neural network for modeling sentence pairs. arXiv preprint_arXiv:1512.05193.