Aspect extraction for opinion mining with a deep convolutional neural network

Knowledge-Based Systems

Volumn 108, Issue , 2016, Pages 42-49

  Poria, Soujanya ^a   Cambria, Erik ^b   Gelbukh, Alexander ^c  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c INSTITUTO POLITÉCNICO NACIONAL   (Mexico)

Author keywords

Aspect extraction; CNN; DNN; Opinion mining; RBM; Sentiment analysis

Indexed keywords

CONVOLUTION; EXTRACTION; NEURAL NETWORKS;

CONVOLUTIONAL NEURAL NETWORK; DEEP LEARNING; ENSEMBLE CLASSIFIERS; LINGUISTIC PATTERNS; OPINION MINING; OPINION TARGETS; SENTIMENT ANALYSIS; STATE-OF-THE-ART METHODS;

DATA MINING;

EID: 84981713239     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2016.06.009     Document Type: Article

References (41)

1. [1] Cambria, E., Affective computing and sentiment analysis. IEEE Intell. Syst. 31:2 (2016), 102–107.
2. [2] Cambria, E., Wang, H., White, B., Guest editorial: Big social data analysis. Knowl.-Based Syst. 69 (2014), 1–2.
3. [3] Cambria, E., Schuller, B., Liu, B., Wang, H., Havasi, C., Statistical approaches to concept-level sentiment analysis. IEEE Intell. Syst. 28:3 (2013), 6–9.
4. [4] Hu, M., Liu, B., Mining and summarizing customer reviews. Proceedings of ACM SIGKDD Conference on Knowledge Discovery & Data Mining. Seattle, 2004, 168–177.
5. [5] Ding, X., Liu, B., Yu, P.S., A holistic lexicon-based approach to opinion mining. Proceedings of First ACM International Conference on Web Search and Data Mining (WSDM-2008), 2008, Stanford University, Stanford, California, USA, 231–240.
6. [6] Jakob, N., Gurevych, I., Extracting opinion targets in a single- and cross-domain setting with conditional random fields. Proceedings of EMNLP-2010, 2010, ACL, 1035–1045.
7. [7] Zhiqiang, T., Wenting, W., DLIREC: Aspect term extraction and term polarity classification system. Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), 2014, 235–240.
8. [8] Poria, S., Cambria, E., Gelbukh, A., Bisio, F., Hussain, A., Sentiment data flow analysis by means of dynamic linguistic patterns. IEEE Comput. Intell. Mag. 10:4 (2015), 26–36.
9. [9] Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P., Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12 (2011), 2493–2537.
10. [10] Popescu, A.-M., Etzioni, O., Extracting product features and opinions from reviews. Proceedings of EMNLP-2005, 2005, 3–28.
11. [11] Blair-Goldensohn, S., Hannan, K., McDonald, R., Neylon, T., Reis, G.A., Reynar, J., Building a sentiment summarizer for local service reviews. Proceedings of WWW-2008 workshop on NLP in the Information Explosion Era, 2008, 14–23.
12. [12] Scaffidi, C., Bierhoff, K., Chang, E., Felker, M., Ng, H., Jin, C., Red Opal: Product-feature scoring from reviews. Proceedings of the 8th ACM Conference on Electronic Commerce, 2007, ACM, 182–191.
13. [13] Hu, Y., Boyd-Graber, J., Satinoff, B., Smith, A., Interactive topic modeling. Mach. Learn. 95:3 (2014), 423–469.
14. [14] Chen, Z., Liu, B., Mining topics in documents: standing on the shoulders of big data. Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2014, ACM, 1116–1125.
15. [15] Hofmann, T., Probabilistic latent semantic indexing. Proceedings of 22nd ACM SIGIR Conference on Research and Development in Information Retrieval, 1999, ACM, 50–57.
16. [16] Blei, D.M., Ng, A.Y., Jordan, M.I., Latent Dirichlet allocation. J. Mach. Learn. Res. 3 (2003), 993–1022.
17. [17] Rill, S., Reinel, D., Scheidt, J., Zicari, R., Politwi: Early detection of emerging political topics on twitter and the impact on concept-level sentiment analysis. Knowl.-Based Syst. 69 (2014), 14–23.
18. [18] Titov, I., McDonald, R., Modeling online reviews with multi-grain topic models. Proceedings of 17th Conference on World Wide Web, 2008, ACM, 111–120.
19. [19] Branavan, S., Chen, H., Eisenstein, J., Barzilay, R., Learning document-level semantic properties from free-text annotations. J. Artif. Intell. Res., 34(2), 2009, 569.
20. [20] Wang, H., Lu, Y., Zhai, C., Latent aspect rating analysis on review text data: a rating regression approach. Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2010, ACM, 783–792.
21. [21] Lu, Y., Zhai, C., Sundaresan, N., Rated aspect summarization of short comments. Proceedings of 18th World Wide Web Conference, 2009, ACM, 131–140.
22. [22] Zhao, W.X., Jiang, J., Yan, H., Li, X., Jointly modeling aspects and opinions with a MaxEnt-LDA hybrid. Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, 2010, Association for Computational Linguistics, 56–65.
23. [23] Mcauliffe, J.D., Blei, D.M., Supervised topic models. Advances in Neural Information Processing Systems, 2008, 121–128.
24. [24] Lu, Y., Zhai, C., Opinion integration through semi-supervised topic modeling. Proceedings of the 17th International Conference on World Wide Web, 2008, ACM, 121–130.
25. [25] Andrzejewski, D., Zhu, X., Craven, M., Incorporating domain knowledge into topic modeling via Dirichlet forest priors. Proceedings of the 26th Annual International Conference on Machine Learning, 2009, ACM, 25–32.
26. [26] Poria, S., Chaturvedi, I., Cambria, E., Bisio, F., Sentic LDA: Improving on LDA with semantic similarity for aspect-based sentiment analysis. IJCNN, 2016.
27. [27] Cambria, E., Hussain, A., Havasi, C., Eckl, C., Common sense computing: From the society of mind to digital intuition and beyond. Fierrez, J., Ortega, J., Esposito, A., Drygajlo, A., Faundez-Zanuy, M., (eds.) Biometric ID Management and Multimodal Communication Lecture Notes in Computer Science, 5707, 2009, Springer, Berlin Heidelberg, 252–259.
28. [28] Wang, T., Cai, Y., Leung, H.-f., Lau, R.Y., Li, Q., Min, H., Product aspect extraction supervised with online domain knowledge. Knowl.-Based Syst. 71 (2014), 86–100.
29. [29] Jagarlamudi, J., Daumé III, H., Udupa, R., Incorporating lexical priors into topic models. Proceedings of the 13th EACL Conference, 2012, Association for Computational Linguistics, 204–213.
30. [30] Mukherjee, A., Liu, B., Aspect extraction through semi-supervised modeling. Proceedings of 50th Annual Meeting of the ACL: Long Papers, Volume 1, 2012, ACL, 339–348.
31. [31] Poria, S., Cambria, E., Gelbukh, A., Deep convolutional neural network textual features and multiple kernel learning for utterance-level multimodal sentiment analysis. EMNLP, 2015, 2539–2544.
32. [32] Hinton, G.E., Training products of experts by minimizing contrastive divergence. Neural Comput. 14:8 (2002), 1771–1800.
33. [33] Taylor, G.W., Hinton, G.E., Roweis, S.T., Modeling human motion using binary latent variables. Advances in Neural Information Processing Systems, 19, 2007, MIT Press, 1345–1352.
34. [34] Fonseca, E.R., Rosa, J.L.G., A two-step convolutional neural network approach for semantic role labeling. The 2013 International Joint Conference on Neural Networks (IJCNN), 2013, IEEE, Dallas, TX, 1–7.
35. [35] Mikolov, T., Yih, W.-t., Zweig, G., Linguistic regularities in continuous space word representations. HLT-NAACL, 2013, 746–751.
36. [36] McAuley, J., Leskovec, J., Hidden factors and hidden topics: Understanding rating dimensions with review text. Proceedings of RecSys’13. Hong Kong, China, 2013.
37. [37] Qiu, G., Liu, B., Bu, J., Chen, C., Opinion word expansion and target extraction through double propagation. Comput. Linguist. 37:1 (2011), 9–27.
38. [38] Cambria, E., Olsher, D., Rajagopal, D., SenticNet 3: a common and common-sense knowledge base for cognition-driven sentiment analysis. AAAI. Quebec City, 2014, 1515–1521.
39. [39] Poria, S., Gelbukh, A., Cambria, E., Yang, P., Hussain, A., Durrani, T., Merging senticnet and wordnet-affect emotion lists for sentiment analysis. Signal Processing (ICSP), 2012 IEEE 11th International Conference on, vol. 2, 2012, IEEE, 1251–1255.
40. [40] Poria, S., Gelbukh, A., Cambria, E., Das, D., Bandyopadhyay, S., Enriching SenticNet polarity scores through semi-supervised fuzzy clustering. IEEE ICDM. Brussels, 2012, 709–716.
41. [41] Cambria, E., Hussain, A., Sentic Computing: A Common-Sense-Based Framework for Concept-Level Sentiment Analysis. 2015, Springer, Cham, Switzerland.