Active deep learning method for semi-supervised sentiment classification

Neurocomputing

Volumn 120, Issue , 2013, Pages 536-546

  Zhou, Shusen ^a   Chen, Qingcai ^b   Wang, Xiaolong ^b  

^a LUDONG UNIVERSITY   (China)

^b HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Active learning; Deep learning; Neural networks; Sentiment classification

Indexed keywords

ACTIVE LEARNING; DEEP LEARNING; EXPONENTIAL LOSS FUNCTION; INFORMATION DENSITY; NATURAL LANGUAGE PROCESSING; RESTRICTED BOLTZMANN MACHINE; SEMI-SUPERVISED LEARNING; SENTIMENT CLASSIFICATION;

LEARNING ALGORITHMS; NATURAL LANGUAGE PROCESSING SYSTEMS; NEURAL NETWORKS;

SUPERVISED LEARNING;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CLASSIFICATION ALGORITHM; COMPUTER NETWORK; CONCEPTUAL FRAMEWORK; LEARNING ALGORITHM; MACHINE LEARNING; MATHEMATICAL COMPUTING; NETWORK LEARNING; PRIORITY JOURNAL; RESTRICTED BOLTZMANN MACHINE; STRUCTURAL EQUATION MODELING;

EID: 84882929257     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.04.017     Document Type: Article

References (50)

1. B. Pang, L. Lee, S. Vaithyanathan, Thumbs up? Sentiment classification using machine learning techniques, in: Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Stroudsburg, PA, USA, 2002, pp. 79-86.
2. J. Blitzer, M. Dredze, F. Pereira, Biographies, bollywood, boom-boxes and blenders: domain adaptation for sentiment classification, in: Annual Meeting of the Association of Computational Linguistics, Association for Computational Linguistics, Prague, Czech Republic, 2007, pp. 440-447.
3. S. Dasgupta, V. Ng, Mine the easy, classify the hard: a semi-supervised approach to automatic sentiment classification, in: Joint Conference of the 47th Annual Meeting of the Association for Computational Linguistics and 4th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Association for Computational Linguistics, Stroudsburg, PA, USA, 2009, pp. 701-709.
4. S. Li, C.-R. Huang, G. Zhou, S.Y.M. Lee, Employing personal/impersonal views in supervised and semi-supervised sentiment classification, in: Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Uppsala, Sweden, 2010, pp. 414-423.
5. M. Gamon, Sentiment classification on customer feedback data: noisy data, large feature vectors, and the role of linguistic analysis, in: International Conference on Computational Linguistics, Association for Computational Linguistics, Switzerland, 2004, pp. 841-847.
6. T. Li, Y. Zhang, V. Sindhwani, A non-negative matrix tri-factorization approach to sentiment classification with lexical prior knowledge, in: Joint Conference of the 47th Annual Meeting of the Association for Computational Linguistics and 4th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Association for Computational Linguistics, Singapore, 2009, pp. 244-252.
7. R. Raina, A. Battle, H. Lee, B. Packer, A. Y. Ng, Self-taught learning: transfer learning from unlabeled data, in: International Conference on Machine learning, ACM, Corvallis, Oregon, USA, 2007, pp. 759-766.
8. X. Zhu, Semi-supervised Learning Literature Survey, Technical Report, University of Wisconsin Madison, Madison, WI, USA, 2007.
9. Wang M., Hua X.-S., Mei T., Hong R., Qi G., Song Y., Dai L.-R. Semi-supervised kernel density estimation for video annotation. Comput. Vis. Image Understanding 2009, 113:384-396.
10. Wang M., Hua X.-S., Hong R., Tang J., Qi G.-J., Song Y. Unified video annotation via multigraph learning. IEEE Trans. Circuits Syst. Video Technol. 2009, 19:733-746.
11. Zha Z., Mei T., Wang J., Wang Z., Hua X. Graph-based semi-supervised learning with multiple labels. J. Visual Commun. Image Representation 2009, 20:97-103.
12. Y. Bengio, Learning Deep Architectures for AI, Technical Report, IRO, Universite de Montreal, 2007.
13. Salakhutdinov R., Hinton G.E. Learning a nonlinear embedding by preserving class neighbourhood structure. J. Mach. Learn. Res. 2007, 2:412-419.
14. Hinton G.E., Salakhutdinov R. Reducing the dimensionality of data with neural networks. Science 2006, 313:504-507.
15. M. Ranzato, M. Szummer, Semi-supervised learning of compact document representations with deep networks, in: International Conference on Machine Learning, ACM, Helsinki, Finland, 2008, pp. 792-799.
16. Tong S., Koller D. Support vector machine active learning with applications to text classification. J. Mach. Learn. Res. 2002, 2:45-66.
17. Wang M., Hua X.-S. Active learning in multimedia annotation and retrieval: a survey. ACM Trans. Intell. Syst. Technol. 2011, 2:1-21.
18. Zheng-Jun Z., Meng W., Yan-Tao Z., Yi Y., Richang H., Tat-Seng C. Interactive video indexing with statistical active learning. IEEE Trans. Multimedia 2012, 14:17-27.
19. B. Settles, M. Craven, An analysis of active learning strategies for sequence labeling tasks, in: Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Stroudsburg, PA, USA, 2008, pp. 1070-1079.
20. G. Druck, B. Settles, A. McCallum, Active learning by labeling features, in: Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Singapore, 2009, pp. 81-90.
21. X. Zhu, J. Lafferty, Z. Ghahramani, Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions, in: ICML 2003 Workshop on the Continuum from Labeled to Unlabeled Data in Machine Learning and Data Mining, AAAI, Washington DC, USA, 2003, pp. 58-65.
22. S. Zhou, Q. Chen, X. Wang, Active deep networks for semi-supervised sentiment classification, in: International Conference on Computational Linguistics, Coling 2010 Organizing Committee, Beijing, China, 2010, pp. 1515-1523.
23. R. Socher, J. Pennington, E.H. Huang, A.Y. Ng, C.D. Manning, Semi-supervised recursive autoencoders for predicting sentiment distributions, in: Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Edinburgh, UK, 2011, pp. 151-161.
24. X. Wan, Co-training for cross-lingual sentiment classification, in: Joint Conference of the 47th Annual Meeting of the Association for Computational Linguistics and 4th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Association for Computational Linguistics, Stroudsburg, PA, USA, 2009, pp. 235-243.
25. B. Pang, L. Lee, Opinion mining and sentiment analysis, Found. Trends Inf. Retr. 2, 2008.
26. K. Dave, S. Lawrence, D.M. Pennock, Mining the peanut gallery: opinion extraction and semantic classification of product reviews, in: International Conference on World Wide Web, ACM, New York, NY, USA, 2003, pp. 519-528.
27. B. Pang, L. Lee, A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts, in: 42th Annual Meeting of the Association of Computational Linguistics, Association for Computational Linguistics, Barcelona, Spain, 2004, pp. 271-278.
28. T. Mullen, N. Collier, Sentiment analysis using support vector machines with diverse information sources, in: Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Barcelona, Spain, 2004, pp. 412-418.
29. V. Ng, S. Dasgupta, S.M.N. Arifin, Examining the role of linguistic knowledge sources in the automatic identification and classification of reviews, in: 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Sydney, Australia, 2006, pp. 611-618.
30. R. Mcdonald, K. Hannan, T. Neylon, M. Wells, J. Reynar, Structured models for fine-to-coarse sentiment analysis, in: Annual Meeting of the Association of Computational Linguistics, Association for Computational Linguistics, Prague, Czech Republic, 2007, pp. 432-439.
31. Y. Xia, L. Wang, K.-F. Wong, M. Xu, Lyric-based song sentiment classification with sentiment vector space model, in: Annual Meeting of the Association of Computational Linguistics, Association for Computational Linguistics, Columbus, Ohio, 2008, pp. 133-136.
32. S. Li, S.Y.M. Lee, Y. Chen, C.-R. Huang, G. Zhou, Sentiment classification and polarity shifting, in: International Conference on Computational Linguistics, Association for Computational Linguistics, Stroudsburg, PA, USA, 2010, pp. 635-643.
33. Y. Liu, X. Yu, X. Huang, A. An, S-PLASA+: adaptive sentiment analysis with application to sales performance prediction, in: International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, New York, NY, USA, 2010, pp. 873-874.
34. W. Wei, J.A. Gulla, Sentiment learning on product reviews via sentiment ontology tree, in: Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Stroudsburg, PA, USA, 2010, pp. 404-413.
35. A. Aue, M. Gamon, Customizing sentiment classifiers to new domains: a case study, in: International Conference on Recent Advances in Natural Language Processing, RANLP 2005 Organising Committee, Borovets, Bulgaria, 2005.
36. S. Tan, G. Wu, H. Tang, X. Cheng, A novel scheme for domain-transfer problem in the context of sentiment analysis, in: Conference on Information and Knowledge Management, ACM, New York, NY, USA, 2007, pp. 979-982.
37. S. Li, C. Zong, Multi-domain sentiment classification, in: 46th Annual Meeting of the Association of Computational Linguistics, Association for Computational Linguistics, Columbus, Ohio, 2008, pp. 257-260.
38. S.J. Pan, X. Ni, J.-T. Sun, Q. Yang, Z. Chen, Cross-domain sentiment classification via spectral feature alignment, in: International World Wide Web Conference, ACM, New York, NY, USA, 2010, pp. 751-760.
39. D. Bollegala, D. Weir, J. Carroll, Using multiple sources to construct a sentiment sensitive thesaurus for cross-domain sentiment classification, in: Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Portland, Oregon, USA, 2011, pp. 132-141.
40. Y. He, C. Lin, H. Alani, Automatically extracting polarity-bearing topics for cross-domain sentiment classification, in: Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Portland, Oregon, USA, 2011, pp. 123-131.
41. A.B. Goldberg, X. Zhu, Seeing stars when there aren't many stars: graph-based semi-supervised learning for sentiment categorization, in: Proceedings of TextGraphs: The First Workshop on Graph Based Methods for Natural Language Processing, Association for Computational Linguistics, Stroudsburg, PA, USA, 2006, pp. 45-52.
42. V. Sindhwani, P. Melville, Document-word co-regularization for semi-supervised sentiment analysis, in: International Conference on Data Mining, IEEE, Pisa, Italy, 2008, pp. 1025-1030.
43. T. Zagibalov, J. Carroll, Automatic seed word selection for unsupervised sentiment classification of Chinese text, in: International Conference on Computational Linguistics, Association for Computational Linguistics, Stroudsburg, PA, USA, 2008, pp. 1073-1080.
44. J. Read, Using emoticons to reduce dependency in machine learning techniques for sentiment classification, in: the Association of Computational Linguistics Student Research Workshop, Association for Computational Linguistics, Ann Arbor, Michigan, 2005, pp. 43-48.
45. B. Lu, C. Tan, C. Cardie, B.K. Tsou, Joint bilingual sentiment classification with unlabeled parallel corpora, in: Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Portland, Oregon, USA, 2011, pp. 320-330.
46. R. Salakhutdinov, I. Murray, On the quantitative analysis of deep belief networks, in: International Conference on Machine learning, ACM, Helsinki, Finland, 2008, pp. 872-879.
47. Hinton G.E. Training products of experts by minimizing contrastive divergence. Neural Comput. 2002, 14:1771-1800.
48. T. Joachims, Transductive inference for text classification using support vector machines, in: International Conference on Machine Learning, Morgan Kaufmann Publishers, Bled, Slovenia, 1999, pp. 200-209.
49. S. Kamvar, D. Klein, C. Manning, Spectral learning, in: International Joint Conferences on Artificial Intelligence, AAAI Press, Catalonia, Spain, 2003, pp. 561-566.
50. Liu Y., Zhou S., Chen Q. Discriminative deep belief networks for visual data classification. Pattern Recognition 2011, 44:2287-2296.