Document-level sentiment classification: An empirical comparison between SVM and ANN

Expert Systems with Applications

Volumn 40, Issue 2, 2013, Pages 621-633

  Moraes, Rodrigo ^a   Valiati, João Francisco ^a   Gavião Neto, Wilson P ^a  

^a UNIVERSIDADE DO VALE DO RIO DOS SINOS   (Brazil)

Author keywords

Artificial Neural Networks; Comparative study; Opinion mining; Sentiment classification; Support Vector Machines; Text classification

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA MINING; INFORMATION RETRIEVAL; INFORMATION RETRIEVAL SYSTEMS; NEURAL NETWORKS; SENTIMENT ANALYSIS; SUPERVISED LEARNING; TEXT PROCESSING;

CLASSIFICATION ACCURACY; COMPARATIVE STUDIES; EMPIRICAL - COMPARISONS; FEATURE SELECTION AND WEIGHTING; SENTIMENT CLASSIFICATION; STANDARD EVALUATIONS; STATISTICALLY SIGNIFICANT DIFFERENCE; TEXT CLASSIFICATION;

SUPPORT VECTOR MACHINES;

EID: 84867689553     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2012.07.059     Document Type: Article

References (66)

1. A. Abbasi Intelligent feature selection for opinion classification IEEE Intelligent Systems 25 2010 75 79
2. A. Abbasi, H. Chen, and A. Salem Sentiment analysis in multiple languages: Feature selection for opinion classification in web forums ACM Transactions on Information Systems 26 2008 12:1 12:34
3. A. Abbasi, S. France, Z. Zhang, and H. Chen Selecting attributes for sentiment classification using feature relation networks IEEE Transactions on Knowledge and Data Engineering 23 2011 447 462
4. E. Alpaydin Introduction to machine learning 2004 Mit Press Cambridge, Mass
5. Atakulreka, A.; & Sutivong, D. (2007). Avoiding local minima in feedforward neural networks by simultaneous learning. In Proceedings of the Australian joint conference on advances in artificial intelligence (pp. 100-109).
6. A.E.S. Baccianella, and F. Sebastiani Sentiwordnet 3.0: An enhanced lexical resource for sentiment analysis and opinion mining Proceedings of the 7th conference on international language resources and evaluation (LREC'10) 2010 European Language Resources Association (ELRA) Valletta, Malta
7. X. Bai Predicting consumer sentiments from online text Decision Support Systems 50 2011 732 742
8. A. Ben-Hur, and J. Weston A user's guide to support vector machines data mining techniques for the life sciences Methods in molecular biology (Clifton, N.J.) 609 2010 223 239
9. M.W. Berry, and J. Kogan Text mining: Applications and theory 2010 Wiley Chichester, UK
10. Bespalov, D.; Bai, B.; Qi, Y.; & Shokoufandeh, A. (2011). Sentiment classification based on supervised latent n-gram analysis. In Proceedings of the 20th ACM international conference on information and knowledge management (pp. 375-382).
11. C.M. Bishop Pattern recognition and machine learning 2nd ed. 2007 Springer
12. C.J.C. Burges A tutorial on support vector machines for pattern recognition Data Mining and Knowledge Discovery 2 1998 121 167
13. N. Burns, Y. Bi, H. Wang, and T. Anderson Sentiment analysis of customer reviews: Balanced versus unbalanced datasets Knowledge-based and intelligent information and engineering systems Lecture notes in computer science Vol. 6881 2011 Springer Berlin/ Heidelberg 161 170
14. C.-C. Chang, and C.-J. Lin LIBSVM: A library for support vector machines ACM Transactions on Intelligent Systems and Technology 2 2011 27:1 27:27
15. L.-S. Chen, C.-H. Liu, and H.-J. Chiu A neural network based approach for sentiment classification in the blogosphere Journal of Informetrics 5 2011 313 322
16. Claster, W.; Hung, D.Q.; & Shanmuganathan, S. (2010). Unsupervised artificial neural nets for modeling movie sentiment. In International conference on computational intelligence, communication systems and networks (pp. 349-354).
17. F. Colas, P. Paclík, J.N. Kok, and P. Brazdil Does SVM really scale up to large bag of words feature spaces? Proceedings of the 7th international conference on Intelligent data analysis 2007 Springer-Verlag Berlin, Heidelberg 296 307
18. N. Cristianini, and J. Shawe-Taylor An introduction to support vector machines and other Kernel-based learning methods 1st ed. 2000 Cambridge University Press
19. Y. Dang, Y. Zhang, and H. Chen A lexicon-enhanced method for sentiment classification: An experiment on online product reviews IEEE Intelligent Systems 25 2010 46 53
20. M. Fodslette, and Mnller A scaled conjugate gradient algorithm for fast supervised learning Neural Networks 6 1993 525 533
21. G. Forman An extensive empirical study of feature selection metrics for text classification Journal of Machine Learning Research 3 2003 1289 1305
22. E. Gabrilovich, and S. Markovitch Text categorization with many redundant features: Using aggressive feature selection to make svms competitive with c4.5 Proceedings of the 21st international conference on machine learning 2004 Morgan Kaufman Banff, Alberta, Canada 321 328
23. Glorot, X.; Bordes, A.; & Bengio, Y. (2011). Domain adaptation for large-scale sentiment classification: A deep learning approach. In Proceedings of the international conference on machine learning (pp. 513-520).
24. T. Hastie, R. Tibshirani, and J. Friedman The Elements of Statistical Learning 2001 Springer New York Inc New York, NY, USA
25. Hatzivassiloglou, V.; & McKeown, K. (1997). Predicting the semantic orientation of adjectives (pp. 174-181).
26. S. Haykin Neural networks: A comprehensive foundation 2nd ed. 1998 Prentice Hall Upper Saddle River, NJ
27. He, Y.; Lin, C.; & Alani, H. (2011). Automatically extracting polarity-bearing topics for cross-domain sentiment classification. In Proceedings of annual meeting of the association for computational linguistics (pp. 123-131).
28. G. Horváth Neural networks in measurement systems (an engineering view) J. Suykens, G. Horváth, S. Basu, C. Micchelli, J. Vandewalle, Advances in learning theory: Methods, models and applications NATO science series. Series III: Computer and systems sciences Vol. 190 2003 IOS Press Amsterdam 375 402 chap. 18
29. T.M. Huang, V. Kecman, and I. Kopriva Kernel based algorithms for mining huge data sets: Supervised, semi-supervised, and unsupervised learning Studies in computational intelligence Vol. 17 2006 Springer Secaucus, NJ, USA
30. Joachims, T. (1998). Text categorization with suport vector machines: Learning with many relevant features. In Proceedings of the 10th European conference on machine learning (pp. 137-142).
31. Li, S.; Wang, Z.; Zhou, G.; & Lee, S.Y.M. (2011a). Semi-supervised learning for imbalanced sentiment classification. In Proceedings of international joint conference on artificial intelligence (pp. 1826-1831).
32. Li, S.; Xia, R.; Zong, C.; & Huang, C.-R. (2009). A framework of feature selection methods for text categorization. In Proceedings of the 47th annual meeting of the ACL (pp. 692-700).
33. Li, S.; Zhou, G.; Wang, Z.; Lee, S.Y.M.; & Wang, R. (2011b). Imbalanced sentiment classification. In Proceedings of ACM international conference on information and knowledge management (pp. 2469-2472).
34. Lin, C.; & He, Y. (2009). Joint sentiment/topic model for sentiment analysis. In Proceedings of the 18th ACM conference on information and knowledge management (pp. 375-384).
35. B. Liu Web data mining: Exploring hyperlinks 2nd ed. 2011 Springer New York
36. J.B. Lovins Development of a stemming algorithm Mechanical Translation and Computational Linguistic 1968 22 31
37. C.D. Manning, P. Raghavan, and H. Schtze Introduction to information retrieval 2008 Cambridge University Press New York, NY, USA
38. McCallum, A.; & Nigam, K. (1998). A comparison of event models for naive Bayes text classification. In Proceedings of the AAAI-98 workshop on learning for text categorization (pp. 41-48).
39. O'Keefe, T.; & Koprinska, I. (2009). Feature selection and weighting methods in sentiment analysis. In Proceedings of the Australasian document computing symposium (pp. 67-74).
40. Paltoglou, G.; & Thelwall, M. (2010). A study of information retrieval weighting schemes for sentiment analysis (pp. 1386-1395).
41. Pang, B.; & Lee, L. (2004). A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. In Proceedings of the association for computational linguistics (pp. 271-278).
42. B. Pang, and L. Lee Opinion mining and sentiment analysis Foundations and Trends in Information Retrieval 2 2008 1 135
43. Pang, B.; Lee, L.; & Vaithyanathan, S. (2002). Thumbs up? Sentiment classification using machine learning techniques. In Proceedings of the 2002 conference on empirical methods in natural language processing (pp. 79-86).
44. M. Porter An algorithm for suffix stripping Program 14 1980 130 137
45. Porter, M. (2001). Snowball: A language for stemming algorithms.
46. R. Prabowo, and M. Thelwall Sentiment analysis: A combined approach Journal of Informetrics 3 2009 143 157
47. Raychev, V.; & Nakov, P. (2009). Language-independent sentiment analysis using subjectivity and positional information. In Proceedings of the international conference RANLP-2009 (pp. 360-364).
48. Riloff, E.; Patwardhan, S.; & Wiebe, J. (2006). Feature subsumption for opinion analysis. In Proceedings of the conference on empirical methods in natural language processing (pp. 440-448).
49. E. Romero, and D. Toppo Comparing support vector machines and feedforward neural networks with similar hidden-layer weights IEEE Transactions on Neural Networks 18 2007 959 963
50. S.J. Russell, P. Norvig, and E. Davis Artificial intelligence: A modern approach 2010 Prentice Hall
51. J. Suykens, J. Vandewalle, and B.D. Moor Optimal control by least squares support vector machines Neural Networks 14 2001 23 35
52. Taira, H.; & Haruno, M. (1999). Feature selection in svm text categorization. In Proceedings of the AAAI conference on artificial intelligence (pp. 480-486).
53. H. Tang, S. Tan, and X. Cheng A survey on sentiment detection of reviews Expert Systems with Application 36 2009 10760 10773
54. M. Tsytsarau, and T. Palpanas Survey on mining subjective data on the web Data Mining and Knowledge Discovery 24 2012 478 514
55. P.D. Turney Thumbs up or thumbs down?: Semantic orientation applied to unsupervised classification of reviews Proceedings of the 40th annual meeting on association for computational linguistics ACL '02 2002 Association for Computational Linguistics Stroudsburg, PA, USA 417 424
56. Van Hulse, J.; Khoshgoftaar, T.M.; & Napolitano, A. (2007). Experimental perspectives on learning from imbalanced data. In Proceedings of the international conference on machine learning (pp. 935-942).
57. Wang, Z.; Li, S.; Zhou, G.; Li, P.; & Zhu, Q. (2011). Imbalanced sentiment classification with multi strategy ensemble learning. In Proceedings of international conference on Asian language processing (pp. 131-134).
58. S.M. Weiss, N. Indurkhya, and T. Zhang Text mining 1st ed. Predictive methods for analyzing unstructured information 2004 Springer Berlin
59. S.M. Weiss, N. Indurkhya, and T. Zhang Fundamentals of predictive text mining 2010 Springer-Verlag London; New York
60. Whitelaw, C.; Garg, N.; & Argamon, S. (2005). Using appraisal groups for sentiment analysis. In Proceedings of the 14th ACM international conference on information and knowledge management (pp. 625-631).
61. Xia, R.; & Zong, C. (2010). Exploring the use of word relation features for sentiment classification. In Proceedings of the international conference on computational linguistics (pp. 1336-1344).
62. R. Xia, C. Zong, and S. Li Ensemble of feature sets and classification algorithms for sentiment classification Information Sciences 181 2011 1138 1152
63. Y. Yang, and J.O. Pedersen A comparative study on feature selection in text categorization Proceedings of the 14th international conference on machine learning ICML '97 1997 Morgan Kaufman San Francisco, CA, USA 412 420
64. Q. Ye, Z. Zhang, and R. Law Sentiment classification of online reviews to travel destinations by supervised machine learning approaches Expert Systems with Application 36 2009 6527 6535
65. Zaidan, O.F.; Eisner, J.; & Piatko, C. (2007). Using "annotator rationales" to improve machine learning for text categorization. In Proceedings of the association for computational linguistics (pp. 260-267).
66. J. Zhu, C. XU, and H. shi Wang Sentiment classification using the theory of anns The Journal of China Universities of Posts and Telecommunications 17 2010 58 62