On developing robust models for favourability analysis: Model choice, feature sets and imbalanced data

Decision Support Systems

Volumn 53, Issue 4, 2012, Pages 712-718

  Lane, Peter C R ^a   Clarke, Daoud ^a,b   Hender, Paul ^b  

^a UNIVERSITY OF HERTFORDSHIRE   (United Kingdom)

^b Metrica   (United Kingdom)

Author keywords

Bayesian models; Favourability analysis; Imbalanced data; Machine learning; Sentiment analysis; Support vector machines

Indexed keywords

BAYESIAN MODEL; CLASSIFICATION PROCESS; DATA SETS; FAVOURABILITY ANALYSIS; FEATURE SETS; IMBALANCED DATA; INPUT DATAS; MACHINE-LEARNING; MODEL CHOICE; OPINION MINING; ROBUST MODELS; SENTIMENT ANALYSIS; TIME-PERIODS; TRAINING STRATEGY; UNDER-SAMPLING;

BAYESIAN NETWORKS; DATA MINING;

LEARNING SYSTEMS;

EID: 84865482239     PISSN: 01679236     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dss.2012.05.028     Document Type: Conference Paper

References (39)

1. R. Akbani, S. Kwek, and N. Japkowicz Applying support-vector machines to imbalanced datasets J.-F. Boulicaut, F. Esposito, F. Giannotti, D. Pedreschi, Machine Learning: ECML 2004 Lecture Notes in Computer Science vol. 3201 2004 39 50
2. A. Balahur, R. Steinberger, M. Kabadjov, V. Zavarella, E. Van Der Goot, M. Halkia, B. Pouliquen, and J. Belyaeva Sentiment analysis in the news Proceedings of the Seventh International Conference on Language Resources and Evaluation 2010 2216 2220
3. A. Balahur, J.M. Hermida, and A. Montoyo Detecting implicit expressions of sentiment in text based on commonsense knowledge A. Balahur, E. Boldrini, A. Montoyo, P. Martinez-Barco, Proceedings of the Second Workshop on Computational Approaches to Subjectivity and Sentiment Analysis (WASSA 2.011) 2011 Association for Computational Linguistics Portland, Oregon 53 60
4. J.P. Bao, C.M. Lyon, and P.C.R. Lane A text annotation method based on semantic sequence Proceedings of the Seventh International Workshop on Computational Semantics 2007
5. A.L. Blum, and P. Langley Selection of relevant features and examples in machine learning Artificial Intelligence 97 1997 245 271
6. N.V. Chawla, N. Japkowicz, and A. Kotcz Editorial: special issue on learning from imbalanced data sets ACM SIGKDD Explorations Newsletter 6 2004 1 6
7. D. Clarke, P.C.R. Lane, and P. Hender Developing robust models for favourability analysis A. Balahur, E. Boldrini, A. Montoyo, P. Martinez-Barco, Proceedings of the Second Workshop on Computational Approaches to Subjectivity and Sentiment Analysis (WASSA 2.011) 2011 Association for Computational Linguistics Portland, Oregon 44 52
8. M.-C. de Marneffe, B. MacCartney, and C.D. Manning Generating typed dependency parsers from phrase structure parses Proceedings of the Fifth International Conference on Language Resources and Evaluation 2006
9. G. Forman An extensive empirical study of feature selection metrics for text classification The Journal of Machine Learning Research 3 2003 1289 1305
10. M. Gamon, A. Aue, S. Corston-Oliver, and E. Ringger Pulse: mining customer opinions from free text Advances in Intelligent Data Analysis VI 2005 121 132
11. N. Godbole, M. Srinivasaiah, and S. Skiena Large-scale sentiment analysis for news and blogs Proceedings of the International Conference on Weblogs and Social Media (ICWSM) 2007
12. D. Gray, D. Bowes, N. Davey, Y. Sun, and B. Christianson Further thoughts on precision Proceedings of Evaluation and Assessment in Software Engineering 2011
13. P.D. Green, P.C.R. Lane, A.W. Rainer, and S. Scholz Selecting measures in origin analysis M. Bramer, M. Pehidis, A. Hopgood, Research and Development in Intelligent Systems XXVII: Proceedings of the Thirtieth SGAI International Conference on Artificial Intelligence 2011 Springer-Verlag 379 392
14. H. He, and E.A. Garcia Learning from imbalanced data IEEE Transactions on Knowledge and Data Engineering 21 2009 1263 1284
15. T. Joachims Text categorization with support vector machines: learning with many relevant features C. Nédellec, C. Rouveirol, Machine Learning: ECML-98 Lecture Notes in Computer Science vol. 1398 1998 Springer Berlin / Heidelberg 137 142
16. M. Koppel, and J. Schler The importance of neutral examples for learning sentiment Computational Intelligence 22 2006 100 109
17. K. Krippendorff Content Analysis: An Introduction to its Methodology 2004 Sage Publications, Inc.
18. M. Kubat, R.C. Holte, and S. Matwin Machine learning for the detection of oil spills in satellite radar images Machine Learning 30 1998 195 215
19. P.C.R. Lane, C.M. Lyon, and J.A. Malcolm Demonstration of the Ferret plagiarism detector Proceedings of the Second International Plagiarism Conference 2006
20. N. Li, and D.D. Wu Using text mining and sentiment analysis for online forums hotspot detection and forecast Decision Support Systems 48 2010 354 368
21. T. Li, V. Sindhwani, C. Ding, and Y. Zhang Knowledge transformation for cross-domain sentiment classification Proceedings of the Thirty-Second International ACM SIGIR Conference on Research and Development in Information Retrieval 2009 ACM 716 717
22. P. Melville, W. Gryc, and R.D. Lawrence Sentiment analysis of blogs by combining lexical knowledge with text classification Proceedings of the Fifteenth ACM SIGKDD international conference on Knowledge discovery and data mining, KDD '09, ACM 2009 1275 1284 New York, NY, USA
23. T. Mitchell Machine Learning 1997 McGraw-Hill New York
24. D. Mladenić Feature subset selection in text-learning C. Nédellec, C. Rouveirol, Machine Learning: ECML-98 Lecture Notes in Computer Science vol. 1398 1998 Springer Berlin / Heidelberg 95 100
25. T. Mullen, and N. Collier Sentiment analysis using support vector machines with diverse information sources Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing vol. 4 2004 412 418
26. B. Pang, and L. Lee Opinion mining and sentiment analysis Foundations and Trends in Information Retrieval 2 2008 1 135
27. B. Pang, L. Lee, and S. Vaithyanathan Thumbs up?: sentiment classification using machine learning techniques Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing vol. 10 2002 Association for Computational Linguistics 79 86
28. R. Prabowo, and M. Thelwall Sentiment analysis: a combined approach Journal of Informetrics 3 2009 143 157
29. F. Provost Machine learning from imbalanced data sets 101 AAAI Workshop on Learning from Imbalanced Data Sets 2000 AAAI Press
30. M. Rogati, and Y. Yang High-performing feature selection for text classification Proceedings of the Eleventh International Conference on Information and Knowledge Management 2002 ACM 659 661
31. A. Sun, E.-P. Ling, and Y. Lui On strategies for imbalanced text classification using SVM: a comparative study Decision Support Systems 48 2010 191 201
32. G. Tatzl, and C. Waldhauser Aggregating opinions: explorations into graphs and media content analysis TextGraphs-5 Workshop, ACL 2010 2010 93
33. P.D. Turney Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews Proceedings of the 40th Annual Meeting on Association for Computational Linguistics Association for Computational Linguistics 2002 417 424
34. J. van Hulse, T.M. Khoshgoftaar, and A. Napolitano Experimental perspectives on learning from imbalanced data Z. Ghahramani, Proceedings of the Twenty-Fourth International Conference on Machine Learning 2007 935 942
35. X. Wan Co-training for cross-lingual sentiment classification Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP vol. 1 2009 Association for Computational Linguistics 235 243
36. C.G. Weng, and J. Poon A new evaluation measure for imbalanced datasets Proceedings of the Seventh Australasian Data Mining Conference 2008
37. J. Wiebe, T. Wilson, R. Bruce, M. Bell, and M. Martin Learning subjective language. Computational linguistics 30 2004 277 308
38. I.H. Witten, and E. Frank Data Mining: Practical Machine Learning Tools and Techniques 2005 Morgan Kaufmann
39. Z. Zheng, X. Wu, and R. Srihari Feature selection for text categorization on imbalanced data ACM Sigkdd Explorations Newsletter: Special Issue on Learning from Imbalanced Datasets 6 2004 80 89