On strategies for imbalanced text classification using SVM: A comparative study

Decision Support Systems

Volumn 48, Issue 1, 2009, Pages 191-201

  Sun, Aixin ^a   Lim, Ee Peng ^b   Liu, Ying ^c  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b SINGAPORE MANAGEMENT UNIVERSITY   (Singapore)

^c HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Imbalanced text classification; Instance weighting; Resampling; Support Vector Machines; SVM

Indexed keywords

APPLICATION DEVELOPERS; BENCHMARK DATASETS; BEST DECISION; CLASSIFICATION ACCURACY; COMPARATIVE STUDIES; IMBALANCED CLASSIFICATION; IMBALANCED TEXT CLASSIFICATION; INSTANCE WEIGHTING; NEWSGROUPS; PERFORMANCE MEASURE; REAL-WORLD; RESAMPLING; REUTERS-21578; SVM; TEST PHASIS; TEXT CLASSIFICATION; THRESHOLDING; TRAINING EXAMPLE;

IMAGE RETRIEVAL; SUPPORT VECTOR MACHINES; TAXONOMIES;

TEXT PROCESSING;

EID: 70350565063     PISSN: 01679236     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dss.2009.07.011     Document Type: Article

References (37)

1. Akbani R., Kwek S., and Japkowicz N. Applying support vector machines to imbalanced datasets. Proc. of ECML'04 (Sep. 2004) 39-50 Pisa, Italy
2. Brank J., Grobelnik M., Milic-Frayling N., and Mladenic D. Training text classifiers with SVM on very few positive examples. Technical Report MSR-TR-2003-34, Microsoft Research (Apr. 2003)
3. Chau M., and Chen H. A machine learning approach to web page filtering using content and structure analysis. Decision Support Systems 44 2 (2008) 482-494
4. Chawla N.V., Bowyer K.W., Hall L.O., and Kegelmeyer W.P. SMOTE: synthetic minority over-sampling technique. Journal of Artificial Intelligence Research 16 (2002) 321-357
5. Chen C.-M., Lee H.-M., and Kao M.-T. Multi-class svm with negative data selection for web page classification. Proc. of IEEE Int'l Joint Conf. on Neural Networks vol. 3 (July 2004) 2047-2052 Budapest, Hungary
6. Combarro E.F., Montanes E., Diaz I., Ranilla J., and Mones R. Introducing a family of linear measures for feature selection in text categorization. IEEE Transactions on Knowledge and Data Engineering(TKDE) 17 9 (Sep. 2005) 1223-1232
7. Davis J., and Goadrich M. The relationship between precision-recall and ROC curves. Proc. of ICML'06 (June 2006), ACM Press, Pittsburgh, Pennsylvania 233-240
8. Dumais S.T., Platt J., Heckerman D., and Sahami M. Inductive learning algorithms and representations for text categorization. Proc. of ACM CIKM'98 (Nov. 1998) 148-155 Bethesda, Maryland
9. Fan W., Gordon M.D., and Pathak P. An integrated two-stage model for intelligent information routing. Decision Support Systems 42 1 (2006) 362-374
10. T. Fawcett. Roc graphs: Notes and practical considerations for data mining researchers. Technical Report HPL-2003-4, HP Laboratories, Jan. 2003. http://www.hpl.hp.com/techreports/2003/HPL-2003-4.html.
11. Fragoudis D., Meretakis D., and Likothanassis S. Integrating feature and instance selection for text classification. Proc. of ACM SIGKDD'02 (July 2002), Edmonton, Alberta, Canada 501-506
12. Japkowicz N., and Stephen S. The class imbalance problem: a systematic study. Intelligent Data Analysis 6 5 (2002) 429-449
13. Joachims T. Text categorization with support vector machines: learning with many relevant features. Proc. of ECML'98 (Apr. 1998) 137-142 Springer-Verlag
14. Joachims T. A support vector method for multivariate performance measures. Proc. of ICML'05 (Aug. 2005) 377-384 Bonn, Germany
15. Krebel U.H.-G. Pairwise classification and support vector machines. In: Schölkopf B., Burges C., and Smola A. (Eds). Advances in kernel methods: support vector learning (1999), MIT Press 255-268
16. Kubat M., and Matwin S. Addressing the curse of imbalanced training sets: one-sided selection. Proc. of ICML'97 (July 1997) 179-186
17. Leopold E., and Kindermann J. Text categorization with support vector machines how to represent texts in input space?. Machine Learning 46 1-3 (2002) 423-444
18. Liu H., and Motoda H. On issues of instance selection. Data Mining and Knowledge Discovery 6 (2002) 115-130
19. Liu X.-Y., Wu J., and Zhou Z.-H. Exploratory under-sampling for class-imbalance learning. Proc. of ICDM'06 (Dec. 2006) 965-969 Hong Kong, China
20. Liu Y., Loh H.T., and Sun A. Imbalanced text classification: a term weighting approach. Expert System with Applications 36 1 (2009) 690-701
21. Morik K., Brockhausen P., and Joachims T. Combining statistical learning with a knowledge-based approach - a case study in intensive care monitoring. Proc. of ICML'99 (1999) 268-277 Bled, Slowenien
22. Provost F. Machine learning from imbalanced data sets 101. Proc. of Workshop on Learning from Imbalanced Data Sets (AAAI'00) (2000) 1-3 Menlo Park, California
23. Rifkin R., and Klautau A. In defense of one-vs-all classification. Journal of Machine Learning Research 5 (2004) 101-141
24. Sebastiani F. Machine learning in automated text categorization. ACM Computing Surveys 34 1 (2002) 1-47
25. Shanahan J.G., and Roma N. Boosting support vector machines for text classification through parameter-free threshold relaxation. Proc. of CIKM'03 (2003) 247-254 New Orleans, LA
26. Song D., Lau R.Y.K., Bruza P.D., Wong K.-F., and Chen D.-Y. An intelligent information agent for document title classification and filtering in document-intensive domains. Decision Support Systems 44 1 (2007) 251-265
27. Sun A., Lim E.-P., Benatallah B., and Hassan M. FISA: Feature-based instance selection for imbalanced text classification. Proc. of PAKDD'06 (2006) 250-254 Singapore
28. Sun A., Lim E.-P., and Ng W.-K. Web classification using support vector machine. Proc. of WIDM'02 (2002), ACM, McLean, Virginia, USA 96-99
29. Sun A., Lim E.-P., Ng W.-K., and Srivastava J. Blocking reduction strategies in hierarchical text classification. IEEE Transactions on Knowledge and Data Engineering (TKDE) 16 10 (Oct. 2004) 1305-1308
30. Vapnik V.N. The nature of statistical learning theory (1995), Springer Verlag, Heidelberg, DE
31. Visa S., and Ralescu A. Issues in mining imbalanced data sets - a review paper. Proc. of Midwest Artificial Intelligence and Cognitive Science Conference (MAICS'05) (2005) 67-73 Dayton
32. Wu G., and Chang E.Y. KBA: kernel boundary alignment considering imbalanced data distribution. IEEE Transactions on Knowledge and Data Engineering (TKDE) 17 6 (June 2005) 786-795
33. Yang Y. A study of thresholding strategies for text categorization. Proc. of SIGIR'01 (2001) 137-145 New Orleans, USA
34. Yang Y., and Liu X. A re-examination of text categorization methods. Proc. of ACM SIGIR'99 (Aug. 1999) 42-49 Berkeley, USA
35. Yoon K., and Kwek S. An unsupervised learning approach to resolving the data imbalanced issue in supervised learning problems in functional genomics. Proc. of International Conference on Hybrid Intelligent Systems (2005) 303-308
36. Zhang Y., Dang Y., Chen H., Thurmond M., and Larson C. Automatic online news monitoring and classification for syndromic surveillance. Decision Support Systems 47 4 (2009) 508-517
37. Zheng Z., Wu X., and Srihari R. Feature selection for text categorization on imbalanced data. SIGKDD Explorations Newsletter 6 1 (2004) 80-89