A novel SVM modeling approach for highly imbalanced and overlapping classification

Intelligent Data Analysis

Volumn 15, Issue 3, 2011, Pages 319-341

  Qu, Yu ^a   Su, Hongye ^a   Guo, Lichao ^a   Chu, Jian ^a  

^a STATE KEY LABORATORY OF INDUSTRIAL CONTROL TECHNOLOGY   (China)

Author keywords

Highly imbalanced classification; inseparability; nonlinear; overlapping; SVM

Indexed keywords

IMBALANCED CLASSIFICATION; INSEPARABILITY; NONLINEAR; OVERLAPPING; SVM;

CLASSIFICATION (OF INFORMATION); LEARNING ALGORITHMS;

SUPPORT VECTOR MACHINES;

EID: 79957852245     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/IDA-2010-0470     Document Type: Article

References (47)

1. Adam Kowalczyk and Bhavani Raskutti, One class SVM for yeast regulation prediction, ACM SIGKDD Explorations Newsletter, pp. 99-100, 2002.
2. R. Akbani, S. Kwek and N. Japkowicz, Applying Support Vector Machines to Imbalanced Datasets, In Proceeding of 15th European Conference on Machine Learning (ECML), Vol. 3201, pp. 39-50, 2004. (Pubitemid 41050079)
3. Andrew P. Bradley, The use of the area under the ROC curve in the evaluation of machine learning algorithms, Journal of Pattern Recognition 30(7) (Jul 1997), 1145-1159. (Pubitemid 127406521)
4. Benjamin X.Wang and Nathalie Japkowicz, Boosting svm for imbalanced data sets, Journal of Foundations of Intelligent Systems (4994) (2008), 38-47.
5. Bernhard Scholkopf and Alexander J. Smola, Learning with Kernels,Massachusetts Institute of Technology Press, p. 204, 2002.
6. Bhavani Raskutti and Adam Kowalczyk, Extreme rebalancing for SVMs: A case study, SIGKDD Explorations 6(1) (2004), 60-69.
7. U. Brefeld and T. Scheffer, AUC Maximizing Support Vector Learning, In Proceeding of ICML Workshop on ROC Analysis in Machine Learning, 2005.
8. N.V. Chawla, N. Japkowicz and A. Kolcz, Editorial: Special issue on learning from imbalanced data sets, SIGKDD Explorations 6(1) (2004), 1-6.
9. N.V. Chawla, A. Lazarevic, O. Halll et al., SMOTEBoost: Improving prediction of the minority class in boosting: Knowledge discovery in databases. In Proceeding the 7th European Conference on Principles and Practice of Knowledge Discovery in Databases, pp. 107-119, 2003. (Pubitemid 37231089)
10. C. Cortes and V.N. Vapnik, Support Vector Networks, Machine Learning (20) (1995), 273-297.
11. David M.J. Tax and Robert P.W. Duin, Support Vector Data Description, Journal of Machine Learning (54) (2004), 45-66.
12. T. Fawcett and F. Provost, Combining Data Mining and Machine Learning for Effective User Profile, Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, pp. 8-13, 1996.
13. Gary M. Weiss, Mining with rarity: A unifying framework, SIGKDD Explorations Special Issue on Learning from Imbalanced Datasets 6(1) (2004), 7-19.
14. E.A.P.A.Gustavo. R.C.Batista andM.C. Prati,Monard, A study of the behavior of severalmethods for balancing machine learning training data, SIGKDD Explorations Special Issue on Learning from Imbalanced Datasets 6(1) (2004), 20-29.
15. D.J. Hand and Vinciottiv, Choosing k for twoclass nearest neighbour classifiers with unbalanced classes, Journal of Pattern Recognition Letters (24) (2003), 1555-1562. (Pubitemid 36225860)
16. H.Y. Wang, Combination approach of SMOTE and biasedSVM for imbalanced datasets, IEEE International Joint Conference on Neural Networks, pp. 228-231, 2008.
17. Huang Kaizhu, Yang Haiqin, I. King et al., Imbalanced learning with biased minimax probability machine, Journal of IEEE Trans on System, Man, and Cybernetics 36(4) (2006), 913-923. (Pubitemid 44178159)
18. Hui Han, WenYuan Wang and BingHuan Mao, BorderlineSMOTE: A new oversampling method in imbalanced data sets learning, International Conference on Intelligent Computing. Lecture Notes in Computer Science 3644, pp. 878-887. Springer-Verlag, 2005. (Pubitemid 41491129)
19. Jesse Davis and Mark Goadrich, The relationship between PrecisionRecall and ROC curves, Proceeding of the 23rd ICML, pp. 233-240, 2006.
20. S. KoknarTezel and L.J. Latecki, Improving SVM Classification on Imbalanced Data Sets in Distance Spaces, Ninth IEEE International Conference on Data Mining, pp. 259-267, 2009.
21. M. Kubat, R. Holte and S. Matwin, Machine Learning for the Detection of Oil Spills in Satellite Radar Images, Machine Learning (30) (1998), 195-215.
22. M. Kubat, R. Holte and S.Matwin, Learning when Negative Examples Abound, Proceedings of 9th European Conference on Machine Learning (ECML), 1997.
23. Liansheng Zhuang, Wei Zhou, Qi Tian and Nenghai Yu, Learning object from small and imbalanced dataset with BoostBFKO, IEEE International Conference on Multimedia and Expo, pp. 1449-1452, 2008.
24. Ling Zhuang and Honghua Dai, Parameter Estimation of OneClass SVM on Imbalance Text Classification, 19th Conference of the Canadian Society for Computational Studies of Intelligence, pp. 538-549, 2006. (Pubitemid 44077495)
25. Y.L. Murphey, H. Guo and L.A. Feldkamp, Neural learning from unbalanced data, Journal of Applied Intelligence 21(2) (2004), 117-128.
26. Nathalie Japkowicz, Conceptlearning in the presence of betweenclass and withinclass imbalances, in Proceedings of the Fourteenth Conference of the Canadian Society for Computational Studies of Intelligence, Ottawa, Canada, pp. 67-77, June 2001. (Pubitemid 33276088)
27. Nathalie Japkowicz and Shaju Stephen. The class imbalance problem: A systemstudy, Journal of IntelligentData Analysis 6(5) (2002), 429-449.
28. Nitesh V. Chawla, Lawrence O. Hall, Kevin W. Bowyer andW. Philip, Kegelmeyer. Smote: Synthetic minority oversampling technique, Journal of Artificial Intelligence Research (16) (2002), 321-357. (Pubitemid 43057176)
29. Rehan Akbani, Stephen Kwek and Nathalie Japkowicz, Applying support vector machines to imbalanced datasets. In Proceeding of the 15th European Conference on Machine Learning (ECML'04), pp. 39-50, 2004. (Pubitemid 41050079)
30. Robert E. Schapire, Yoav Freund, Peter Bartlett and Wee SunLee, Boosting the margin:a new explanation for the effectiveness of voting methods, Journal of Institute of Mathematical Statistics (26) (1998), 1651-1686. (Pubitemid 128376902)
31. Rukshan Batuwita and Vasile Palade, FSVMCIL: Fuzzy Support Vector Machines for Class Imbalance Learning, IEEE Transactions on Fuzzy Systems, pp. 1-1, 2010.
32. Salvador García and Francisco Herrera, Evolutionary Undersampling for Classification with Imbalanced datasetsProposals and Taxonomy, Journal of Evolutionary Computation 17(3) (2009), 275-306.
33. C. Seiffert, T.M. Khoshgoftaar, J. Van Hulse and A. Napolitano, A Comparative Study of Data Sampling and Cost Sensitive Learning, IEEE International Conference on Data Mining Workshops (2008), 46-52.
34. C. Seiffert, T.M. Khoshgoftaar, J. Van Hulse and A. Napolitano, RUSBoost: A Hybrid Approach to Alleviating Class Imbalance, Part A: Systems and Humans, IEEE Transactions on Systems, Man and Cybernetics, pp. 185-197, 2010.
35. Sotiris Kotsiantis, Stacking Cost Sensitive Models, Proceedings of the Panhellenic Conference on Informatics (2008), 217-221.
36. K. Veropoulos, C. Campbell and N. Cristianini, Controlling the Sensitivity of Support Vector Machines, Proceeding of Artificial Intelligence, pp. 55-60, Sweden, 1999.
37. P. Villar, A. Fernandez and F. Herrera, A Genetic Learning of the Fuzzy RuleBased Classification System Granularity for Highly Imbalanced DataSets, IEEE International Conference on Fuzzy Systems, pp. 1689-1694, 2009.
38. N. Vladimir, Vapnik, Statistical Learning Theory, New York: Wiley, 1998.
39. Wu Gang and E.Y. KBA, Chang, kernel boundary alignment considering imbalanced data distribution, Journal of IEEE Trans on Knowledge and Data Engineering 17(6) (2005), 786-795. (Pubitemid 40860458)
40. Xuchun Li, Lei Wang and Eric Sung, Adaboost with svmbased component classifiers, Journal of Engineering Applications of Artificial Intelligence (21) (2008), 785-795.
41. Yanmin Sun, Mohamed S. Kamel, Andrew K.C. Wong and Yang Wang, Costsensitive boosting for classification of imbalanced data, Journal of pattern recognition (40) (2007), 3358-3378. (Pubitemid 47223287)
42. YiHung Liu, YenTing Chen and SheyShin, Face Detection Using Kernel PCA and Imbalanced SVM, ICNC 2006, Part I, LNCS 4221, pp. 351-360, 2006.
43. Yin Zhendong, Research of Communication SignalModulation Scheme Recognition Based on OneClass SVMBayesian Algorithm, the 5th International Conference onWireless Communications, Networking and Mobile Computing, pp. 1-4, 2009.
44. Yuchun Tang, YanQing Zhang, Nitesh V. Chawla and Sven Krasser, SVMs Modeling for Highly Imbalanced Classification, IEEE Transactions on Systems, Man, and CyberneticsPart B: Cybernetics 39(1) (February 2009).
45. ZhiFei Ye and BaoLiang Lu, Learning Imbalanced Data Sets with a MinMax Modular Support Vector Machine, International Joint Conference on Neural Networks, pp. 1673-1678, 2007.
46. Z.H. Zhou andX.Y. Liu,Onmulticlass costsensitive learning, Proceedings of the 21stNationalConference on Artificial Intelligence, pages 567-572, Boston, MA, 2006. Databases, CavtatDubrovnik, Croatia, pp. 107-119, September, 2003
47. Z.H. Zhou and X.Y. Liu, Training costsensitive neural networks with methods addressing the class imbalance problem, IEEE Transactions on Knowledge and Data Engineering 18(1) (2006), 63-77.