Clustering-based undersampling in class-imbalanced data

Information Sciences

Volumn 409-410, Issue , 2017, Pages 17-26

  Lin, Wei Chao ^a   Tsai, Chih Fong ^b   Hu, Ya Han ^c   Jhang, Jing Shang ^b  

^a ASIA UNIVERSITY   (Taiwan)

^b NATIONAL CENTRAL UNIVERSITY   (Taiwan)

^c NATIONAL CHUNG CHENG UNIVERSITY   (Taiwan)

Author keywords

Class imbalance; Classifier ensembles; Clustering; Imbalanced data; Machine learning

Indexed keywords

ARTIFICIAL INTELLIGENCE; DATA MINING; DECISION TREES; LEARNING ALGORITHMS; LEARNING SYSTEMS; TREES (MATHEMATICS); VIRTUAL REALITY;

C4.5 DECISION TREE CLASSIFIER; CLASS IMBALANCE; CLASSIFIER ENSEMBLES; CLUSTERING; IMBALANCED DATA; LARGE SCALE DATA SETS; MULTI-LAYER PERCEPTRON CLASSIFIERS; RANDOM UNDER SAMPLINGS;

CLASSIFICATION (OF INFORMATION);

EID: 85019061365     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2017.05.008     Document Type: Article

References (40)

1. Abdi, L., Hashemi, S., To combat multi-class imbalanced problems by means of over-sampling techniques. IEEE Trans. Knowl. Data Eng. 28:1 (2016), 238–251.
2. Barandela, R., Valdovinos, R.M., Sanchez, J.S., New applications of ensembles of classifiers. Pattern Anal. Appl. 6 (2003), 245–256.
3. Batista, G.E.A.P.A., Prati, R.C., Monard, M.C., A survey of the behavior of several methods for balancing machine learning training data. SIGKDD Explor. 6:1 (2004), 20–29.
4. Bayan, C., Fisher, R., Classifying imbalanced data sets using similarity based hierarchical decomposition. Pattern Recognit. 48 (2015), 1653–1672.
5. Blaszczynski, J., Stefanowski, J., Neighborhood sampling in bagging for imbalanced data. Neurocomputing 150 (2015), 529–542.
6. Breiman, L., Bagging predictors. Mach. Learn. 24:2 (1996), 123–140.
7. Chawla, N.V., Data mining for imbalanced datasets: an overview. Maimon, O., Rokach, L., (eds.) Data Mining and Knowledge Discovery Handbook, 2005, Springer-Verlag, New York, 853–867.
8. Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P., SMOTE: synthetic minority over-sampling technique. J. Artifi. Intell. Res. 16 (2002), 321–357.
9. Chawla, N.V., Lazarevic, A., Hall, L.O., Bowyer, K.W., SMOTEBoost: improving prediction of the minority class in boosting. European Conference on Principles and Practice of Knowledge Discovery in Databases, 2003, 107–119.
10. Cohen, W.W., Fast effective rule induction. International Conference on Machine Learning, 1995, 115–123.
11. Fawcett, T., An introduction to ROC analysis. Pattern Recognit. Lett. 27 (2006), 861–874.
12. Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., Herrera, F., A review on ensembles for the class imbalance problem: bagging-, boosting-, and hybrid-based approaches. IEEE Trans. Syst. Man Cybern. – Part C 42:4 (2012), 463–484.
13. Galar, M., Fernandez, A., Barrenechea, E., Herrera, F., EUSBoost: enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling. Pattern Recognit. 46 (2014), 3460–3471.
14. Hartigan, J.A., Wong, M.A., Algorithm AS 136: a k-means clustering algorithm. J. R. Stat. Soc., Ser. C 28:1 (1979), 100–108.
15. Hu, S., Liang, Y., Ma, L., He, Y., MSMOTE: improving classification performance when training data is imbalanced. International Workshop on Computer Science and Engineering, 2009, 13–17.
16. Jain, A.K., Murty, M.N., Flynn, P.J., Data clustering: a review. ACM Comput. Surv. 31:3 (1999), 264–323.
17. Japkowicz, N., The class imbalance problem: significance and strategies. International Conference on Artificial Intelligence, 2000, 111–117.
18. Kasabov, N., Evolving connectionist systems for adaptive learning and knowledge discovery: trends and directions. Knowl.-Based Syst. 80 (2015), 24–33.
19. Kasabov, N., Doborjeh, M., Doborjeh, Z., Mapping, learning, visualisation, classification and understanding of fMRI data in the NeuCube spatio temporal data machine. IEEE Trans. Neural Netw. Learn. Syst., 2016, 10.1109/TNNLS.2016.2612890 Manuscript Number: TNNLS-2016-P-6356, 2016.
20. Kasabov, N., Feigin, V., Hou, Z.-G., Chen, Y., Liang, L., Krishnamurthi, R., Parmar, P., Evolving spiking neural networks for personalised modelling, classification and prediction of spatio-temporal patterns with a case study on stroke. Neurocomputing 134 (2014), 269–279.
21. Kohavi, R., A study of cross-validation and bootstrap for accuracy estimation and model selection. International Joint Conference on Artificial Intelligence, 2, 1995, 1137–1143.
22. Kotsiantis, S., Kanellopoulos, D., Pintelas, P., Handling imbalanced datasets: a review. GESTS Int. Trans. Comput. Sci. Eng. 30:1 (2006), 25–36.
23. Kubat, M., Matwin, S., Addressing the curse of imbalanced training sets: one-sided selection. International Conference on Machine Learning, 1997, 179–186.
24. Liu, X.-Y., Wu, J., Zhou, Z.-H., Exploratory undersampling for class-imbalance learning. IEEE Trans. Syst. Man Cybern. – Part B 39:2 (2009), 539–550.
25. Liu, Y.-H., Chen, Y.-T., Total margin based adaptive fuzzy support vector machines for multiview face recognition. IEEE International Conference on Systems, Man and Cybernetics, 2, 2005, 1704–1711.
26. Longadge, R., Dongrre, S.S., Malik, L., Class imbalance problem in data mining: review. Int. J. Comput. Sci. Netw. 2:1 (2013), 83–87.
27. Mazurowski, M.A., Habas, P.A., Zurada, J.M., Lo, J.Y., Baker, J.A., Tourassi, G.D., Training neural network classifiers for medical decision making: the effects of imbalanced datasets on classification performance. Neural Netw. 21:2-3 (2008), 427–436.
28. Mohemmed, A., Schliebs, S., Matsuda, S., Kasabov, N., SPAN: spike pattern association neuron for learning spatio-temporal sequences. Int. J. Neural Syst. 22:4 (2012), 1–16.
29. Nanni, L., Fantozzi, C., Lazzarini, N., Coupling different methods for overcoming the class imbalance problem. Neurocomputing 158 (2015), 48–61.
30. Raskutti, B., Kowalczyk, A., Extreme rebalancing for SVMs: a case study. ACM SIGKDD Explor. 6:1 (2004), 60–69.
31. Schapire, R.E., The strength of weak learnabilty. Mach. Learn. 5:2 (1990), 197–227.
32. Seiffert, C., Khoshgoftaar, T., Van Hulse, J., Napolitano, A., RUSBoost: a hybrid approach to alleviating class imbalance. IEEE Trans. Syst. Man Cybern. – Part A 40:1 (2010), 185–197.
33. Sun, Y., Wong, A.K.C., Kamel, M.S., Classification of imbalanced data: a review. Int. J. Pattern Recognit. Artif. Intell. 23:4 (2009), 687–719.
34. Sun, Z., Song, Q., Zhu, X., Sun, H., Xu, B., Zhou, Y., A novel ensemble method for classifying imbalanced data. Pattern Recognit. 48 (2015), 1623–1637.
35. Taehoon, K., Hyunchul, A., A hybrid under-sampling approach for better bankruptcy prediction. J. Intell. Inf. Syst. 21:2 (2015), 173–190.
36. Wang, S., Yao, X., Diversity analysis on imbalanced data sets by using ensemble models. IEEE International Symposium on Computational Intelligence and Data Mining, 2009, 324–331.
37. Weiss, G.M., Mining with rarity: a unifying framework. SIGKDD Explor. 6:1 (2004), 1–7.
38. Zhang, X., Song, Q., Wang, G., Zhang, K., He, L., Jia, X., A dissimilarity-based imbalance data classification algorithm. Appl. Intell. 42 (2015), 544–565.
39. Zhou, L., Performance of corporate bankruptcy prediction models on imbalanced dataset: the effect of sampling methods. Knowl.-Based Syst. 41 (2013), 16–25.
40. Zhu, Z.-B., Song, Z.-H., Fault diagnosis based on imbalance modified kernel Fisher discriminant analysis. Chem. Eng. Res. Des. 88:8 (2010), 936–951.