Dynamic ensemble selection for multi-class imbalanced datasets

Information Sciences

Volumn 445-446, Issue , 2018, Pages 22-37

  García, Salvador ^a   Zhang, Zhong Liang ^b   Altalhi, Abdulrahman ^c   Alshomrani, Saleh ^d   Herrera, Francisco ^a,c  

^a UNIVERSITY OF GRANADA   (Spain)

^b HANGZHOU DIANZI UNIVERSITY   (China)

^c KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

^d UNIVERSITY OF JEDDAH   (Saudi Arabia)

Author keywords

Binary decomposition; Ensemble learning; Imbalanced datasets; Multi class classification; Multiple classifier system; Resampling techniques

Indexed keywords

ARTIFICIAL INTELLIGENCE; SOFTWARE ENGINEERING;

BINARY DECOMPOSITIONS; ENSEMBLE LEARNING; IMBALANCED DATA-SETS; MULTI-CLASS CLASSIFICATION; MULTIPLE CLASSIFIER SYSTEMS; RESAMPLING TECHNIQUE;

CLASSIFICATION (OF INFORMATION);

EID: 85043364952     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2018.03.002     Document Type: Article

References (50)

1. Abdi, L., Hashemi, S., To combat multi-class imbalanced problems by means of over-sampling and boosting techniques. Soft Comput. 19:12 (2015), 3369–3385.
2. Abdi, L., Hashemi, S., To combat multi-class imbalanced problems by means of over-sampling techniques. IEEE Trans. Knowl. Data Eng. 28:1 (2016), 238–251.
3. Breiman, L., Friedman, J., Stone, C.J., Olshen, R.A., Classification and Regression Trees. 1984, CRC Press.
4. Britto, A.S., Sabourin, R., Oliveira, L.E., Dynamic selection of classifiers – a comprehensive review. Pattern Recognit. 47:11 (2014), 3665–3680.
5. Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P., SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16 (2002), 321–357.
6. Datta, S., Das, S., Near-Bayesian support vector machines for imbalanced data classification with equal or unequal misclassification costs. Neural Netw. 70 (2015), 39–52.
7. Derrac, J., García, S., Molina, D., Herrera, F., A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol. Comput. 1:1 (2011), 3–18.
8. Dos Santos, E.M., Sabourin, R., Maupin, P., A dynamic overproduce-and-choose strategy for the selection of classifier ensembles. Pattern Recognit. 41:10 (2008), 2993–3009.
9. Fernández, A., López, V., Galar, M., Del Jesus, M.J., Herrera, F., Analysing the classification of imbalanced data-sets with multiple classes: binarization techniques and ad-hoc approaches. Knowl. Based Syst. 42 (2013), 97–110.
10. Fernández-Baldera, A., Buenaposada, J.M., Baumela, L., Multi-class boosting for imbalanced data. Proceedings of Iberian Conference on Pattern Recognition and Image Analysis, 2015, 57–64.
11. Fernández-Navarro, F., Hervás-Martínez, C., Gutiérrez, P.A., A dynamic over-sampling procedure based on sensitivity for multi-class problems. Pattern Recognit. 44:8 (2011), 1821–1833.
12. Ferri, C., Hernández-Orallo, J., Modroiu, R., An experimental comparison of performance measures for classification. Pattern Recognit. Lett. 30:1 (2009), 27–38.
13. Galar, M., Fernández, A., Barrenechea, E., Bustince, H., Herrera, F., NMC: Nearest matrix classification – a new combination model for pruning one-vs-one ensembles by transforming the aggregation problem. Inf. Fusion 36 (2017), 26–51.
14. García, V., Mollineda, R.A., Sánchez, J.S., On the k-nn performance in a challenging scenario of imbalance and overlapping. Pattern Anal. Appl. 11:3–4 (2008), 269–280.
15. Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., Bing, G., Learning from class-imbalanced data: review of methods and applications. Expert Syst. Appl. 73 (2017), 220–239, 10.1016/j.eswa.2016.12.035.
16. Haixiang, G., Yijing, L., Yanan, L., Xiao, L., Jinling, L., BPSO-adaboost-KNN ensemble learning algorithm for multi-class imbalanced data classification. Eng. Appl. Artif. Intell. 49 (2016), 176–193.
17. He, H., Garcia, E.A., Learning from imbalanced data. IEEE Trans. Knowl. Data Eng. 21:9 (2009), 1263–1284.
18. Hodges, J., Lehmann, E.L., et al. Rank methods for combination of independent experiments in analysis of variance. Ann. Math. Stat. 33:2 (1962), 482–497.
19. Hoens, T., Qian, Q., Chawla, N., Zhou, Z.-H., Building decision trees for the multi-class imbalance problem. Adv. Knowl. Discov. Data Min. LNCS 7301 (2012), 122–134.
20. Kittler, J., Hatef, M., Duin, R.P., Matas, J., On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20:3 (1998), 226–239.
21. Ko, A.H., Sabourin, R., Britto Jr, A.S., From dynamic classifier selection to dynamic ensemble selection. Pattern Recognit. 41:5 (2008), 1718–1731.
22. Krawczyk, B., Learning from imbalanced data: open challenges and future directions. Prog. Artif. Intell. 5:4 (2016), 221–232.
23. Liu, X.-Y., Wu, J., Zhou, Z.-H., Exploratory undersampling for class-imbalance learning. IEEE Trans. Syst. Man Cybern. – Part B: Cybern. 39:2 (2009), 539–550.
24. Liu, Y., Nie, L., Han, L., Zhang, L., Rosenblum, D.S., Action2Activity: recognizing complex activities from sensor data. Proceedings of International Conference on Artificial Intelligence, 2015, 1617–1623.
25. Liu, Y., Zhang, L., Nie, L., Yan, Y., Rosenblum, D.S., Fortune teller: predicting your career path. Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, 2016, 201–207.
26. Liu, Y., Zheng, Y., Liang, Y., Liu, S., Rosenblum, D.S., Urban water quality prediction based on multi-task multi-view learning. Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, 2016, 2576–2582.
27. López, V., Fernández, A., Herrera, F., On the importance of the validation technique for classification with imbalanced datasets: addressing covariate shift when data is skewed. Inf. Sci. 257 (2014), 1–13.
28. Lysiak, R., Kurzynski, M., Woloszynski, T., Probabilistic approach to the dynamic ensemble selection using measures of competence and diversity of base classifiers. Proceedings of International Conference on Hybrid Artificial Intelligence Systems, 2011, 229–236.
29. Moreno-Torres, J.G., Sáez, J.A., Herrera, F., Study on the impact of partition-induced dataset shift on k-fold cross-validation. IEEE Trans. Neural Netw. Learn. Syst. 23:8 (2012), 1304–1312.
30. Mousavi, R., Eftekhari, M., A new ensemble learning methodology based on hybridization of classifier ensemble selection approaches. Appl. Soft Comput. 37 (2015), 652–666.
31. Sáez, J.A., Krawczyk, B., Woźniak, M., Analyzing the oversampling of different classes and types of examples in multi-class imbalanced datasets. Pattern Recognit. 57 (2016), 164–178.
32. Sánchez-Crisostomo, J.P., Alejo, R., López-González, E., Valdovinos, R.M., Pacheco-Sánchez, J.H., Empirical analysis of assessments metrics for multi-class imbalance learning on the back-propagation context. Proceedings of International Conference in Swarm Intelligence, 2014, 17–23.
33. Santana, A., Soares, R.G., Canuto, A.M., de Souto, M.C., A dynamic classifier selection method to build ensembles using accuracy and diversity. Proceedings of Ninth Brazilian Symposium on Neural Networks, SBRN’06, 2006, 36–41.
34. Y. Sun, M.S. Kamel, Y. Wang, Boosting for learning multiple classes with imbalanced class distribution, in: Proceedings of International Conference on Data Mining, ICDM, 2006, pp. 592–602.
35. Tang, M., Nie, F., Pongpaichet, S., Jain, R., Semi-supervised learning on large-scale geotagged photos for situation recognition. J. Vis. Commun. Image Represent. 48 (2017), 310–316.
36. Triguero, I., González, S., Moyano, J., García, S., Alcalá-Fdez, J., Luengo, J., Fernández, A., del Jesus, M., Sánchez, L., Herrera, F., KEEL 3.0: an open source software for multi-stage analysis in data mining. Int. J. Comput. Intell. Syst. 10 (2017), 1238–1249.
37. Wang, S., Yao, X., Multiclass imbalance problems: analysis and potential solutions. IEEE Trans. Syst. Man Cybern. – Part B: Cybern. 42:4 (2012), 1119–1130.
38. Weiss, G.M., The impact of small disjuncts on classifier learning. Data Mining, 2010, Springer, 193–226.
39. Wilcoxon, F., Individual comparisons by ranking methods. Biom. Bull. 1:6 (1945), 80–83.
40. T. Woloszynski, M. Kurzynski, On a new measure of classifier competence applied to the design of multiclassifier systems, Proceedings of International Conference on Image Analysis and Processing, ICIAP 2009 (2009) 995–1004.
41. Woloszynski, T., Kurzynski, M., A probabilistic model of classifier competence for dynamic ensemble selection. Pattern Recognit. 44:10 (2011), 2656–2668.
42. Woloszynski, T., Kurzynski, M., Podsiadlo, P., Stachowiak, G.W., A measure of competence based on random classification for dynamic ensemble selection. Inf. Fusion 13:3 (2012), 207–213.
43. Wu, Q., Ye, Y., Zhang, H., Ng, M.K., Ho, S.-S., Forestexter: an efficient random forest algorithm for imbalanced text categorization. Knowl. Based Syst. 67 (2014), 105–116.
44. Wu, X., Kumar, V., Quinlan, J.R., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G.J., Ng, A., Liu, B., Philip, S.Y., et al. Top 10 algorithms in data mining. Knowl. Inf. Syst. 14:1 (2008), 1–37.
45. Xiao, J., Dynamic classifier ensemble model for customer classification with imbalanced class distribution. Expert Syst. Appl. 39:3 (2012), 3668–3675.
46. Yijing, L., Haixiang, G., Xiao, L., Yanan, L., Jinling, L., Adapted ensemble classification algorithm based on multiple classifier system and feature selection for classifying multi-class imbalanced data. Knowl. Based Syst. 94 (2016), 88–104.
47. Zhang, C., Liu, C., Zhang, X., Almpanidis, G., An up-to-date comparison of state-of-the-art classification algorithms. Expert Syst. Appl. 82 (2017), 128–150, 10.1016/j.eswa.2017.04.003.
48. Zhang, Z., Krawczyk, B., Garcìa, S., Rosales-Pérez, A., Herrera, F., Empowering one-vs-one decomposition with ensemble learning for multi-class imbalanced data. Knowl. Based Syst. 106 (2016), 251–263.
49. Zhang, Z., Luo, X., García, S., Tang, J., Herrera, F., Exploring the effectiveness of dynamic ensemble selection in the one-versus-one scheme. Knowl. Based Syst. 125 (2017), 53–63.
50. Zhou, Z.-H., Liu, X.-Y., Training cost-sensitive neural networks with methods addressing the class imbalance problem. IEEE Trans. Knowl. Data Eng. 18:1 (2006), 63–77.