BPSO-Adaboost-KNN ensemble learning algorithm for multi-class imbalanced data classification

Engineering Applications of Artificial Intelligence

Volumn 49, Issue , 2016, Pages 176-193

  Haixiang, Guo ^a,b   Yijing, Li ^a   Yanan, Li ^a   Xiao, Liu ^a   Jinling, Li ^a  

^a CHINA UNIVERSITY OF GEOSCIENCES   (China)

^b CENTRAL SOUTH UNIVERSITY   (China)

Author keywords

Classification; Ensemble; Feature selection; Imbalanced data; Oil reservoir

Indexed keywords

ADAPTIVE BOOSTING; ALGORITHMS; FEATURE EXTRACTION; LEARNING ALGORITHMS; OIL BEARING FORMATIONS; OIL FIELDS; OIL WELL LOGGING; PETROLEUM RESERVOIR ENGINEERING; PETROLEUM RESERVOIRS; WELL LOGGING;

ENSEMBLE; ENSEMBLE LEARNING ALGORITHM; FEATURE SELECTION ALGORITHM; IMBALANCED DATA; MULTI-CLASS CLASSIFICATION; MULTI-CLASS IMBALANCED DATUM; OIL RESERVOIRS; STATE-OF-THE-ART ALGORITHMS;

CLASSIFICATION (OF INFORMATION);

EID: 84962476443     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2015.09.011     Document Type: Article

References (60)

1. M. Alibeigi, S. Hashemi, and A. Hamzeh DBFS: An effective Density Based Feature Selection scheme for small sample size and high dimensional imbalanced data sets Data Knowl. Eng. 2012 67 103
2. F. Alberto, L. Victoria, G. Mikel, and et al. Analysing the classification of imbalanced data-sets with multiple classes: binarization techniques and ad-hoc approaches Knowl.-Based Syst. 42 2013 97 110
3. L. Breiman Bagging predictors Mach. Learn. 24 2 1996 123 140
4. W. Bin, P. Qinke, Z. Jing, and et al. A binary particle swarm optimization algorithm inspired by multi-level organizational learning behavior Eur. J. Oper. Res. 219 2012 224 233
5. K. Bache, and M. Lichman UCI Machine Learning Repository 2013 University of California, School of Information and Computer Science Irvine, CA
6. J.M. Bland, and D.G. Altman Statistical methods for assessing agreement between two methods of clinical measurement Lancet 8476 1986 307 310
7. N.V. Chawla, K.W. Bowyer, and L.O. Hall SMOTE: synthetic minority over-sampling technique Artif. Intell. Res. 16 2002 321 357
8. Cao, Miao, Liu, and et al. Advance and prospects of AdaBoost algorithm Acta Autom. Sin. 39 6 2013 745 758
9. N.V. Chawla, N. Japkowicz, and A. Kotcz Editorial: Special Issue on Learning from Imbalanced Data Sets ACM SIGKDD Explor. Newsl. 6 1 2004 1 6
10. J.H. David, and J.T. Robert A Simple generalization of the area under the ROC curve for multiple class classification problems Mach. Learn. 45 2001 171 186
11. J.F. Díez-Pastor, J.J. Rodríguez, C. García-Osorio, and L.I. Kuncheva Random balance: ensembles of variable priors classifiers for imbalanced data Knowledge-Based Systems 85 2015 96 111
12. S.R. Searle Linear Models for Unbalanced Data 1987 Wiley
13. G.Q. Feng, Y. Li, and D.H. Tan Application of fuzzy closeness degree in reservoir recognition J. Southwest Petrol. Ins. 21 4 1999 46 49
14. Yoav Freund Boosting a weak learning algorithm by majority Inf. Comput. 121 2 1995 256 285
15. Freund, Y., Schapire, R.E., 1996. Experiments with a New boosting algorithm. In: Proceedings of the Thirteenth International Conference on Machine Learning, pp. 148-156.
16. Tom Fawcett An introduction to ROC analysis Pattern Recognit. Lett. 27 2006 861 874
17. Yoav Freund, and Robert E. Schapire A decision-theoretic generalization of on-line learning and an application to boosting J. Comput. Syst. Sci. 55 1 1997 119 139
18. Ferri, C., Hernández-orallo, J., Salido, M.A., 2003. Volume under the ROC Surface for Multi-class Problems. Exact computation and evaluation of approximations. In: Proceedings of 14th European Conference on Machine Learning, pp. 108-120.
19. M. Galar, A. Fernández, E. Barrenechea, and et al. EUSBoost: enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling Pattern Recognit. 46 2013 3460 3471
20. H.X. Guo, X.W. Liao, K.J. Zhu, and et al. Optimizing reservoir features in oil exploration management based on fusion of soft computing Appl. Soft Comput. 11 2011 1144 1155
21. M. Galar, A. Fernández, and E. Barrenechea A review on ensembles for the class imbalance problem: bagging-, boosting-, and hybrid-based approaches IEEE Trans. Syst. Man Cybern C: Appl. Rev. 42 4 2012 463 484
22. Ming Gao, Xia Hong, and J. Chris Construcion of neurofuzzy models for imbalanced data classification IEEE Trans. Fuzzy Syst. 22 6 2014 1473 1488
23. Md Hassan, Kotagiri, R., Chandan, K. et.al., June, 21-24, 2010. A novel scalable multi-class ROC for effective visualization and computation. Advances in Knowledge Discovery and Data Mining. 14th Pacific-Asia Conference,.
24. He, H., Bai, Y. et al., 2008. Adasyn: adaptive synthetic sampling approach for imbalanced learning. In: Proceedings of IEEE International Joint Conference on Neural Networks, pp. 1322-1328.
25. S. Holm A simple sequentially rejective multiple test procedure, Scand J. Stat 6 1979 65 70
26. H. Inbarani, A. Azar, and G. Jothi Supervised hybrid feature selection based on PSO and rough sets for medical diagnosis Comput. Methods Progr. Biomed. 113 2014 175 185
27. B. Krawczyk, M. Wozniak, and G. Schaefer Cost-sensitive decision tree ensembles for effective imbalanced classification Appl. Soft Comput. 14 2014 554 562
28. Kennedy, J., Eberhart, R.,1995. Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks, pp. 1942-1948.
29. Kennedy, J., Eberhart, R.C., 1997. A discrete binary version of the particle swarm algorithm. In: Proceedings of IEEE International Conference on Systems Man and Cybernetics Computational Cybernetics and Simulation.
30. Krawczyk, B., Schaefer, G., 2013. An improved ensemble approach for imbalanced classification problems, In: Proceedings of 8th IEEE International Symposium on Applied Computational Intelligence and Informatics.
31. B. Krawczyk, M. Wozniak, and F. Herrera Weighted one-class classification for different types of minority class examples in imbalanced data, Computational Intelligence and Data Mining (CIDM) IEEE Symposium on 2014 337 344
32. Krawczyk, B., Woźniak, M., 2015. Hypertension type classification using hierarchical ensemble of one-class classifiers for imbalanced data. Advances in Intelligent Systems Computing.
33. V. López, A. Fernández, M.J. del Jesuse, and et al. A hierarchical genetic fuzzy system based on genetic programming for addressing classification with highly imbalanced and borderline data-sets Knowl.-Based Syst. 38 2013 85 104
34. V. López, A. Fernández, S. García, and et al. An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics Inf. Sci. 250 2013 113 141
35. V. López, S. Río, J.M. Benítez, and et al. Cost-sensitive linguistic fuzzy rule based classification systems under the MapReduce framework for imbalanced big data Fuzzy Sets and Syst 258 2015 5 38
36. X.Y. Liu, J. Wu, and Z.H. Zhou Exploratory undersampling for class-imbalance learning IEEE Trans. Syst. Man Cybern. Part B: Cybern. 39 2 2009 539 550
37. V. López, A. Fernández, S. García, and et al. An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics Inf. Sci. 250 2013 2006 113 141
38. Lachiche, N., Flach, P.A., 2003. Improving accuracy and cost of two-class and multi-class probabilistic classifiers using ROC curves. ICML-2003.
39. G. Menardi, and N. Torelli Training and assessing classification rules with imbalanced data Data Min. Knowl. Discov. 2014 92 122
40. S. Maldonado, R. Weber, and F. Famili Feature selection for high-dimensional class-imbalanced data sets using support vector machines Inf. Sci. 286 2014 228 246
41. M.D. Martino, A. Fernández, P. Iturralde, and et al. Novel classifier scheme for imbalanced problems Pattern Recognit. Lett. 34 2013 1146 1151
42. Nitesh, V.C., Aleksandar, L., Lawrence, O.H., et.al., 2003. SMOTEBoost: improving prediction of the minority class in boosting. In: Proceedings of 7th European Conference on Principles and Practice of Knowledge Discovery in Databases, pp. 107-119.
43. M.K. Naimul, K. Riadh, and S.A. Imran Covariance-guided One-Class Support Vector Machine Pattern Recognit. 47 6 2014 2165 2177
44. C.T. Nakas, and C.T. Yiannoutsos Ordered multiple-class ROC analysis with continuous measurements Stat. Med. 23 22 2004 3437 3449
45. L. Nanni, C. Fantozzi, and N. Lazzarini Coupling different methods for overcoming the class imbalance problem Neurocomputing 158 2015 48 61
46. R.C. Prati, E. Gustavo, and Diego F. Silva Class imbalance revisited: a new experimental setup to assess the performance of treatment methods Knowl. Inf. Syst. 2015 10.1007/s10115-014-0794-3
47. M. Richard, and E. Jonathan Multi-class ROC analysis from a multi-objective optimization perspective Pattern Recognit. Lett. 27 2006 916 927
48. Z. Sun, Q. Song, X. Zhu, and et al. A novel ensemble method for classifying imbalanced data Pattern Recognit. 48 2015 1623 1637
49. D. Sheskin Handbook of Parametric and Nonparametric Statistical Procedures 2006 Chapman & Hall/CRC London, U.K.
50. Robert E. Schapire, and Yoram Singer Improved boosting algorithms using confidence-rated pre-dictions Mach. Learn. 37 3 1999 297 336
51. Shanab, A., Khoshgoftaar, T., Wald, R. et al., 2011. Comparison of approaches to alleviate problems with high-dimensional and class-imbalanced data. In: Proceedings of IEEE International Conference on Information Reuse and Integration, pp. 234-239.
52. K. Sathiya, C. Olivier, and D. Dennis Building support vector machines with reduced classifier complexity J. Mach. Learn. Res. 7 2006 1493 1515
53. J. Tian, H. Gu, and W. Liu Imbalanced classification using support vector machine ensemble Neural Comput. Appl. 20 2 2011 203 209
54. Thai-Nghe, N., Gantner, Z. Schmidt-Thieme, L., 2010. Cost-sensitive learning methods for imbalanced data. In: Proceedings of IEEE International Joint Conference Neural Networks (IJCNN), pp. 1-8.
55. Thomas, L., Robert, P.W.D., 2006. A simplified extension of the Area under the ROC to the multiclass domain. In: Proceedings of 17th Annual Symposium of the Pattern Recognition Association of South Africa. PRASA, pp. 241-245.
56. P. Vorraboot, S. Rasmequan, K. Chinnasarn, and et al. Improving classification rate constrained to imbalanced data between overlapped and non-overlapped regions by hybrid algorithms Neurocomputing 152 2015 429 443
57. Wang, X., Matwin, S., Japkowicz, N., Liu, X., 2013. Cost-sensitive boosting algorithms for imbalanced multi-instance datasets. In: Proceedings of the Canadian Conference on Artificial Intelligence, pp. 174-186.
58. F. Wilcoxon Individual comparisons by ranking methods Biom. Bull. 6 1945 80 83
59. L. Yin, Y. Ge, K. Xiao, and et al. Feature selection for high-dimensional imbalanced data Neurocomputing 105 2013 3 11
60. L. Yin, Y. Ge, and K. Xiao Feature selection for high-dimensional imbalanced data Neurocomputing 105 3 2013 3 11