Adapted ensemble classification algorithm based on multiple classifier system and feature selection for classifying multi-class imbalanced data

Knowledge-Based Systems

Volumn 94, Issue , 2016, Pages 88-104

  Yijing, Li ^a   Haixiang, Guo ^a,b   Xiao, Liu ^a   Yanan, Li ^a   Jinling, Li ^a,b  

^a CHINA UNIVERSITY OF GEOSCIENCES   (China)

^b UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Adaptive learning; Imbalanced data; Multiple classifier system; Oil reservoir

Indexed keywords

ALGORITHMS; DATA MINING; FEATURE EXTRACTION; OIL BEARING FORMATIONS; OIL FIELDS; OIL WELL LOGGING; PETROLEUM RESERVOIR ENGINEERING; PETROLEUM RESERVOIRS; WELL LOGGING;

ADAPTIVE LEARNING; ENSEMBLE CLASSIFICATION; FEATURE SELECTION METHODS; IMBALANCED DATA; MULTI-CLASS IMBALANCED DATUM; MULTIPLE CLASSIFIER SYSTEMS; OIL RESERVOIRS; STATE-OF-THE-ART ALGORITHMS;

CLASSIFICATION (OF INFORMATION);

EID: 84953638515     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2015.11.013     Document Type: Article

References (68)

1. Díez-Pastor J.F., Rodríguez J.J., García-Osorio C. et al. Random balance: ensembles of variable priors classifiers for imbalanced data Knowl.-Based Syst. 85 2015 96 111
2. M. Galar, A. Fernández, E. Barrenechea EUSBoost: enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling Pattern Recogn. 46 2013 3460 3471
3. P. Vorraboot, S. Rasmequan, K. Chinnasarn Improving classification rate constrained to imbalanced data between overlapped and non-overlapped regions by hybrid algorithms Neurocomputing 152 2015 429 443
4. Z. Sun, Q. Song, X. Zhu A novel ensemble method for classifying imbalanced data Pattern Recogn. 48 2015 1623 1637
5. S.R. Earle Linear Models for Unbalanced Data 1987 Wiley
6. G. Menardi, N. Torelli Training and assessing classification rules with imbalanced data Data Min. Knowl. Discov. 2014 92 122
7. S. Maldonado, R. Weber, F. Famili Feature selection for high-dimensional class-imbalanced data sets using support vector machines Inf. Sci. 286 2014 228 246
8. G.Q. Feng, Y. Li, D.H. Tan Application of fuzzy closeness degree in reservoir recognition J. Southwest Pet. Inst. 21 4 1999 46 49
9. Guo H.X., Liao X.W., Zhu K.J. Optimizing reservoir features in oil exploration management based on fusion of soft computing Appl. Soft Comput. 11 2011 1144 1155
10. N.V. Chawla, K.W. Bowyer, L.O. Hall SMOTE: synthetic minority over-sampling technique Artif. Intell. Res. 16 2002 321 357
11. P. Vorraboot, S. Rasmequan, K. Chinnasarn Improving classification rate constrained to imbalanced data between overlapped and non-overlapped regions by hybrid algorithms Neurocomputing 152 2015 429 443
12. Díez-Pastor J.F., Rodríguez J.J., García-Osorio C. et al. Random balance: ensembles of variable priors classifiers for imbalanced data Knowl.-Based Syst. 85 2015 96 111
13. Yoav Freund Boosting a weak learning algorithm by majority Inf. Comput. 121 2 1995 256 285
14. Peng L., Zhang H., Yang B. et al. A new approach for imbalanced data classification based on data gravitation Inf. Sci. 288 2014 347 373
15. Z. Sun, Q. Song, X. Zhu A novel ensemble method for classifying imbalanced data Pattern Recogn. 48 2015 1623 1637
16. Nitesh V.C., Aleksandar L., Lawrence O.H. SMOTEBoost: improving prediction of the minority class in boosting Proceedings of the 7th European Conference on Principles and Practice of Knowledge Discovery in Databases 2003 107 119
17. V. López, S. Río, J.M. Benítez et al. Cost-sensitive linguistic fuzzy rule based classification systems under the MapReduce framework for imbalanced big data Fuzzy Sets Syst. 258 2015 5 38
18. B. Krawczyk, M. Wozniak, G. Schaefer Cost-sensitive decision tree ensembles for effective imbalanced classification Appl. Soft Comput. 14 2014 554 562
19. Datta S., Das S. Near-bayesian support vector machines for imbalanced data classification with equal or unequal misclassification costs Neural Netw. 70 2015 39 52
20. L. Yin, Y. Ge, K. Xiao Feature selection for high-dimensional imbalanced data Neurocomputing 105 2013 3 11
21. M. Alibeigi, S. Hashemi, A. Hamzeh DBFS: an effective density based feature selection scheme for small sample size and high dimensional imbalanced data sets Data Knowl. Eng. 81-82 4 2012 67 103
22. Han H., Wang W.Y., Mao B.H. Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning 2005 Springer Berlin Heidelberg 878 887 Advances in Intelligent Computing
23. Ii W.A.Y., Nykl S.L., Weckman G.R. et al. Using Voronoi diagrams to improve classification performances when modeling imbalanced datasets Neural Comput. Appl. 26 2015 1 14
24. Freund Y., R.E. Schapire Experiments with a new boosting algorithm Proceedings of the Thirteenth International Conference on Machine Learning 1996 148 156
25. X.Y. Liu, J. Wu, Z.H. Zhou Exploratory Under-sampling for class-imbalance learning, bioinformatics Proceedings of the IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 39(2) 2009 539 550
26. H. Yu, J. Ni, J. Zhao ACOSampling: an ant colony optimization-based undersampling method for classifying imbalanced DNA microarray data Neurocomputing 101 2013 309 318
27. M.D. Martino, A. Fernández, P. Iturralde Novel classifier scheme for imbalanced problems Pattern Recogn. Lett. 34 2013 1146 1151
28. V. López, A. Fernández, S. García et al. An insight into classification with imbalanced data: empirical results and current trends on using data intrinsic characteristics Inf. Sci. 250 2013 113 141
29. Tom Fawcett. An introduction to ROC analysis, Pattern Recogn. Lett., 27: 861-874.
30. Richard M., Jonathan E. Multi-class ROC analysis from a multi-objective optimization perspective Pattern Recogn. Lett. 27 2006 916 927
31. Md. Hassan, Kotagiri R., Chandan K. et al. A Novel scalable multi-class ROC for effective visualization and computation Advances in Knowledge Discovery and Data Mining14th Pacific-Asia Conference June, 21-24 2010
32. Kennedy J., Eberhart R. Particle swarm optimization Proceedings of IEEE International Conference on Neural Networks 1995 1942 1948
33. W. Bin, P. Qinke, Z. Jing A binary particle swarm optimization algorithm inspired by multi-level organizational learning behavior Eur. J. Oper. Res. 219 2012 224 233
34. Kennedy J., Eberhart R.C. A discrete binary version of the particle swarm algorithm IEEE International Conference on Systems Man and Cybernetics Computational Cybernetics and Simulation 1997
35. Bache K., Lichman M. UCI Machine Learning Repository [http://archive.ics.uci.edu/ml] 2013 University of California, School of Information and Computer Science Irvine, CA
36. Ando S. Classifying imbalanced data in distance-based feature space Knowl. Inf. Syst. 2015 1 24
37. R.C. Prati, Gustavo E., DiegoF. Silva Class imbalance revisited: a new experimental setup to assess the performance of treatment methods Knowl. Inf. Syst. 45 2015 247 270
38. Liu Z., Cao H., Chen X. et al. Multi-fault classification based on wavelet SVM with PSO algorithm to analyze vibration signals from rolling element bearings Neurocomputing 99 1 2013 399 410
39. Wang X., Matwin S., Japkowicz N., Liu X. Cost-sensitive boosting algorithms for imbalanced multi-instance datasets Canadian Conference on Artificial Intelligence 2013 174 186
40. Alberto F., Victoria L., Mikel G. et al. Analysing the classification of imbalanced data-sets with multiple classes: binarization techniques and ad-hoc approaches Knowl.-Based Syst. 42 2013 97 110
41. F. Wilcoxon Individual comparisons by ranking methods Biometr. Bull. 6 1945 80 83
42. D. Sheskin Handbook of Parametric and Nonparametric Statistical Procedures 2006 Chapman & Hall/CRC London, U.K.
43. S. Holm A simple sequentially rejective multiple test procedure Scand. J. Stat. 6 1979 65 70
44. M.D. Pérez-Godoy, Rivera A.J, Carmona C.J. et al. Training algorithms for radial basis function networks to tackle learning processes with imbalanced data-sets Appl. Soft Comput. 25 2014 26 39
45. RobertE. Schapire, Yoram Singer Improved boosting algorithms using confidence-rated pre-dictions Mach. Learn. 37 3 1999 297 336
46. Yoav Freund, RobertE. Schapire A decision-theoretic generalization of on-line learning and an application to boosting J. Comput. Syst. Sci. 55 1 1997 119 139
47. B. Krawczyk, G. Schaefer An improved ensemble approach for imbalanced classification problems 8th IEEE International Symposium on Applied Computational Intelligence and Informatics 2013
48. Yin Q.Y., Zhang J.S., Zhang C.X. et al. A novel selective ensemble algorithm for imbalanced data classification based on exploratory undersampling Math. Prob. Eng. 71 3 2014 741 764
49. L. Yin, Y. Ge, K. Xiao Feature selection for high-dimensional imbalanced data Neurocomputing 105 3 2013 3 11
50. Shanab A., Khoshgoftaar T., Wald R. et al. Comparison of approaches to alleviate problems with high-dimensional and class-imbalanced data IEEE International Conference on Information Reuse and Integration 2011 234 239
51. Seiffert C., Khoshgoftaar T.M., Van Hulse J. et al. RUSBoost: a hybrid approach to alleviating class imbalance IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 40 1 2010 185 197
52. Vorraboot P., Rasmequan S., Lursinsap C. et al. Improving classification rate constrained to imbalanced data between overlapped and non-overlapped regions by hybrid algorithms Neurocomputing 152 2015 429 443
53. Krawczyk B., Wozniak M., Herrera F. Weighted one-class classification for different types of minority class examples in imbalanced data IEEE Computational Intelligence and Data Mining (CIDM) 2014 337 344
54. Tian J., Gu H., Liu W. Imbalanced classification using support vector machine ensemble Neural Comput. Appl. 20 2 2011 203 209
55. Thai-Nghe N., Gantner Z., Schmidt-Thieme L. Cost-sensitive learning methods for imbalanced data IEEE International Joint Conference Neural Networks (IJCNN) 2010 1 8
56. Zięba M., Tomczak J.M. Boosted SVM with active learning strategy for imbalanced data Soft Comput. 2014 1 12
57. Krawczyk B., M. Woźniak Hypertension Type Classification Using Hierarchical Ensemble of One-Class Classifiers for Imbalanced Data 2015 Springer International Publishing 341 349
58. Wallace B.C., Dahabreh I.J. Improving class probability estimates for imbalanced data Knowl. Inf. Syst. 41 1 2014 33 52
59. López V., Fernández A., Herrera F. On the importance of the validation technique for classification with imbalanced datasets: addressing covariate shift when data is skewed Inf. Sci. 257 2 2014 1 13
60. Thomas L., Robert P.W.D. A simplified extension of the Area under the ROC to the multiclass domain Proceedings 17th Annual Symposium of the Pattern Recognition Association of South Africa 2006 PRASA 241 245
61. C. Ferri, J. Hernández-orallo, M.A. Salido Volume under the ROC surface for multi-class problems. exact computation and evaluation of approximations Proc. of 14th European Conference on Machine Learning 2003 108 120
62. Lachiche, N., Flach, P.A., 2003. Improving accuracy and cost of two-class and multi-class probabilistic classifiers using roc curves. ICML-2003.
63. Nanni L., Fantozzi C., &Lazzarini N. Coupling different methods for overcoming the class imbalance problem Neurocomputing 158 2015 48 61
64. Song B., Zhang G., Wei Z. et al. ROC operating point selection for classification of imbalanced data with application to computer-aided polyp detection in CT colonography Int. J. Comput. Assist. Radiol. Surg. 9 1 2014 79 89
65. Jerzy S., Krystyna N. Addressing imbalanced data with argument based rule learning Exp. Syst. Appl. 24 2015 9468 9481
66. Yu L., Liu H., Yu L. et al. Efficient feature selection via analysis of relvance and redundancy J. Mach. Learn. Res. 5 4 2004 1205 1224
67. Kittler J., Hatef M., Duin R.P.W. et al. On combining classifiers IEEE Trans. Pattern Anal. Mach. Intell. 1998 226 239
68. Peng L., Chen Y., Yang B. et al. A novel classification method based on data gravitation, neural networks and brain, 2005 ICNN&B '05. International Conference on IEEE 2005 667 672