A new ensemble learning methodology based on hybridization of classifier ensemble selection approaches

Applied Soft Computing Journal

Volumn 37, Issue , 2015, Pages 652-666

  Mousavi, R ^a   Eftekhari, M ^b  

^a GRADUATE UNIVERSITY OF ADVANCED TECHNOLOGY   (Iran)

^b SHAHID BAHONAR UNIVERSITY OF KERMAN   (Iran)

Author keywords

Classifier combination; Classifier diversity; Dynamic ensemble selection; Ensemble learning system; Multi objective optimization; Static ensemble selection

Indexed keywords

CLASSIFICATION (OF INFORMATION); GENETIC ALGORITHMS; LEARNING SYSTEMS;

CLASSIFIER COMBINATION; CLASSIFIER DIVERSITIES; DYNAMIC ENSEMBLE SELECTIONS; ENSEMBLE LEARNING; ENSEMBLE SELECTIONS;

MULTIOBJECTIVE OPTIMIZATION;

EID: 84942420474     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2015.09.009     Document Type: Article

References (50)

1. R. Polikar Ensemble based systems in decision making IEEE Circuits Syst. Mag. 6 2006 21 45
2. S. Oh, M.S. Lee, and B.-T. Zhang Ensemble learning with active example selection for imbalanced biomedical data classification IEEE/ACM Trans. Comput. Biol. Bioinform. 8 2011 316 325
3. M.-J. Kim, and D.-K. Kang Classifiers selection in ensembles using genetic algorithms for bankruptcy prediction Expert Syst. Appl. 39 2012 9308 9314
4. D. Hillard, S. Purpura, and J. Wilkerson An active learning framework for classifying political text Annual meeting of the Midwest Political Science Association 2007
5. H. Moon, H. Ahn, R.L. Kodell, S. Baek, C.-J. Lin, and J.J. Chen Ensemble methods for classification of patients for personalized medicine with high-dimensional data Artif. Intell. Med. 41 2007 197 207
6. L.L. Minku, and X. Yao DDD: a new ensemble approach for dealing with concept drift IEEE Trans. Knowl. Data Eng. 24 2012 619 633
7. G. Ditzler, and R. Polikar Incremental learning of concept drift from streaming imbalanced data IEEE Trans. Knowl. Data Eng. 25 2012 2283 2301
8. G.A. Carpenter, S. Martens, and O.J. Ogas Self-organizing information fusion and hierarchical knowledge discovery: a new framework using ARTMAP neural networks Neural Netw. 18 2005 287 295
9. S. Gunter, and H. Bunke An evaluation of ensemble methods in handwritten word recognition based on feature selection Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on, IEEE 2004 388 392
10. M. Muhlbaier, A. Topalis, and R. Polikar Ensemble confidence estimates posterior probability Mult. Classif. Syst. 2005 844 845
11. C. Zhang Ensemble Machine Learning 2012 Springer Science + Business Media
12. C. Zhang, and Y. Ma Ensemble Machine Learning: Methods and Applications 2012 Springer
13. L.I. Kuncheva Clustering-and-selection model for classifier combination Knowledge-Based Intelligent Engineering Systems and Allied Technologies, 2000. Proceedings. Fourth International Conference on, IEEE 2000 185 188
14. R. Liu, and B. Yuan Multiple classifiers combination by clustering and selection Inf. Fus. 2 2001 163 168
15. L. Yang Classifiers selection for ensemble learning based on accuracy and diversity Procedia Eng. 15 2011 4266 4270
16. K. Woods, W.P. Kegelmeyer Jr., and K. Bowyer Combination of multiple classifiers using local accuracy estimates IEEE Trans. Pattern Anal. Mach. Intell. 19 1997 405 410
17. G. Giacinto, and F. Roli Dynamic classifier selection based on multiple classifier behaviour Pattern Recognit. 34 2001 1879 1881
18. P.C. Smits Multiple classifier systems for supervised remote sensing image classification based on dynamic classifier selection IEEE Trans. Geosci. Remote Sens. 40 2002 801 813
19. A.H. Ko, R. Sabourin, and A.S. Britto Jr. From dynamic classifier selection to dynamic ensemble selection Pattern Recognit. 41 2008 1718 1731
20. T. Woloszynski, M. Kurzynski, P. Podsiadlo, and G.W. Stachowiak A measure of competence based on random classification for dynamic ensemble selection Inf. Fus. 13 2012 207 213
21. T. Woloszynski, and M. Kurzynski On a new measure of classifier competence in the feature space Computer Recognition Systems 3 2009 Springer 285 292
22. J. Xiao, and C. He Dynamic classifier ensemble selection based on GMDH Computational Sciences and Optimization, 2009. CSO 2009. International Joint Conference on, IEEE 2009 731 734
23. T. Woloszynski, and M. Kurzynski A probabilistic model of classifier competence for dynamic ensemble selection Pattern Recognit. 44 2011 2656 2668
24. R.A. Jacobs, M.I. Jordan, S.J. Nowlan, and G.E. Hinton Adaptive mixtures of local experts Neural Comput. 3 1991 79 87
25. D. Ruta, and B. Gabrys Classifier selection for majority voting Inf. Fus. 6 2005 63 81
26. J. Xiao, C. He, X. Jiang, and D. Liu A dynamic classifier ensemble selection approach for noise data Inf. Sci. 180 2010 3402 3421
27. A. Chandra, H. Chen, and X. Yao Trade-off between diversity and accuracy in ensemble generation Multi-objective Machine Learning 2006 Springer 429 464
28. A. Frank, and A. Asuncion UCI Machine Learning Repository 2010 http://archive.ics.uci.edu/ml
29. L.I. Kuncheva Ludmila Kuncheva Collection 2004 http://www.bangor.ac.uk/mas00a/activities/patrec1.html
30. K. Kottathra, and Y. Attikiouzel A novel multicriteria optimization algorithm for the structure determination of multilayer feedforward neural networks J. Netw. Comput. Appl. 19 1996 135 147
31. M.A. Kupinski, and M.A. Anastasio Multiobjective genetic optimization of diagnostic classifiers with implications for generating receiver operating characteristic curves IEEE Trans. Med. Imaging 18 1999 675 685
32. H.A. Abbass Speeding up backpropagation using multiobjective evolutionary algorithms Neural Comput. 15 2003 2705 2726
33. A. Chandra, and X. Yao Ensemble learning using multi-objective evolutionary algorithms J. Math. Model. Algorithms 5 2006 417 445
34. A. Chandra, and X. Yao DIVACE: diverse and accurate ensemble learning algorithm Intelligent Data Engineering and Automated Learning-IDEAL 2004 2004 Springer 619 625
35. H. Chen, and X. Yao Multiobjective neural network ensembles based on regularized negative correlation learning IEEE Trans. Knowl. Data Eng. 22 2010 1738 1751
36. A. Hatamlou Black hole: a new heuristic optimization approach for data clustering Inf. Sci. 222 2013 175 184
37. B. Javidy, A. Hatamlou, and S. Mirjalili Ions motion algorithm for solving optimization problems Appl. Soft Comput. 32 2015 72 79
38. C.A.C. Coello, G.B. Lamont, and D.A. Van Veldhuisen Evolutionary Algorithms for Solving Multi-objective Problems 2007 Springer
39. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan A fast and elitist multiobjective genetic algorithm: NSGA-II IEEE Trans. Evolut. Comput. 6 2002 182 197
40. G. Brown, J. Wyatt, R. Harris, and X. Yao Diversity creation methods: a survey and categorisation Inf. Fus. 6 2005 5 20
41. R.W. Johnson An introduction to the bootstrap Teach. Stat. 23 2001 49 54
42. T.K. Ho The random subspace method for constructing decision forests IEEE Trans. Pattern Anal. Mach. Intell. 20 1998 832 844
43. L.I. Kuncheva, and C.J. Whitaker Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy Mach. Learn. 51 2003 181 207
44. P.H.A. Sneath, and R.R. Sokal Numerical taxonomy The principles and practice of numerical classification 1973
45. G. Giacinto, and F. Roli Design of effective neural network ensembles for image classification purposes Image Vis. Comput. 19 2001 699 707
46. R. Duin, P. Juszczak, P. Paclik, E. Pekalska, D. De Ridder, D. Tax, and S. Verzakov A Matlab Toolbox for Pattern Recognition 2007 http://prtools.org
47. A. Rahman, and B. Verma Ensemble classifier generation using non-uniform layered clustering and Genetic Algorithm Knowl. Based Syst. 43 2013 30 42
48. J. Alcalá, A. Fernández, J. Luengo, J. Derrac, S. García, L. Sánchez, and F. Herrera KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework J. Mul. Valued Log. Soft Comput. 17 2011 255 287
49. J. Demšar Statistical comparisons of classifiers over multiple data sets J. Mach. Learn. Res. 7 2006 1 30
50. D.W. Corne, and J.D. Knowles No free lunch and free leftovers theorems for multiobjective optimisation problems Evolutionary Multi-Criterion Optimization 2003 Springer 327 341