A measure of competence based on random classification for dynamic ensemble selection

Information Fusion

Volumn 13, Issue 3, 2012, Pages 207-213

  Woloszynski, Tomasz ^a   Kurzynski, Marek ^b   Podsiadlo, Pawel ^a   Stachowiak, Gwidon W ^a  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

^b WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Competence measure; Dynamic ensemble selection; Multiple classifier system; Random classification

Indexed keywords

CLASSIFICATION ACCURACY; CLASSIFICATION SYSTEM; CLASSIFIER ENSEMBLES; COMPETENCE MEASURE; DATA SETS; DYNAMIC ENSEMBLE; DYNAMIC ENSEMBLE SELECTION; MAJORITY VOTING RULES; MULTIPLE CLASSIFIER SYSTEMS; TEST EXAMPLES; UCI MACHINE LEARNING REPOSITORY;

INFORMATION FUSION;

SOFTWARE ENGINEERING;

EID: 84858073995     PISSN: 15662535     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.inffus.2011.03.007     Document Type: Article

References (43)

1. L.I. Kuncheva Combining Pattern Classifiers: Methods and Algorithms 2004 Wiley Interscience
2. J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas On combining classifiers IEEE Transactions on Pattern Analysis and Machine Intelligence 20 3 1998 226 239 (Pubitemid 128741312)
3. T. Woloszynski, M. Kurzynski, Application of combining classifiers using dynamic weights to the protein secondary structure prediction - comparative analysis of fusion methods, in: Proceedings of the 7th International Symposium on Biological and Medical Data Analysis, 2006, pp. 83-91. (Pubitemid 47163844)
4. A.M.P. Canuto, M.C.C. Abreu, L.M. Oliveira, J.C. Xavier Jr., and A.M. Santos Investigating the influence of the choice of the ensemble members in accuracy and diversity of selection-based and fusion-based methods for ensembles Pattern Recognition Letters 28 4 2007 472 486 (Pubitemid 44918135)
5. L. Breiman Bagging predictors Machine Learning 24 2 1996 123 140 (Pubitemid 126724382)
6. Y. Freund, and R.E. Schapire A decision-theoretic generalization of on-line learning and an application to boosting Journal of Computer and System Sciences 55 1 1997 119 139 (Pubitemid 127433398)
7. T.K. Ho The random subspace method for constructing decision forests IEEE Transactions on Pattern Analysis and Machine Intelligence 20 8 1998 832 844 (Pubitemid 128741345)
8. L.I. Kuncheva A theoretical study on six classifier fusion strategies IEEE Transactions on Pattern Analysis and Machine Intelligence 24 2 2002 281 286 (Pubitemid 34198215)
9. R.E. Banfield, L.O. Hall, K.W. Bowyer, and W.P. Kegelmeyer Ensemble diversity measures and their application to thinning Information Fusion 6 1 2005 49 62
10. D. Ruta, and B. Gabrys Classifier selection for majority voting Information Fusion 6 1 2005 63 81
11. G. Martinez-Munoz, D. Hernandez-Lobato, and A. Suarez An analysis of ensemble pruning techniques based on ordered aggregation IEEE Transactions on Pattern Analysis and Machine Intelligence 31 2 2009 245 259
12. D.D. Margineantu, T.G. Dietterich, Pruning adaptive boosting, in: Proceedings of the Fourteenth International Conference on Machine Learning, 1997, pp. 211-218.
13. G. Martinez-Munoz, A. Suarez, Aggregation ordering in bagging, in: Proceedings of the IASTED International Conference on Artificial Intelligence and Applications, 2004, pp. 258-263. (Pubitemid 40027393)
14. G. Tsoumakas, L. Angelis, and I. Vlahavas Selective fusion of heterogeneous classifiers Intelligent Data Analysis 9 6 2005 511 525
15. I. Partalas, G. Tsoumakas, and I. Vlahavas Pruning an ensemble of classifiers via reinforcement learning Neurocomputing 72 7-9 2009 1900 1909
16. Z.-H. Zhou, J. Wu, and W. Tang Ensembling neural networks: many could be better than all Artificial Intelligence 137 1-2 2002 239 263 (Pubitemid 34405220)
17. Y. Zhang, S. Burer, and W.N. Street Ensemble pruning via semi-definite programming Journal of Machine Learning Research 7 2006 1315 1338 (Pubitemid 44024598)
18. L.I. Kuncheva, Clustering-and-selection model for classifier combination, in: Proceedings of the Fourth International Conference on Knowledge-based Intelligent Engineering Systems and Allied Technologies, 2000, pp. 185-188.
19. R. Liu, and B. Yuan Multiple classifiers combination by clustering and selection Information Fusion 2 3 2001 163 168 (Pubitemid 33396498)
20. B.V. Dasarathy, and B.V. Sheela A composite classifier system design: concepts and methodology Proceedings of the IEEE 67 5 1979 708 713
21. K. Woods, W.P. Kegelmeyer Jr., and K. Bowyer Combination of multiple classifiers using local accuracy estimates IEEE Transactions on Pattern Analysis and Machine Intelligence 19 4 1997 405 410 (Pubitemid 127762896)
22. G. Giacinto, and F. Roli Dynamic classifier selection based on multiple classifier behaviour Pattern Recognition 34 2001 1879 1881
23. L. Didaci, G. Giacinto, F. Roli, and G.L. Marcialis A study on the performances of dynamic classifier selection based on local accuracy estimation Pattern Recognition 38 2005 2188 2191 (Pubitemid 41214654)
24. A.H.R. Ko, R. Sabourin, and A.S. Britto Jr. From dynamic classifier selection to dynamic ensemble selection Pattern Recognition 41 5 2008 1718 1731
25. E. Kim, Y. Lee, Multiple classifier fusion method based on local competence, in: Proceedings of the IASTED International Conference, 2002, pp. 404-409.
26. M.C.P. de Souto, R.G.F. Soares, A. Santana, A.M.P. Canuto, Empirical comparison of dynamic classifier selection methods based on diversity and accuracy for building ensembles, in: Proceedings of the International Joint Conference on Neural Networks, 2008, pp. 1480-1487.
27. E.M.D. Santos, R. Sabourin, and P. Maupin A dynamic overproduce-and- choose strategy for the selection of classifier ensembles Pattern Recognition 41 10 2008 2993 3009
28. L. Breiman Random forests Machine Learning 45 1 2001 5 32 (Pubitemid 32933532)
29. T. Woloszynski, M. Kurzynski, On a new measure of classifier competence applied to the design of multiclassifier systems, in: Proceedings of the 15th International Conference on Image Analysis and Processing, 2009, pp. 995-1004.
30. P.C. Smits Multiple classifier systems for supervised remote sensing image classification based on dynamics classifier selection IEEE Transactions on Geoscience and Remote Sensing 40 4 2002 801 813 (Pubitemid 34741654)
31. A. Asuncion, D.J. Newman, UCI Machine Learning Repository, 2007. < http://www.ics.uci.edu/mlearn/MLRepository.html >.
32. L.I. Kuncheva, Ludmila Kuncheva Collection, 2004. < http://www.bangor.ac.uk/mas00a/activities/patrec1.html >.
33. P.J. Boland Majority systems and the Condorcet Jury Theorem Journal of the Royal Statistical Society: Series D (The Statistician) 38 3 1989 181 189
34. C. List, and R.E. Goodin Epistemic democracy: generalizing the Condorcet Jury Theorem Journal of Political Philosophy 9 3 2001 277 306
35. L. Devroye, L. Gyorfi, and G. Lugosi A Probabilistic Theory of Pattern Recognition (Stochastic Modelling and Applied Probability) 1997 Springer
36. R.P. Duin, P. Juszczak, P. Paclik, E. Pekalska, D. de Ridder, D. Tax, S. Verzakov, PR-Tools4.1, A MATLAB Toolbox for Pattern Recognition, 2007. < http://prtools.org >.
37. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification 2001 Wiley Interscience
38. J. Demsar Statistical comparison of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30 (Pubitemid 43022939)
39. E. Alpaydin Combined 5x2cv F test for comparing supervised classification learning algorithms Neural Computation 11 8 1999 1885 1992
40. S.-C. Fang, and H.-L. Chan Human identification by quantifying similarity and dissimilarity in electrocardiogram phase space Pattern Recognition 42 9 2009 1824 1831
41. J.L. Hernandez, R. Biscay, J.C. Jimenez, P. Valdes, and R.G. de Peralta Measuring the dissimilarity between EEG recordings through a non-linear dynamical system approach International Journal of Bio-Medical Computing 38 2 1995 121 129
42. R.G. Geocadin, R. Ghodadra, T. Kimura, H. Lei, D.L. Sherman, D.F. Hanley, and N.V. Thakor A novel quantitative EEG injury measure of global cerebral ischemia Clinical Neurophysiology 111 10 2000 1779 1787
43. T. Woloszynski, P. Podsiadlo, G.W. Stachowiak, and M. Kurzynski A signature dissimilarity measure for trabecular bone texture in knee radiographs Medical Physics 37 5 2010 2030 2042