Dynamic ensemble pruning based on multi-label classification

Neurocomputing

Volumn 150, Issue PB, 2015, Pages 501-512

  Markatopoulou, Fotini ^b   Tsoumakas, Grigorios ^a   Vlahavas, Ioannis ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^b INFORMATION TECHNOLOGIES INSTITUTE   (Greece)

Author keywords

Dynamic classifier fusion; Ensemble pruning; Ensemble selection; Multi label classification

Indexed keywords

PERSONNEL TRAINING;

CLASSIFICATION ACCURACY; DYNAMIC CLASSIFIERS; DYNAMIC ENSEMBLE; ENSEMBLE PRUNING; ENSEMBLE SELECTIONS; HETEROGENEOUS ENSEMBLES; MULTI LABEL CLASSIFICATION; PREDICTION ACCURACY;

CLASSIFICATION (OF INFORMATION);

ARTICLE; CALIBRATED LABEL RANKING; CLASSIFICATION ALGORITHM; CLASSIFIER FUSION; CONTROLLED STUDY; DYNAMIC SELECTION; DYNAMIC VOTING; DYNAMIC VOTING WITH SELECTION; ENSEMBLE PRUNING; K NEAREST NEIGHBOR; K NEAREST ORACLE; LOCAL CLASS ACCURACY; MACHINE LEARNING; MEASUREMENT ACCURACY; MODEL COMBINATION; MULTIPLECLASSIFIER BEHAVIOR; OVERALL LOCAL ACCURACY;

EID: 84922661095     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2014.07.063     Document Type: Article

References (34)

1. A. Asuncion, D. Newman, UCI machine learning repository. URL 〈〉, 2007. http://www.ics.uci.edu/~mlearn/MLRepository.html.
2. Crammer K., Singer Y. A family of additive online algorithms for category ranking. J. Mach. Learn. Res. 2003, 3:1025-1058.
3. Demsar J. Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 2006, 7:1-30.
4. W. Fan, F. Chu, H. Wang, P.S. Yu, Pruning and dynamic scheduling of cost-sensitive ensembles, in: Eighteenth National Conference on Artificial Intelligence, American Association for Artificial Intelligence, 2002, pp. 146-151.
5. C. Feng, A. Sutherland, R. King, S. Muggleton, R. Henery, Comparison of machine learning classifiers to statistics and neural networks, in: Proceedings of the Third International Workshop in Artificial Intelligence and Statistics, 1993, pp. 41-52.
6. Fürnkranz J., Hüllermeier E., Mencia E.L., Brinker K. Multilabel classification via calibrated label ranking. Mach. Learn. 2008, 73(2):133-153.
7. G. Giacinto, F. Roli, Adaptive selection of image classifiers, in: Proceedings of 9th International Conference on Image Analysis and Processing (ICIAP[U+05F3]97), vol. I, 1997, pp. 38-45.
8. Giacinto G., Roli F. Dynamic classifier selection based on multiple classifier behavior. Pattern Recognit. 2001, 34(9):1879-1881.
9. S. Godbole, S. Sarawagi, Discriminative methods for multi-labeled classification, in: Proceedings of the 8th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD 2004), 2004, pp. 22-30.
10. Hernández-Lobato D., Martínez-Muñoz G., Suárez A. Statistical instance-based pruning in ensembles of independent classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 2009, 31(2):364-369.
11. Hüllermeier E., Fürnkranz J., Cheng W., Bringer K. Label ranking by learning pairwise preferences 2008, Artif. Intell.
12. M. Ioannou, G. Sakkas, G. Tsoumakas, I. Vlahavas, Obtaining bipartitions from score vectors for multi-label classification, in: Proceedings 22nd IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2010), IEEE Computer Society, Los Alamitos, CA, USA, 2010, pp. 409-416.
13. Ko A.H., Sabourin R., Alceu Souza Britto J. From dynamic classifier selection to dynamic ensemble selection. Pattern Recognit. 2007, 41:1718-1731.
14. L. Kuncheva, Clustering-and-selection model for classifier combination, in: Proceedings. Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies, vol. 1, 2000, pp. 185-188.
15. Kuncheva L.I., Whitaker C.J. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Mach. Learn. 2003, 51(May (2)):181-207.
16. Li L., Zou B., Hu Q., Wu X., Yu D. Dynamic classifier ensemble using classification confidence. Neurocomputing 2013, 99(0):581-591.
17. Lysiak R., Kurzynski M., Woloszynski T. Optimal selection of ensemble classifiers using measures of competence and diversity of base classifiers. Neurocomputing 2014, 126(0):29-35.
18. F. Markatopoulou, G. Tsoumakas, I. Vlahavas, Instance-based ensemble pruning via multi-label classification, in: 22nd IEEE International Conference on Tools with Artificial Intelligence (ICTAI), vol. 1, 2010, pp. 401-408.
19. Ortega J., Koppel M., Argamon S. Arbitrating among competing classifiers using learned referees. Knowl. Inf. Syst. 2001, 3(4):470-490.
20. Puuronen S., Terziyan V.Y., Tsymbal A. A dynamic integration algorithm for an ensemble of classifiers. ISMIS, Lecture Notes in Computer Science 1999, vol. 1609:592-600. Springer.
21. S. Puuronen, V.Y. Terziyan, A.K.A. Tsymbal, Dynamic integration of multiple data mining techniques in a knowledge discovery management system, in: Proceedings of SPIE Conference on Data Mining and Knowledge Discovery, 1999, pp. 128-139.
22. J. Read, B. Pfahringer, G. Holmes, Multi-label classification using ensembles of pruned sets, in: Proceedings of 8th IEEE International Conference on Data Mining (ICDM 08), 2008, pp. 995-1000.
23. J. Read, B. Pfahringer, G. Holmes, E. Frank, Classifier chains for multi-label classification, in: Proceedings of 20th European Conference on Machine Learning (ECML 2009), 2009, pp. 254-269.
24. Tsoumakas G., Katakis I., Vlahavas I. Mining multi-label data. Data Mining and Knowledge Discovery Handbook 2010, 667-685. Springer, US, (Chapter 34). 2nd edition. O. Maimon, L. Rokach (Eds.).
25. Tsoumakas G., Katakis I., Vlahavas I. Random k-labelsets for multi-label classification. IEEE Trans. Knowl. Data Eng. 2011, 23:1079-1089.
26. Tsoumakas G., Partalas I., Vlahavas I. An ensemble pruning primer. Supervised and Unsupervised Methods and Their Applications to Ensemble Methods (SUEMA 2009) 2009, 1-13. Springer Verlag, Berlin, Heidelberg. O. Okun, G. Valentini (Eds.).
27. A. Tsymbal, Decision committee learning with dynamic integration of classifiers, in: Proceedings of 2000 ADBIS-DASFAA Symposium on Advances in Databases and Information Systems, 2000.
28. A. Tsymbal, S. Puuronen, Bagging and boosting with dynamic integration of classifiers, in: Proceedings of 4th European Conference on Principles of Data Mining and Knowledge Discovery (PKDD 2000), Lyon, France, 2000, pp. 195-206.
29. Witten I.H., Frank E. Data Mining: Practical Machine Learning Tools and Techniques 2005, Morgan Kaufmann, San Francisco.
30. Woods K., Kegelmeyer W.P., Bowyer K. Combination of multiple classifiers using local accuracy estimates. IEEE Trans. Pattern Anal. Mach. Intell. 1997, 19(4):405-410.
31. Xiao J., He C., Jiang X., Liu D. A dynamic classifier ensemble selection approach for noise data. Inf. Sci. 2010, 180(18):3402-3421.
32. Y. Yan, X.-C. Yin, Z.-B. Wang, X. Yin, C. Yang, H.-W. Hao, Sorting-based dynamic classifier ensemble selection, in: 12th International Conference on Document Analysis and Recognition, IEEE, 2013, pp. 673-677.
33. Zhang M.-L., Zhou Z.-H. Multi-label neural networks with applications to functional genomics and text categorization. IEEE Trans. Knowl. Data Eng. 2006, 18(10):1338-1351.
34. Zhang M.-L., Zhou Z.-H. Ml-knn. a lazy learning approach to multi-label learning. Pattern Recognit. 2007, 40(7):2038-2048.