Addressing imbalance in multilabel classification: Measures and random resampling algorithms

Neurocomputing

Volumn 163, Issue , 2015, Pages 3-16

  Charte, Francisco ^a   Rivera, Antonio J ^b   del Jesus, María J ^b   Herrera, Francisco ^a,c  

^a UNIVERSITY OF GRANADA   (Spain)

^b UNIVERSITY OF JAÉN   (Spain)

^c KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

Author keywords

Imbalanced classification; Multilabel classification; Oversampling; Resampling algorithms; Undersampling

Indexed keywords

COMPUTER APPLICATIONS; NEURAL NETWORKS;

IMBALANCED CLASSIFICATION; MULTI-LABEL CLASSIFICATIONS; OVER SAMPLING; RESAMPLING ALGORITHMS; UNDER-SAMPLING;

CLASSIFICATION (OF INFORMATION);

ACCURACY; ALGORITHM; ARTICLE; CLASSIFICATION; CLASSIFIER; DATA BASE; LEARNING; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MEASUREMENT; MULTILABEL CLASSIFICATION; PRIORITY JOURNAL; RESAMPLING ALGORITHM; STANDARDIZATION; STATISTICAL ANALYSIS;

EID: 84930273620     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2014.08.091     Document Type: Article

References (43)

1. Tsoumakas G., Katakis I., Vlahavas I. Mining multi-label data. Data Mining and Knowledge Discovery Handbook 2010, 667-685. Springer, Boston, MA, USA, (Chapter 34). 10.1007/978-0-387-09823-4_34. L. Rokach, O. Maimon (Eds.).
2. Zhang M.-L. Multilabel neural networks with applications to functional genomics and text categorization. IEEE Trans. Knowl. Data Eng. 2006, 18(10):1338-1351. 10.1109/TKDE.2006.162.
3. A. Wieczorkowska, P. Synak, Z. Raś, Multi-label classification of emotions in music, in: Intelligent Information Processing and Web Mining, AISC, vol. 35, 2006, pp. 307-315 (Chapter 30). doi:10.1007/3-540-33521-8_30.
4. Japkowicz N., Stephen S. The class imbalance problem. a systematic study. Intell. Data Anal. 2002, 6(5):429-449.
5. Fernández A., López V., Galar M., del Jesus M.J., Herrera F. Analysing the classification of imbalanced data-sets with multiple classes. binarization techniques and ad-hoc approaches. Knowl. Based Syst. 2013, 42:97-110. 10.1016/j.knosys.2013.01.018.
6. López V., Fernández A., García S., Palade V., Herrera F. An insight into classification with imbalanced data. empirical results and current trends on using data intrinsic characteristics. Inf. Sci. 2013, 250:113-141. 10.1016/j.ins.2013.07.007.
7. Tahir M.A., Kittler J., Bouridane A. Multilabel classification using heterogeneous ensemble of multi-label classifiers. Pattern Recognit. Lett. 2012, 33(5):513-523. 10.1016/j.patrec.2011.10.019.
8. Tahir M.A., Kittler J., Yan F. Inverse random under sampling for class imbalance problem and its application to multi-label classification. Pattern Recognit. 2012, 45(10):3738-3750. 10.1016/j.patcog.2012.03.014.
9. He J., Gu H., Liu W. Imbalanced multi-modal multi-label learning for subcellular localization prediction of human proteins with both single and multiple sites. PloS One 2012, 7(6):7155. 10.1371/journal.pone.0037155.
10. S. Diplaris, G. Tsoumakas, P. Mitkas, I. Vlahavas, Protein classification with multiple algorithms, in: Proceedings of the 10th Panhellenic Conference on Informatics, Volos, Greece, PCI'05, 2005, pp. 448-456. doi:10.1007/11573036_42.
11. S. Godbole, S. Sarawagi, Discriminative methods for multi-labeled classification, in: Advances in Knowledge Discovery and Data Mining, vol. 3056, 2004, pp. 22-30. doi:10.1007/978-3-540-24775-3_5.
12. Hüllermeier E., Fürnkranz J., Cheng W., Brinker K. Label ranking by learning pairwise preferences. Artif. Intell. 2008, 172(16):1897-1916. 10.1016/j.artint.2008.08.002.
13. Boutell M., Luo J., Shen X., Brown C. Learning multi-label scene classification. Pattern Recognit. 2004, 37(9):1757-1771. 10.1016/j.patcog.2004.03.009.
14. A. Clare, R.D. King, Knowledge discovery in multi-label phenotype data, in: Proceedings of the Fifth European Conference on Principles on Data Mining and Knowledge Discovery, Freiburg, Germany, PKDD'01, vol. 2168, 2001, pp. 42-53. doi:10.1007/3-540-44794-6_4.
15. Zhang M., Zhou Z. ML-KNN. a lazy learning approach to multi-label learning. Pattern Recognit. 2007, 40(7):2038-2048. 10.1016/j.patcog.2006.12.019.
16. Zhang M.-L. Ml-rbf. RBF neural networks for multi-label learning. Neural Process. Lett. 2009, 29:61-74. 10.1007/s11063-009-9095-3.
17. A. Elisseeff, J. Weston, A kernel method for multi-labelled classification, in: Advances in Neural Information Processing Systems, vol. 14, MIT Press, Cambridge, MA, USA, 2001, pp. 681-687.
18. Zhang M.L., Zhou Z.H. A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 2014, 8:1819-1837. 10.1109/TKDE.2013.39.
19. Chawla N.V., Japkowicz N., Kotcz A. Editorial. special issue on learning from imbalanced data sets. SIGKDD Explor. Newslett. 2004, 6(1):1-6. 10.1145/1007730.1007733.
20. Krawczyk B., Woźniak M., Schaefer G. Cost-sensitive decision tree ensembles for effective imbalanced classification. Appl. Soft Comput. 2014, 14:554-562. 10.1016/j.asoc.2013.08.014.
21. Kotsiantis S.B., Pintelas P.E. Mixture of expert agents for handling imbalanced data sets. Ann. Math. Comput. Teleinform. 2003, 1:46-55.
22. Chawla N.V., Bowyer K.W., Hall L.O., Kegelmeyer W.P. Smote. synthetic minority over-sampling technique. J. Artif. Intell. Res. 2002, 16:321-357. 10.1613/jair.953.
23. He H., Ma Y. Imbalanced Learning: Foundations, Algorithms, and Applications 2013, Wiley-IEEE Press, Hoboken, NJ, USA.
24. G. Tsoumakas, E.S. Xioufis, J. Vilcek, I. Vlahavas, MULAN Multi-Label Dataset Repository. URL . http://mulan.sourceforge.net/datasets.html.
25. I. Katakis, G. Tsoumakas, I. Vlahavas, Multilabel text classification for automated tag suggestion, in: Proceedings of ECML PKDD'08 Discovery Challenge, Antwerp, Belgium, 2008, pp. 75-83.
26. Turnbull D., Barrington L., Torres D., Lanckriet G. Semantic annotation and retrieval of music and sound effects. IEEE Audio Speech Lang. Process. 2008, 16(2):467-476. 10.1109/TASL.2007.913750.
27. P. Duygulu, K. Barnard, J. de Freitas, D. Forsyth, Object recognition as machine translation: learning a Lexicon for a fixed image vocabulary, in: Proceedings of the Seventh European Conference on Computer Vision-Part IV, Copenhagen, Denmark, ECCV'02, 2002, pp. 97-112. doi:10.1007/3-540-47979-1_7.
28. Barnard K., Duygulu P., Forsyth D., de Freitas N., Blei D.M., Jordan M.I. Matching words and pictures. J. Mach. Learn. Res. 2003, 3:1107-1135.
29. B. Klimt, Y. Yang, The Enron Corpus: a new dataset for email classification research, in: Proceedings of ECML'04, Pisa, Italy, 2004, pp. 217-226. doi:10.1007/978-3-540-30115-8_22.
30. J. Read, P. Reutemann, MEKA Multi-Label Dataset Repository. URL . http://meka.sourceforge.net/#datasets.
31. C.G.M. Snoek, M. Worring, J.C. van Gemert, J.M. Geusebroek, A.W.M. Smeulders, The challenge problem for automated detection of 101 semantic concepts in multimedia, in: Proceeding of the 14th Annual ACM International Conference on Multimedia, Santa Barbara, CA, USA, MULTIMEDIA'06, 2006, pp. 421-430. doi:10.1145/1180639.1180727.
32. A.N. Srivastava, B. Zane-Ulman, Discovering recurring anomalies in text reports regarding complex space systems, in: Aerospace Conference, IEEE, Big Sky, MT, USA, 2005, pp. 3853-3862. doi:10.1109/AERO.2005.1559692.
33. F. Charte, A. Rivera, M.J. Jesus, F. Herrera, A first approach to deal with imbalance in multi-label datasets, in: Hybrid Artificial Intelligent Systems, Lecture Notes in Computer Science, vol. 8073, 2013, pp. 150-160. doi:10.1007/978-3-642-40846-5_16.
34. G. Tsoumakas, I. Vlahavas, Random k-labelsets: an ensemble method for multilabel classification, in: Proceedings of the 18th European Conference on Machine Learning, Warsaw, Poland, ECML'07, vol. 4701, 2007, pp. 406-417. doi:10.1007/978-3-540-74958-5_38.
35. G. Tsoumakas, I. Katakis, I. Vlahavas, Effective and efficient multilabel classification in domains with large number of labels, in: Proceedings of ECML/PKDD Workshop on Mining Multidimensional Data, Antwerp, Belgium, MMD'08, 2008, pp. 30-44.
36. K. Sechidis, G. Tsoumakas, I. Vlahavas, On the stratification of multi-label data, in: Machine Learning and Knowledge Discovery in Databases, Springer, Athens, Greece, 2011, pp. 145-158. doi:10.1007/978-3-642-23808-6_10.
37. Fürnkranz J., Hüllermeier E., Loza Mencía E., Brinker K. Multilabel classification via calibrated label ranking. Mach. Learn. 2008, 73:133-153. 10.1007/s10994-008-5064-8.
38. Cheng W., Hüllermeier E. Combining instance-based learning and logistic regression for multilabel classification. Mach. Learn. 2009, 76(2-3):211-225. 10.1007/s10994-009-5127-5.
39. Madjarov G., Kocev D., Gjorgjevikj D., Džeroski S. An extensive experimental comparison of methods for multi-label learning. Pattern Recognit. 2012, 45(9):3084-3104. 10.1016/j.patcog.2012.03.004.
40. L. Tang, S. Rajan, V.K. Narayanan, Large scale multi-label classification via metalabeler, in: Proceedings of the 18th International Conference on World Wide Web, WWW '09, 2009, pp. 211-220. doi:10.1145/1526709.1526738.
41. Garci{dotless}a S., Herrera F. An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons. J. Mach. Learn. Res. 2008, 9(2677-2694):66.
42. García S., Fernández A., Luengo J., Herrera F. Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining. experimental analysis of power. Inf. Sci. 2010, 180(10):2044-2064. 10.1016/j.ins.2009.12.010.
43. García V., Sánchez J., Mollineda R. On the effectiveness of preprocessing methods when dealing with different levels of class imbalance. Knowl. Based Syst. 2012, 25(1):13-21. 10.1016/j.knosys.2011.06.013.