Multilabel classification: Problem analysis, metrics and techniques

Multilabel Classification: Problem Analysis, Metrics and Techniques

Volumn , Issue , 2016, Pages 1-194

  Herrera, Francisco ^a   Charte, Francisco ^a   Rivera, Antonio J ^b   Del Jesus, María J ^b  

^a UNIVERSITY OF GRANADA   (Spain)

^b UNIVERSITY OF JAÉN   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SOFTWARE; REVIEWS;

DATA CHARACTERIZATION; LABEL CORRELATIONS; MULTI LABEL CLASSIFICATION; MULTI-LABEL CLASSIFICATIONS; MULTIPLE APPLICATIONS; ON-LINE INFORMATION; PREPROCESSING TECHNIQUES; STEP-BY-STEP INSTRUCTIONS;

CLASSIFICATION (OF INFORMATION);

EID: 85006335487     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-3-319-41111-8     Document Type: Book

References (283)

1. Aggarwal, C.C. (ed.): Data Classification: Algorithms and Applications. CRC Press (2014)
2. Agrawal, R., Srikant, R., et al.: Fast algorithms for mining association rules. In: Proceedings of 20th International Conference on Very Large Data Bases, VLDB’94, pp. 487-499. Morgan Kaufmann (1994)
3. Aha, D.W. (ed.): Lazy Learning. Springer (1997)
4. Amores, J.: Multiple instance classification: review, taxonomy and comparative study. Artif. Intell. 201, 81-105 (2013)
5. Barber, D.: Bayesian Reasoning and Machine Learning. Cambridge University Press (2012)
6. Bielza, C., Li, G., Larranaga, P.: Multi-dimensional classification with Bayesian networks. Int. J. Approximate Reasoning 52(6), 705-727 (2011)
7. Breiman, L., Friedman, J., Stone, C.J., Olshen, R.A.: Classification and Regression Trees. CRC press (1984)
8. Celebi, M.E., Aydin, K. (eds.): Unsupervised Learning Algoritms. Springer (2016)
9. Cherkassky, V., Mulier, F.: Learning from Data: Concepts, Theory and Methods. Wiley-IEEE Press (2007)
10. Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273-297 (1995)
11. Cover, T., Hart, P.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13(1), 21-27 (1967)
12. De Gooijer, J.G., Hyndman, R.J.: 25 years of time series forecasting. Int. J. Forecast. 22(3), 443-473 (2006)
13. Dong, G., Pei, J.: Sequence Data Mining. Springer (2007)
14. Fayyad, U., Piatetsky-Shapiro, G., Smyth, P.: From data mining to knowledge discovery in databases. AI Mag. 17(3), 37 (1996)
15. Furnkranz, J., Gamberger, D., Lavra C. N.: Foundations of Rule Learning. Springer (2012)
16. Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., Herrera, F.: An overview of ensemble methods for binary classifiers in multi-class problems: experimental study on one-vs-one and one-vs-all schemes. Pattern Recogn. 44(8), 1761-1776 (2011)
17. Garrfa, S., Luengo, J., Herrera, F.: Data Preprocessing in Data Mining. Springer (2015)
18. Gibaja, E., Ventura, S.: A tutorial on multi-label learning. ACM Comput. Surv. 47(3) (2015)
19. Han, J., Kamber, M., Pei, J.: Data Mining: Concepts and Techniques. Morgan Jaufmann (2011)
20. Han, J., Pei, J., Yin, Y., Mao, R.: Mining frequent patterns without candidate generation: a frequent-pattern tree approach. Data Min. Knowl. Disc. 8(1), 53-87 (2004)
21. Hernandez-Gonzalez, J., Inza, I., Lozano, J.A.: Weak supervision and other non-standard classification problems: a taxonomy. Pattern Recogn. Lett. 69, 49-55 (2016)
22. Hyndman, R.J., Athanasopoulos, G.: Forecasting: Principles and practice. OText books (2013)
23. Koller, D., Friedman, N.: Probabilistic Graphical Models. Principles and Techniques. MIT Press (2009)
24. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436-444 (2015)
25. Novak, P.K., Lavrac, N., Webb, G.I.: Supervised descriptive rule discovery: aunifying survey of contrast set, emerging pattern and subgroup mining. J. Mach. Learn. Res. 10, 377-403 (2009)
26. Quinlan, J.R.: C4.5: Programs for Machine Learning (1993)
27. Rojas, R.: Neural Networks. A Systematic Study. Springer (1996)
28. Rokach, K., Maimon, O.: Data Mining with Decision Trees, 2nd edn. World Scientific (2015)
29. Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining multi-label data. In: Data Mining and Knowledge Discovery Handbook, pp. 667-685. Springer (2010)
30. Zhang, C., Zhang, S.: Association Rule Mining. Springer (2002)
31. Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26(8), 1819-1837 (2014)
32. Zhou, Z.H., Zhang, M.L., Huang, S.J., Li, Y.F.: Multi-instance multi-label learning. Artif. Intell. 176(1), 2291-2320 (2012)
33. Zhu, X., Goldberg, A.B.: Introduction to Semi-supervised Learning. Morgan & Claypool Publishers (2009)
34. Alcala-Fdez, J., Fernandez, A., Luengo, J., Derrac, J., Garrfa, S., Sanchez, L., Herrera, F: KEEL multi-label dataset repository. http://sci2s.ugr.es/keel/multilabel.php
35. Alcala-Fdez, J., Fernandez, A., Luengo, J., Derrac, J., Garrfa, S., Sanchez, L., Herrera, F.: KEEL data-mining software tool: data set repository and integration of algorithms and experimental analysis framework. J. Mult-valued Log. Soft Comput. 17(2-3), 255-287 (2011)
36. Alvares-Cherman, E., Metz, J., Monard, M.C.: Incorporating label dependency into the binary relevance framework for multi-label classification. Expert Syst. Appl. 39(2), 1647-1655 (2012)
37. Aly, M.: Survey on multiclass classification methods. In: Technical Report, pp. 1-9. California Institute of Technology (2005)
38. Boutell, M., Luo, J., Shen, X., Brown, C.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757-1771 (2004)
39. Breiman, L.: Bagging predictors. Mach. Learn. 24(2), 123-140 (1996)
40. Briggs, F., Lakshminarayanan, B., Neal, L., Fern, X.Z., Raich, R., Hadley, S.J.K., Hadley, A.S., Betts, M.G.: Acoustic classification of multiple simultaneous bird species: a multi-instance multi-label approach. J. Acoust. Soc. Am. 131(6), 4640-4650 (2012)
41. Brinker, K., Hullermeier, E.: Case-based multilabel ranking. In: Proceedings of 20th International Joint Conference on Artificial Intelligence, IJCAI’07, pp. 702-707. Morgan Kaufmann (2007)
42. Burges, C.J.C.: A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Disc. 2(2), 121-167 (1998)
43. Charte, F., Charte, D.: Working with multilabel datasets in R: the mldr package. R J. 7(2), 149-162(2015)
44. Charte, F., Charte, D., Rivera, A.J., del Jesus, M.J., Herrera, F.: R Ultimate multilabel dataset repository. In: Proceedings of 11th International Conference on Hybrid Artificial Intelligent Systems, HAIS’16, vol. 9648, pp. 487-499. Springer (2016)
45. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: Multilabel classification. In: Problem Analysis, Metrics and Techniques Book Repository. https://github.com/fcharte/SM-MLC
46. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: Addressing imbalance in multilabel classification: measures and random resampling algorithms. Neurocomputing 163, 3-16 (2015)
47. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: MLSMOTE: approaching imbalanced multilabel learning through synthetic instance generation. Knowl.-Based Syst. 89, 385-397 (2015)
48. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: QUINTA: a question tagging assistant to improve the answering ratio in electronic forums. In: Proceedings of IEEE International Conference on Computer as a Tool, EUROCON’15, pp. 1-6. IEEE (2015)
49. Chen, K., Lu, B., Kwok, J.: Efficient classification of multi-label and imbalanced data using min-max modular classifiers. In: Proceedings of IEEE International Joint Conference on Neural Networks, IJCNN’06, pp. 1770-1775 (2006)
50. Chen, X., Zhan, Y., Ke, J., Chen, X.: Complex video event detection via pairwise fusion of trajectory and multi-label hypergraphs. Multimedia Tools Appl. 1-22 (2015)
51. Cherkassky, V., Mulier, F.: Learning from Data: Concepts. Theory and Methods. Wiley-IEEE Press (2007)
52. Cong, H., Tong, L.H.: Grouping of triz inventive principles to facilitate automatic patent classification. Expert Syst. Appl. 34(1), 788-795 (2008)
53. Cover, T., Hart, P.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13(1), 21-27 (1967)
54. Crammer, K., Dredze, M., Ganchev, K., Talukdar, P.P., Carroll, S.: Automatic code assignment to medical text. In: Proceedings of Workshop on Biological, Translational, and Clinical Language Processing, BioNLP’07, pp. 129-136. Association for Computational Linguistics (2007)
55. Dembszynski, K., Waegeman, W., Cheng, W., Hullermeier, E.: On label dependence in multilabel classification. In: ICML Workshop on Learning from Multi-label data, pp. 5-12 (2010)
56. Dendamrongvit, S., Kubat, M.: Undersampling approach for imbalanced training sets and induction from multi-label text-categorization domains. In: New Frontiers in Applied Data Mining, LNCS, vol. 5669, pp. 40-52. Springer (2010)
57. Dietterich, T.: Ensemble methods in machine learning. In: Multiple Classifier Systems. LNCS, vol. 1857, pp. 1-15. Springer (2000)
58. Diplaris, S., Tsoumakas, G., Mitkas, P., Vlahavas, I.: Protein classification with multiple algorithms. In: Proc. 10th Panhellenic Conference on Informatics, PCI’05, vol. 3746, pp. 448-456. Springer (2005)
59. Duda, R., Hart, P., Stork, D.: Pattern Classification, 2nd edn. John Wiley (2000)
60. Dumais, S., Furnas, G., Landauer, T., Deerwester, S., Deerwester, S., et al.: Latent semantic indexing. In: Proceedings of 4th Text Retrieval Conference, TREC-4, pp. 105-115. NIST (1995)
61. Duygulu, P., Barnard, K., de Freitas, J., Forsyth, D.: Object recognition as machine translation: learning a lexicon for a fixed image vocabulary. In: Proceedings of 7th European Conference on Computer Vision, ECCV’02, vol. 2353, pp. 97-112. Springer (2002)
62. Elisseeff, A., Weston, J.: A kernel method for multi-labelled classification. In: Advances in Neural Information Processing Systems, vol. 14, pp. 681-687. MIT Press (2001)
63. Furnkranz, J., Hullermeier, E., Loza Menrfa, E., Brinker, K.: Multilabel classification via calibrated label ranking. Mach. Learn. 73, 133-153 (2008)
64. Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., Herrera, F.: An overview of ensemble methods for binary classifiers in multi-class problems: experimental study on one-vs-one and one-vs-all schemes. Pattern Recogn. 44(8), 1761-1776 (2011)
65. Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., Herrera, F.: A review on ensembles for the class imbalance problem: bagging, boosting, and hybrid-based approaches. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 42(4), 463-484 (2012)
66. Ghamrawi, N., McCallum, A.: Collective multi-label classification. In: Proceedings of 14th ACM International Conference on Information and Knowledge Management, CIKM’05, pp. 195-200. ACM (2005)
67. Gibaja, E., Ventura, S.: A tutorial on multi-label learning. ACM Comput. Surv. 47(3) (2015)
68. Gonfalves, T., Quaresma, P.: A preliminary approach to the multilabel classification problem of Portuguese juridical documents. In: Proceedings of 11th Portuguese Conference on Artificial Intelligence, EPIA’03, pp. 435-444. Springer (2003)
69. Guo, Y., Gu, S.: Multi-label classification using conditional dependency networks. In: Proceedings of 22th International Joint Conference on Artificial Intelligence, IJCAI’11, vol. 2, pp. 1300-1305 (2011)
70. Holmes, G., Donkin, A., Witten, I.H.: WEKA: a machine learning workbench. In: Proceedings of 2nd Australian and New Zealand Conference on Intelligent Information Systems, ANZIIS’02, pp. 357-361 (2002)
71. Hullermeier, E., Furnkranz, J., Cheng, W., Brinker, K.: Label ranking by learning pairwise preferences. Artif. Intell. 172(16), 1897-1916 (2008)
72. Jolliffe, I.: Introduction. In: Principal Component Analysis, pp. 1-7. Springer (1986)
73. Katakis, I., Tsoumakas, G., Vlahavas, I.: Multilabel text classification for automated tag suggestion. In: Proceedings of European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD’08, pp. 75-83 (2008)
74. Klimt, B., Yang, Y.: The enron corpus: a new dataset for email classification research. In: Proc eedings of 15th European Conference on Machine Learning, ECML’04, pp. 217-226. Springer (2004)
75. Lewis, D.D., Yang, Y., Rose, T.G., Li, F.: RCV1: a new benchmark collection for text categorization research. J. Mach. Learn. Res. 5, 361-397 (2004)
76. Read, J., Pfahringer, B., Holmes, G.: Multi-label classification using ensembles of pruned sets. In: Proc eedings of 8th IEEE International Conference on Data Mining, ICDM’08, pp. 995-1000. IEEE (2008)
77. Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. Mach. Learn. 85, 333-359 (2011)
78. Read, J., Reutemann, P.: MEKA multi-label dataset repository. http://sourceforge.net/projects/meka/files/Datasets/
79. Rokach, L.: Pattern classification using ensemble methods. World Scientific (2009)
80. Salton, G., Fox, E.A., Wu, H.: Extended Boolean information retrieval. Commun. ACM 26(11), 1022-1036 (1983)
81. Snoek, C.G.M., Worring, M., van Gemert, J.C., Geusebroek, J.M., Smeulders, A.W.M.: The challenge problem for automated detection of 101 semantic concepts in multimedia. In: Proceedings of 14th ACM International Conference on Multimedia, MULTIMEDIA’06, pp. 421-430 (2006)
82. Sobol-Shikler, T., Robinson, P.: Classification of complex information: Inference of cooccurring affective states from their expressions in speech. IEEE Trans. Pattern Anal. Mach. Intell. 32(7), 1284-1297 (2010)
83. Sriram, B., Fuhry, D., Demir, E., Ferhatosmanoglu, H., Demirbas, M.: Short text classification in twitter to improve information filtering. In: Proceedings of 33rd international ACM SIGIR conference on Research and development in information retrieval, pp. 841-842. ACM (2010)
84. Sun, L., Ji, S., Ye, J.: Multi-label dimensionality reduction. CRC Press (2013)
85. Tenenboim-Chekina, L., Rokach, L., Shapira, B.: Identification of label dependences for multilabel classification. In: Proceedings of 2nd International Workshop on Learning from MultiLabel Data, MLD’10, pp. 53-60 (2010)
86. Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining multi-label data. In: Data Mining and Knowledge Discovery Handbook, pp. 667-685. Springer (2010)
87. Tsoumakas, G., Xioufis, E.S., Vilcek, J., Vlahavas, I.: MULAN multi-label dataset repository. http://mulan.sourceforge.net/datasets.html
88. Tsoumakas, G., Xioufis, E.S., Vilcek, J., Vlahavas, I.: MULAN: a java library for multi-label learning. J. Mach. Learn. Res. 12, 2411-2414 (2011)
89. Turnbull, D., Barrington, L., Torres, D., Lanckriet, G.: Semantic annotation and retrieval of music and sound effects. IEEE Trans. Audio Speech Lang. Process. 16(2), 467-476 (2008)
90. Vembu, S., Gartner, T.: Label ranking algorithms: a survey. In: Preference learning, pp. 45-64. Springer (2011)
91. Wieczorkowska, A., Synak, P., Ras, Z.: Multi-label classification of emotions in music. In: Intelligent Information Processing and Web Mining. AISC, vol. 35, Chap. 30, pp. 307-315 (2006)
92. Wolpert, D.H., Macready, W.G.: No free lunch theorems for optimization. IEEE Trans. Evol. Comput. 1(1), 67-82 (1997)
93. Zhang, M., Zhang, K.: Multi-label learning by exploiting label dependency. In: Proceedings of 16th International Conference on Knowledge Discovery and Data Mining, ACM SIGKDD’10, pp. 999-1008 (2010)
94. Aha, D.W. (ed.): Lazy Learning. Springer (1997)
95. Aha, D.W., Kibler, D., Albert, M.K.: Instance-based learning algorithms. Mach. Learn. 6(1), 37-66 (1991)
96. Alcala-Fdez, J., Fernandez, A., Luengo, J., Derrac, J., Garrfa, S., Sanchez, L., Herrera, F: KEEL multi-label dataset repository. http://sci2s.ugr.es/keel/multilabel.php
97. Atkinson, A.B.: On the measurement of inequality. J. Econ. Theory 2(3), 244-263 (1970)
98. Barnard, K., Duygulu, P., Forsyth, D., de Freitas, N., Blei, D.M., Jordan, M.I.: Matching words and pictures. J. Mach. Learn. Res. 3, 1107-1135 (2003)
99. Boutell, M., Luo, J., Shen, X., Brown, C.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757-1771 (2004)
100. Briggs, F., Lakshminarayanan, B., Neal, L., Fern, X.Z., Raich, R., Hadley, S.J.K., Hadley, A.S., Betts, M.G.: Acoustic classification of multiple simultaneous bird species: a multi-instance multi-label approach. J. Acoust. Soc. Am. 131(6), 4640-4650 (2012)
101. Cesa-Bianchi, N., Gentile, C., Zaniboni, L.: Incremental algorithms for hierarchical classification. J. Mach. Learn. Res. 7, 31-54 (2006)
102. Chang, C.C., Lin, C.J.: LIBSVM data: multi-label classification repository. http://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/multilabel.html
103. Charte, F., Charte, D., Rivera, A.J., del Jesus, M.J., Herrera, F.: R Ultimate multilabel dataset repository. In: Proceedings of 11th International Conference on Hybrid Artificial Intelligent Systems, HAIS’16, vol. 9648, pp. 487-499. Springer (2016)
104. Charte, F., Rivera, A., del Jesus, M.J., Herrera, F.: LI-MLC: a label inference methodology for addressing high dimensionality in the label space for multilabel classification. IEEE Trans. Neural Netw. Learn. Syst. 25(10), 1842-1854 (2014)
105. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: Multilabel classification. Problem analysis, metrics and techniques book repository. https://github.com/fcharte/SM-MLC
106. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: Concurrence among Imbalanced labels and its influence on multilabel resampling algorithms. In: Proceedings of 9th International Conference on Hybrid Artificial Intelligent Systems, HAIS’14, vol. 8480. Springer (2014)
107. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: Addressing imbalance in multilabel classification: measures and random resampling algorithms. Neurocomputing 163, 3-16 (2015)
108. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: QUINTA: a question tagging assistant to improve the answering ratio in electronic forums. In: Proceedings of IEEE International Conference on Computer as a Tool, EUROCON’15, pp. 1-6. IEEE (2015)
109. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: On the impact of dataset complexity and sampling strategy in multilabel classifiers performance. In: Proceedings of 11th International Conference on Hybrid Artificial Intelligent Systems, HAIS’16, vol. 9648, pp. 500-511. Springer (2016)
110. Chua, T.S., Tang, J., Hong, R., Li, H., Luo, Z., Zheng, Y.: NUS-WIDE: a real-world web image database from National University of Singapore. In: Proceedings of 8th ACM international Conference on Image and Video Retrieval, CIVR’09, pp. 48:1-48:9. ACM (2009)
111. Crammer, K., Dredze, M., Ganchev, K., Talukdar, P.P., Carroll, S.: Automatic code assignment to medical text. In: Proceedings of Workshop on Biological, Translational, and Clinical Language Processing, BioNLP’07, pp. 129-136. Association for Computational Linguistics (2007)
112. Diplaris, S., Tsoumakas, G., Mitkas, P., Vlahavas, I.: Protein classification with multiple algorithms. In: Proceedings of 10th Panhellenic Conference on Informatics, PCI’05, vol. 3746, pp. 448-456. Springer (2005)
113. Duygulu, P., Barnard, K., de Freitas, J., Forsyth, D.: Object recognition as machine translation: learning a Lexicon for a fixed image vocabulary. In: Proceedings of 7th European Conference on Computer Vision, ECCV’02, vol. 2353, pp. 97-112. Springer (2002)
114. Elisseeff, A., Weston, J.: A kernel method for multi-labelled classification. In: Advances in Neural Information Processing Systems, vol. 14, pp. 681-687. MIT Press (2001)
115. Ghamrawi, N., McCallum, A.: Collective multi-label classification. In: Proceedings of 14th ACM International Conference on Information and Knowledge Management, CIKM’05, pp. 195-200. ACM (2005)
116. Godbole, S., Sarawagi, S.: Discriminative methods for multi-labeled classification. Adv. Knowl. Discov. Data Min. 3056, 22-30 (2004)
117. Gonfalves, E.C., Plastino, A., Freitas, A.A.: A genetic algorithm for optimizing the label ordering in multi-label classifier chains. In: Proceedings of 25th IEEE International Conference on Tools with Artificial Intelligence, ICTAI’13, pp. 469-476. IEEE (2013)
118. Joachims, T.: Text categorization with suport vector machines: learning with many relevant features. In: Proceedings of 10th European Conference on Machine Learning, ECML’98, pp. 137-142. Springer (1998)
119. Katakis, I., Tsoumakas, G., Vlahavas, I.: Multilabel text classification for automated tag suggestion. In: Proceedings of European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD’08, pp. 75-83 (2008)
120. Klimt, B., Yang, Y.: The enron corpus: a new dataset for email classification research. In: Proceedings of 15th European Conference on Machine Learning, ECML’04, pp. 217-226. Springer (2004)
121. Lang, K.: Newsweeder: learning to filter netnews. In: Proceedings of 12th International Conference on Machine Learning, ML’95, pp. 331-339 (1995)
122. Lewis, D.D., Yang, Y., Rose, T.G., Li, F.: RCV1: a new benchmark collection for text categorization research. J. Mach. Learn. Res. 5, 361-397 (2004)
123. Mencia, E.L., Furnkranz, J.: Efficient pairwise multilabel classification for large-scale problems in the legal domain. In: Proceedings of 11th European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD’08, pp. 50-65. Springer (2008)
124. Read, J.: Scalable multi-label classification. Ph.D. thesis, University of Waikato (2010)
125. Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. Mach. Learn. 85, 333-359 (2011)
126. Read, J., Reutemann, P.: MEKA multi-label dataset repository. http://sourceforge.net/projects/meka/files/Datasets/
127. Schapire, R.E., Singer, Y.: Boostexter: a boosting-based system for text categorization. Mach. Learn. 39(2-3), 135-168 (2000)
128. Snoek, C.G.M., Worring, M., van Gemert, J.C., Geusebroek, J.M., Smeulders, A.W.M.: The challenge problem for automated detection of 101 semantic concepts in multimedia. In: Proceedings of 14th ACM International Conference on Multimedia, MULTIMEDIA’06, pp. 421-430 (2006)
129. Spyromitros-Xioufis, E., Papadopoulos, S., Kompatsiaris, I.Y., Tsoumakas, G., Vlahavas, I.: A comprehensive study over vlad and product quantization in large-scale image retrieval. IEEE Trans. Multimedia 16(6), 1713-1728 (2014)
130. Srivastava, A.N., Zane-Ulman, B.: Discovering recurring anomalies in text reports regarding complex space systems. In: Aerospace Conference, pp. 3853-3862. IEEE (2005)
131. Tomas, J.T., Spolaor, N., Cherman, E.A., Monard, M.C.: A framework to generate synthetic multi-label datasets. Electron. Notes Theoret. Comput. Sci. 302, 155-176 (2014)
132. Tsoumakas, G., Katakis, I.: Multi-label classification: An overview. Int. J. Data Warehouse. Min. 3(3), 1-13 (2007)
133. Tsoumakas, G., Katakis, I., Vlahavas, I.: Effective and efficient multilabel classification in domains with large number of labels. In: Proceedings of ECML/PKDD Workshop on Mining Multidimensional Data, MMD’08, pp. 30-44 (2008)
134. Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining multi-label data. In: Data Mining and Knowledge Discovery Handbook, pp. 667-685. Springer (2010)
135. Tsoumakas, G., Vlahavas, I.: Random k-Labelsets: an ensemble method for multilabel classification. In: Proceedings of 18th European Conference on Machine Learning, ECML’07, vol. 4701, pp. 406-417. Springer (2007)
136. Tsoumakas, G., Xioufis, E.S., Vilcek, J., Vlahavas, I.: MULAN multi-label dataset repository. http://mulan.sourceforge.net/datasets.html
137. Turnbull, D., Barrington, L., Torres, D., Lanckriet, G.: Semantic annotation and retrieval of music and sound effects. IEEE Trans. Audio Speech Lang. Process. 16(2), 467-476 (2008)
138. Turner, M.D., Chakrabarti, C., Jones, T.B., Xu, J.F., Fox, P.T., Luger, G.F., Laird, A.R., Turner, J.A.: Automated annotation of functional imaging experiments via multi-label classification. Front. Neurosci. 7 (2013)
139. Tzanetakis, G., Cook, P.: Musical genre classification of audio signals. IEEE Trans. Speech Audio Process. 10(5), 293-302 (2002)
140. Ueda, N., Saito, K.: Parametric mixture models for multi-labeled text. In: Proceedings of 15th Annual Conference on Neural Information Processing Systems, NIPS’02, pp. 721-728 (2002)
141. Wieczorkowska, A., Synak, P., Ras, Z.: Multi-label classification of emotions in music. In: Intelligent Information Processing and Web Mining, AISC, vol. 35, chap. 30, pp. 307-315 (2006)
142. Zhang, M., Zhou, Z.: ML-KNN: a lazy learning approach to multi-label learning. Pattern Recogn. 40(7), 2038-2048 (2007)
143. Alvares-Cherman, E., Metz, J., Monard, M.C.: Incorporating label dependency into the binary relevance framework for multi-label classification. Expert Syst. Appl. 39(2), 1647-1655 (2012)
144. Barot, P., Panchal, M.: Review on various problem transformation methods for classifying multi-label data. Int. J. Data Mining Emerg. Technol. 4(2), 45-52 (2014)
145. Boutell, M., Luo, J., Shen, X., Brown, C.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757-1771 (2004)
146. Furnkranz, J., Hullermeier, E., Loza Menrfa, E., Brinker, K.: Multilabel classification via calibrated label ranking. Mach. Learn. 73, 133-153 (2008)
147. Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., Herrera, F.: An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes. Pattern Recogn. 44(8), 1761-1776 (2011)
148. Godbole, S., Sarawagi, S.: Discriminative methods for multi-labeled classification. Adv. Knowl. Discov. Data Mining 3056, 22-30 (2004)
149. Hullermeier, E., Furnkranz, J., Cheng, W., Brinker, K.: Label ranking by learning pairwise preferences. Artif. Intell. 172(16), 1897-1916 (2008)
150. Quinlan, J.R.: C4.5: Programs for Machine Learning (1993)
151. Read, J.: A pruned problem transformation method for multi-label classification. In: Proceedings of New Zealand Computer Science Research Student Conference, NZCSRS’08, pp. 143-150 (2008)
152. Read, J., Pfahringer, B., Holmes, G.: Multi-label classification using ensembles of pruned sets. In: Proceedings of 8th IEEE International Conference on Data Mining, ICDM’08, pp. 995-1000. IEEE (2008)
153. Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. Mach. Learn. 85, 333-359 (2011)
154. Tenenboim-Chekina, L., Rokach, L., Shapira, B.: Identification of label dependencies for multilabel classification. In: Working Notes of the Second International Workshop on Learning from Multi-Label Data, MLD’10, pp. 53-60 (2010)
155. Tsoumakas, G., Dimou, A., Spyromitros, E., Mezaris, V., Kompatsiaris, I., Vlahavas, I.: Correlation-based pruning of stacked binary relevance models for multi-label learning. In: Proceedings of 1st International Workshop on Learning from Multi-Label Data, MLD’09, pp. 101-116(2009)
156. Tsoumakas, G., Katakis, I., Vlahavas, I.: Effective and efficient multilabel classification in domains with large number of labels. In: Proceedings of ECML/PKDD Workshop on Mining Multidimensional Data, MMD’08, pp. 30-44 (2008)
157. Tsoumakas, G., Vlahavas, I.: Random k-Labelsets: an ensemble method for multilabel classification. In: Proceedings of 18th European Conference on Machine Learning, ECML’07, vol. 4701, pp. 406-417. Springer (2007)
158. Agrawal, R., Srikant, R., et al.: Fast algorithms for mining association rules. In: Proceedings of the 20th International Conference on Very Large Data Bases, VLDB’94, pp. 487-499. Morgan Kaufmann (1994)
159. Agrawal, J., Agrawal, S., Kaur, S., Sharma, S.: An Investigation of fuzzy PSO and fuzzy SVD based RBF neural network for multi-label classification. In: Proceedings of the 3rd International Conference on Soft Computing for Problem Solving, SocProS’13, vol. 1, pp. 677-687. Springer (2014)
160. Al-Otaibi, R., Kull, M., Flach, P.: Lacova: atree-based multi-label classifier using label covariance as splitting criterion. In: Proceedings of the 13th International Conference on Machine Learning and Applications, ICMLA’14, pp. 74-79. IEEE (2014)
161. Avila, J., Gibaja, E., Ventura, S.: Multi-label classification with gene expression programming. In: Proceedings of the 4th International Conference on Hybrid Artificial Intelligence Systems, HAIS’09, pp. 629-637. Springer (2009)
162. Boutell, M., Luo, J., Shen, X., Brown, C.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757-1771 (2004)
163. Calvo-Zaragoza, J., Valero-Mas, J.J., Rico-Juan, J.R.: Improving knn multi-label classification in prototype selection scenarios using class proposals. Pattern Recogn. 48(5), 1608-1622 (2015)
164. Chan, A., Freitas, A.A.: A new ant colony algorithm for multi-label classification with applications in bioinfomatics. In: Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation, GECCO’06, pp. 27-34. ACM Press (2006)
165. Cheng, W., Hullermeier, E.: Combining instance-based learning and logistic regression for multilabel classification. Mach. Learn. 76(2-3), 211-225 (2009)
166. Cheng, W., Hullermeier, E., Dembczynski, K.J.: Bayes optimal multilabel classification via probabilistic classifier chains. In: Proceedings of the 27th International Conference on Machine Learning, ICML’10, pp. 279-286 (2010)
167. Clare, A., King, R.D.: Knowledge discovery in multi-label phenotype data. In: Proceedings of the 5th European Conference Principles on Data Mining and Knowledge Discovery, PKDD’01, vol. 2168, pp. 42-53. Springer (2001)
168. De Comite, F., Gilleron, R., Tommasi, M.: Learning multi-label alternating decision trees from texts and data. In: Proceedings of the 3rd International Conference on Machine Learning and Data Mining in Pattern Recognition, MLDM’03, vol. 2734, pp. 35-49. Springer (2003)
169. Dorigo, M., Stutzle, T.: Ant Colony Optimization. The MIT Press (2004)
170. Elisseeff, A., Weston, J.: A kernel method for multi-labelled classification. In: Advances in Neural Information Processing Systems, vol. 14, pp. 681-687. MIT Press (2001)
171. Ferreira, C.: Gene expression programming in problem solving. In: Soft Computing and Industry, pp. 635-653. Springer (2002)
172. Freund, Y., Mason, L.: The alternating decision tree learning algorithm. In: Proceedings of the 16th International Conference on Machine Learning, ICML’99, pp. 124-133 (1999)
173. Genga, X., Tanga, Y., Zhua, Y., Chengb, G.: An improved multi-label classification algorithm BRkNN. J. Inf. Comput. Sci. 11(16), 5927-5936 (2014)
174. Ghamrawi, N., McCallum, A.: Collective multi-label classification. In: Proceedings of the 14th ACM International Conference on Information and Knowledge Management, CIKM’05, pp. 195-200. ACM (2005)
175. Gonfalves, E.C., Plastino, A., Freitas, A.A.: A genetic algorithm for optimizing the label ordering in multi-label classifier chains. In: Proceedings of the 25th IEEE International Conference on Tools with Artificial Intelligence, ICTAI’13, pp. 469-476. IEEE (2013)
176. Grodzicki, R., Mandziuk, J., Wang, L.: Improved multilabel classification with neural networks. In: Proceedings of the 10th International Conference on Parallel Problem Solving from Nature, PPSN X, pp. 409-416. Springer (2008)
177. Kongsorot, Y., Horata, P.: Multi-label classification with extreme learning machine. In: Proceedings of the 6th International Conference on Knowledge and Smart Technology, KST’14, pp. 81-86. IEEE (2014)
178. Li, X., Zhao, F., Guo, Y.: Conditional restricted boltzmann machines for multi-label learning with incomplete labels. In: Proceedings of the 18th International Conference on Artificial Intelligence and Statistics, AISTATS’15, pp. 635-643 (2015)
179. Liang, Q., Wang, Z., Fan, Y., Liu, C., Yan, X., Hu, C., Yao, H.: Multi-label classification based on particle swarm algorithm. In: Proceedings of the 9th IEEE International Conference on Mobile Ad-hoc and Sensor Networks, MSN’13, pp. 421-424. IEEE (2013)
180. Parpinelli, R.S., Lopes, H.S., Freitas, A.A.: Data mining with an ant colony optimization algorithm. IEEE Trans. Evol. Comput. 6(4), 321-332 (2002)
181. Quinlan, J.R.: C4.5: Programs for machine learning (1993)
182. Schapire, R.E., Singer, Y.: Improved boosting algorithms using confidence-rated predictions. Mach. Learn. 37(3), 297-336 (1999)
183. Smolensky, P.: Information processing in dynamical systems: foundations of harmony theory (1986)
184. Spyromitros, E., Tsoumakas, G., Vlahavas, I.: An empirical study of lazy multilabel classification algorithms. In: Artificial Intelligence: Theories, Models and Applications, pp. 401-406. Springer (2008)
185. Sucar, L.E., Bielza, C., Morales, E.F., Hernandez-Leal, P., Zaragoza, J.H., Larranaga, P.: Multilabel classification with bayesian network-based chain classifiers. Pattern Recogn. Lett. 41, 14-22(2014)
186. Sun, L., Ji, S., Ye, J.: Hypergraph spectral learning for multi-label classification. In: Proceedings of the 14th International Conference on Knowledge Discovery and Data Mining, ACM SIGKDD’08, pp. 668-676. ACM (2008)
187. Tsoumakas, G., Xioufis, E.S., Vilcek, J., Vlahavas, I.: MULAN: a java library for multi-label learning. J. Mach. Learn. Res. 12, 2411-2414 (2011)
188. Ueda, N., Saito, K.: Parametric mixture models for multi-labeled text. In: Proceedings of the 15th Annual Conference on Neural Information Processing Systems, NIPS’02, pp. 721-728 (2002)
189. Veloso, A., Meira Jr, W., Gonfalves, M., Zaki, M.: Multi-label lazy associative classification. In: Proceedings of the 11th European Conference on Principles and Practice of Knowledge Discovery in Databases, PKDD’07, pp. 605-612. Springer (2007)
190. Wang, J., Feng, J., Sun, X., Chen, S., Chen, B.: Simplified constraints Rank-SVM for multilabel classification. In: Proceedings of the 6th Chinese Conference on Pattern Recognition, CCPR’14, pp. 229-236. Springer (2014)
191. Wu, Q., Ye, Y., Zhang, H., Chow, T.W., Ho, S.S.: Ml-tree: a tree-structure-based approach to multilabel learning. IEEE Trans. Neural Networks Learn. Syst. 26(3), 430-443 (2015)
192. Xu, J.: Fast multi-label core vector machine. Pattern Recogn. 46(3), 885-898 (2013)
193. Zhang, M.: Multilabel neural networks with applications to functional genomics and text categorization. IEEE Trans. Knowl. Data Eng. 18(10), 1338-1351 (2006)
194. Zhang, M.: Ml-rbf: RBF neural networks for multi-label learning. Neural Process. Lett. 29, 61-74(2009)
195. Zhang, M., Zhou, Z.: ML-KNN: a lazy learning approach to multi-label learning. Pattern Recogn. 40(7), 2038-2048 (2007)
196. Tsoumakas, G., Dimou, A., Spyromitros, E., Mezaris, V., Kompatsiaris, I., Vlahavas, I.: Correlation-based pruning of stacked binary relevance models for multi-label learning. In: Proceedings of 1st International Workshop on Learning from Multi-Label Data, MLD’09, pp. 101-116(2009)
197. Alvares-Cherman, E., Metz, J., Monard, M.C.: Incorporating label dependency into the binary relevance framework for multi-label classification. Expert Syst. Appl. 39(2), 1647-1655 (2012)
198. Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. Mach. Learn. 85, 333-359 (2011)
199. Hullermeier, E., Furnkranz, J., Cheng, W., Brinker, K.: Label ranking by learning pairwise preferences. Artif. Intell. 172(16), 1897-1916 (2008)
200. Furnkranz, J., Hullermeier, E., Loza Menrfa, E., Brinker, K.: Multilabel classification via calibrated label ranking. Mach. Learn. 73, 133-153 (2008)
201. Read, J., Pfahringer, B., Holmes, G.: Multi-label classification using ensembles of pruned sets. In: Proceedings of 8th IEEE International Conference on Data Mining, ICDM’08, pp. 995-1000. IEEE (2008)
202. Tsoumakas, G., Vlahavas, I.: Random k-Labelsets: An ensemble method for multilabel classification. In: Proceedings of 18th European Conference on Machine Learning, ECML’07, vol. 4701, pp. 406-417. Springer (2007)
203. Tsoumakas, G., Katakis, I., Vlahavas, I.: Effective and efficient multilabel classification in domains with large number of labels. In: Proceedings of ECML/PKDD Workshop on Mining Multidimensional Data, MMD’08, pp. 30-44 (2008)
204. Tenenboim-Chekina, L., Rokach, L., Shapira, B.: Identification of label dependencies for multilabel classification. In: Working Notes of the Second International Workshop on Learning from Multi-Label Data, MLD’10, pp. 53-60 (2010)
205. Kocev, D., Vens, C., Struyf, J., Dzeroski, S.: Ensembles of multi-objective decision trees. In: Proceedings of 18th European Conference on Machine Learning, ECML’07, pp. 624-631. Springer (2007)
206. Tahir, M.A., Kittler, J., Bouridane, A.: Multilabel classification using heterogeneous ensemble of multi-label classifiers. Pattern Recogn. Lett. 33(5), 513-523 (2012)
207. Read, J., Martino, L., Olmos, P.M., Luengo, D.: Scalable multi-output label prediction: from classifier chains to classifier trellises. Pattern Recogn. 48(6), 2096-2109 (2015)
208. Madjarov, G., Gjorgjevikj, D., Dzeroski, S.: Dual layer voting method for efficient multi-label classification. In: Proceedings of 5th Iberian Conference, IbPRIA’11, pp. 232-239. Springer (2011)
209. Menda, E.L., Park, S., Furnkranz, J.: Efficient voting prediction for pairwise multilabel classification. Neurocomputing 73(7), 1164-1176 (2010)
210. Quevedo, J.R., Luaces, O., Bahamonde, A.: Multilabel classifiers with a probabilistic thresholding strategy. Pattern Recogn. 45(2), 876-883 (2012)
211. Quinlan, J.R.: C4.5: Programs for machine learning (1993)
212. Bellman, R.: Dynamic Programming. P (Rand Corporation). Princeton University Press (1957)
213. Breiman, L.: Random forests. Mach. Learn. 45(1), 5-32 (2001)
214. Charte, F., Rivera, A., del Jesus, M.J., Herrera, F.: LI-MLC: a label inference methodology for addressing high dimensionality in the label space for multilabel classification. IEEE Trans. Neural Networks Learn. Syst. 25(10), 1842-1854 (2014)
215. Das, S.: Filters, wrappers and a boosting-based hybrid for feature selection. In: Proceedings of 18th International Conference on Machine Learning, ICML’01, pp. 74-81. Morgan Kaufmann (2001)
216. Dash, M., Liu, H.: Feature selection for classification. Intell. Data Anal. 1(3), 131-156 (1997)
217. Dembszynski, K., Waegeman, W., Cheng, W., Hullermeier, E.: On label dependence in multilabel classification. In: ICML Workshop on Learning from Multi-label Data, pp. 5-12 (2010)
218. Doquire, G., Verleysen, M.: Mutual information-based feature selection for multilabel classification. Neurocomputing 122, 148-155 (2013)
219. Fisher, R.A.: The statistical utilization of multiple measurements. Ann. Eugenics 8(4), 376-386 (1938)
220. Guyon, I., Bitter, H.M., Ahmed, Z., Brown, M., Heller, J.: Multivariate non-linear feature selection with kernel multiplicative updates and Gram-Schmidt relief. In: Proceedings of International Joint Workshop on Soft Computing for Internet and Bioinformatics, BISC Flint-CIBI’03, pp. 1-11 (2003)
221. Guyon, I., Gunn, S., Nikravesh, M., Zadeh, L.A. (eds.): Feature Extraction: Foundations and Applications. Springer (2008)
222. Hotelling, H.: Relations between two sets of variates. In: Breakthroughs in Statistics, pp. 162-190. Springer (1992)
223. Hsu, D., Kakade, S., Langford, J., Zhang, T.: Multi-label prediction via compressed sensing. In: Proceedings of 22th Annual Conference on Advances in Neural Information Processing Systems, NIPS’09, vol. 22, pp. 772-780 (2009)
224. Jolliffe, I.: Principal Component Analysis. Springer Series in Statistics, vol. 1. Springer, Berlin (1986)
225. Kira, K., Rendell, L.A.: The feature selection problem: traditional methods and a new algorithm. In: Proceedings of 10th National Conference on Artificial Intelligence, AAAI’92, pp. 129-134. AAAI Press (1992)
226. Kohavi, R., John, G.H.: Wrappers for feature subset selection. Artif. Intell. 97(1), 273-324 (1997)
227. Kononenko, I.: Estimating attributes: analysis and extensions of RELIEF. In: Machine Learning: ECML-94, pp. 171-182 (1994)
228. Lee, J.S., Kim, D.W.: Mutual information-based multi-label feature selection using interaction information. Expert Syst. Appl. 42, 2013-2025 (2015)
229. Liu, H., Motoda, H.: Feature Selection for Knowledge Discovery and Data Mining, vol. 454. Springer Science & Business Media (2012)
230. Read, J.: A pruned problem transformation method for multi-label classification. In: Proceedings of New Zealand Computer Science Research Student Conference, NZCSRS’08, pp. 143-150 (2008)
231. Read, J., Pfahringer, B., Holmes, G.: Multi-label classification using ensembles of pruned sets. In: Proceedings of 8th IEEE International Conference on Data Mining, ICDM’08, pp. 995-1000. IEEE (2008)
232. Spolaor, N., Cherman, E.A., Monard, M.C., Lee, H.D.: A comparison of multi-label feature selection methods using the problem transformation approach. Electron. Notes Theor. Comput. Sci. 292, 135-151 (2013)
233. Sun, L., Ji, S., Ye, J.: Hypergraph spectral learning for multi-label classification. In: Proceedings of 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 668-676. ACM (2008)
234. Sun, L., Ji, S., Ye, J.: Multi-Label Dimensionality Reduction. CRC Press (2013)
235. Tsoumakas, G., Katakis, I., Vlahavas, I.: Effective and efficient multilabel classification in domains with large number of labels. In: Proceedings of ECML/PKDD Workshop on Mining Multidimensional Data, MMD’08, pp. 30-44 (2008)
236. Tsoumakas, G., Vlahavas, I.: Random k-Labelsets: an ensemble method for multilabel classification. In: Proceedings of 18th European Conference on Machine Learning, ECML’07, vol. 4701, pp. 406-417. Springer (2007)
237. Weston, J., Chapelle, O., Elisseeff, A., Scholkopf, B., Vapnik, V.: Kernel dependency estimation. In: Proceedings of 16th Annual Conference on Advances in Neural Information Processing Systems, NIPS’02, vol. 15, pp. 873-880 (2002)
238. Wyse, N., Dubes, R., Jain, A.K.: A critical evaluation of intrinsic dimensionality algorithms. Pattern Recogn. Pract. 415-425 (1980)
239. Yu, K., Yu, S., Tresp, V.: Multi-label informed latent semantic indexing. In: Proceedings of 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 258-265. ACM (2005)
240. Zhang, M., Zhou, Z.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26(8), 1819-1837 (2014)
241. Zhang, Y., Zhou, Z.H.: Multilabel dimensionality reduction via dependence maximization. ACM Trans. Knowl. Discovery Data (TKDD) 4(3), 14 (2010)
242. Zhao, Z., Liu, H.: Semi-supervised feature selection via spectral analysis. In: Proceedings of 7th SIAM International Conference on Data Mining, SDM’07, pp. 641-646 (2007)
243. Zhou, T., Tao, D., Wu, X.: Compressed labeling on distilled labelsets for multi-label learning. Mach. Learn. 88(1-2), 69-126 (2012)
244. Charte, F., Rivera, A., del Jesus, M.J., Herrera, F.: Resampling multilabel datasets by decoupling highly imbalanced labels. In: Proceedings of 10th International Conference on Hybrid Artificial Intelligent Systems, HAIS’15, vol. 9121, pp. 489-501. Springer (2015)
245. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: A first approach to deal with imbalance in multi-label datasets. In: Proceedings of 8th International Conference on Hybrid Artificial Intelligent Systems, HAIS’13, vol. 8073, pp. 150-160. Springer (2013)
246. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: Concurrence among imbalanced labels and its influence on multilabel resampling algorithms. In: Proceedings of 9th International Conference on Hybrid Artificial Intelligent Systems, HAIS’14, vol. 8480. Springer (2014)
247. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: MLeNN: a first approach to heuristic multilabel undersampling. In: Proceedings of 15th International Conference on Intelligent Data Engineering and Automated Learning, IDEAL’14, vol. 8669, pp. 1-9. Springer (2014)
248. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: Addressing imbalance in multilabel classification: measures and random resampling algorithms. Neurocomputing 163, 3-16 (2015)
249. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: MLSMOTE: approaching imbalanced multilabel learning through synthetic instance generation. Knowl. Based Syst. 89, 385-397 (2015)
250. Charte, F., Rivera, A.J., del Jesus, M.J., Herrera, F.: Multilabel Classification. Problem analysis, metrics and techniques book repository. https://github.com/fcharte/SM-MLC
251. Chen, K., Lu, B., Kwok, J.: Efficient classification of multi-label and imbalanced data using min-max modular classifiers. In: Proceedings of IEEE International Joint Conference on Neural Networks, IJCNN’06, pp. 1770-1775 (2006)
252. Dendamrongvit, S., Kubat, M.: Undersampling approach for imbalanced training sets and induction from multi-label text-categorization domains. In: New Frontiers in Applied Data Mining. LNCS, vol. 5669, pp. 40-52. Springer (2010)
253. Fernandez, A., Lopez, V., Galar, M., del Jesus, M.J., Herrera, F.: Analysing the classification of imbalanced data-sets with multiple classes: binarization techniques and ad-hoc approaches. Knowl. Based Syst. 42, 97-110 (2013)
254. Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., Herrera, F.: An overview of ensemble methods for binary classifiers in multi-class problems: experimental study on one-vs-one and one-vs-all schemes. pattern Recogn. 44(8), 1761-1776 (2011)
255. Giraldo-Forero, A.F., Jaramillo-Garzon, J.A., Ruiz-Munoz, J.F., Castellanos-Dommguez, C.G.: Managing imbalanced data sets in multi-label problems: a case study with the SMOTE algorithm. In: Proceedings of 18th Iberoamerican Congress on Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, CIARP’13, vol. 8258, pp. 334-342. Springer (2013)
256. He, H., Garcia, E.A.: Learning from imbalanced data. IEEE Trans. Knowl. Data Eng. 21(9), 1263-1284 (2009)
257. He, J., Gu, H., Liu, W.: Imbalanced multi-modal multi-label learning for subcellular localization prediction of human proteins with both single and multiple sites. PloS One 7(6), 7155 (2012)
258. Li, C., Shi, G.: Improvement of learning algorithm for the multi-instance multi-label RBF neural networks trained with imbalanced samples. J. Inf. Sci. Eng. 29(4), 765-776 (2013)
259. Lopez, V., Fernandez, A., Garda, S., Palade, V., Herrera, F.: An insight into classification with imbalanced data: empirical results and current trends on using data intrinsic characteristics. Inf. Sci. 250, 113-141 (2013)
260. Lu, B., Ito, M.: Task decomposition and module combination based on class relations: a modular neural network for pattern classification. IEEE Trans. Neural Netw. 10(5), 1244-1256 (1999)
261. Nitesh, V.C., Kevin, W.B., Lawrence, O.H., Kegelmeyer, W.P.: SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321-357 (2002)
262. Prati, R.C., Batista, G.E., Silva, D.F.: Class imbalance revisited: a new experimental setup to assess the performance of treatment methods. Knowl. Inf. Syst. 45(1), 247-270 (2015)
263. Quinlan, J.R.: C4.5: Programs for Machine Learning (1993)
264. Sheskin, D.J.: Handbook of Parametric and Nonparametric Statistical Procedures. Chapman & Hall (2003)
265. Sun, Y., Wong, A.K.C., Kamel, M.S.: Classification of imbalanced data: a review. Int. J. Pattern Recogn. Artif. Intell. 23(4), 687-719 (2009)
266. Tahir, M.A., Kittler, J., Bouridane, A.: Multilabel classification using heterogeneous ensemble of multi-label classifiers. Pattern Recogn. Lett. 33(5), 513-523 (2012)
267. Tahir, M.A., Kittler, J., Yan, F.: Inverse random under sampling for class imbalance problem and its application to multi-label classification. Pattern Recogn. 45(10), 3738-3750 (2012)
268. Tepvorachai, G., Papachristou, C.: Multi-label imbalanced data enrichment process in neural net classifier training. In: Proceedings of IEEE International Joint Conference on Neural Networks, IJCNN’08, pp. 1301-1307. IEEE (2008)
269. Zhang, M., Wang, Z.: MIMLRBF: RBF neural networks for multi-instance multi-label learning. Neurocomputing 72(16), 3951-3956 (2009)
270. Tsoumakas, G., Xioufis, E.S., Vilcek, J., Vlahavas, I.: MULAN: A Java Library for multi-label learning. J. Mach. Learn. Res. 12, 2411-2414 (2011)
271. Read, J., Reutemann, P.: MEKA multi-label dataset repository. http://sourceforge.net/projects/meka/files/Datasets/
272. Chang, C.C., Lin, C.J.: Libsvm: a Library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(3), 1-27 (2011)
273. Alcala-Fdez, J., Fernandez, A., Luengo, J., Derrac, J., Garrfa, S., Sanchez, L., Herrera, F.: KEEL data-mining software tool: data set repository and integration of algorithms and experimental analysis framework. J. Mult-Valued Log. Soft Comput. 17(2-3), 255-287 (2011)
274. Charte, F., Charte, D., Rivera, A.J., del Jesus, M.J., Herrera, F.: R Ultimate Multilabel Dataset Repository. https://github.com/fcharte/mldr.datasets
275. Tsoumakas, G., Xioufis, E.S., Vilcek, J., Vlahavas, I.: MULAN multi-label dataset repository. http://mulan.sourceforge.net/datasets.html
276. Chang, C.C., Lin, C.J.: LIBSVM data: multi-label classification repository. http://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/multilabel.html
277. Alcala-Fdez, J., Fernandez, A., Luengo, J., Derrac, J., Garrfa, S., Sanchez, L., Herrera, F: KEEL multi-label dataset repository. http://sci2s.ugr.es/keel/multilabel.php
278. Charte, F., Charte, D., Rivera, A.J., del Jesus, M.J., Herrera, F.: R ultimate multilabel dataset repository. In: Proceeedings of 11th International Conference on Hybrid Artificial Intelligent Systems, HAIS’16, vol. 9648, pp. 487-499. Springer (2016)
279. Bhatia, K.H., Jain, P.J., Varma, M.: The extreme classification repository: multilabel datasets & code. http://research.microsoft.com/en-us/um/people/manik/downloads/XC/XMLRepository.html
280. R Core Team: R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria (2014). http://www.R-project.org/
281. Tomas, J.T., Spolaor, N., Cherman, E.A., Monard, M.C.: A framework to generate synthetic multi-label datasets. Electron. Notes Theor. Comput. Sci. 302, 155-176 (2014)
282. Read, J., Pfahringer, B., Holmes, G.: Generating synthetic multi-label data streams. In: Proceedings of European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD’09, pp. 69-84 (2009)
283. Charte, F., Charte, D.: Working with multilabel datasets in R: the mldr package. R J. 7(2), 149-162(2015)