An extensive experimental comparison of methods for multi-label learning

Pattern Recognition

Volumn 45, Issue 9, 2012, Pages 3084-3104

  Madjarov, Gjorgji ^a,b   Kocev, Dragi ^b   Gjorgjevikj, Dejan ^a   Džeroski, Sašo ^b  

^a SS CYRIL AND METHODIUS UNIVERSITY   (Macedonia)

^b JO EF STEFAN INSTITUTE   (Slovenia)

Author keywords

Comparison of multi label learning methods; Multi label classification; Multi label ranking

Indexed keywords

APPLICATION DOMAINS; BENCHMARK DATASETS; CLUSTERING TREES; DATA SETS; DIFFERENT DOMAINS; EVALUATION MEASURES; EXPERIMENTAL COMPARISON; LEARNING METHODS; MACHINE LEARNING METHODS; MULTI-LABEL; RANDOM FORESTS; RESEARCH COMMUNITIES; STATISTICAL SIGNIFICANCE;

BINARY TREES; DECISION TREES;

LEARNING SYSTEMS;

EID: 84861617363     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.03.004     Document Type: Conference Paper

References (47)

1. K. Brinker, J. Fürnkranz, E. Hüllermeier, A unified model for multilabel classification and ranking, in: Proceedings of the 17th European Conference on Artificial Intelligence, 2006, pp. 489-493.
2. G. Tsoumakas, and I. Katakis Multi label classification: an overview International Journal of Data Warehouse and Mining 3 3 2007 1 13
3. M.L. Zhang, and Z.H. Zhou ML-kNN: a lazy learning approach to multi-label learning Pattern Recognition 40 7 2007 2038 2048
4. A. Wieczorkowska, P. Synak, Z. Ras, Multi-label classification of emotions in music, in: Intelligent Information Processing and Web Mining, Springer, Berlin/Heidelberg, 2006, pp. 307-315.
5. E. Spyromitros, G. Tsoumakas, I. Vlahavas, An empirical study of lazy multilabel classification algorithms, in: Proceedings of the 5th Hellenic conference on Artificial Intelligence: Theories, Models and Applications, 2008, pp. 401-406.
6. K. Crammer, and Y. Singer A family of additive online algorithms for category ranking Journal of Machine Learning Research 3 2003 1025 1058
7. M.L. Zhang, and Z.H. Zhou Multi-label neural networks with applications to functional genomics and text categorization IEEE Transactions on Knowledge and Data Engineering 18 10 2006 1338 1351
8. R.E. Schapire, and Y. Singer Boostexter: a boosting-based system for text categorization Machine Learning 39 2000 135 168
9. F. De Comité, R. Gilleron, M. Tommasi, Learning multi-label alternating decision trees from texts and data, in: Proceedings of the 3rd international conference on Machine learning and data mining in pattern recognition, 2003, pp. 35-49.
10. F.A. Thabtah, P. Cowling, Y. Peng, MMAC: a new multi-class, multi-label associative classification approach, in: Proceedings of the 4th IEEE International Conference on Data Mining, 2004, pp. 217-224.
11. A. Clare, R.D. King, Knowledge discovery in multi-label phenotype data, in: Proceedings of the 5th European Conference on PKDD, 2001, pp. 42-53.
12. H. Blockeel, L.D. Raedt, J. Ramon, Top-down induction of clustering trees, in: Proceedings of the 15th International Conference on Machine Learning, 1998, pp. 55-63.
13. J. Fürnkranz Round robin classification Journal of Machine Learning Research 2 2002 721 747
14. T.-F. Wu, C.-J. Lin, and R.C. Weng Probability estimates for multi-class classification by pairwise coupling Journal of Machine Learning Research 5 2004 975 1005
15. G. Tsoumakas, I. Vlahavas, Random k-labelsets: an ensemble method for multilabel classification, in: Proceedings of the 18th European conference on Machine Learning, 2007, pp. 406-417.
16. J. Read, B. Pfahringer, G. Holmes, E. Frank, Classifier chains for multi-label classification, in: Proceedings of the 20th European Conference on Machine Learning, 2009, pp. 254-269.
17. D. Kocev, C. Vens, J. Struyf, S. Džeroski, Ensembles of multi-objective decision trees, in: Proceedings of the 18th European conference on Machine Learning, 2007, pp. 624-631.
18. D. Kocev, Ensembles for predicting structured outputs, Ph.D. thesis, IPS Jožef Stefan, Ljubljana, Slovenia, 2011.
19. W. Cheng, and E. Hullermeier Combining instance-based learning and logistic regression for multilabel classification Machine Learning 76 2009 211 225
20. A. Elisseeff, J. Weston, A Kernel method for multi-labelled classification, in: Proceedings of the Annual ACM Conference on Research and Development in Information Retrieval, 2005, pp. 274-281.
21. S. Godbole, S. Sarawagi, Discriminative methods for multi-labeled classification, in: Advances in Knowledge Discovery and Data Mining, Springer, Berlin/Heidelberg, 2004, pp. 22-30.
22. J. Read, B. Pfahringer, G. Holmes, Multi-label classification using ensembles of pruned sets, in: Proceedings of the 8th IEEE International Conference on Data Mining, 2008, pp. 995-1000.
23. J. Read, A pruned problem transformation method for multi-label classification, in: Proceedings of the New Zealand Computer Science Research Student Conference, 2008, pp. 143-150.
24. G. Tsoumakas, I. Katakis, I. Vlahavas, Effective and efficient multilabel classification in domains with large number of labels, in: Proceedings of the ECML/PKDD Workshop on Mining Multidimensional Data, 2008, pp. 30-44.
25. S.-H. Park, J. Fürnkranz, Efficient pairwise classification, in: Proceedings of the 18th European Conference on Machine Learning, 2007, pp. 658-665.
26. E.L. Mencía, S.-H. Park, and J. Fürnkranz Efficient voting prediction for pairwise multilabel classification Neurocomputing 73 2010 1164 1176
27. J. Read, B. Pfahringer, G. Holmes, Multi-label classification using ensembles of pruned sets, in: Proceedings of the 8th IEEE International Conference on Data Mining, 2008, pp. 995-1000.
28. L. Breiman, J. Friedman, R. Olshen, and C.J. Stone Classification and Regression Trees 1984 Chapman & Hall/CRC
29. L. Breiman Random forests Machine Learning 45 2001 5 32
30. G. Tsoumakas, I. Katakis, I. Vlahavas, Mining multi-label data, in: Data Mining and Knowledge Discovery Handbook, Springer, Berlin/Heidelberg, 2010, pp. 667-685.
31. K. Trohidis, G. Tsoumakas, G. Kalliris, I. Vlahavas, Multilabel classification of music into emotions, in: Proceedings of the 9th International Conference on Music Information Retrieval, 2008, pp. 320-330.
32. M.R. Boutell, J. Luo, X. Shen, and C.M. Brown Learning multi-label scene classification Pattern Recognition 37 9 2004 1757 1771
33. B. Klimt, Y. Yang, The enron corpus: a new dataset for email classification research, in: Proceedings of the 15th European conference on Machine Learning, 2004, pp. 217-226.
34. P. Duygulu, K. Barnard, J. de Freitas, D. Forsyth, Object recognition as machine translation: learning a lexicon for a fixed image vocabulary, in: Proceedings of the 7th European Conference on Computer Vision, 2002, pp. 349-354.
35. A. Srivastava, B. Zane-Ulman, Discovering recurring anomalies in text reports regarding complex space systems, in: Proceedings of the IEEE Aerospace Conference, 2005, pp. 55-63.
36. C.G.M. Snoek, M. Worring, J.C. van Gemert, J.-M. Geusebroek, A.W.M. Smeulders, The challenge problem for automated detection of 101 semantic concepts in multimedia, in: Proceedings of the 14th Annual ACM International Conference on Multimedia, 2006, pp. 421-430.
37. I. Katakis, G. Tsoumakas, I. Vlahavas, Multilabel text classification for automated tag suggestion, in: Proceedings of the ECML/PKDD Discovery Challenge, 2008.
38. CDC/National Center for Health Statistics, International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM), 〈 http://www.cdc.gov/nchs/icd/icd9cm.htm 〉 (2011).
39. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I.H. Witten The WEKA data mining software: an update SIGKDD Explorations 11 2009 10 18
40. C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines, software available at 〈 http://www.csie.ntu.edu.tw/cjlin/libsvm 〉 (2001).
41. E. Bauer, and R. Kohavi An empirical comparison of voting classification algorithms: bagging, boosting, and variants Machine Learning 36 1 1999 105 139
42. M. Friedman A comparison of alternative tests of significance for the problem of m rankings Annals of Mathematical Statistics 11 1940 86 92
43. P.B. Nemenyi, Distribution-free multiple comparisons, Ph.D. thesis, Princeton University, 1963.
44. J. Demšar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30
45. R.L. Iman, and J.M. Davenport Approximations of the critical region of the Friedman statistic Communications in Statistics 1980 571 595
46. E.S. Pearson, and H.O. Hartley Biometrika Tables for Statisticians vol. I 1966 Cambridge University Press
47. C. Vens, J. Struyf, L. Schietgat, S. Džeroski, and H. Blockeel Decision trees for hierarchical multi-label classification Machine Learning 73 2 2008 185 214