Generalized k-labelsets ensemble for multi-label and cost-sensitive classification

IEEE Transactions on Knowledge and Data Engineering

Volumn 26, Issue 7, 2014, Pages 1679-1691

  Lo, Hung Yi ^a   Lin, Shou De ^b   Wang, Hsin Min ^c  

^a SHIH CHIEN UNIVERSITY   (Taiwan)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^c INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

Author keywords

cost sensitive learning; ensemble method; hypergraph; labelset; Multi label classification; social tag; tag count

Indexed keywords

E-LEARNING; LEARNING ALGORITHMS; LEARNING SYSTEMS;

COST-SENSITIVE LEARNING; ENSEMBLE METHODS; HYPERGRAPH; LABELSET; MULTI-LABEL CLASSIFICATIONS; SOCIAL TAGS; TAG COUNT;

COSTS;

EID: 84904424108     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2013.112     Document Type: Article

References (38)

1. G. Tsoumakas, I. Katakis, and I. Vlahavas, "Mining multilabel data, " in Data Mining and Knowledge Discovery Handbook, O. Maimon and L. Rokach, Eds. New York, NY, USA: Springer, 2010.
2. K. Dembczý nski, W. Waegeman, W. Cheng, and E. Hüllermeier, "On label dependence in multi-label classification, " in Proc. Int. Workshop Learn. Multi-Label Data, Haifa, Israel, 2010.
3. G. Tsoumakas, I. Katakis, and I. Vlahavas, "Random k-labelsets for multilabel classification, " IEEE Trans. Knowl. Data Eng., vol. 23, no. 7, pp. 1079-1089, Jul. 2011.
4. T. Dietterich, "Ensemble methods in machine learning, " in Proc. 1st Int. Workshop MCS, Cagliari, Italy, 2000.
5. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting, " J. Comput. Syst. Sci., vol. 55, no. 1, pp. 119-139, Aug. 1997. (Pubitemid 127433398)
6. L. Breiman, "Arcing the edge, " Dep. Stat., Univ. California, Tech. Rep. 486, Berkeley, CA, USA, 1997.
7. R. Caruana, A. Munson, and A. Niculescu-Mizil, "Getting the most out of ensemble selection, " in Proc. 6th ICDM, Hong Kong, China, 2006.
8. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning. New York, NY, USA: Springer, 2001.
9. H.-Y. Lo, J.-C. Wang, H.-M. Wang, and S.-D. Lin, "Cost-sensitive multi-label learning for audio tag annotation and retrieval, " IEEE Trans. Multimedia, vol. 13, no. 3, pp. 518-529, Jun. 2011.
10. M.-C. Yuen, L.-J. Chen, and I. King, "A survey of human computation systems, " in Proc. Int. Conf. Comput. Sci. Eng., Vancouver, BC, Canada, 2009.
11. D. Eck, P. Lamere, T. Bertin-Mahieux, and S. Green, "Automatic generation of social tags for music recommendation, " in Proc. Adv. Neural Inform. Process. Syst., 2007.
12. M. I. Mandel and D. P. W. Ellis, "Multiple-instance learning for music information retrieval, " in Proc. Int. Conf. Music Inform. Retrieval, 2007.
13. G. Tsoumakas, I. Katakis, and I. Vlahavas, "Effective and efficient multilabel classification in domains with large number of labels, " in Proc. ECML/PKDD Workshop Mining Multidimensional Data, Antwerp, Belgium, 2008.
14. C. Sanden and J. Z. Zhang, "An empirical study of multi-label classifiers for music tag annotation, " in Proc. 12th Int. Soc. Music Inform. Retrieval, Miami, FL, USA, 2011.
15. G.-J. Qi et al., "Correlative multi-label video annotation, " in Proc. ACM Int. Conf. Multimedia, Augsburg, Germany, 2007.
16. X. Li, C. G. M. Snoek, and M. Worring, "Learning social tag relevance by neighbor voting, " IEEE Trans. Multimedia, vol. 11, no. 7, pp. 1310-1322, Nov. 2009.
17. M.-L. Zhang and Z.-H. Zhou, "Multilabel neural networks with applications to functional genomics and text categorization, " IEEE Trans. Knowl. Data Eng., vol. 18, no. 10, pp. 1338-1351, Oct. 2006. (Pubitemid 44335199)
18. M.-L. Zhang and Z.-H. Zhou, "Ml-knn: A lazy learning approach to multi-label learning, " Pattern Recognit., vol. 40, no. 7, pp. 2038-2048, Jul. 2007. (Pubitemid 46497248)
19. W. Cheng and E. Hüllermeier, "Combining instance-based learning and logistic regression for multilabel classification, " Mach. Learn., vol. 76, no. 2-3, pp. 211-225, 2009.
20. J. Wang, Y. Zhao, X. Wu, and X.-S. Hua, "A transductive multilabel learning approach for video concept detection, " Pattern Recognit., vol. 44, no. 10-11, pp. 2274-2286, 2011.
21. Y. Liu, R. Jin, and L. Yang, "Semi-supervised multi-label learning by constrained non-negative matrix factorization, " in Proc. 21st Nat. Conf. Artif. Intell., 2006.
22. L. Sun, S. Ji, and J. Ye, "Hypergraph spectral learning for multilabel classification, " in Proc. ACM Int. Conf. KDD, Las Vegas, NV, USA, 2008.
23. L. Rokach and E. Itach, "An ensemble method for multi-label classification using an approximation algorithm for the set covering problem, " in Proc. Int. Workshop Learn. Multi-Label Data, 2010.
24. M.-L. Zhang and K. Zhang, "Multi-label learning by exploiting label dependency, " in Proc. 16th ACM Int. Conf. KDD, Washington, DC, USA, 2010.
25. M.-L. Zhang, "Lift: Multi-label learning with label-specific features, " in Proc. Int. Joint Conf. Artif. Intell., 2011.
26. L. Breiman, "Random forests, " Mach. Learn., vol. 45, pp. 5-32, Jan. 2001. (Pubitemid 32933532)
27. R. E. Schapire and Y. Singer, "Improved boosting algorithms using confidence-rated predictions, " Mach. Learn., vol. 37, no. 3, pp. 297-336, Dec. 1999. (Pubitemid 32210620)
28. H.-Y. Lo, S.-D. Lin, and H.-M. Wang, "Generalized k-labelset ensemble for multi-label classification, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., 2012.
29. S. Agarwal, K. Branson, and S. Belongie, "Higher order learning with graphs, " in Proc. Int. Conf. Mach. Learn., Pittsburgh, PA, USA, 2006.
30. D. Zhou, J. Huang, and B. Scholkopf, "Learning with hypergraphs: Clustering, classification, and embedding, " in Proc. Adv. Neural Inform. Process. Syst., 2006.
31. F. R. K. Chung, Spectral Graph Theory. Providence, RI, USA: American Mathematical Society, 1997.
32. G. Tsoumakas, E. Spyromitros-Xioufis, J. Vilcek, and I. Vlahavas, "Mulan: A Java library for multi-label learning, " J. Mach. Learn. Res., vol. 12, pp. 2411-2414, Jul. 2011.
33. M. I. Mandel and D. P. W. Ellis, "A web-based game for collecting music metadata, " J. New Music Res., vol. 37, no. 2, pp. 151-165, 2008.
34. D. Turnbull, L. Barrington, D. Torres, and G. Lanckriet, "Semantic annotation and retrieval of music and sound effects, " IEEE Trans. Audio Speech Lang. Process., vol. 16, no. 16. pp. 467-476, Feb. 2008.
35. R. Miotto and G. R. G. Lanckriet, "A generative context model for semantic music annotation and retrieval, " IEEE Trans. Audio Speech Lang. Process., vol. 20, no. 4, pp. 1096-1108, May 2012.
36. M.-H. Hsu and H.-H. Chen, "Tag normalization and prediction for effective social media retrieval, " in Proc. IEEE/WIC/ACM WIIAT, Sydney, NSW, Australia, 2008.
37. G. Madjarov, D. Kocev, D. Gjorgjevikj, and S. Deroski, "An extensive experimental comparison of methods for multi-label learning, " Pattern Recognit., vol. 45, no. 9, pp. 3084-3104, 2012.
38. J. Read, B. Pfahringer, G. Holmes, and E. Frank, "Classifier chains for multi-label classification, " in Proc. ECML PKDD, Bled, Slovenia, 2009.