Fast multi-label feature selection based on information-theoretic feature ranking

Pattern Recognition

Volumn 48, Issue 9, 2015, Pages 2761-2771

  Lee, Jaesung ^a   Kim, Dae Won ^a  

^a Chung Ang University   (South Korea)

Author keywords

Entropy; Interaction information; Multi label feature selection; Mutual information

Indexed keywords

ENTROPY; INFORMATION THEORY; LEARNING SYSTEMS;

COMPUTATIONALLY EFFICIENT; FEATURE RANKING; FEATURE SELECTION METHODS; IMPORTANT FEATURES; INTERACTION INFORMATION; MULTI-LABEL; MULTI-LABEL LEARNING; MUTUAL INFORMATIONS;

FEATURE EXTRACTION;

EID: 84929510253     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2015.04.009     Document Type: Article

References (39)

1. R. Agrawal, A. Gupta, Y. Prabhu, M. Varma, Multi-label learning with millions of labels: recommending advertiser bid phrases for web pages, in: Proceedings of 22nd International Conference on World Wide Web, Rio de Janeiro, Brazil, 2013, pp. 13-24.
2. M. Bennasar, R. Setchi, and Y. Hicks Feature interaction maximisation Pattern Recognit. Lett. 34 2013 1630 1635
3. M. Boutell, J. Luo, X. Shen, and C. Brown Learning multi-label scene classification Pattern Recognit. 37 2004 1757 1771
4. W. Chen, J. Yan, B. Zhang, Z. Chen, Q. Yang, Document transformation for multi-label feature selection in text categorization, in: Proceedings of 7th IEEE International Conference on Data Mining, Omaha, USA, 2007, pp. 451-456.
5. T. Cover, J. Thomas, and J. Wiley Elements of Information Theory vol. 6 1991 Wiley Online Library Wiley-Interscience, New York
6. K. Dembczyński, W. Waegeman, W. Cheng, E. Hüllermeier, Regret analysis for performance metrics in multi-label classification: the case of hamming and subset zero-one loss, in: Lecture Notes in Computer Science, vol. 6321 (2010) 280-295.
7. S. Diplaris, G. Tsoumakas, P. Mitkas, I. Vlahavas, Protein classification with multiple algorithms, Lect. Notes Comput. Sci. 3746 (2005) 448-456.
8. G. Doquire, and M. Verleysen Mutual information-based feature selection for multilabel classification Neurocomputing 122 2013 148 155
9. P. Duygulu, K. Barnard, J.F. de Freitas, D.A. Forsyth, Object recognition as machine translation: learning a lexicon for a fixed image vocabulary, in: Proceedings of 7th European Conference on Computer Vision, Springer, Copenhagen, Denmark, 2002, pp. 97-112.
10. Q. Gu, Z. Li, J. Han, Correlated multi-label feature selection, in: Proceedings of 20th ACM International Conference on Information and knowledge management, Glasgow, UK, 2011, pp. 1087-1096.
11. D. Hsu, S. Kakade, J. Langford, T. Zhang, Multi-label prediction via compressed sensing, in: Proceedings of 24th Annual Conference on Neural Information Processing Systems, Vancouver, Canada, 2009, pp. 772-780.
12. A. Jakulin, Attribute interactions in machine learning (Ph.D. thesis), Univerza v Ljubljani, 2003.
13. S. Ji, L. Tang, S. Yu, J. Ye, Extracting shared subspace for multi-label classification, in: Proceedings of 14th ACM SIGKDD International Conference on Knowledge discovery and data mining, Las Vegas, USA, 2008, pp. 381-389.
14. I. Katakis, G. Tsoumakas, I. Vlahavas, Multilabel text classification for automated tag suggestion, in: Proceedings of 18th European Conference on Machine Learning and 11th Principles and Practice of Knowledge Discovery in Databases, Antwerp, Belgium, 2008, pp. 1-9.
15. D. Kong, C. Ding, H. Huang, H. Zhao, Multi-label ReliefF and F-statistic feature selections for image annotation, in: Proceedings of 25th IEEE Conference on Computer Vision and Pattern Recognition, Providence, USA, 2012, pp. 2352-2359.
16. X. Kong, and P. Yu gMLC a multi-label feature selection framework for graph classification Knowl. Inf. Syst. 31 2012 281 305
17. G. Lastra, O. Luaces, J.R. Quevedo, A. Bahamonde, Graphical feature selection for multilabel classification tasks, in: Lecture Notes in Computer Science, vol. 7014 (2011) 246-257.
18. J. Lee, and D.W. Kim Feature selection for multi-label classification using multivariate mutual information Pattern Recognit. Lett. 34 2013 349 357
19. D. Lewis, Y. Yang, T. Rose, and F. Li Rcv1 a new benchmark collection for text categorization research J. Mach. Learn. Res. 5 2004 361 397
20. G. Madjarov, D. Kocev, D. Gjorgjevikj, and S. Džeroski An extensive experimental comparison of methods for multi-label learning Pattern Recognit. 45 2012 3084 3104
21. 2,1-norms minimization Adv. Neural Inf. Process. Syst. 23 2010 1813 1821
22. I. Oh, J. Lee, and B. Moon Hybrid genetic algorithms for feature selection IEEE Trans. Pattern Anal. Mach. Intell. 26 2004 1424 1437
23. B. Qian, I. Davidson, Semi-supervised dimension reduction for multi-label classification, in: Proceedings of 24th AAAI Conference on Artificial Intelligence, Atlanta, USA, 2010, pp. 569-574.
24. J. Read, B. Pfahringer, G. Holmes, and E. Frank Classifier chains for multi-label classification Mach. Learn. 85 2011 333 359
25. R. Schapire, and Y. Singer Boostexter a boosting-based system for text categorization Mach. Learn. 39 2000 135 168
26. F. Sebastiani Machine learning in automated text categorization ACM Comput. Surv. 34 2002 1 47
27. C. Shannon A mathematical theory of communication ACM SIGMOBILE Mobile Comput. Commun. Rev. 5 2001 3 55
28. L. Song, A. Smola, A. Gretton, J. Bedo, and K. Borgwardt Feature selection via dependence maximization J. Mach. Learn. Res. 13 2012 1393 1434
29. N. Spolaôr, E.A. Cherman, M.C. Monard, and H.D. Lee A comparison of multi-label feature selection methods using the problem transformation approach Electron. Notes Theor. Comput. Sci. 292 2013 135 151
30. A.N. Srivastava, B. Zane-Ulman, Discovering recurring anomalies in text reports regarding complex space systems, in: Proceedings of IEEE Aerospace Conference, Big Sky, USA, 2005, pp. 3853-3862.
31. K. Trohidis, G. Tsoumakas, G. Kalliris, I. Vlahavas, Multi-label classification of music into emotions, in: Proceedings of 9th International Conference on Music Information Retrieval, Philadelphia, USA, 2008, pp. 325-330.
32. G. Tsoumakas, I. Katakis, I. Vlahavas, Effective and efficient multilabel classification in domains with large number of labels, in: Proceedings of 18th European Conference on Machine Learning and 11th Principles and Practice of Knowledge Discovery in Databases, Antwerp, Belgium, 2008, pp. 30-44.
33. G. Tsoumakas, I. Katakis, and I. Vlahavas Random k-labelsets for multilabel classification IEEE Trans. Knowl. Data Eng. 23 2011 1079 1089
34. G. Tsoumakas, E. Spyromitros-Xioufis, J. Vilcek, and I. Vlahavas Mulan a java library for multi-label learning J. Mach. Learn. Res. 12 2011 2411 2414
35. M. Zhang, J. Pena, and V. Robles Feature selection for multi-label naive Bayes classification Inf. Sci. 179 2009 3218 3229
36. M. Zhang, K. Zhang, Multi-label learning by exploiting label dependency, in: Proceedings of 16th ACM SIGKDD International Conference on Knowledge discovery and data mining, Washington, USA, 2010, pp. 999-1008.
37. M. Zhang, and Z. Zhou ML-kNN a lazy learning approach to multi-label learning Pattern Recognit. 40 2007 2038 2048
38. M. Zhang, and Z. Zhou A review on multi-label learning algorithm IEEE Trans. Knowl. Data Eng. 26 2013 1819 1837
39. Y. Zhang, and Z. Zhou Multilabel dimensionality reduction via dependence maximization ACM Trans. Knowl. Disc. Data 4 2010 Article No. 14