Mutual Information-based multi-label feature selection using interaction information

Expert Systems with Applications

Volumn 42, Issue 4, 2015, Pages 2013-2025

  Lee, Jaesung ^a   Kim, Dae Won ^a  

^a Chung Ang University   (South Korea)

Author keywords

Feature dependency; Interaction information; Multi label feature selection; Multivariate feature selection

Indexed keywords

CLASSIFICATION (OF INFORMATION); INFORMATION USE;

FEATURE DEPENDENCY; FEATURE SELECTION ALGORITHM; FEATURE SELECTION METHODS; INTERACTION INFORMATION; MULTI-LABEL; MULTI-LABEL CLASSIFICATIONS; MUTUAL INFORMATIONS; THEORETICAL BOUNDS;

FEATURE EXTRACTION;

EID: 84910651885     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2014.09.063     Document Type: Article

References (36)

1. Battiti, R. (1994). Using mutual information for selecting features in supervised neural net learning. IEEE Transactions on Neural Networks, 5, 537-550.
2. Boutell, M., Luo, J., Shen, X., & Brown, C. (2004). Learning multi-label scene classification. Pattern Recognition, 37, 1757-1771.
3. Brown, G. (2009). A new perspective for information theoretic feature selection. In Proceedings of the 12th international conference of artificial intelligence and statistics (pp. 49-56)..
4. Chen, W., Yan, J., Zhang, B., Chen, Z., & Yang, Q. (2007). Document transformation for multi-label feature selection in text categorization. In Proceedings of the seventh IEEE international conference of data mining (pp. 451-456)..
5. Diplaris, S., Tsoumakas, G., Mitkas, P., & Vlahavas, I. (2005). Protein classification with multiple algorithms. Advances in Informatics, 3746, 448-456.
6. Doquire, G., & Verleysen, M. (2013). Mutual information-based feature selection for multilabel classification. Neurocomputing, 122, 148-155.
7. Dougherty, J., Kohavi, R., & Sahami, M. (1995). Supervised and unsupervised discretization of continuous features. In Machine learning: Proceedings of the 12th international conference of machine learning (pp. 194-202)..
8. Elisseeff, A., & Weston, J. (2001). A kernel method for multi-labelled classification. Advances in Neural Information Processing Systems, 14, 681-687.
9. Estévez, P., Tesmer, M., Perez, C., & Zurada, J. (2009). Normalized mutual information feature selection. IEEE Transactions on Neural Networks, 20, 189-201.
10. Fano, R. M. (1961). Transmission of information: A statistical theory of communication. MIT Press.
11. Guyon, I., & Elisseeff, A. (2003). An introduction to variable and feature selection. Journal of Machine Learning Research, 3, 1157-1182.
12. Han, T. (1978). Nonnegative entropy measures of multivariate symmetric correlations. Information and Control, 36, 133-156.
13. Jain, A., & Zongker, D. (1997). Feature selection: Evaluation, application, and small sample performance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19, 153-158.
14. Klimt, B., & Yang, Y. (2004). The Enron corpus: A new dataset for email classification research. Lecture Notes in Computer Science, 3201, 217-226.
15. Kong, X., & Yu, P. (2013). gMLC: A multi-label feature selection framework for graph classification. Knowledge and Information Systems, 31, 281-305.
16. Kwak, N., & Choi, C. (2002). Input feature selection for classification problems. IEEE Transactions on Neural Networks, 13, 143-159.
17. Lee, J., & Kim, D. W. (2013). Feature selection for multi-label classification using multivariate mutual information. Pattern Recognition Letters, 34, 349-357.
18. Lewis, D., Yang, Y., Rose, T., & Li, F. (2004). RCV1: A new benchmark collection for text categorization research. Journal of Machine Learning Research, 5, 361-397.
19. Nie, F., Huang, H., Cai, X., & Ding, C. (2010). Efficient and robust feature selection via joint l2, 1-norms minimization. Advances in Neural Information Processing Systems, 23, 1813-1821.
20. Novovičová, J., Somol, P., Haindl, M., & Pudil, P. (2007). Conditional mutual information based feature selection for classification task. Lecture Notes in Computer Science, 4756, 417-426.
21. Peng, H., Long, F., & Ding, C. (2005). Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 1226-1238.
22. Rao, Y., Li, Q., Mao, X., & Wenyin, L. (2014). Sentiment topic models for social emotion mining. Information Sciences, 266, 90-100.
23. Read, J. (2008). A pruned problem transformation method for multi-label classification. In Proceedings of the 2008 New Zealand computer science research student conference (pp. 143-150)..
24. Saeys, Y., Inza, I., & Larrañaga, P. (2007). A review of feature selection techniques in bioinformatics. Bioinformatics, 23, 2507-2517.
25. Schapire, R., & Singer, Y. (2000). Boostexter: A boosting-based system for text categorization. Machine Learning, 39, 135-168.
26. Sebastiani, F. (2002). Machine learning in automated text categorization. ACM Computing Surveys, 34, 1-47.
27. Shannon, C. (2001). A mathematical theory of communication. ACM SIGMOBILE Mobile Computing and Communications Review, 5, 3-55.
28. Spolaôr, N., Cherman, E. A., Monard, M. C., & Lee, H. D. (2013). A comparison of multi-label feature selection methods using the problem transformation approach. Electronic Notes in Theoretical Computer Science, 292, 135-151.
29. Sun, Y., Wong, A., & Kamel, M. (2009). Classification of imbalanced data: A review. International Journal of Pattern Recognition and Artificial Intelligence, 23, 687.
30. Trohidis, K., Tsoumakas, G., Kalliris, G., & Vlahavas, I. (2008). Multilabel classification of music into emotions. In Proceedings of the ninth international conference of music information retrieval (pp. 325-330)..
31. Tsoumakas, G., & Vlahavas, I. (2007). Random k-labelsets: An ensemble method for multilabel classification. In Proceedings of the 18th European conference of machine learning (pp. 406-417)..
32. Tsoumakas, G., & Katakis, I. (2007). Multi-label classification: An overview. International Journal of Data Warehousing and Mining, 3, 1-13.
33. Tsoumakas, G., Katakis, I., & Vlahavas, I. (2011). Random k-labelsets for multi-label classification. IEEE Transactions on Knowledge and Data Engineering, 23, 1079-1089.
34. Watanabe, S. (1969). Knowing and guessing: A quantitative study of inference and information. New York: Wiley.
35. Yang, Y., & Pedersen, J. (1997). A comparative study on feature selection in text categorization. In Proceedings of the 14th international conference of machine learning (pp. 412-420)..
36. Zhang, M., Peña, J., & Robles, V. (2009). Feature selection for multi-label naive Bayes classification. Information Sciences, 179, 3218-3229.