Feature selection for multi-label classification using multivariate mutual information

Pattern Recognition Letters

Volumn 34, Issue 3, 2013, Pages 349-357

  Lee, Jaesung ^a   Kim, Dae Won ^a  

^a Chung Ang University   (South Korea)

Author keywords

Label dependency; Multi label feature selection; Multivariate feature selection; Multivariate mutual information

Indexed keywords

FEATURE EXTRACTION; TEXT PROCESSING;

CLASSIFICATION PERFORMANCE; CONVENTIONAL METHODS; FEATURE SELECTION METHODS; GENE FUNCTION PREDICTION; LABEL DEPENDENCIES; MULTI LABEL CLASSIFICATION; MULTI-LABEL; MULTIVARIATE MUTUAL INFORMATION;

CLASSIFICATION (OF INFORMATION);

EID: 84870668654     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2012.10.005     Document Type: Article

References (27)

1. Beirlant, J., Dudewicz, E., Györfi, L., Van der Meulen, E., 1997. Nonparametric entropy estimation: An overview. Internat. J. Math. Statist. Sci. 6, 17-40.
2. Boutell, M., Luo, J., Shen, X., Brown, C, 2004. Learning multi-label scene classification. Pattern Recognition 37, 1757-1771. (Pubitemid 38804465)
3. Chen, W., Yan, J., Zhang, B., Chen, Z., Yang, Q., 2007. Document transformation for multi-label feature selection in text categorization. In: Proc. Seventh IEEE Internat Conf. of Data Mining (ICDM'07), pp. 451-456.
4. Diplaris, S., Tsoumakas, G., Mitkas, P., Vlahavas, I., 2005. Protein classification with multiple algorithms. Adv. Inf. 3746, 448-456.
5. Doquire, G., Verleysen, M., 2011. Feature selection for multi-label classification problems. Adv. Comput. Intell. 6691, 9-16.
6. Dougherty, J., Kohavi, R., Sahami, M., 1995. Supervised and unsupervised discretization of continuous features. In: Internat. Worksh. Conf. on Machine Learning. Morgan Kaufmann Publishers, Inc., pp. 194-202.
7. Elisseeff, A., Weston, J., 2001. A kernel method for multi-labelled classification. Adv. Neural Inf. Process. Systems 14, 681-687.
8. Gu, Q., Li, Z., Han, J., 2011. Correlated multi-label feature selection. In: Proc. 20th ACM Internat. Conf. on Information and Knowledge Management. ACM, pp. 1087-1096.
9. Guyon, I., Elisseeff, A., 2003. An introduction to variable and feature selection. J. Machine Learn. Res. 3, 1157-1182.
10. Klimt, B., Yang, Y., 2004. The enron corpus: A new dataset for email classification research. Lect. Note Comput. Sci. 3201, 217-226. (Pubitemid 41050094)
11. Lee, I., 2010. Sample-spacings-based density and entropy estimators for spherically invariant multidimensional data. Neural Comput. 22, 2208-2227.
12. Lewis, D., Yang, Y., Rose, T., Li, F., 2004. Rcvl: A new benchmark collection for text categorization research. J. Machine Learn. Res. 5, 361-397.
13. McGill, W., 1954. Multivariate information transmission. IRE Trans. Inf. Theory 4, 93-111.
14. Miller, E., 2003. A new class of entropy estimators for multi-dimensional densities. In: Proc. 2003 IEEE Internat. Conf. on Acoustic, Speech and Signal Processing (ICASSP'03). IEEE, pp. 297-300.
15. Read, J., 2008. A pruned problem transformation method for multi-label classification. In: Proc. 2008 New Zealand Comput. Sci. Res. Stud. Conf. (NZCSRS'08), pp. 143-150.
16. Saeys, Y., Inza, I., Larranaga, P., 2007. A review of feature selection techniques in bioinformatics. Bioinformatics 23, 2507-2517. (Pubitemid 350048351)
17. Schapire, R., Singer, Y, 2000. Boostexter: A boosting-based system for text categorization. Machine Learn. 39, 135-168. (Pubitemid 30594821)
18. Sebastiani, F., 2002. Machine learning in automated text categorization. ACM Comput. Surv. 34, 1-47.
19. Sun, Y., Wong, A., Kamel, M., 2009. Classification of imbalanced data: A review. Int. J. Pattern Recognition Artif. Intell. 23, 687.
20. Trohidis, K., Tsoumakas, G., Kalliris, G., Vlahavas, I., 2008. Multilabel classification of music into emotions. In: Proc. Ninth Internat. Conf. Music Inform. Retrieval (ISMIR'08), Philadelphia, PA, USA.
21. Tsoumakas, G., Katakis, I., 2007. Multi-label classification: An overview. Internat. J. Data Warehouse Min. 3, 1-13.
22. Tsoumakas, G., Katakis, I., Vlahavas, I., 2011. Random k-labelsets for multi-label classification. IEEE Trans. Knowl. Data Eng. 23, 1079-1089.
23. Tsoumakas, G., Vlahavas, I., 2007. Random k-labelsets: An ensemble method for multilabel classification. Machine Learn. (ECML'07) 4701, 406-417.
24. Watanabe, S., 1969. Knowing and Guessing: A Quantitative Study of Inference and Information. Wiley, New York.
25. Yang, Y, Pedersen, J., 1997. A comparative study on feature selection in text categorization. In: Proc. 14th Internat. Conf. on Machine Learning, pp. 412-420.
26. Zhang, M., Pena, J., Robles, V., 2009. Feature selection for multi-label naive bayes classification. Inf. Sci. 179, 3218-3229.
27. Zhang, M., Zhou, Z., 2007. ML-KNN: A lazy learning approach to multi-label learning. Pattern Recognition 40, 2038-2048. (Pubitemid 46497248)