Feature selection with partition differentiation entropy for large-scale data sets

Information Sciences

Volumn 329, Issue , 2016, Pages 690-700

  Li, Fachao ^a   Zhang, Zan ^b   Jin, Chenxia ^a  

^a HEBEI UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b TIANJIN UNIVERSITY   (China)

Author keywords

Attributes significance; Feature selection; Large scale data sets; Partition differentiation entropy; Uncertainty

Indexed keywords

ARTIFICIAL INTELLIGENCE; DATA MINING; DIGITAL STORAGE; ENTROPY; INFORMATION SYSTEMS; INFORMATION THEORY; LEARNING SYSTEMS; PATTERN RECOGNITION; ROUGH SET THEORY; UNCERTAINTY ANALYSIS;

ATTRIBUTE SIGNIFICANCE; ATTRIBUTES SIGNIFICANCE; DECISION INFORMATION SYSTEM; FEATURE SELECTION METHODS; IMPORTANT FEATURES; LARGE SCALE DATA SETS; STORAGE TECHNOLOGY; UNCERTAINTY;

FEATURE EXTRACTION;

EID: 84949681785     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2015.10.002     Document Type: Article

References (36)

1. H. Banka, S. Dara A Hamming distance based binary particle swarm optimization(HDBPSO) algorithm for high dimensional feature selection, classification and validation Pattern Recognit. Lett. 52 2014 94 100
2. M. Banerjee, N.R. Pal Feature selection with SVD entropy: some modification and extension Inf. Sci. 264 20 2014 118 134
3. J.H. Dai, W.T. Wang, H.W. Tian, L. Liu Attribute selection based on a new conditional entropy for incomplete decision systems Knowl. Based Syst. 39 2013 207 213
4. J.W. Grzymala-Busse An algorithm for computing a single covering J.W. Grzymala-Busse Managing Uncertainty in Expert Systems 1991 Kluwer Academic Publishers
5. R.V.L. Hartley Transmission of information The Bell Syst. Tech. J. 7 1928 535 563
6. D.L.H Emiro, D.L.H Eduardo, A. Ortiz, J. Ortega, A. Martínez-álvarez Feature selection by multi-objective optimisation: application to network anomaly detection by hierarchical self-organising maps Knowl. Based Syst. 71 2014 322 338
7. X. Hu, N. Cercone Learning in relational databases: a rough set approach Comput. Intell.: Int. J. 11 1995 323 338
8. Q.H. Hu, D.R. Yu, J.F. Liu, C.X. Wu Neighborhood rough set based heterogeneous feature selection Inf. Sci. 178 2008 3577 3594
9. X.H. Hu Knowledge discovery in databases: an attribute-oriented rough set approach 1995 Ph. D. Thesis, University of Regina
10. F. Jiang, Y.F. Sui, L. Zhou A relative decision entropy-based feature selection approach Pattern Recognit. 48 7 2015 2151 2163
11. J. Komorowski, Z. Pawlak, L. Polkowski, A. Skowron Rough sets: a tutorial, in: rough fuzzy hybridization A New Trend In Decision-Making 1999 Springer-Verlag Singapore Ptv., Ltd. Singapore
12. J. Lee, D.W. Kim Feature selection for multi-label classification using multivariate mutual information Pattern Recognit. Lett. 34 3 2013 349 357
13. J.Y. Liang, K.S. Chin, C.Y. Dang, C.M. Yam Richid A new method for measuring uncertainty and fuzziness in rough set theory Int. J. Gen. Syst. 31 4 2002 331 342
14. J.Y. Liang, F. Wang, C.Y. Dang, Y.H. Qian An efficient rough feature selection algorithm with a multi-granulation view Int. J. Approx. Reason. 53 2012 912 926
15. J.Y. Liang, Y.H. Qian Information granules and entropy theory in information systems Sci. Chin. Series F: Inf. Sci. 51 10 2008 1427 1444
16. S. Maldonado, R. Montoya, R. Weber Advanced conjoint analysis using feature selection via support vector machines Eur. J. Oper. Res. 241 2015 564 574
17. S. Maldonado, R. Weber, F. Famili Feature selection for high-dimensional class-imbalanced data sets using support vector machines Inf. Sci. 286 2014 228 246
18. Z. Pawlak Rough sets. Int. J. Comput. Inf. Sci. 11 1982 341 356
19. R.H.W. Pinheiro, G.D.C. Cavalcanti, T.I. Ren Data-driven global-ranking local feature selection methods for text categorization Expert Syst. Appl. 42 2015 1941 1949
20. L. Polkowski On convergence of rough sets R. Slowinski Intelligent Decision Support: Handbook of Applications and Advances of Rough Set Theory vol. 11 1992 Kluwer Dordrecht 305 311
21. Y.H. Qian, J.Y. Liang, D.Y. Li, H.Y. Zhang, C.Y. Dang Measures for evaluating the decision performance of a decision table in rough set theory Inf. Sci. 178 2008 181 202
22. Y.H. Qian, J.Y. Liang Combination entropy and combination granulation in rough set theory Int. J. Uncertainty, Fuzziness Knowl. Based Syst. 16 2 2008 179 193
23. Y.H. Qian, J.Y. Liang, W. Pedrycz, C.Y. Dang Positive approximation: an accelerator for attribute reduction in rough set theory Artif. Intell. 174 2010 597 618
24. C.E. Shannon The mathematical theory of communication Bell Syst. Tech. J. 27 3, 4 1948 373 423
25. W.H. Shu, H. Shen Incremental feature selection based on rough set in dynamic incomplete data Pattern Recognit. 47 2014 3890 3906
26. A. Skowron Extracting laws from decision tables: a rough set approach Comput. Intell. 11 1995 371 388
27. D. Slezak Approximate entropy reducts Fundam. Inf. 53 3-4 2002 365 390
28. Q.B. Song, J.J. Ni, G.T. Wang A fast clustering-based feature subset selection algorithm for high-dimensional data Knowl. Data Eng. 25 1 2013 1 14
29. L. Sun, J.C Xu, Y. Tian Feature selection using rough entropy-based uncertainty measures in incomplete decision systems Knowl. Based Syst. 36 2012 206 216
30. H.A.L. Thi, X.T. Vo, T.P. Dinh Feature selection for linear SVMs under uncertain data: robust optimization based on difference of convex functions algorithms Neural Netw. 59 2014 36 50
31. C.Z. Wang, Q. He, D.G. Chen, Q.H. Hu A novel method for attribute reduction of covering decision systems Inf. Sci. 254 2014 181 196
32. G.Y. Wang, H. Yu, D.C. Yang Decision table reduction based on conditional information entropy Chin. J. Comput. 25 7 2002 759 766
33. K.J. Wang, K.H. Chen, M.A. Angelia An improved artificial immune recognition system with the opposite sign test for feature selection Knowl. Based Syst. 71 2014 126 145
34. S.K.M. Wong, W. Ziarko On optional decision rules in decision tables Bull. Pol. Acad. Sci. 33 11/12 1985 693 696
35. A.P. Zeng, T.R. Li, D. Liu, J.B. Zhang, H.M. Chen A fuzzy rough set approach for incremental feature selection on hybrid information systems Fuzzy Sets Syst. 258 2015 39 60
36. X.H. Zhao, D.L. Li, B. Yang, C. Ma, Y.G. Zhu, H.L. Chen Feature selection based on improved ant colony optimization for online detection of foreign fiber in cotton Appl. Soft Comput. 24 2014 585 596