A relative decision entropy-based feature selection approach

Pattern Recognition

Volumn 48, Issue 7, 2015, Pages 2151-2163

  Jiang, Feng ^a   Sui, Yuefei ^b   Zhou, Lin ^a  

^a QINGDAO UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b INSTITUTE OF COMPUTING TECHNOLOGY   (China)

Author keywords

Feature selection; Feature significance; Relative decision entropy; Rough sets; Roughness; The degree of dependency

Indexed keywords

COMPUTATION THEORY; FEATURE EXTRACTION; HEURISTIC ALGORITHMS; HEURISTIC METHODS; INTRUSION DETECTION; SURFACE ROUGHNESS;

COMPUTATIONAL COSTS; DECISION ENTROPY; DEGREE OF DEPENDENCY; EXPONENTIAL COMPUTATION; FEATURE SELECTION ALGORITHM; FEATURE SIGNIFICANCE; HEURISTIC INFORMATION; INFORMATION ENTROPY;

ROUGH SET THEORY;

EID: 84925585448     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2015.01.023     Document Type: Article

References (51)

1. K. Bache, M. Lichman, UCI machine learning repository 〈 http://archive.ics.uci.edu/ml 〉, 2013.
2. KDD Cup 99 Data set, Available online at: 〈 http://kdd.ics.uci.edu/databases/kddcup99/kddcup99.html 〉, 1999.
3. R. Jensen, and Q. Shen Semantics-preserving dimensionality reduction rough and fuzzy-rough based approaches IEEE Trans. Knowl. Data Eng. 16 12 2004 1457 1471
4. R. Jensen, and Q. Shen Computational Intelligence and Feature Selection: Rough and Fuzzy Approaches 2008 IEEE Press, Wiley & Sons New Jersey
5. C.E. Shannon The mathematical theory of communication Bell Syst. Tech. J. 27 3-4 1948 373 423
6. M. Sebban, and R. Nock A hybrid filter/wrapper approach of feature selection using information theory Pattern Recognit. 35 4 2002 835 846
7. H.W. Liu, J.G. Sun, L. Liu, and H.J. Zhang Feature selection with dynamic mutual information Pattern Recognit. 42 7 2009 1330 1339
8. J.M. Sotoca, and F. Pla Supervised feature selection by clustering using conditional mutual information-based distances Pattern Recognit. 43 6 2010 2068 2081
9. H. Yan, X.T. Yuan, S.C. Yan, and J.Y. Yang Correntropy based feature selection using binary projection Pattern Recognit. 44 12 2011 2834 2842
10. Z. Pawlak Rough sets Int. J. Comput. Inf. Sci. 11 1982 341 356
11. X.H. Hu, Knowledge discovery in databases: an attribute-oriented rough set approach (Ph.D. thesis), Regina University, 1995.
12. K.Y. Hu, Y.C. Lu, and C.Y. Shi Feature ranking in rough sets AI Commun. 16 1 2003 41 50
13. Q.H. Hu, Z.X. Xie, and D.R. Yu Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation Pattern Recognit. 40 12 2007 3509 3521
14. Q.H. Hu, D.R. Yu, J.F. Liu, and C.X. Wu Neighborhood rough set based heterogeneous feature subset selection Inf. Sci. 178 18 2008 3577 3594
15. J.Y. Liang, and Z.B. Xu The algorithm on knowledge reduction in incomplete information systems Int. J. Uncertain. Fuzziness Knowl.-Based Syst. 10 1 2002 95 103
16. P. Maji, and S.K. Pal Feature selection using f-information measures in fuzzy approximation spaces IEEE Trans. Knowl. Data Eng. 22 6 2010 854 867
17. D.Q. Miao, and G.R. Hu An heuristic algorithm of knowledge reduction Comput. Res. Dev. 36 6 1999 681 684
18. N.M. Parthaláin, and Q. Shen Exploring the boundary region of tolerance rough sets for feature selection Pattern Recognit. 42 5 2009 655 667
19. Y.H. Qian, J.Y. Liang, and F. Wang A new method for measuring the uncertainty in incomplete information systems Int. J. Uncertain. Fuzziness Knowl.-Based Syst. 17 6 2009 855 880
20. Y.H. Qian, J.Y. Liang, W. Pedrycz, and C.Y. Dang An efficient accelerator for attribute reduction from incomplete data in rough set framework Pattern Recognit. 44 8 2011 1658 1670
21. Q. Shen, and R. Jensen Selecting informative features with fuzzy-rough sets and its application for complex systems monitoring Pattern Recognit. 37 7 2004 1351 1363
22. D. Slezak Approximate entropy reducts Fundam. Inform. 53 3-4 2002 365 390
23. G.Y. Wang, H. Yu, and D.C. Yang Decision table reduction based on conditional information entropy Chin. J. Comput. 25 7 2002 759 766
24. X.Y. Wang, J. Yang, X.L. Teng, W.J. Xia, and R. Jensen Feature selection based on rough sets and particle swarm optimization Pattern Recognit. Lett. 28 4 2007 459 471
25. 2 | U / C |)) Chin. J. Comput. 29 3 2006 391 399
26. J.P. Anderson Computer Security Threat Monitoring and Surveillance 1980 James P. Anderson Co Fort Washington, PA, USA
27. W. Lee, S.J. Stolfo, Data mining approaches for intrusion detection, in: Proceedings of the 7th USENIX Security Symposium, 1998, pp. 79-94.
28. J.T. Yao, S.L. Zhao, L. Fan, An enhanced support vector machine model for intrusion detection, in: Proceedings of RSKT 2006, Lecture Notes in Artificial Intelligence, vol. 4062, Springer, Berlin, 2006, pp. 538-543.
29. Q. Shen, and A. Chouchoulas A rough-fuzzy approach for generating classification rules Pattern Recognit. 35 11 2002 2425 2438
30. L. Zhou, F. Jiang, A rough set approach to feature selection based on relative decision entropy, in: Proceedings of the 6th International Conference on Rough Set and Knowledge Technology, Lecture Notes in Computer Science, vol. 6954, 2011, pp. 110-119.
31. Z. Pawlak Rough Sets: Theoretical Aspects of Reasoning about Data 1991 Kluwer Academic Publishers Dordrecht
32. I. Düntsch, and G. Gediga Uncertainty measures of rough set prediction Artif. Intell. 106 1998 109 137
33. J.Y. Liang, Z.Z. Shi, D.Y. Li, and M.J. Wierman Information entropy rough entropy, and knowledge granularity in incomplete information systems Int. J. Gen. Syst. 35 6 2006 641 654
34. H.S. Nguyen, and S.H. Nguyen Discretization methods in data mining L. Polkowski, A. Skowron, Rough Sets in Knowledge Discovery 1998 Physica Heidelberg 451 482
35. A. Ohrn, Rosetta Technical Reference Manual, Available online at: 〈 http://www.idi.ntnu.no/-aleks/rosetta 〉, 1999.
36. I.H. Witten, and E. Frank Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations 2000 Morgan Kaufmann San Francisco
37. S.T. Chen, G.L. Chen, W.Z. Guo, and Y.H. Liu Feature selection of the intrusion detection data based on particle swarm optimization and neighborhood reduction J. Comput. Res. Dev. 47 7 2010 1261 1267
38. J. Wroblewski, Finding minimal reducts using genetic algorithms, in: Proceedings of the 2nd Annual Join Conference on Information Sciences, 1995, pp. 186-189.
39. A. Skowron, J. Bazan, N.H. Son, and J. Wroblewski RSES 2.2 User's Guide 2005 Institute of Mathematics, Warsaw University Poland
40. R. Jensen, Q. Shen, Finding rough set reducts with ant colony optimization, in: Proceedings of the 2003 UK Workshop on Computational Intelligence, 2003, pp. 15-22.
41. R. Quinlan Induction of decision trees Mach. Learn. 1 1 1986 81 106
42. U.M. Fayyad, K.B. Irani, Multi-interval discretization of continuous-valued attributes for classification learning, in: Proceedings of the 13th International Conference on Artificial Intelligence, 1993, pp. 1022-1027.
43. S. Das, Filters, wrappers and a boosting-based hybrid for feature selection, in: Proceedings of the 8th International Conference on Machine Learning, 2001, pp. 74-81.
44. R. Kohavi, and G. John Wrappers for feature subset selection Artif. Intell. 97 1997 273 324
45. M. Dash, H. Liu, H. Motoda, Consistency based feature selection, in: Proceedings of the 4th Pacific Asia Conference on Knowledge Discovery and Data Mining, Springer, Kyoto, Japan, 2000, pp. 98-109.
46. M.A. Hall, Correlation based feature selection for machine learning (Doctoral dissertation), University of Waikato, Department of Computer Science, 1999.
47. W. Pedrycz, and G. Vukovich Feature analysis through information granulation and fuzzy sets Pattern Recognit. 35 4 2002 825 834
48. Q.H. Hu, D.R. Yu, W. Pedrycz, and D.G. Chen Kernelized fuzzy rough sets and their applications IEEE Trans. Knowl. Data Eng. 23 11 2011 1649 1667
49. G. Michal, S. Jacek, RSL - The Rough Set Library, Version 2.0, ICS Research Report, Warsaw University of Technology, 1994.
50. A. Zainal, M.A. Maarof, S.M. Shamsuddin, Feature selection using rough set in intrusion detection, in: IEEE TENCON 2006, Hongkong, 2006, pp. 1-4.
51. Z. Pawlak Rough sets and intelligent data analysis Inf. Sci. 147 1 2002 1 12