Attribute selection based on a new conditional entropy for incomplete decision systems

Knowledge-Based Systems

Volumn 39, Issue , 2013, Pages 207-213

  Dai, Jianhua ^a   Wang, Wentao ^a   Tian, Haowei ^a   Liu, Liang ^a  

^a ZHEJIANG UNIVERSITY   (China)

Author keywords

Attribute selection; Conditional entropy; Incomplete decision systems; Information theory; Rough set theory

Indexed keywords

ATTRIBUTE IMPORTANCE; ATTRIBUTE SELECTION; CONDITIONAL ENTROPY; EXHAUSTIVE SEARCH; INCOMPLETE DATA; INCOMPLETE DECISION SYSTEM; NEW FORMS; PROBABILISTIC SEARCH APPROACHES; SEARCH STRATEGIES; SHANNON'S ENTROPY;

INFORMATION THEORY; ROUGH SET THEORY;

ENTROPY;

EID: 84871919380     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2012.10.018     Document Type: Article

References (43)

1. Z. Pawlak Rough Sets: Theoretical Aspects of Reasoning About Data 1991 Kluwer Academic Publishers Dordrecht & Boston
2. Z. Pawlak, and A. Skowron Rudiments of rough sets Information Sciences 177 2007 3 27
3. H.M. Abu-Donia Multi knowledge based rough approximations and applications Knowledge-Based Systems 26 2012 20 29
4. Y.-S. Chen, and C.-H. Cheng A soft-computing based rough sets classifier for classifying IPO returns in the financial markets Applied Soft Computing 12 1 2012 462 475
5. M. Chmielewski, J. Grzymala-Busse, N. Peterson, and S. Than The rule induction system LERS-a version for personal computers Foundations of Computing and Decision Sciences 18 3-4 1993 181 212
6. A. Skowron, and J. Stepaniuk Tolerance approximation spaces Fundamenta Informaticae 27 1996 245 253
7. Y.Y. Yao Two views of the theory of rough sets in finite universes International Journal of Approximation Reasoning 15 1996 291 317
8. Y.Y. Yao Constructive and algebraic methods of the theory of rough sets Information Sciences 109 1998 21 47
9. H.S. Own, and A. Abraham A new weighted rough set framework based classification for egyptian neonatal jaundice Applied Soft Computing 12 3 2012 999 1005
10. M.L. Othman, I. Aris, M.R. Othman, and H. Osman Rough-set-based timing characteristic analyses of distance protective relay Applied Soft Computing 12 8 2012 2053 2062
11. Y.-L. Li, J.-F. Tang, K.-S. Chin, Y. Han, and X.-G. Luo A roughset approach for estimating correlation measures in quality function deployment Information Sciences 189 2012 126 142
12. J. Dai Rough 3-valued algebras Information Sciences 178 2008 1986 1996
13. J. Dai, Q. Xu, and W. Wang A comparative study on strategies of rule induction for incomplete data based on rough set approach International Journal of Advancements in Computing Technology 3 2011 176 183
14. J. Dai, Q. Xu, W. Wang, and H. Tian Conditional entropy for incomplete decision systems and its application in data mining International Journal of General Systems 41 7 2012 713 728
15. J. Dai, X. Liu, and Q. Xu Neural spike sorting by rough set method International Journal of Digital Content Technology and its Applications 4 2010 203 209
16. Y. Leung, and D. Li Maximal consistent block technique for rule acquisition in incomplete information systems Information Sciences 153 2003 85 106
17. I. Duentsch, and G. Gediga Uncertainty measures of rough set prediction Artificial Intelligence 106 1998 109 137
18. J. Dai, Y.X. Li, and Q. Liu Hybrid genetic algorithm for reduct of attributes in decision system based on rough set theory Wuhan University Journal of Natural Sciences 7 2002 285 289
19. Y. Du, Q. Hu, P. Zhu, and P. Ma Rule learning for classification based on neighborhood covering reduction Information Sciences 181 2011 5457 5467
20. J. Dai, and Q. Xu Attribute selection based on information gain ratio in fuzzy rough set theory with application to tumor classification Applied Soft Computing 13 1 2013 211 221
21. W. Xu, Y. Li, and X. Liao Approaches to attribute reductions based on rough set and matrix computation in inconsistent ordered information systems Knowledge-Based Systems 27 2012 78 91
22. M. Kryszkiewicz Rough set approach to incomplete information systems Information Sciences 112 1-4 1998 39 49
23. M. Kryszkiewicz Rules in incomplete information systems Information Sciences 113 3 1999 271 292
24. R. Slowinski, and D. Vanderpooten A generalized definition of rough approximations based on similarity IEEE Transactions on Knowledge and Data Engineering 12 2000 331 336
25. J. Stefanowski, and A. Tsoukias Incomplete information tables and rough classification Computational Intelligence 17 2001 545 566
26. J. Dai, and Q. Xu Approximations and uncertainty measures in incomplete information systems Information Sciences 198 2012 62 80
27. C. Shannon A mathematical theory of communication The Bell System Technical Journal 27 1948 379 423
28. H. Peng, F. Long, and C. Ding Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2005 1226 1238
29. J. Quinlan Induction on decision trees Machine Learning 1 1986 81 106
30. L. Yu, and H. Liu Efficient feature selection via analysis of relevance and redundancy The Journal of Machine Learning Research 5 2004 1205 1224
31. T. Beaubouef, F. Petry, and G. Arora Information-theoretic measures of un-certainty for rough sets and rough relational databases Information Sciences 109 1998 535 563
32. J. Dai, W. Wang, Q. Xu, and H. Tian Uncertainty measurement for interval-valued decision systems based on extended conditional entropy Knowledge-Based Systems 27 2012 443 450
33. J. Liang, K. Chin, C. Dang, and C. Richard A new method for measuring uncertainty and fuzziness in rough set theory International Journal of General Systems 31 2002 331 342
34. Y. Qian, and J. Liang Combination entropy and combination granulation in incomplete information system LNAI 4062 2006 184 190
35. Y. Qian, J. Liang, and F. Wang A new method for measuring the uncertainty in incomplete information systems International Journal of Uncertainty Fuzziness and Knowledge-Based Systems 17 6 2009 855 880
36. M. Dash, and H. Liu Consistency-based search in feature selection Artificial Intelligence 151 1-2 2003 155 176
37. H. Almuallim, and T. Dietterich Learning boolean concepts in the presence of many irrelevant features Artificial Intelligence 69 1 1994 279 305
38. M. Dash Feature selection via set cover Proceedings of 1997 Knowledge and Data Engineering Exchange Workshop 1997 IEEE 165 171
39. H. Liu, R. Setiono, A probabilistic approach to feature selection-a filter solution, in: ICML'96, 1996, pp. 319-327.
40. G. Brassard, and P. Bratley Fundamentals of Algorithms 1996 Prentice Hall Englewood Cliffs, NJ
41. A. Frank, A. Asuncion, UCI Machine Learning Repository. < http://archive.ics.uci.edu/ml >.
42. I. Witten, and E. Frank Data Mining: Practical Machine Learning Tools and Techniques 2005 Morgan Kaufmann
43. M.A. Hall, and L.A. Smith Practical feature subset selection for machine learning C. McDonald, Proceedings of the 21st Australasian Computer Science Conference 1998 Springer 181 191