Conditional entropy for incomplete decision systems and its application in data mining

International Journal of General Systems

Volumn 41, Issue 7, 2012, Pages 713-728

  Dai, Jianhua ^a   Xu, Qing ^a   Wang, Wentao ^a   Tian, Haowei ^a  

^a ZHEJIANG UNIVERSITY   (China)

Author keywords

attribute reduction; conditional entropy; incomplete decision systems; rough set theory; Shannon entropy

Indexed keywords

ATTRIBUTE IMPORTANCE; ATTRIBUTE REDUCTION; ATTRIBUTE REDUCTION ALGORITHM; CONDITION ATTRIBUTES; CONDITIONAL ENTROPY; DATA SETS; DECISION ATTRIBUTE; INCOMPLETE DATA; INCOMPLETE DECISION SYSTEM; JOINT ENTROPY; SHANNON ENTROPY; SHANNON'S ENTROPY; UNCERTAIN INFORMATIONS;

DATA HANDLING; DATA MINING; INFORMATION THEORY;

ROUGH SET THEORY;

EID: 84864063529     PISSN: 03081079     EISSN: 15635104     Source Type: Journal    
DOI: 10.1080/03081079.2012.685471     Document Type: Article

References (41)

1. Beaubouef, T., Petry, F.E., and Arora, G. (1998), 'Information-Theoretic Measures of Uncertainty for Rough Sets and Rough Relational Databases,' Information Sciences, 109, 1-4, 185-195.
2. Dai, J.H. (2008), 'Rough 3-Valued Algebras,' Information Sciences, 178, 1986-1996.
3. Dai, J.H., Wang, W., Xu, Q., and Tian, H. (2012), 'Uncertainty Measurement for Interval-Valued Decision Systems Based on Extended Conditional Entropy,' Knowledge-Based Systems, 27, 443-450.
4. Dai, J.H., and Xu, Q. (2012), 'Approximations and Uncertainty Measures in Incomplete Information Systems,' Information Sciences, 198, 62-80.
5. Duentsch, I., and Gediga, G. (1998), 'Uncertainty Measures of Rough Set Prediction,' Artificial Intelligence, 106, 1, 109-137. (Pubitemid 128402352)
6. Frank, A., and Asuncion, A. (2010), 'UCI Machine Learning Repository,' http://archive.ics.uci.edu/ml
7. Herawan, T., Deris, M.M., and Abawajy, J.H. (2010), 'A Rough Set Approach for Selecting Clustering Attribute,' Knowledge-Based Systems, 23, 220-231.
8. Jelonek, J., Krawiec, K., and Slowinski, R. (1995), 'Rough Set Reduction of Attributes and their Domains for Neural Networks,' Computational Intelligence, 11, 2, 339-347.
9. Kim, D., and Bang, S. (2002), 'A Handwritten Numeral Character Classification Using Tolerant Rough Set,' IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 9, 923-937.
10. Kryszkiewicz, M. (1998), 'Rough Set Approach to Incomplete Information Systems,' Information Sciences, 112, 1-4, 39-49. (Pubitemid 128649627)
11. Kryszkiewicz, M. (1999), 'Rules in Incomplete Information Systems,' Information Sciences, 113, 3, 271-292.
12. Li, H., Yao, Y., Zhou, X., and Huang, B. (2009), 'A Two-Phase Model for Learning Rules from Incomplete Data,' Fundamenta Informaticae, 94, 2, 219-232.
13. Liang, J., Chin, K., Dang, C., and Richard, C. (2002), 'A New Method for Measuring Uncertainty and Fuzziness in Rough Set Theory,' International Journal of General Systems, 31, 331-342. (Pubitemid 41623247)
14. Liang, J., and Shi, Z. (2004), 'The Information Entropy, Rough Entropy and Knowledge Granulation in Rough Set Theory,' International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 12, 1, 37-46.
15. Liang, J., Shi, Z., Li, D., and Wierman, M. (2006), 'Information Entropy, Rough Entropy and Knowledge Granulation in Incomplete Information Systems,' International Journal of General Systems, 35, 6, 641-654. (Pubitemid 44728618)
16. Liang, J., and Xu, Z. (2002), 'The Algorithm on Knowledge Reduction in Incomplete Information Systems,' International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 10, 1, 95-103. (Pubitemid 40048684)
17. Mac Parthalain, N., and Shen, Q. (2009), 'Exploring the Boundary Region of Tolerance Rough Sets for Feature Selection,' Pattern Recognition, 42, 5, 655-667.
18. Mac Parthalain, N., Shen, Q., and Jensen, R. (2010), 'A Distance Measure Approach to Exploring the Rough Set Boundary Region for Attribute Reduction,' IEEE Transactions on Knowledge and Data Engineering, 22, 3, 305-317.
19. Meng, Z., and Shi, Z. (2009), 'A Fast Approach to Attribute Reduction in Incomplete Decision Systems with Tolerance Relation-Based Rough Sets,' Information Sciences, 179, 16, 2774-2793.
20. Mi, J.S., Wu, W.Z., and Zhang, W.X. (2004), 'Approaches to Knowledge Reduction Based on Variable Precision Rough Set Model,' Information Sciences, 159, 3-4, 255-272.
21. Min, F., He, H., Qian, Y., and Zhu, W. (2011), 'Test-Cost-Sensitive Attribute Reduction,' Information Sciences, 181, 4928-4942.
22. Pawlak, Z. (1991), Rough Sets: Theoretical Aspects of Reasoning about Data, Dordrecht & Boston: Kluwer Academic Publishers.
23. Pawlak, Z. (1995), 'Vagueness and Uncertainty: A Rough Set Perspective,' Computational Intelligence, 11, 2, 227-232.
24. Pawlak, Z. (1997), 'Rough Set Approach to Knowledge-Based Decision Support,' European Journal of Operational Research, 99, 1, 48-57. (Pubitemid 127443690)
25. Pawlak, Z. (1998), 'Rough Set Theory and its Applications to Data Analysis,' Cybernetics and Systems: An International Journal, 29, 7, 661-688. (Pubitemid 128591850)
26. Pawlak, Z., and Skowron, A. (2007), 'Rudiments of Rough Sets,' Information Sciences, 177, 1, 3-27. (Pubitemid 44556698)
27. Pawlak, Z., Wong, S., and Ziarko, W. (1988), 'Rough Sets: Probabilistic Versus Deterministic Approach,' International Journal of Man-Machine Studies, 29, 1, 91-95.
28. Qian, Y., and Liang, J. (2006), 'Combination Entropy and Combination Granulation in Incomplete Information System,' Lecture Notes in Computer Science, 4062, 184-190. (Pubitemid 44165639)
29. Qian, Y., Liang, J., Pedrycz, W., and Dang, C. (2010), 'Positive Approximation: An Accelerator for Attribute Reduction in Rough Set Theory,' Artificial Intelligence, 174, 9-10, 597-618.
30. Quinlan, J. (1986), 'Induction of Decision Trees,' Machine Learning, 1, 1, 81-106.
31. Shannon, C. (1948), 'A Mathematical Theory of Communication,' The Bell System Technical Journal, 27, 379-423, 623-656.
32. Shen, Q., and Jensen, R. (2004), 'Selecting Informative Features with Fuzzy-Rough Sets and its Application for Complex Systems Monitoring,' Pattern Recognition, 37, 7, 1351-1363. (Pubitemid 38653366)
33. Shyng, J.Y., Shieh, H.M., and Tzeng, G.H. (2010), 'An Integration Method Combining Rough Set Theory with Formal Concept Analysis for Personal Investment Portfolios,' Knowledge-Based Systems, 23, 586-597.
34. Su, J.H., Wang, B.W., Hsiao, C.Y., and Tseng, V.S. (2010), 'Personalized Rough-Set-Based Recommendation by Integrating Multiple Contents and Collaborative Information,' Information Sciences, 180, 113-131.
35. Swiniarski, R., and Skowron, A. (2003), 'Rough Set Methods in Feature Selection and Recognition,' Pattern Recognition Letters, 24, 6, 833-849. (Pubitemid 35391801)
36. Trabelsi, S., and Elouedi, Z. (2010), 'Heuristic Method for Attribute Selection from Partially Uncertain Data using Rough Sets,' International Journal of General Systems, 39, 271-290.
37. Tsumoto, S. (1998), 'Automated Extraction of Medical Expert System Rules from Clinical Databases Based on Rough Set Theory,' Information Sciences, 112, 1-4, 67-84. (Pubitemid 128649629)
38. Wang, H., and Wang, S. (2009), 'Discovering Patterns of Missing Data in Survey Databases: An Application of Rough Sets,' Expert Systems with Applications, 36, 3, 6256-6260.
39. Wei, W., Liang, J., Qian, Y., Wang, F., and Dang, C. (2010), 'Comparative Study of Decision Performance of Decision Tables Induced by Attribute Reductions,' International Journal of General Systems, 39, 813-838.
40. Wierman, M.J. (1999), 'Measuring Uncertainty in Rough Set Theory,' International Journal of General Systems, 28, 283-297. (Pubitemid 30534574)
41. Zhu, W., and Wang, F.Y. (2003), 'Reduction and Axiomization of Covering Generalized Rough Sets,' Information Sciences, 152, 217-230.