An uncertainty measure for incomplete decision tables and its applications

IEEE Transactions on Cybernetics

Volumn 43, Issue 4, 2013, Pages 1277-1289

  Dai, Jianhua ^a   Wang, Wentao ^a   Xu, Qing ^a  

^a ZHEJIANG UNIVERSITY   (China)

Author keywords

Feature selection; Incomplete decision systems; Monotonicity; Rough set theory; Uncertainty measure

Indexed keywords

CONDITIONAL ENTROPY; DECISION SYSTEMS; INCOMPLETE DECISION SYSTEM; INCOMPLETE DECISION TABLE; MONOTONICITY; REAL LIFE DATASETS; UNCERTAINTY MEASUREMENTS; UNCERTAINTY MEASURES;

DECISION TABLES; ENTROPY; EXPERIMENTS; FEATURE EXTRACTION; SET THEORY;

UNCERTAINTY ANALYSIS;

EID: 84890331804     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2228480     Document Type: Article

References (45)

1. Z. Pawlak, Rough Sets: Theoretical Aspects of Reasoning About Data. Boston, MA: Kluwer, 1991.
2. Z. Pawlak, "Vagueness and uncertainty: A rough set perspective," Comput. Intell., vol. 11, no. 2, pp. 227-232, May 1995.
3. J. Dai and Q. Xu, "Attribute selection based on information gain ratio in fuzzy rough set theory with application to tumor classification," Appl. Soft Comput., vol. 13, no. 1, pp. 211-221, Jan. 2013.
4. Q. Hu, W. Pedrycz, D. Yu, and J. Lang, "Selecting discrete and continuous features based on neighborhood decision error minimization," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 1, pp. 137-150, Feb. 2010.
5. R. Jensen and Q. Shen, "Fuzzy-rough sets assisted attribute selection," IEEE Trans. Fuzzy Syst., vol. 15, no. 1, pp. 73-89, Feb. 2007.
6. R. Jensen and Q. Shen, "New approaches to fuzzy-rough feature selection," IEEE Trans. Fuzzy Syst., vol. 17, no. 4, pp. 824-838, Aug. 2009.
7. N. Mac Parthalain and Q. Shen, "Exploring the boundary region of tolerance rough sets for feature selection," Pattern Recognit., vol. 42, no. 5, pp. 655-667, May 2009.
8. P. Maji and S. K. Pal, "Fuzzy-rough sets for information measures and selection of relevant genes frommicroarray data," IEEE Trans. Syst.,Man, Cybern. B, Cybern., vol. 40, no. 3, pp. 741-752, Jun. 2010.
9. P.Maji, "Fuzzy-rough supervised attribute clustering algorithm and classification of microarray data," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 1, pp. 222-233, Feb. 2011.
10. S. K. Pal and P. Mitra, "Case generation using rough sets with fuzzy representation," IEEE Trans. Knowl. Data Eng., vol. 16, no. 3, pp. 293-300, Mar. 2004.
11. Q. Shen and R. Jensen, "Selecting informative features with fuzzy rough sets and its application for complex systems monitoring," Pattern Recognit., vol. 37, no. 7, pp. 1351-1363, Jul. 2004.
12. D. Slezak, "Degrees of conditional (in)dependence: A framework for approximate Bayesian networks and examples related to the rough set based feature selection," Inf. Sci., vol. 179, no. 3, pp. 197-209, Jan. 2009.
13. E. C. C. Tsang, D. Chen, D. S. Yeung, X.-Z. Wang, and J. W. T. Lee, "Attributes reduction using fuzzy rough sets," IEEE Trans. Fuzzy Syst., vol. 16, no. 5, pp. 1130-1141, Oct. 2008.
14. B. Xu, Y. Zhou, and H. Lu, "An improved accuracy measure for rough sets," J. Comput. Syst. Sci., vol. 71, no. 2, pp. 163-173, Aug. 2005.
15. J. Liang, J. Wang, and Y. Qian, "A new measure of uncertainty based on knowledge granulation for rough sets," Inf. Sci., vol. 179, no. 4, pp. 458-470, Feb. 2009.
16. J. Dai and Q. Xu, "Approximations and uncertainty measures in incomplete information systems," Inf. Sci., vol. 198, no. 1, pp. 62-80, Sep. 2012.
17. C. Shannon, "The mathematical theory of communication," Bell Syst. Tech. J., vol. 27, no. 3/4, pp. 379-423, Jul.-Oct. 1948.
18. T. Beaubouef, F. E. Petry, and G. Arora, "Information-theoretic measures of uncertainty for rough sets and rough relational databases," Inf. Sci., vol. 109, no. 1-4, pp. 185-195, Aug. 1998.
19. D. Bianucci and G. Cattaneo, "Information entropy and granulation coentropy of partitions and coverings: A summary," in Transactions on Rough Sets. Berlin, Germany: Springer-Verlag, 2009, pp. 15-66.
20. G. Cattaneo, D. Ciucci, and D. Bianucci, "Entropy and co-entropy of partitions and coverings with applications to roughness theory," in Studies in Fuzziness and Soft Computing. Berlin, Germany: Springer-Verlag, 2008, pp. 55-77.
21. J. Dai, W. Wang, Q. Xu, and H. Tian, "Uncertainty measurement for interval-valued decision systems based on extended conditional entropy," Knowl.-Based Syst., vol. 27, pp. 443-450, Mar. 2012.
22. I. Düntsch and G. Gediga, "Uncertainty measures of rough set prediction," Artif. Intell., vol. 106, no. 1, pp. 109-137, Nov. 1998.
23. J. Liang, K. S. Chin, C. Dang, and R. C. M. Yam, "A new method for measuring uncertainty and fuzziness in rough set theory," Int. J. Gen. Syst., vol. 31, no. 4, pp. 331-342, Jul. 2002.
24. Y. Qian and J. Liang, "Combination entropy and combination granulation in rough set theory," Int. J. Uncertainty Fuzz. Knowl.-Based Syst., vol. 16, no. 2, pp. 179-193, Apr. 2008.
25. Y. Qian, J. Liang, W. Wu, and C. Y. Dang, "Information granularity in fuzzy binary GrCmodel," IEEE Trans. Fuzzy Syst., vol. 19, no. 2, pp. 253-264, Apr. 2011.
26. D. Slezak, "Approximate entropy reducts," Fundam. Inf., vol. 53, no. 3/4, pp. 365-390, May 2002.
27. M. J. Wierman, "Measuring uncertainty in rough set theory," Int. J. Gen. Syst., vol. 28, no. 4/5, pp. 283-297, Oct. 1999.
28. Y. Y. Yao, "Probabilistic approaches to rough sets," Expert Syst., vol. 20, no. 5, pp. 287-297, Nov. 2003.
29. Y. Y. Yao and L. Zhao, "A measurement theory view on the granularity of partitions," Inf. Sci., vol. 213, pp. 1-13, Dec. 2012.
30. D. Yu, Q. Hu, and C. Wu, "Uncertainty measures for fuzzy relations and their applications," Appl. Soft Comput., vol. 7, no. 3, pp. 1135-1143, Jun. 2007.
31. M. Kryszkiewicz, "Rough set approach to incomplete information systems," Inf. Sci., vol. 112, no. 1-4, pp. 39-49, Dec. 1998.
32. M. Kryszkiewicz, "Rules in incomplete information systems," Inf. Sci., vol. 113, no. 3/4, pp. 271-292, Feb. 1999.
33. J. Dai, Q. Xu, and W. Wang, "A comparative study on strategies of rule induction for incomplete data based on rough set approach," Int. J. Adv. Comput. Technol., vol. 3, no. 3, pp. 176-183, Apr. 2011.
34. P. Clark and T. Niblett, "The CN2 induction algorithm," Mach. Learn., vol. 3, no. 4, pp. 261-283, Mar. 1989.
35. J. W. Grzymala-Busse, "On the unknown attribute values in learning from examples," in Methodologies for Intelligent Systems. London, U.K.: Springer-Verlag, 1991, ser. Lecture Notes in Computer Science, pp. 368-377.
36. J.W. Grzymala-Busse, "Rough set strategies to data with missing attribute values," in Foundations and Novel Approaches in Data Mining. Berlin, Germany: Springer-Verlag, 2006, ser. Studies in Computational Intelligence, pp. 197-212.
37. J. Liang, Z. Shi, D. Li, and M. J. Wierman, "Information entropy, rough entropy and knowledge granulation in incomplete information systems," Int. J. Gen. Syst., vol. 35, no. 6, pp. 641-654, Dec. 2006.
38. Y. Qian, J. Liang, and F. Wang, "A new method for measuring the uncertainty in incomplete information systems," Int. J. Uncertainty Fuzz. Knowl.-Based Syst., vol. 17, no. 6, pp. 855-880, Dec. 2009.
39. J. Dai, Q. Xu,W.Wang, and H. Tian, "Conditional entropy for incomplete decision systems and its application in data mining," Int. J. Gen. Syst., vol. 41, no. 7, pp. 713-728, Oct. 2012.
40. Z. Pawlak and A. Skowron, "Rudiments of rough sets," Inf. Sci., vol. 177, no. 1, pp. 3-27, Jan. 2007.
41. A. Frank and A. Asuncion, UCI Machine Learning Repository, Univ. of California, Irvine, CA. [Online]. Available: http://archive.ics.uci.edu/ml
42. U. Fayyad and K. Irani, "Multi-interval discretization of continuous valued attributes for classification learning," in Proc. Int. Joint Conf. Uncertainty AI, 1993, pp. 1022-1027.
43. I. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques. San Mateo, CA: Morgan Kaufmann, 2005.
44. J. G. Bazan, A. Skowron, and P. Synak, "Dynamic reducts as a tool for extracting laws from decisions tables," in Methodologies for Intelligent Systems. London, U.K.: Springer-Verlag, 1994, pp. 346-355.
45. I. Kononenko, I. Bratko, and E. Roskar, "Experiments in automatic learning of medical diagnostic rules," presented at the Proc. Int. School Synth. Experts Knowl. Workshop, Bled, Slovenia, 1984, ISSEK-84.