Implementing algorithms of rough set theory and fuzzy rough set theory in the R package "roughSets"

Information Sciences

Volumn 287, Issue , 2014, Pages 68-89

  Riza, Lala Septem ^a   Janusz, Andrzej ^b   Bergmeir, Christoph ^a   Cornelis, Chris ^a   Herrera, Francisco ^a   Ślȩzak, Dominik ^b   Benítez, José Manuel ^a  

^a UNIVERSITY OF GRANADA   (Spain)

^b UNIVERSITY OF WARSAW   (Poland)

Author keywords

Discretization; Feature selection; Fuzzy rough set; Instance selection; Rough set; Rule induction

Indexed keywords

ALGORITHMS; FEATURE EXTRACTION;

DISCRETIZATIONS; FUNDAMENTAL CONCEPTS; FUZZY ROUGH SET THEORY; FUZZY-ROUGH SETS; INDISCERNIBILITY RELATION; INSTANCE SELECTION; ROUGH SET THEORY (RST); RULE INDUCTION;

ROUGH SET THEORY;

EID: 84906861442     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2014.07.029     Document Type: Article

References (120)

1. J. Alcalá-Fdez, L. Sánchez, S. García, M.J. del Jesus, S. Ventura, J.M. Garrell, J. Otero, C. Romero, J. Bacardit, V.M. Rivas, J.C. Fernández, and F. Herrera KEEL: a software tool to assess evolutionary algorithms for data mining problems Soft Comput. 13 3 2009 307 318
2. J. Bazan A comparison of dynamic and non-dynamic rough set methods for extracting laws from decision tables A. Skowron, L. Polkowski, Rough Sets in Knowledge Discovery vol. 1 1998 Physica Verlag Heidelberg 321 365
3. J.G. Bazan, M. Szczuka, RSES and RSESlib-a collection of tools for rough set computations, in: W. Ziarko, Y. Yao (Eds.), Proceedings of the 2nd International Conference on Rough Sets and Current Trends in Computing (RSCTC'2000), vol. 2005, 2000, pp. 106-113.
4. J.G. Bazan, M. Szczuka, The rough set exploration system, in: J.F. Peters, A. Skowron (Eds.), Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 3400 LNCS, 2005, pp. 37-56.
5. J.G. Bazan, H.S. Nguyen, S.H. Nguyen, P. Synak, and J. Wróblewski Rough set algorithms in classification problem L. Polkowski, S. Tsumoto, T.Y. Lin, Rough Set Methods and Applications 2000 Physica-Verlag Heidelberg, New York 49 88
6. R.B. Bhatt, and M. Gopal On fuzzy-rough sets approach to feature selection Patt. Recog. Lett. 26 2005 965 975
7. Y. Caballero, R. Bello, Y. Salgado, and M.M. Garca A method to edit training set based on rough sets Int. J. Comput. Intell. Res. 3 2007 219 229
8. C.L.P. Chen, and C. Zhang Data-intensive applications, challenges, techniques and technologies: A survey on big data Inform. Sci. 275 2014 314 347
9. D. Chen, L. Zhang, S. Zhao, Q. Hu, and P. Zhu A novel algorithm for finding reducts with fuzzy rough sets IEEE Trans. Fuzzy Syst. 20 2012 385 389
10. D.G. Chen, Q.H. Hu, and Y.P. Yang Parameterized attribute reduction with gaussian kernel based fuzzy rough sets Inform. Sci. 181 2011 5169 5179
11. C. Cornelis, R. Jensen, A noise-tolerant approach to fuzzy-rough feature selection, in: Proceedings of the 2008 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2008), 2008, pp. 1598-1605.
12. C. Cornelis, M. De Cock, A. Radzikowska, Vaguely quantified rough sets, in: Proceedings of 11th International Conference on Rough Sets, Fuzzy Sets, Data Mining and Granular Computing (RSFDGrC2007), Lecture Notes in Artificial Intelligence, vol. 4482, 2007, pp. 87-94.
13. C. Cornelis, M. De Cock, and A. Radzikowska Fuzzy rough sets: from theory into practice W. Pedrycz, A. Skowron, V. Kreinovich, Handbook of Granular Computing 2008 Wiley 533 552
14. C. Cornelis, R. Jensen, G. Hurtado, and D. Ślȩzak Attribute selection with fuzzy decision reducts Inform. Sci. 180 2 2010 209 224
15. C. Cornelis, N. Verbiest, R. Jensen, Ordered weighted average based fuzzy rough sets, in: Proceedings of the 5th International Conference on Rough Sets and Knowledge Technology (RSKT 2010), 2010, pp. 78-85.
16. T.M. Cover, and P.E. Hart Nearest neighbor pattern classification IEEE Trans. Inform. Theory 13 1967 21 27
17. J. Dai, and Q. Xu Attribute selection based on information gain ratio in fuzzy rough set theory with application to tumor classification Appl. Soft Comput. 13 2013 211 221
18. J. Dougherty, R. Kohavi, and M. Sahami Supervised and Unsupervised Discretization of Continuous Features 1995 Morgan Kaufman San Francisco, CA
19. D. Dubois, and H. Prade Rough fuzzy sets and fuzzy rough sets Int. J. Gen. Syst. 17 1990 91 209
20. D. Dubois, and H. Prade Putting rough sets and fuzzy sets together R. Słowiński, Intelligent Decision Support Handbook of Applications and Advances of the Rough Sets Theory 1992 Kluwer Dordrecht 203 233
21. R.O. Duda, and P.E. Hart Pattern Classification and Scene Analysis 1973 Wiley New York
22. U.M. Fayyad, and K.B. Irani On the handling of continuous-valued attributes in decision tree generation Mach. Learn. 8 1992 87 102
23. U.M. Fayyad, and K.B. Irani Multi-interval discretization of continuous attributes as preprocessing for classification learning Proceeding Thirteenth International Joint Conference on Artificial Intelligence 1995 Morgan Kaufman 1022 1027
24. E. Fix, J. Hodges, Discriminatory Analysis, Nonparametric Discrimination: Consistency Properties, Technical report, 1951.
25. M. Forina, E. Leardi, C. Armanino, and S. Lanteri PARVUS: an extendable package of programs for data exploration, classification and correlation J. Chem. 4 2 1988 191 193
26. S. Greco, B. Matarazzo, R. Słowiński, Generalizing rough set theory through dominance-based rough set approach, in: Proceedings of 10th International Conference on Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing, part II, 2005, pp. 1-11.
27. J.W. Grzymała-Busse, LERS - a system for learning from examples based on rough sets, in: R. Słowiński (Ed.), Intelligent Decision Support, 1992, pp. 3-18.
28. J.W. Grzymała-Busse A new version of the rule induction system LERS Fund. Inform. 31 1 1997 27 39
29. J.W. Grzymała-Busse, MLEM2: a new algorithm for rule induction from imperfect data, in: Proceedings of the 9th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems (IPMU), 2002, pp. 243-250.
30. J.W. Grzymała-Busse Lers - a data mining system Oded Maimon, Lior Rokach, Data Mining and Knowledge Discovery Handbook 2005 Springer US 1347 1351 ISBN 978-0-387-24435-8
31. J.W. Grzymała-Busse, and M. Hu A comparison of several approaches to missing attribute values in data mining Proceedings of the Second International Conference on Rough Sets and Current Trends in Computing RSCTC'2000, LNAI 2005 2000 Springer-Verlag Berlin 378 385
32. J.W. Grzymała-Busse, and W. Rzasa A local version of the MLEM2 algorithm for rule induction Fund. Inform. 100 1-4 2010 99 116
33. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, I.H. Witten, The WEKA data mining software: an update, in: ACM SIGKDD Explorations Newsletter, vol. 11, 2009, pp. 10-18.
34. D. Harrison, and D.L. Rubinfeld Hedonic prices and the demand for clean air J. Environ. Econ. Manage. 5 1978 81 102
35. Q. Hu, S. An, and D. Yu Soft fuzzy rough sets for robust feature evaluation and selection Inform. Sci. 180 2010 4384 44007
36. Q. Hu, D. Yu, W. Pedrycz, and D. Chen Kernelized fuzzy rough sets and their applications IEEE Trans. Knowl. Data Eng. 23 2011 1649-1471
37. Q. Hu, L. Zhang, S. An, D. Zhang, and D. Yu On robust fuzzy rough set models IEEE Trans. Fuzzy Syst. 20 2012 636 651
38. B. Huang, Y. Zhuang, H. Li, and D. Wei A dominance intuitionistic fuzzy-rough set approach and its applications Appl. Math. Model. 37 2013 7128 7141
39. R. Ihaka, and R. Gentleman R: a language for data analysis and graphics J. Comput. Graph. Statist. 5 1996 299 314
40. A. Janusz, and D. Ślȩzak Rough set methods for attribute clustering and selection Appl. Artif. Intell. 28 3 2014 220 242
41. A. Janusz, S. Stawicki, Applications of approximate reducts to the feature selection problem, in: Proceedings of International Conference on Rough Sets and Knowledge Technology (RSKT), vol. 6954, 2011, pp. 45-50.
42. R. Jensen, Fuzzy-Rough Data Mining with WEKA, Technical report, 2010 < http://users.aber.ac.uk/rkj/Weka.pdf >.
43. R. Jensen, C. Cornelis, A new approach to fuzzy-rough nearest neighbour classification, in: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 5306 LNAI, 2008, pp. 310-319.
44. R. Jensen, C. Cornelis, Fuzzy-rough instance selection, in: Proceedings of the 19th International Conference on Fuzzy Systems (FUZZ-IEEE 2010), 2010, pp. 1776-1782.
45. R. Jensen, and C. Cornelis Fuzzy-rough nearest neighbour classification and prediction Theoret. Comp. Sci. 412 2011 5871 5884
46. R. Jensen, Q. Shen, Fuzzy-rough sets for descriptive dimensionality reduction, in: Proceedings of IEEE International Conference on Fuzzy System, FUZZ-IEEE, 2002, pp. 29-34.
47. R. Jensen, and Q. Shen Fuzzy-rough data reduction with ant colony optimization Fuzzy Sets Syst. 149 1 2005 5 20
48. R. Jensen, and Q. Shen New approaches to fuzzy-rough feature selection IEEE Trans. Fuzzy Syst. 19 2009 824 838
49. R. Jensen, C. Cornelis, Q. Shen, Hybrid fuzzy-rough rule induction and feature selection, in: IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), 2009, pp. 1151-1156.
50. R. Jensen, A. Tuson, Q. Shen, Extending propositional satisfiability to determine minimal fuzzy-rough reducts, in: IEEE World Congress on Computational Intelligence, WCCI 2010, 2010, pp. 1-8.
51. R. Jensen, A. Tuson, and Q. Shen Finding rough and fuzzy-rough set reducts with SAT Inform. Sci. 255 2014 100 120
52. J. Karami, A. Alimohammadi, and T. Seifouri Water quality analysis using a variable consistency dominance-based rough set approach Comp., Environ. Urban Syst. 43 2014 25 33
53. J.M. Keller, M.R. Gray, and J.R. Givens A fuzzy k-nearest neighbor algorithm IEEE Trans. Syst., Man, Cybernet. 15 1985 580 585
54. R. Kerber ChiMerge: discretization of numeric attributes AAAI-92 Proceedings of the Ninth National Conference on Artificial Intelligence 1992 AAAI Press/MIT Press 123 128
55. J. Komorowski, Z. Pawlak, L. Polwski, and A. Skowron Rough sets: a tutorial S.K. Pal, A. Skowron, Rough Fuzzy Hybridization, A New Trend in Decision Making 1999 Springer Singapore 3 98
56. K. Krawiec, R. Słowiński, and D. Vanderpooten Learning of decision rules from similarity based rough approximations A. Skowron, L. Polkowski, Rough Sets in Knowledge Discovery vol. 2 1998 Physica Verlag Heidelberg 37 54
57. C. Li, Y. Yang, M. Jia, Y. Zhang, X. Yu, and C. Wang Phylogenetic analysis of dna sequences based on k-word and rough set theory Phys. A: Statist. Mech. Appl. 398 2014 162 171
58. H. Liu, R. Setiono, Discretization of ordinal attributes and feature selection, in: Proceedings of the Seventh International Conference on Tools with Artificial Intelligence, Washington, DC, 1995, pp. 388-391.
59. Y. Liu, Q. Zhou, E. Rakus-Anderson, G. Bai, A fuzzy-rough sets based compact rule induction method for classifying hybrid data, in: Rough Sets and Knowledge Technology, Lecture Notes in Computer Science, vol. 7414, 2012, pp. 63-70.
60. Y.L. Liu Research on information technology with character pattern recognition method based on rough set theory Advan. Mater. Res. 886 2014 519 523
61. V. López, A. Fernandez, S. García, V. Palade, and F. Herrera An insight into classification with imbalanced data: empirical results and current trends on using data intrinsic characteristics Inform. Sci. 250 2013 113 141
62. J. Luengo, S. García, and F. Herrera On the choice of the best imputation methods for missing values considering three groups of classification methods Knowl. Inform. Syst. 32 1 2012 77 108
63. S. Ma, H. Liao, Y. Yuan, Intrusion detection based on rough-set attribute reduction, in: Lecture Notes in Electrical Engineering 219 LNEE, vol. 4, 2013, pp. 363-369.
64. R.S. Michalski A theory and methodology of inductive learning R.S. Michalski, J.G. Carbonell, T.M. Mitchell, Machine Learning 1983 Morgan Kaufman 83 134
65. R. Mienko, J. Stefanowski, K. Tuomi, D. Vanderpooten, Discovery-oriented induction of decision rules, Cahier du Lamsade no. 141, 1996.
66. R.A. Muenchen, The Popularity of Data Analysis Software, Technical report, 2013 < http://r4stats.com/articles/popularity/ >.
67. H. Naessens, H. De Meyer, and B. De Baets Algorithms for the computation of t-transitive closures IEEE Trans. Fuzzy Syst. 10 2002 541 551
68. H.S. Nguyen, and S.H. Nguyen Discretization methods in data mining A. Skowron, L. Polkowski, Rough Sets in Knowledge Discovery vol. 1 1998 Physica Verlag Heidelberg 451 482
69. S.H. Nguyen On efficient handling of continuous attributes in large data bases Fund. Inform. 48 2001 61 81
70. S.H. Nguyen, A. Skowron, Quantization of real-valued attributes, in: P.P. Wang (Ed.), Second Annual Joint Conference on Information Sciences (JCIS'95), Wrightsville Beach, North Carolina, 1995, pp. 34-37.
71. J. Nieminen Rough tolerance equality Fund. Inform. 11 3 1988 289 296
72. A. Øhrn, ROSETTA - A Rough Set Toolkit for Analysis of Data, Technical report, 2009 < http://www.lcb.uu.se/tools/rosetta/ >.
73. A. Øhrn, J. Komorowski, ROSETTA - a rough set tool kit for analysis of data, in: Proceedings of the fifth International Workshop on Rough Sets and Soft Computing (RSSC'97) at the Third Joint Conference on Information Sciences (JCIS'97), Research Triangle Park, NC, 1997, pp. 403-407.
74. Z. Pawlak Information systems - theoretical foundations Inform. Sci. 6 1981 205 218
75. Z. Pawlak Rough sets Int. J. Comp. Sci. 11 1982 341 356
76. Z. Pawlak Rough Sets - Theoretical Aspects of Reasoning About Data 1991 Kluwer Academic
77. Z. Pawlak, and A. Skowron Rough sets and boolean reasoning Inform. Sci. 177 2007 41 73
78. Z. Pawlak, and A. Skowron Rough sets: some extensions Inform. Sci. 177 2007 28 40
79. Z. Pawlak, and A. Skowron Rudiments of rough sets Inform. Sci. 177 2007 3 27
80. L. Polkowski, A. Skowron, J. Zytkow, Tolerance based rough sets, in: T.Y. Lin, A.M. Wildberger (Eds.), Soft Computing: Rough Sets, Fuzzy Logic, Neural Networks, Uncertainty Management, 1995, pp. 55-58.
81. B. Predki, and S. Wilk Rough set based data exploration using ROSE system Z.W. Ras, A. Skowron, Foundations of Intelligent Systems Lecture Notes in Artificial Intelligence vol. 1609 1999 Springer-Verlag Berlin 172 180
82. B. Predki, R. Słowiński, J. Stefanowski, R. Susmaga, and S. Wilk ROSE - software implementation of the rough set theory L. Polkowski, A. Skowron, Proceedings of the Rough Sets and Current Trends in Computing'98 Conference Lecture Notes in Artificial Intelligence vol. 1424 1998 Springer Berlin 605 608
83. A.M. Radzikowska, and E.E. Kerre A comparative study of fuzzy rough sets Fuzzy Sets Syst. 126 2002 137 156
84. S. Río, V. López, J.M. Benítez, and F. Herrera On the use of map reduce for imbalanced big data using random forest Inform. Sci. 285 2014 112 137
85. S. Romanski, Operation on families of sets for exhaustive search, given a monotonic function, in: W. Beeri, C. Schmidt, N. Doyle (Eds.), Proceedings of the 3rd International Conference on Data and Knowledge Bases, 1988, pp. 310-322.
86. J.M.F. Salido, and S. Murakami Rough set analysis of a general type of fuzzy data using transitive aggregations of fuzzy similarity relations Fuzzy Sets Syst. 139 2003 635 660
87. M. Sarkar, Fuzzy-rough nearest neighbors algorithm, in: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, vol. 5, 2000, pp. 3556-3561.
88. M. Sarkar Fuzzy-rough nearest-neighbor algorithm in classification Fuzzy Sets Syst. 158 2007 2123 2152
89. M. Sarkar Fuzzy-rough nearest algorithms in classification Fuzzy Sets Syst. 158 2012 2134 2152
90. C.E. Shannon A mathematical theory of communication Bell Syst. Tech. J. 27 1948 379 423 623-656
91. Q. Shen, and A. Chouchoulas A modular approach to generating fuzzy rules with reduced attributes for the monitoring of complex systems Eng. Appl. Artif. Intell. 13 2000 263 278
92. A. Skowron, and C. Rauszer The discernibility matrices and functions in information systems R. Słowiński, Intelligent Decision Support: Handbook of Applications and Advances of Rough Sets Theory 1992 Kluwer Academic Publishers Dordrecht, Netherland 331 362
93. D. Ślȩzak Approximate entropy reducts Fund. Inform. 53 2002 365 390
94. D. Ślȩzak Approximate bayesian networks B. Bounchon-Meunier, J. Gutierrez-Rios, L. Magdalena, R.R. Yager, Technologies for Constructing Intelligent Systems: 2 Tools 2002 Springer Verlag 313 326
95. R. Słowiński, and J. Stefanowski Rough set reasoning about uncertain data Fund. Inform. 27 2-3 1996 229 244
96. R. Słowiński, D. Vanderpooten, Similarity Relation as a Basis for Rough Approximations, Technical report, ICS Research Report 53/95, Warsaw University Technology, 1995.
97. R. Słowiński, D. Vanderpooten, Similarity relation as a basis for rough approximations, in: P.P. Wang (Ed.), Advances in Machine Intelligence and Soft Computing, Bookwrights, Raleigh, NC, 1997, pp. 17-33.
98. R. Słowiński, and D. Vanderpooten A generalized definition of rough approximations based on similarity IEEE Trans. Knowl. Data Eng. 12 2 2000 331 336
99. J. Stefanowski On rough set based approaches to induction of decision rules L. Polkowski, A. Skowron, Rough Sets in Knowledge Discovery: 1 Methodology and Applications 1998 Physica-Verlag Heidelberg 500 529
100. J. Stefanowski, and D. Vanderpooten A general two stage approach to rule induction from examples W. Ziarko, Rough Sets, Fuzzy Sets and Knowledge Discovery 1994 Springer-Verlag 317 325
101. J. Stefanowski, and S. Wilk Rough sets for handling imbalanced data: combining filtering and rule-based classifiers Fund. Inform. 72 2006 379 391
102. R Core Team, R. Bivand, V.J. Carey, S. DebRoy, S. Eglen, R. Guha, N. Lewin-Koh, M. Myatt, B. Pfaff, B. Quistorff, F. Warmerdam, S. Weigand, Free Software Foundation Inc. foreign: Read data stored by minitab, s, sas, spss, stata, systat, weka, dbase. Technical report, 2014 < http://CRAN.R-project. org/package=foreign >. R package version 0.8-61.
103. R Development Core Team, An Introduction to R.R Foundation for Statistical Computing, Vienna, Austria, 2008. ISBN 3-900051-12-7 < http://www.R-project.org/ >.
104. R Development Core Team, R: A language and environment for statistical computing, Technical report, R Foundation for Statistical Computing, Vienna, Austria, 2010 < http://www.r-project.org/foundation/ >.
105. E.C.C. Tsang, D.G. Chen, D.S. Yeung, X.Z. Wang, and J.W.T. Lee Attributes reduction using fuzzy rough sets IEEE Trans. Fuzzy Syst. 16 2008 1130 1141
106. S. Tsumoto Automated induction of medical expert system rules from clinical databases based on rough set theory Inform. Sci. 112 1998 67 84
107. N. Verbiest, C. Cornelis, R. Jensen, Fuzzy-rough positive region based nearest neighbour classification, in: Proceedings of the 20th International Conference on Fuzzy Systems (FUZZ-IEEE 2012), 2012, pp. 1961-1967.
108. N. Verbiest, C. Cornelis, and F. Herrera A fuzzy rough prototype selection method Patt. Recog. 46 2013 2770 2782
109. G. Wang, Z. Zheng, Y. Zhang, RIDAS - a rough set based intelligent data analysis system, in: Proceedings of the International Conference on Machine Learning and Cybernetics, 2002, vol. 2, 2002, pp. 646-649.
110. X. Wang, J. Yang, X. Teng, W. Xia, and R. Jensen Feature selection based on rough sets and particle swarm optimization Patt. Recog. Lett. 28 4 2007 459 471
111. M. Wojnarski LTF-C: architecture, training algorithm and applications of new neural classifier Fund. Inform. 54 1 2003 89 105
112. J. Wróblewski Covering with reducts - a fast algorithm for rule generation Proceeding of RSCTC'98 LNAI vol. 1424 1998 Springer Verlag Berlin 402 407
113. J. Wróblewski Ensembles of classifiers based on approximate reducts Fund. Inform. 47 2001 351 360
114. W.Z. Wu, and W.X. Zhang Contructive and axiomatic approaches of fuzzy approximation operators Inform. Sci. 159 2004 3 4
115. W.Z. Wu, J.S. Mi, and W.X. Zhang Generalized fuzzy rough sets Inform. Sci. 151 2003 263 282
116. X.D. Yu A new patterns recognition method based on fuzzy rough sets Appl. Mech. Mater. 380-384 2013 3795 3798
117. L.A. Zadeh Fuzzy sets Inform. Control 8 1965 338 353
118. S.Y. Zhao, E.C.C. Tsang, and D.G. Chen The model of fuzzy variable precision rough sets IEEE Trans. Fuzzy Syst. 17 2009 451 467
119. S.Y. Zhao, E.C.C. Tsang, D.G. Chen, and X.Z. Wang Building a rule-based classifier - a fuzzy-rough set approach IEEE Trans. Knowl. Data Eng. 22 2010 624 638
120. W. Ziarko Analysis of uncertain information in the framework of variable precision rough sets Found. Comput. Dec. Sci. 18 3-4 1993 381 396