A group incremental approach to feature selection applying rough set technique

IEEE Transactions on Knowledge and Data Engineering

Volumn 26, Issue 2, 2014, Pages 294-308

  Liang, Jiye ^a   Wang, Feng ^a   Dang, Chuangyin ^b   Qian, Yuhua ^a  

^a SHANXI UNIVERSITY   (China)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Dynamic data sets; feature selection; incremental algorithm; rough set theory

Indexed keywords

DYNAMIC DATA SETS; FEATURE SELECTION ALGORITHM; INCREMENTAL ALGORITHM; INCREMENTAL APPROACH; INCREMENTAL TECHNIQUES; INFORMATION ENTROPY; MEDICAL RESEARCH; POPULATION STUDIES;

DECISION TABLES; ECONOMICS; FEATURE EXTRACTION; ROUGH SET THEORY;

ALGORITHMS;

EID: 84891792205     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2012.146     Document Type: Article

References (56)

1. A. An, N. Shan, C. Chan, N. Cercone, and W. Ziarko, Discovering Rules for Water Demand Prediction: An Enhanced Rough-Set Approach, Eng. Application and Artificial Intelligence, vol. 9, no. 6, pp. 645-653, 1996. (Pubitemid 126371625)
2. W.C. Bang and B. Zeungnam, New Incremental Learning Algorithm in the Framework of Rough Set Theory, Int'l J. Fuzzy Systems, vol. 1, no. 1, pp. 25-36, 1999.
3. C.C. Chan, A Rough Set Approach to Attribute Generalization in Data Mining, Information Sciences, vol. 107, pp. 177-194, 1998.
4. H.M. Chen, T.R. Li, D. Ruan, J.H. Lin, and C.X. Hu, A Rough-Set Based Incremental Approach for Updating Approximations under Dynamic Maintenance Environments, IEEE Trans. Knowledge and Data Eng., vol. 25, no. 2, pp. 274-284, Feb. 2013.
5. I. Du ntsch and G. Gediga, Uncertainty Measures of Rough Set Prediction, Artificial Intelligence, vol. 106, no. 1, pp. 109-137, 1998. (Pubitemid 128402352)
6. D. Dubois and H. Prade, Rough Fuzzy Sets and Fuzzy Rough Sets, Int'l J. General Systems, vol. 17, pp. 191-209, 1990.
7. I. Guyon and A. Elisseeff, An Introduction to Variable Feature Selection, Machine Learning Research, vol. 3, pp. 1157-1182, 2003.
8. S. Greco, B. Matarazzo, and R. Slowinski, Rough Sets Theory for Multicriteria Decision Analysis, European J. Operational Research, vol. 129, pp. 1-47, 2001. (Pubitemid 32071221)
9. S. Guo, Z.Y. Wang, Z.C. Wu, and H.P. Yan, A Novel Dynamic Incremental Rules Extraction Algorithm Based on Rough Set Theory, Proc. Fourth Int'l Conf. Machine Learning and Cybernetics, pp. 1902-1907, 2005. (Pubitemid 41734238)
10. F. Hu, G.Y. Wang, H. Huang, and Y. Wu, Incremental Attribute Reduction Based on Elementary Sets, Proc. 10th Int'l Conf. Rough Sets, Fuzzy Sets, Data Mining and Granular Computing, Regina, pp. 185-193, 2005.
11. X.H. Hu and N. Cercone, Learning in Relational Databases: A Rough Set Approach, Int'l J. Computational Intelligence, vol. 11, no. 2, pp. 323-338, 1995.
12. Q.H. Hu, Z.X. Xie, and D.R. Yu, Hybrid Attribute Reduction Based on a Novel Fuzzy-Rough Model and Information Granulation, Pattern Recognition, vol. 40, pp. 3509-3521, 2007.
13. Q.H. Hu, D.R. Yu, W. Pedrycz, and D.G. Chen, Kernelized Fuzzy Rough Sets and Their Applications, IEEE Trans. Knowledge and Data Eng., vol. 23, no. 11, pp. 1649-1667, Nov. 2011.
14. R. Jensen and Q. Shen, Fuzzy-Rough Sets Assisted Attribute Selection, IEEE Trans. Fuzzy Systems, vol. 15, no. 1, pp. 73-89, Feb. 2007. (Pubitemid 46444305)
15. B. Jerzy and R. Slowinski, Incremental Induction of Decision Rules from Dominance-Based Rough Approximations, Electronic Notes in Theoretical Computer Science, vol. 84, no. 4, pp. 40-51, 2003.
16. R. Kohavi and G.H. John, Wrappers for Feature Subset Selection, Artificial Intelligence, vol. 97, nos. 1/2, pp. 273-324, 1997. (Pubitemid 127401107)
17. M. Kryszkiewicz and P. Lasek, FUN: Fast Discovery of Minimal Sets of Attributes Functionally Determining a Decision Attribute, Trans. Rough Sets, vol. 9, pp. 76-95, 2008.
18. M.Z. Li, B. Yu, O. Rana, and Z.D. Wang, Grid Service Discovery with Rough Sets, IEEE Trans. Knowledge and Data Eng., vol. 20, no. 6, pp. 851-862, June 2008. (Pubitemid 351606077)
19. T.R. Li, D. Ruan, W. Geert, J. Song, and Y. Xu, A Rough Sets Based Characteristic Relation Approach for Dynamic Attribute Generalization in Data Mining, Knowledge-Based Systems, vol. 20, no. 5, pp. 485-494, 2007. (Pubitemid 46719940)
20. J.Y. Liang, C.Y. Dang, K.S. Chin, and C.M. Yam Richard, A New Method for Measuring Uncertainty and Fuzziness in Rough Set Theory, Int'l J. General Systems, vol. 31, no. 4, pp. 331-342, 2002. (Pubitemid 41623247)
21. J.Y. Liang and Z.Z. Shi, The Information Entropy, Rough Entropy and Knowledge Granulation in Rough Set Theory, Int'l J. Uncertainty, Fuzziness and Knowledge-Based Systems, vol. 12, no. 1, pp. 37-46, 2004.
22. J.Y. Liang, F. Wang, C.Y. Dang, and Y.H. Qian, An Efficient Rough Feature Selection Algorithm with a Multi-Granulation View, Int'l J. Approximate Reasoning, vol. 53, pp. 912-926, 2012.
23. J.Y. Liang, W. Wei, and Y.H. Qian, An Incremental Approach to Computation of a Core Based on Conditional Entropy, Chinese J. System Eng. Theory and Practice, vol. 4, pp. 81-89, 2008. (Pubitemid 351766189)
24. H. Liu and L. Yu, Toward Integrating Feature Selection Algorithms for Classification and Clustering, IEEE Trans. Knowledge and Data Eng., vol. 17, no. 4, pp. 491-502, Apr. 2005. (Pubitemid 40495592)
25. Z.T. Liu, An Incremental Arithmetic for the Samllest Reduction of Attributes, Acta Electronica Sinica, vol. 27, no. 11, pp. 96-98, 1999.
26. J.S. Mi, W.Z. Wu, and X.W. Zhang, Approaches to Knowledge Reduction Based on Variable Precision Rough Set Model, Information Sciences, vol. 159, nos. 3/4, pp. 255-272, 2004.
27. H.S. Nguyen and D.W. Slezak, Approximate Reducts and Association Rules Correspondence and Complexity Results, Proc. Seventh Int'l Workshop New Directions in Rough Sets, Data Mining, and Granular-Soft Computing, vol. 1711, pp. 137-145, 1999.
28. M. Orlowska and M. Orlowski, Maintenance of Knowledge in Dynamic Information Systems, Intelligent Decision Support: Handbook of Applications and Advances of the Rough Set Theory, R. Slowinski, ed., pp. 315-330, Kluwer Academic Publishers, 1992.
29. Z. Pawlak, Rough Sets: Theoretical Aspects of Reasoning About Data. Kluwer Academic Publishers, 1991.
30. Z. Pawlak and A. Skowron, Rudiments of Rough Sets, Information Sciences, vol. 177, no. 1, pp. 3-27, 2007. (Pubitemid 44556698)
31. N. Parthalain, Q. Shen, and R. Jensen, A Distance Measure Approach to Exploring the Rough Set Boundary Region for Attribute Reduction, IEEE Trans. Knowledge and Data Eng., vol. 22, no. 3, pp. 305-317, Mar. 2010.
32. J.F. Pang and J.Y. Liang, Evaluation of the Results of Multi-Attribute Group Decision-Making with Linguistic Information, Omega, vol. 40, pp. 294-301, 2012.
33. Y.H. Qian, J.Y. Liang, W. Pedrycz, and C.Y. Dang, Positive Approximation: An Accelerator for Attribute Reduction in Rough Set Theory, Artificial Intelligence, vol. 174, pp. 597-618, 2010.
34. Y.H. Qian and J.Y. Liang, Combination Entropy and Combination Granulation in Rough Set Theory, Int'l J. Uncertainty, Fuzziness and Knowledge-Based Systems, vol. 16, no. 2, pp. 179-193, 2008.
35. Y.H. Qian, J.Y. Liang, D.Y. Li, H.Y. Zhang, and C.Y. Dang, Measures for Evaluating the Decision Performance of a Decision Table in Rough Set Theory, Information Sciences, vol. 178, pp. 181-202, 2008.
36. N. Shan and W. Ziarko, Data-Based Acquisition and Incremental Modification of Classification Rules, Computational Intelligence, vol. 11, no. 2, pp. 357-370, 1995.
37. C.E. Shannon, The Mathematical Theory of Communication, The Bell System Technical J., vol. 27, nos. 3/4, pp. 373-423, 1948.
38. D. Slezak, Approximate Entropy Reducts, Fundamenta Informaticae, vol. 53, nos. 3/4, pp. 365-390, 2002.
39. A. Skowron and C. Rauszer, The Discernibility Matrices and Functions in Information Systems, Intelligent Decision Support: Handbook of Applications and Advances of the Rough Sets Theory, R. Slowi-nski, ed. Kluwer Academic Publisher, 1992.
40. R.W. Swiniarski and A. Skowron, Rough set Methods in Feature Selection and Recognition, Pattern Recognition Letters, vol. 24, pp. 833-849, 2003. (Pubitemid 35391801)
41. R. Susmaga, Experiments in Incremental Computation of Reducts, Rough Sets in Data Mining and Knowledge Discovery, A. Skowron and L. Polkowski, eds., Springer-Verlag, 1998.
42. L.Y. Tong and L.P. An, Incremental Learning of Decision Rules Based on Rough Set Theory, Proc. World Congress on Intelligent Control and Automation, pp. 420-425, 2002.
43. C.Z. Wang, C.X. Wu, D.G. Chen, Q.H. Hu, and C. Wu, Communicating between Information Systems, Information Sciences, vol. 178, pp. 3228-3239, 2008.
44. G.Y. Wang, H. Yu, and D.C. Yang, Decision Table Reduction Based on Conditional Information Entropy, Chinese J. Computer, vol. 25, no. 7, pp. 759-766, 2002. (Pubitemid 35339183)
45. W.Z. Wu and W.X. Zhang, Constructive and Axiomatic Approaches of Fuzzy Approximation Operators, Information Sciences, vol. 159, pp. 233-254, 2004.
46. W. Wei, J.Y. Liang, Y.H. Qian, F. Wang, and C.Y. Dang, Comparative Study of Decision Performance of Decision Tables Induced by Attribute Reductions, Int'l J. General Systems, vol, 39, no. 8, pp. 813-838, 2010.
47. Z.B. Xu, J.Y. Liang, C.Y. Dang, and K.S. Chin, Inclusion Degree: A Perspective on Measures for Rough Set Data Analysis, Information Sciences, vol. 141, pp. 227-236, 2002. (Pubitemid 34524129)
48. 2|U/C|)), Chinese J. Computer, vol. 29, no. 3, pp. 391-398, 2006.
49. Y.Y. Yao and Y. Zhao, Attribute Reduction in Decision-Theoretic Rough Set Models, Information Sciences, vol. 178, no. 17, pp. 3356-3373, 2008.
50. Y.Y. Yao, Decision-Theoretic Rough Set Models, Proc. Second Int'l Conf. Rough Sets and Knowledge Technology, vol. 4481, pp. 1-12, 2007.
51. M. Yang, An Incremental Updating Algorithm for Attributes Reduction Based on the Improved Discernibility Matrix, Chinese J. Computers, vol. 30, no. 5, pp. 815-822, 2007. (Pubitemid 46922579)
52. W. Ziarko, Variable Precision Rough Set Model, J. Computer and System Science, vol. 46, no. 1, pp. 39-59, 1993. (Pubitemid 23639120)
53. A. Zeng, D. Pan, Q.L. Zheng, and H. Peng, Knowledge Acquisition Based on Rough Set Theory and Principal Component Analysis, IEEE Intelligent Systems, vol. 21, no. 2, pp. 78-85, Mar./Apr. 2006.
54. W. Zhu and F.Y. Wang, On Three Types of Covering-Based Rough Sets, IEEE Trans. Knowledge and Data Eng., vol. 19, no. 8, pp. 1131-1144, Aug. 2007.
55. S.Y. Zhao, E.C.C. Tsang, D.G Chen, and X.Z. Wang, Building a Rule-Based Classifier-a Fuzzy-Rough Set Approach, IEEE Trans. Knowledge and Data Eng., vol. 22, no. 5, pp. 624-638, May 2010.
56. Z. Zheng and G.Y. Wang, RRIA: A Rough Set and Rule Tree Based Incremental Knowledge Acquisition Algorithm, Fundamenta Informaticae, vol. 59, nos. 2/3, pp. 299-313, 2004.