Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation

Pattern Recognition

Volumn 40, Issue 12, 2007, Pages 3509-3521

  Hu, Qinghua ^a   Xie, Zongxia ^a   Yu, Daren ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Attribute reduction; Categorical feature; Feature selection; Fuzzy set; Inclusion degree; Numerical feature; Rough set

Indexed keywords

ALGORITHMS; DATA MINING; FUZZY SETS; LEARNING SYSTEMS; SEMANTICS;

ATTRIBUTE REDUCTION; FUZZY-ROUGH MODEL; HYBRID ATTRIBUTES; INFORMATION GRANULATION;

FEATURE EXTRACTION;

EID: 34547699509     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.03.017     Document Type: Article

References (57)

1. Guyon I., and Elisseeff A. An introduction to variable feature selection. J. Mach. Learn. Res. 3 (2003) 1157-1182
2. Kwak N., and Choi C.-H. Input feature selection for classification problems. IEEE Trans. on Neural Networks 13 (2002) 143-159
3. Muni D.P., and Das Pal N.R. Genetic programming for simultaneous feature selection and classifier design. IEEE Trans. Syst. Man Cybern. Part B 36 1 (2006) 106-117
4. Pavlenko T. On feature selection, curse-of-dimensionality and error probability in discriminant analysis. J. Stat. Planning Inference 115 (2003) 565-584
5. Kohavi R., and John G.H. Wrappers for feature subset selection. Artif. Intell. 97 1-2 (1997) 273-324
6. K. Kira, L.A. Rendell, The feature selection problem: traditional methods and a new algorithm, in: Proceedings of AAAI-92, San Jose, CA, 1992, pp. 129-134.
7. Lee C.K., and Lee G.G. Information gain and divergence-based feature selection for machine learning-based text categorization. Inf. Process. Manage. 42 (2006) 155-165
8. Dash M., and Liu H. Consistency-based search in feature selection. Artif. Intell. 151 (2003) 155-176
9. Mitra P., Murthy C.A., and Pal S.K. Unsupervised feature selection using feature similarity. IEEE Trans. Pattern Anal. Mach. Intell. 24 3 (2002) 301-312
10. Yu L., and Liu H. Feature selection for high-dimensional data: a fast correlation-based filter solution. Proceedings of the 20th International Conference on Machine Learning (2003) 856-863
11. Modrzejewski M. Feature selection using rough sets theory. In: Brazdil P.B. (Ed). Proceedings of the European Conference on Machine Learning (1993), Vienna, Austria 213-226
12. Setiono R., and Liu H. Neural-network feature selector. IEEE Trans. Neural Networks 8 3 (1997) 654-662
13. Neumann J., Schnorr C., and Steidl G. Combined SVM-based feature selection and classification. Mach. Learn. 61 (2005) 129-150
14. Liu H., and Setiono R. Feature selection via discretization. IEEE Trans. Knowl. Data Eng. 9 4 (1997) 642-645
15. Beynon M.J. An introduction of the condition class space with continuous value discretization and rough set theory. Int. J. Intell. Syst. 21 2 (2006) 173-191
16. Chmielewski M.R., and GrzymalaBusse J.W. Global discretization of continuous attributes as preprocessing for machine learning. Int. J. Approx. reasoning 15 4 (1996) 319-331
17. Swiniarski R.W., and Skowron A. Rough set methods in feature selection and recognition. Pattern Recognition Lett. 24 (2003) 833-849
18. Jensen R., and Shen Q. Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches. IEEE Trans. Knowl. data Eng. 16 12 (2004) 1457-1471
19. R. Jenson, Q. Shen, Fuzzy-rough sets for descriptive dimensionality reductions, Proceedings of IEEE International Conference on Fuzzy Systems, pp. 29-34.
20. Tang W.Y., and Mao K.Z. Feature selection algorithm for data with both nominal and continuous features. In: Ho T.B., Cheung D., and Liu H. (Eds). PAKDD 2005, Lecture Notes in Artificial Intelligence vol. 3518 (2005), Springer, Berlin, Heidelberg 683-688
21. Pedrycz W., and Vukovich G. Feature analysis through information granulation and fuzzy sets. Pattern Recognition 35 (2002) 825-834
22. Shen Q., and Jensen R. Selecting informative features with fuzzy-rough sets and its application for complex systems monitoring. Pattern Recognition 37 7 (2004) 1351-1363
23. Jensen R., and Shen Q. Fuzzy-rough attribute reduction with application to web categorization. Fuzzy Sets and Systems 141 3 (2004) 469-485
24. Bhatt R.B., and Gopal M. On fuzzy-rough sets approach to feature selection. Pattern Recognition Lett. 26 (2005) 965-975
25. Bhatt R.B., and Gopal M. On the compact computational domain of fuzzy-rough sets. Pattern Recognition Lett. 26 (2005) 1632-1640
26. Slezak D. Approximate entropy reducts. Fundam. Inf. 53 3-4 (2002) 365-390
27. Wang G.Y., Zhao J., An J.J., et al. A comparative study of algebra viewpoint and information viewpoint in attribute reduction. Fundam. Inf. 68 3 (2005) 289-301
28. Hu Q.H., and Yu D.R. Entropies of fuzzy indiscernibility relation and its operations. Int. J. Uncertainty Fuzziness Knowl Based Syst. 12 5 (2004) 575-589
29. Hu Q.H., Yu D.R., Xie Z.X., and Liu J.F. Fuzzy probabilistic approximation spaces and their information measures. IEEE Trans. Fuzzy Syst. 14 2 (2006) 191-201
30. Hu Q.H., Yu D.R., and Xie Z.X. Information-preserving hybrid data reduction based on fuzzy-rough techniques. Pattern Recognition Lett. 27 5 (2006) 414-423
31. Zadeh L. Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets and Systems 19 (1997) 111-127
32. Yao Y.Y. Information granulation and rough set approximation. Int. J. Intell. Syst. 16 1 (2001) 87-104
33. Skowron A., and Stepaniuk J. Information granules: towards foundations of granular computing. Int. J. Intell. Syst. 16 (2001) 57-85
34. Bortolan G., and Pedrycz W. Fuzzy descriptive models: an interactive framework of information granulation. IEEE Trans. Fuzzy Syst. 10 6 (2002) 743-755
35. Zhang Y.-Q. Constructive granular systems with universal approximation and fast knowledge discovery. IEEE Trans. Fuzzy Syst. 13 1 (2005) 48-57
36. T.Y. Lin, Neighborhood systems and relational database, Abstract, Proceedings of CSC '88, February, 1988, p. 725.
37. Berthold M.R., Ortolani M., Patterson D., et al. Fuzzy information granules in time series data. Int. J. Intell. Syst. 19 7 (2004) 607-618
38. Bargiela A., and Pedrycz W. Recursive information granulation: aggregation and interpretation issues. IEEE Trans. Syst. Man Cybern. Part B 33 1 (2003) 96-112
39. Lin T.Y. Granular computing: fuzzy logic and rough sets. In: Zadeh L.A., and Kacprzyk J. (Eds). Computing with Words in Information/Intelligent Systems (1999), Physica-Verlag, Wurzburg 183-200
40. Zadeh L.A. Fuzzy logic equals computing with words. IEEE Trans. Fuzzy Syst. 4 2 (1996) 103-111
41. Yao Y.Y. A partition model of granular computing. LNCS Trans. Rough Sets 1 (2004) 232-253
42. Pedrycz W., and Vasilakos A.V. Linguistic models and linguistic modeling. IEEE Trans. Syst. Man Cybernet. Part B 29 6 (1999) 745-757
43. Lin T.Y. Data mining and machine oriented modeling: a granular computing approach. J. Appl. Intell. 13 2 (2000) 113-124
44. Y.H. Chen, Y.Y. Yao, Multiview intelligent data analysis based on granular computing, Proceedings of 2006 IEEE International Conference on Granular Computing, 2006.
45. Pawlak Z. Rough Sets-Theoretical Aspects of Reasoning about Data (1991), Kluwer Academic, Dordrecht
46. Dubois D., and Prade H. Rough fuzzy sets and fuzzy rough sets. Int. J. General Syst. 17 2-3 (1990) 191-209
47. Wu W., and Zhang W. Constructive and axiomatic approaches of fuzzy approximation operators. Inf. Sci. 159 3-4 (2004) 233-254
48. Lin T.Y. Granular data model: semantic data mining and computing with words. Proceeding of IEEE Conference on Fuzzy Systems (2004) 1141-1146
49. Yeung D.S., Chen D.G., Tsang E.C.C., Lee J.W.T., and Wang X.Z. On the generalization of fuzzy rough sets. IEEE Trans. Fuzzy Syst. 13 3 (2005) 343-361
50. Guillaume S., and Charnomordic B. Generating an interpretable family of fuzzy partitions from data. IEEE Trans. Fuzzy Syst. 12 3 (2004) 324-335
51. Bargiela A., and Pedrycz W. A model of granular data: a design problem with the Tchebyschev FCM. Soft. Comput. 9 (2005) 155-163
52. Ma Z.M., Zhang W.J., and Ma W.Y. Assessment of data redundancy in fuzzy relational databases based on semantic inclusion degree. Inf. Process. Lett. 72 (1999) 25-29
53. Xu Z.B., Liang J.Y., Dang C.Y., and Chin K.S. Inclusion degree: a perspective on measures for rough set data analysis. Inf. Sci. 141 3-4 (2002) 227-236
54. Zadeh L.A. Fuzzy sets. Inf. Control 8 (1965) 338-353
55. Oh S.-K., Pedrycz W., and Park H.-S. Implicit rule-based fuzzy-neural networks using the identification algorithm of GA hybrid scheme based on information granulation. Adv. Eng. Inf. 16 (2002) 247-263
56. Q. Hu, D. Yu, An improved clustering algorithm for information granulation, Lecture Notes in Artificial Intelligence, vol. 3613, FSKD 2005, Proceedings, 2005, pp. 494-504.
57. Lee H.-S. An optimal algorithm for computing the max-min transitive closure of a fuzzy similarity matrix. Fuzzy Sets and Systems 123 1 (2001) 129-136