Gaussian kernel based fuzzy rough sets: Model, uncertainty measures and applications

International Journal of Approximate Reasoning

Volumn 51, Issue 4, 2010, Pages 453-471

  Hu, Qinghua ^a,b   Zhang, Lei ^b   Chen, Degang ^c   Pedrycz, Witold ^d   Yu, Daren ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

^c NORTH CHINA ELECTRIC POWER UNIVERSITY   (China)

^d UNIVERSITY OF ALBERTA   (Canada)

Author keywords

Feature selection; Fuzzy set; Gaussian kernel; Rough set; Uncertainty measure

Indexed keywords

APPROXIMATION ALGORITHMS; FEATURE EXTRACTION; FUNCTION EVALUATION; FUZZY SETS; GAUSSIAN DISTRIBUTION; INTELLIGENT SYSTEMS; LEARNING SYSTEMS; MATRIX ALGEBRA; UNCERTAINTY ANALYSIS;

CLASSIFICATION TASKS; EXPERIMENTAL ANALYSIS; GAUSSIAN KERNELS; HIGHER DIMENSIONAL FEATURES; INFORMATION ENTROPY; KERNEL APPROXIMATION; SAMPLE INFORMATION; UNCERTAINTY MEASURES;

ROUGH SET THEORY;

EID: 76049113696     PISSN: 0888613X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijar.2010.01.004     Document Type: Article

References (63)

1. Shawe-Taylor J., and Cristianini N. Kernel Methods for Pattern Analysis (2004), Cambridge University Press
2. Cortes C., and Vapnik V. Support-vector networks. Mach. Learning 20 (1995) 273-297
3. Burges C.J.C. A tutorial on support vector machines for pattern recognition. Data Mining Knowled. Discovery 2 (1998) 121-167
4. Chen J.-H., and Chen C.-S. Fuzzy kernel perceptron. IEEE Trans. Neural Networks 13 (2002) 1364-1373
5. Baudat G., and Anouar F.E. Generalized discriminant analysis using a kernel approach. Neural Comput. 12 (2000) 2385-2404
6. Scholkopf B., Smola A., and Muller K.R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10 (1998) 1299-1319
7. Vincent P., and Bengio Y. Kernel matching pursuit. Mach. Learn. 48 (2002) 65-187
8. Pawlak Z. Rough Sets - Theoretical Aspects of Reasoning about Data (1991), Kluwer Academic Publishers, Dordrecht
9. Wang J., and Tao Q. Theory of rough sets and statistical learning. In: Lu R.Q. (Ed). In Knowledge Science and Computational Science (2003), Tsinghua Publishing House
10. Hu Q.H., Xie Z.X., and Yu D.R. Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation. Pattern Recognit. 40 (2007) 3509-3521
11. Hu X., and Cercone N. Learning in relational databases: a rough set approach. Comput. Intell. 11 (1995) 323-338
12. Hu Q.H., Yu D.R., Xie Z.X., and Li X.D. EROS: ensemble rough subspaces. Pattern Recognit. 40 (2007) 3728-3739
13. Pawlak Z. Rough set theory and its applications to data analysis. Cybern. Syst. 29 (1998) 661-688
14. R.M. Fang, H.Z. Ma, Hybrid rough set and support vector machine for faults diagnosis of power transformer, Dynamics of continuous discrete and impulsive systems - series b - applications and algorithms, vol. 13 (3 Suppl.), 2006, pp. 1209-1213.
15. Asharaf S., Shevade S.K., and Narasimha Murty M. Rough support vector clustering. Pattern Recognit. 38 (2005) 1779-1783
16. Lingras P., and Butz C. Rough set based 1-v-1 and 1-v-r approaches to support vector machine multi-classification. Inform. Sci. 177 (2007) 3782-3798
17. Pawlak Z. Rough sets. Int. J. Inform. Comput. Sci. 11 (1982) 314-356
18. Hu Q.H., Yu D.R., and Xie Z.X. Neighborhood classifiers. Expert Syst. Appl. 34 (2008) 866-876
19. Dubois D., and Prade H. Rough fuzzy sets and fuzzy rough sets. Int. J. Gen. Syst. 17 (1990) 191-209
20. Morsi Nehad N., and Yakout M.M. Axiomatics for fuzzy rough sets. Fuzzy Sets Syst. 100 (1998) 327-342
21. Wu W.-Z., and Zhang W.-X. Constructive and axiomatic approaches of fuzzy approximation operators. Inform. Sci. 159 (2004) 233-254
22. Yeung D.S., Chen D.G., Tsang E.C.C., Lee J.W.T., and Wang X.Z. On the generalization of fuzzy rough sets. IEEE Trans. Fuzzy Syst. 13 (2005) 343-361
23. Hu Q.H., Yu D.R., Xie Z.X., and Liu J.F. Fuzzy probabilistic approximation spaces and their information measures. IEEE Trans. Fuzzy Syst. 14 (2006) 191-201
24. Moser B. On the t-transitivity of kernels. Fuzzy Sets Syst. 157 (2006) 787-1796
25. Moser B. On representing and generating kernels by fuzzy equivalence relations. J. Mach. Learn. Res. 7 (2006) 2603-2620
26. Hu Q.H., Yu D.R., and Xie Z.X. Information-preserving hybrid data reduction based on fuzzy-rough techniques. Pattern Recognit. Lett. 27 (2006) 414-423
27. Genton M.G. Classes of kernels for machine learning: a statistics perspective. J. Mach. Learn. Res. 2 (2001) 299-312
28. Mi J.-S., and Zhang W.-X. An axiomatic characterization of a fuzzy generalization of rough sets. Inform. Sci. 160 (2004) 235-249
29. Jensen R., and Shen Q. Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches. IEEE Trans. Knowledge Data Eng. 16 (2004) 1457-1471
30. Jensen R., and Shen Q. New approaches to fuzzy-rough feature selection. IEEE Trans. Fuzzy Syst. 17 (2009) 824-828
31. Hernandez E., and Recasens J. A reformulation of entropy in the presence of indistinguishability operators. Fuzzy Sets Syst. 128 (2002) 185-196
32. Duntsch I., and Gediga G. Uncertainty measures of rough set prediction. Artif. Intell. 106 (1998) 09-137
33. Qian Y.H., Liang J.Y., Li D.Y., Zhang H.Y., and Dang C. Measures for evaluating the decision performance of a decision table in rough set theory. Inform. Sci. 178 (2008) 181-202
34. Hu Q.H., and Yu D. Entropies of fuzzy indiscernibility relation and its operations. Int. J. Uncertain. Fuzziness Knowledge-Based Syst. 12 (2004) 75-589
35. Yu D., Hu Q.H., and Wu C. Uncertainty measures for fuzzy relations and their applications. Appl. Soft Comput. 7 (2007) 1135-1143
36. K. Kira, L.A. Rendell, A practical approach to feature selection, in: D. Sleeman, P. Edwards (Eds.), Machine Learning: Proceedings of International Conference (ICML'92), Morgan Kaufmann, pp. 249-256.
37. Robnik-Sikonja M., and Kononenko I. Theoretical and empirical analysis of ReliefF and RReliefF. Mach. Learning 53 (2003) 23-69
38. Y. Sun, J. Li, Iterative RELIEF for Feature Weighting, in: Proc. 23rd Int. Conf. Machine Learning, 2006, pp. 913-920.
39. Sun Y.J. Iterative RELIEF for feature weighting: algorithms, theories, and applications. IEEE Trans. Pattern Anal. Mach. Intell. 29 (2007) 035-1051
40. Yu L., and Liu H. Efficient feature selection via analysis of relevance and redundancy. J. Mach. Learning Res. 5 (2004) 1205-1224
41. Liu H., and Yu L. Toward integrating feature selection algorithms for classification and clustering. IEEE Trans. Knowledge Data Eng. 17 (2005) 491-502
42. Battiti R. Using mutual information for selecting features in supervised neural net learning. IEEE Trans. Neural Networks 5 (1994) 537-550
43. M.A. Hall, Correlation-based feature selection for discrete and numeric class machine learning, in: Proceedings of the Seventeenth International Conference on Machine Learning, 2000, pp. 359-366.
44. Dash M., and Liu H. Consistency-based search in feature selection. Artif. Intell. 151 (2003) 155-176
45. Muni D.P., Pal N.R., and Das J. Genetic programming for simultaneous feature selection and classifier design. IEEE Trans. Syst. Man Cybern. - Part B: Cybern. 36 (2006) 106-117
46. Xiong H.L., Swamy M.N.S., and Ahmad M.O. Optimizing the kernel in the empirical feature space. IEEE Trans. Neural Networks 16 (2005) 460-474
47. Yang S., Yan S., Zhang C., et al. Bilinear analysis for Kernel selection and nonlinear feature extraction. IEEE Trans. Neural Networks 18 (2007) 442-1452
48. Muller K.R., Mika S., Ratsch G., et al. An introduction to kernel-based learning algorithms. IEEE Trans. Neural Networks 12 (2001) 181-201
49. R. Gilad-Bachrach, A. Navot, N. Tishby, Margin based feature selection- theory and algorithms, in: Proceeding of ICML 2004, pp. 43-50.
50. Zadeh L.A. Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst. 90 (1997) 111-127
51. Pedrycz W., and Vukovich G. Feature analysis through information granulation and fuzzy sets. Pattern Recognit. 35 (2002) 825-834
52. Chen S., and Cowan C.F.N. Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans. Neural Networks 2 (1991) 302-309
53. Tseng T.-L., and Huang C.-C. Rough set-based approach to feature selection in customer relationship management. Omega 35 (2007) 365-383
54. Leung Y., Fischer M.M., Wu W.-Z., and Mi J.-S. A rough set approach for the discovery of classification rules in interval-valued information systems. Int. J. Approx. Reason. 47 (2008) 233-246
55. Li T.-J., Leung Y., and Zhang W.-X. Generalized fuzzy rough approximation operators based on fuzzy coverings. Int. J. Approx. Reason. 48 (2008) 836-856
56. Wu W.-Z. Attribute reduction based on evidence theory in incomplete decision systems. Inform. Sci. 178 (2008) 1355-1371
57. Mieszkowicz-Rolka A., and Rolka L. Fuzzy rough approximations of process data. Int. J. Approx. Reason. 49 (2008) 301-315
58. Yao Y.Y. Two views of the theory of rough sets in finite universes. Int. J. Approx. Reason. 15 (1996) 291-317
59. Yao Y.Y., and Zhao Y. Attribute reduction in decision-theoretic rough set models. Inform. Sci. 178 (2008) 3356-3373
60. Zhao S., and Tsang E.C.C. On fuzzy approximation operators in attribute reduction with fuzzy rough sets. Inform. Sci. 178 (2008) 3163-3176
61. Qian Y.H., Liang J.Y., and Dang C.Y. Knowledge structure, knowledge granulation and knowledge distance in a knowledge base. Int. J. Approx. Reason. 50 (2009) 174-188
62. Yang Y.J., and John R.I. Generalisation of roughness bounds in rough set operations. Int. J. Approx. Reason. 48 (2008) 868-878
63. U. Fayyad, K. Irani, Multi-interval discretization of continuous-valued attributes for classification learning, in: Proc. Thirteenth International Joint Conference on Artificial Intelligence, Morgan Kaufmann, San Mateo, CA, 1993, pp. 1022-1027.