A feature selection method using a fuzzy mutual information measure

International Journal of Reasoning-based Intelligent Systems

Volumn 2, Issue 2, 2010, Pages 133-141

  del Rosario Suárez, María ^a   Villar, José R ^a   Grande, Javier ^b  

^a UNIVERSITY OF OVIEDO   (Spain)

^b Software Engineering Department ^*  (Spain)

Author keywords

classification; descriptive reasoning; feature selection; genetic fuzzy systems; imprecise data; mutual information

Indexed keywords

EID: 84879494369     PISSN: 17550556     EISSN: 17550564     Source Type: Journal    
DOI: 10.1504/IJRIS.2010.034909     Document Type: Article

References (35)

1. Alcalá-Fdez, J., Sánchez, L., García, S., del Jesus, M.J., Ventura, S., Garrell, J.M., Otero, J., Romero, C., Bacardit, J., Rivas, V.M., Fernández, J.C. and Herrera, F. (2009) ‘KEEL: a software tool to assess evolutionary algorithms to data mining problems’, Soft Computing, Vol. 13, No. 3, pp.307–318.
2. Battiti, R. (1994) ‘Using mutual information for selecting features in supervised neural net learning’, IEEE Transactions on Neural Networks, Vol. 5, No. 4, pp.537–550.
3. Bhatt, R.B. and Gopal, M. (2005) ‘On fuzzy-rough sets approach to feature selection’, Pattern Recognition Letters, Vol. 26, pp.965–975.
4. Casillas, J., Cordón, O., Jesús, M.J.D. and Herrera, F. (2001) ‘Genetic feature selection in a fuzzy rule-based classification system learning process for high-dimensional problems’, Information Sciences, Vol. 136, pp.135–157.
5. del Jesús, M.J., Junco, F.H.L. and Sánchez, L. (2004) ‘Induction of fuzzy-rule-based classifiers with evolutionary boosting algorithms’, IEEE Transactions on Fuzzy Systems, Vol. 12, No. 3, pp.296–308.
6. Ishibuchi, H., Nakashima, T. and Nii, M. (2004) Classification and Modelling with Linguistic Information Granules, Springer.
7. Jensen, R. and Shen, Q. (2005) ‘Fuzzy-rough data reduction with ant colony optimization’, Fuzzy Sets and Systems, Vol. 149, pp.5–20.
8. Jensen, R. and Shen, Q. (2007) ‘Fuzzy-rough sets assisted attribute selection’, IEEE Transactions on Fuzzy Systems, Vol. 15, No. 1, pp.73–89.
9. Kira, K. and Rendell, L. (1992) ‘A practical approach to feature selection’, Proceedings of the Ninth International Conference on Machine Learning (ICML-92), pp.249–256.
10. Marcelloni, F. (2003) ‘Feature selection based on a modified fuzzy c-means algorithm with supervision’, Information Sciences, Vol. 151, pp.201–226.
11. Otero, J. and Sánchez, L. (2005) ‘Induction of descriptive fuzzy classifiers with the logitboost algorithm’, Soft Computing, Vol. 10, No. 9, pp.825–835.
12. Pedrycz, W. and Vukovich, G. (2002) ‘Feature analysis through information granulation and fuzzy sets‘, Pattern Recognition, Vol. 35, pp.825–834.
13. Ravi, V. and Zimmermann, H-J. (2000) ‘Fuzzy rule based classification with feature selector and modified threshold accepting’, European Journal of Operational Research, Vol. 123, pp.16–28.
14. Roubos, J.A., Setnes, M. and Abonyi, J. (2003) ‘Learning fuzzy classification rules from labelled data’, Information Sciences, Vol. 150, pp.77–93.
15. Sánchez, L. and Couso, I. (2005) ‘Advocating the use of imprecisely observed data in genetic fuzzy systems’, Proceedings of I International Workshop on Genetic Fuzzy Systems, GFS 2005.
16. Sánchez, L. and Couso, I. (2006) ‘Advocating the use of imprecisely observed data in genetic fuzzy systems’, IEEE Transactions on Fuzzy Systems.
17. Sánchez, L., Otero, J. and Casillas, J. (2007) ‘Modelling vague data with genetic fuzzy systems under a combination of crisp and imprecise criteria’, Proceedings of the First IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making, MCDM2007, Honolulu, USA.
18. Sánchez, L., Otero, J. and Villar, J.R. (2006) ‘Boosting of fuzzy models for high dimensional imprecise datasets’, Proceedings of the Information Processing and Management of Uncertainty in Knowledge-Based Systems IPMU06, Paris, France.
19. Sánchez, L., Suárez, M.R. and Couso, I. (2007) ‘A fuzzy definition of mutual information with application to the design of genetic fuzzy classifiers’, Proceedings of the IEEE International Conference on Fuzzy Systems, FUZZIEEE 2007, London, UK.
20. Shen, Q. and Chouchoulas, A. (2002) ‘A rough-fuzzy approach for generating classification rules’, Pattern Recognition, Vol. 35, pp.2425–2438.
21. Shen, Q. and Jensen, R. (2004) ‘Selecting informative features with fuzzy-rough sets and its application for complex systems monitoring’, Pattern Recognition, Vol. 37, pp.1351–1363.
22. Suárez, M.R. (2007) ‘Estimación de la información mutua en problemas con datos imprecisos’. PhD thesis, University of Oviedo, Gijón, Spain, April.
23. Tolvi, J. (2004) ‘Genetic algorithms for outlier detection and variable selection in linear regression models’, Soft Computing, Vol. 8, pp.527–533.
24. Tourassi, G.D., Frederik, E.D., Markey, M.K., Carey, E. and Floyd, J. (2001) ‘Application of the mutual information criterion for feature selection in computer-aided diagnosis’, Med. Phys., Vol. 28, No. 12, pp.2394–2402.
25. Uncu, O. and Turksen, I. (2007) ‘A novel feature selection approach: combining feature wrappers and filters’, Information Sciences, Vol. 177, pp.449–466.
26. Wang, X., Wang, Y. and Wang, L. (2004) ‘Improving fuzzy c-means clustering based on feature-weight learning’, Pattern Recognition Letters, Vol. 25, pp.1123–1132.
27. Wang, X., Yang, J., Jensen, R. and Liu, X. (2006) ‘Rough set feature selection and rule induction for prediction of malignancy degree in brain glioma’, Computer methods and Programs in Biomedicine, Vol. 83, pp.147–156.
28. Yu, D., Hu, Q. and Wu, C. (2007) ‘Uncertainty measures for fuzzy relations and their applications’, Applied Soft Computing, Vol. 7, pp. 1135–1143.
29. Yu, S., Backer, S.D. and Scheunders, P. (2002) ‘Genetic feature selection combined with composite fuzzy nearest neighbour classifiers for hyper spectral satellite imagery’, Pattern Recognition Letters, Vol. 23, pp.183–190.
30. Zhang, Y., Wu, X-B., Xiang, Z-R., Hu, W-L. (2007) ‘Design of high-dimensional fuzzy classification systems based on multi-objective evolutionary algorithm’, Journal of System Simulation, Vol. 19, No. 1, pp.210–215.
31. Hu, Q., Liu, J. and Yu, D. (2007) ‘Mixed feature selection based on granulation and approximation’, Knowl. Based Syst., doi:10.1016/j.knosys.2007.07.001.
32. Hu, Q., Xie, Z. and Yu, D. (2007) ‘Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation’, Pattern Recognition, Vol. 40, pp3509–3521.
33. Sánchez, L., Rosario Suárez, M., Villar, J.R. and Couso, I. (2007) ‘Some results about mutual information-based feature selection and fuzzy discretization of vague data’, IEEE International Conference on Fuzzy Systems, London, UK.
34. Grande, J., Rosario Suárez, M. and Villar, J.R. (2007) ‘A feature selection method using a fuzzy mutual information measure’, Advances in Soft Computing, Vol. 44, pp.56–63.
35. Sánchez, L., Rosario Suárez, M., Villar, J.R. and Couso, I. (2009) ‘Mutual information-based feature selection and fuzzy discretization of vague data’, Submitted for evaluation to the International Journal of Approximate Reasoning.