Feature selection based on rough sets and particle swarm optimization

Pattern Recognition Letters

Volumn 28, Issue 4, 2007, Pages 459-471

  Wang, Xiangyang ^a   Yang, Jie ^a   Teng, Xiaolong ^a   Xia, Weijun ^a   Jensen, Richard ^b  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b ABERYSTWYTH UNIVERSITY   (United Kingdom)

Author keywords

Feature selection; Genetic algorithms; Hill climbing method; Particle swarm optimization; Reduct; Rough sets; Stochastic method

Indexed keywords

COMPUTATION THEORY; GENETIC ALGORITHMS; GLOBAL OPTIMIZATION; HEURISTIC METHODS; ROUGH SET THEORY; STOCHASTIC PROGRAMMING;

FEATURE SELECTION; HILL CLIMBING METHOD; PARTICLE SWARM OPTIMIZATION (PSO); REDUCTION ALGORITHMS; STOCHASTIC METHOD;

FEATURE EXTRACTION;

EID: 33845523839     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2006.09.003     Document Type: Article

References (46)

1. Bazan J. A comparison of dynamic and non-dynamic rough set methods for extracting laws from decision table. In: Polkowski L., and Skowron A. (Eds). Rough Sets in Knowledge Discovery (1998), Physica-Verlag, Heidelberg 321-365
2. Bazan J., Nguyen H.S., Nguyen S.H., Synak P., and Wroblewski J. Rough set algorithms in classification problem. In: Polkowski L., Tsumoto S., and Lin T.Y. (Eds). Rough Set Methods and Applications (2000), Physica-Verlag, Heidelberg, New York 49-88
3. Bell D., and Guan J. Computational methods for rough classification and discovery. J. ASIS 49 5 (1998) 403-414
4. Bjorvand, A.T., 1997. 'Rough Enough'-a system supporting the rough sets approach. In: Sixth Scandinavian Conference on Artificial Intelligence SCAI'97.
5. Bjorvand A.T., and Komorowski J. Practical Applications of Genetic Algorithms for Efficient Reduct Computation Vol. 4 (1997), Wissenschaft & Technik Verlag pp. 601-606
6. Blake, C., Keogh, E., Merz, C.J., 1998. UCI repository of machine learning databases. Technical Report, Department of Information and Computer Science, University of California, Irvine, CA. .
7. Chouchoulas A., and Shen Q. Rough set-aided keyword reduction for text categorization. Appl. Artif. Intell. 15 9 (2001) 843-873
8. Eberhart R.C., Shi, Y., 2001. Particle swarm optimization: developments, applications and resources. In: Proceedings of IEEE International Conference on Evolutionary Computation. Seoul, pp. 81-86.
9. Guyon I., and Elisseeff A. An introduction to variable and feature selection. J. Mach. Learning Res. 3 (2003) 1157-1182
10. Hu, X., 1995. Knowledge discovery in databases: an attribute-oriented rough set approach, Ph.D. thesis, Regina University.
11. Hu X., and Cereone N. Learning in relational databases: a rough set approach. Comput. Intell. 11 2 (1995) 323-337
12. Hu K., Lu Y.C., and Shi C.Y. Feature ranking in rough sets. AI Commun. 16 1 (2003) 41-50
13. Janusz A., Starzyk J., Nelson D.E., and Sturtz K. A mathematical foundation for improved reduct generation in information systems. Knowledge Informat. Syst. 2 (2000) 131-146
14. Jensen, R., Shen, Q., 2003. Finding rough set reducts with ant colony optimization. In: Proceedings of the 2003 UK Workshop on Computational Intelligence, pp. 15-22.
15. Kennedy, J., 1997. The particle swarm: social adaptation of knowledge. In: IEEE International Conference on Evolutionary Computation, April 13-16, pp. 303-308.
16. Kennedy, J., Eberhart, R.C., 1995a. Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks, Perth, pp. 1942-1948.
17. Kennedy, J., Eberhart, R.C., 1995b. A new optimizer using particle swarm theory. In: Sixth International Symposium on Micro Machine and Human Science. Nagoya, pp. 39-43.
18. Kennedy, J., Spears, W.M., 1998. Matching algorithms to problems: an experimental test of the particle swarm and some genetic algorithms on the multimodal problem generator. In: Proceedings of the IEEE International Conference on Evolutionary Computation. pp. 39-43.
19. Komorowski J., Pawlak Z., Polkowski L., and Skowron A. Rough sets: a tutorial. In: Pal S.K., and Skowron A. (Eds). Rough Fuzzy Hybridization. A New Trend in Decision-Making (1999), Springer-Verlag Singapore Pte., Ltd., Singapore 3-98
20. Kudo M., and Sklansky J. Comparison of algorithms that select features for pattern classifiers. Pattern Recognition 33 1 (2000) 25-41
21. Liu H., and Motoda H. Feature Selection for Knowledge Discovery and Data Mining (1998), Kluwer Academic Publishers
22. Nguyen, H.S., 1996. Some efficient algorithms for rough set methods. In: Proceedings of the Sixth International Conference, Information Processing and Management of Uncertainty in Knowledge-Based Systems (IPMU'96) 2, July 1-5, 1996, Granada, Spain pp. 1451-1456.
23. In: Pal S.K., and Skowron A. (Eds). Pattern Recognition Lett. 24 6 (2003) 829-933 (special issue on Rough Sets)
24. Pawlak Z. Rough Sets. Int. J. Comput. Informat. Sci. 11 5 (1982) 341-356
25. Pawlak Z. Rough Sets: Theoretical Aspects of Reasoning about Data (1991), Kluwer Academic Publishing, Dordrecht
26. Pawlak Z. Rough set approach to knowledge-based decision support. Eur. J. Operat. Res. 99 (1997) 48-57
27. Shi, Y., Eberhart, R.C., 1998a. A modified particle swarm optimizer. In: Proc. IEEE Int. Conf. on Evolutionary Computation. Anchorage, AK, USA, pp. 69-73.
28. Shi Y., and Eberhart R.C. Parameter selection in particle swarm optimization. Evolutionary Programming VII: Proc. EP98 (1998), Springer-Verlag, New York 591-600
29. Shi Y., and Eberhart R.C. Empirical study of particle swarm optimization. Proc. 1999 Congress on Evolutionary Computation (1999), IEEE Service Center, Piscataway, NJ 1945-1950
30. Skowron A., and Rauszer C. The discernibility matrices and functions in information systems. In: Slowinski R. (Ed). Intelligent Decision Support-Handbook of Applications and Advances of the Rough Sets Theory (1992), Kluwer Academic Publishers, Dordrecht 311-362
31. Skowron, A., Bazan, J., Son, N.H., Wroblewski, J., et al., 2005a. RSES 2.2 User's Guide. Institute of Mathematics, Warsaw University, Warsaw, Poland, January 19, 2005. .
32. Skowron, A., Wang, H., Wojna, A., Bazan J., 2005b. A hierarchical approach to multimodal classification. In: Slezak, D., Wang, G., Szczuka, M., Duentsch, I., Yao, Y.Y., (Eds.), Rough sets, fuzzy sets, data mining, and granular computing. In: Proc. 10th Int. Conf. RSFDGrC 2005, Regina, Canada, September 1-3, 2005, Part 2, Lecture Notes in Artificial Intelligence 3642, Springer, Heidelberg, 2005, pp. 119-127.
33. Slezak, D., 1996. Approximate reducts in decision tables. In: Proc. of IPMU'96, 1996.
34. Slezak, D., Wroblewski, J., 2003. Order based genetic algorithms for the search of approximate entropy reducts. In: Wang, G.Y., et al. (Eds.), RSFDGrC. LNAI, Vol. 2639. Chongqing, China, 2003, pp. 308-311.
35. Starzyk J., Nelson D.E., and Sturtz K. Reduct generation in information systems. Bull. Int. Rough Set Society 3 (1998) 19-22
36. Stefanowski J. On rough set based approaches to induction of decision rules. In: Skowron A., and Polkowski L. (Eds). Rough Sets in Knowledge Discovery Vol. 1 (1998), Physica Verlag, Heidelberg 500-529
37. Susmaga, R., 1998. Parallel computation of reducts. In: Polkowski, L., Skowron, A. (Eds.), RSCTC'98, LNAI 1424, 1998, pp. 450-458.
38. Susmaga R. Reducts and constructs in attribute reduction. Fundamenta Informaticae 61(2) (1996), IOS Press 159-181
39. Susmaga, R., 2004b. Tree-Like Parallelization of Reduct and Construct Computation. In: Tsumoto, S., et al. (Eds.), RSCTC 2004, LNAI 3066, 2004, pp. 455-464.
40. Swiniarski R.W., and Skowron A. Rough set methods in feature selection and recognition. Pattern Recognition Lett. 24 6 (2003) 833-849
41. Vafaie, H., Imam, I.F., 1994. Feature selection methods: genetic algorithms vs. greedy-like search. In: Proc. Int. Conf. on Fuzzy and Intelligent Control Systems.
42. Wang G.Y., Yu H., and Yang D.C. Decision table reduction based on conditional information entropy. Chin. J. Comput. 25 7 (2002) 759-766
43. Wang, G.Y., Zhao, J., 2004. Theoretical study on attribute reduction of rough set theory: comparison of algebra and information views. In: Proc. Third IEEE Int. Conf. on Cognitive Informatics.
44. Wroblewski, J., 1995. Finding minimal reducts using genetic algorithms. In: Proc. Second Annual Join Conf. on Information Sciences, Wrightsville Beach, NC. September 28-October 1, pp. 186-189.
45. Wroblewski J. Theoretical foundations of order-based genetic algorithms. Fundamenta Informaticae 28(3-4) (1996), IOS Press 423-430
46. Zhai L.Y., et al. Feature extraction using rough set theory and genetic algorithms-an application for the simplification of product quality evaluation. Comput. Industrial Eng. 43 (2002) 661-676