Hybrid system based on rough sets and genetic algorithms for medical data classifications

International Journal of Fuzzy System Applications

Volumn 3, Issue 4, 2013, Pages 31-46

  Elshazly, Hanaa Ismail ^a   Azar, Ahmad Taher ^b   Hassanien, Aboul Ella ^a   Elkorany, Abeer Mohamed ^a  

^a Cairo University   (Egypt)

^b Benha University   (Egypt)

Author keywords

Biomedical classification; Data mining; Discretization; Entropy gain information (EI); Feature selection (FS); Genetic algorithm (GA); Machine learning (ML); Rough set (RS)

Indexed keywords

BIOINFORMATICS; DATA MINING; DIAGNOSIS; ENTROPY; FEATURE EXTRACTION; GENETIC ALGORITHMS; HYBRID SYSTEMS; INTELLIGENT COMPUTING; MACHINE LEARNING; MEDICAL APPLICATIONS; MEDICAL COMPUTING; MEDICAL IMAGING; ROUGH SET THEORY;

BIOMEDICAL DATA; BIOMEDICAL DOMAIN; DISCRETIZATION PROCESS; DISCRETIZATIONS; ENTROPY GAIN; HYBRID TECHNIQUES; MACHINE LEARNING TECHNIQUES; MEDICAL DATA SETS;

CLASSIFICATION (OF INFORMATION);

EID: 84897542211     PISSN: 2156177X     EISSN: 21561761     Source Type: Journal    
DOI: 10.4018/ijfsa.2013100103     Document Type: Article

References (62)

1. Batista, G., & Monrad, M. C. (2003). An analysis of four missing data treatment methods for supervised learning. Applied Artificial Intelligence, 17(5-6), 519-533. doi:10.1080/713827181
2. Biesiada, J., & Duch, W. (2008). Feature selection for high-dimensional data-a Pearson redundancy based filter. Advances in Soft Computing, 45, 242-249. doi:10.1007/978-3-540-75175-5-30
3. Catlett, J. (1991). On changing continuous attributes into ordered discrete attributes into ordered discrete attributes. In Y. Kodratoff (Ed.), Proceedings of the European Working Session on Learning (pp. 164- 178). Berlin, Germany: Springer-Verlag.
4. Chen, Y., Miao, D., Wang, R., & Wu, K. (2011). Rough set approach to feature based on power set tree. Knowledge-Based Systems, 24(2), 275-281. doi:10.1016/j.knosys.2010.09.004
5. Chiu, D. K. Y., Cheun, B., & Wong, A. K. C. (1990). Information synthesis based on hierarchical entropy discretization. Journal of Experimental & Theoretical Artificial Intelligence, 2, 117-129. doi:10.1080/ 09528139008953718
6. Cios, K. J., & Mooree, G. W. (2002). Uniqueness of medical data mining. Artificial Intelligence in Medicine, 26(1-2), 1-24. doi:10.1016/S0933- 3657(02)00049-0 PMID:12234714 (Pubitemid 35299395)
7. Cios, K. J., Pedrycz, W., & Swiniarki, R. W. (1998). Data mining methods for knowledge discovery. Neural Networks. IEEE Transactions, 9(6), 1533-1534.
8. Colak, S., & Isik, C. (2003). Feature subset selection for blood pressure classification using orthogonal forward selection. In Proceedings of 2003 IEEE 29th Annual Bioengineering Conference (pp. 122-123).
9. Cotter, S. F., Kreutz-Delgado, K., & Rao, B. D. (2001). Backward sequential elimination for sparse vector selection. Signal Processing, 81(9), 1849-1864. doi:10.1016/S0165-1684(01)00064-0 (Pubitemid 32723681)
10. Cyran, K. A., & Mrózek, A. (2001). Rough sets in hybrid methods for pattern recognition. International Journal of Intelligent Systems, 16(2), 149-168. doi:10.1002/1098-111X(200102)16:2<149::AID-INT10>3.0.CO;2- S (Pubitemid 32168477)
11. Dash, M., & Liu, H. (1997). Feature selection for classification. Intelligent Data Analysis, 1(3), 131-156. doi:10.1016/S1088-467X(97)00008-5
12. Dash, M., & Liu, H. (2003). Consistency-based search in feature selection. Artificial Intelligence, 151(1-2), 155-176. doi:10.1016/S0004- 3702(03)00079-1
13. Elshazly, H. I., Ghali, N. I., Korany, A. M. E., Hassanien, A. E. (2012). Rough sets and genetic algorithms: A hybrid approach to breast cancer classification. Information and Communication Technologies (WICT), 260-265.
14. Escolano, F., Suau, P., & Bonev, B. (2009). Information theory in computer vision and pattern recognition. Springer. doi:10.1007/978-1-84882-297-9
15. Esseghir, M., Liu, H., Motoda, H., Setiono, R., & Zhao, Z. (2010). Effective wrapper-filter hybridization through GRASP schemata. ACM Press, 10, 45-54.
16. Fayyad, U. M., & Irani, K. B. (1993). Multi-interval discretization of continuous-valued attributes for classification learning. In Proceedings of the 13th International Joint Conference on Artificial Intelligence (pp. 1022-1027). Morgan Kaufman.
17. Freitas, A. A. (2005). Evolutionary algorithms for data mining. In O. Maimon, & L. Rokach (Eds.), The data mining and knowledge discovery handbook (pp. 435-467). Springer. doi:10.1007/0-387-25465-X-20
18. Guyon, I., Gunn, S., Nikravesh, M., & Zadeh, L. A. (2006). Feature extraction foundations and applications. Springer-Verlag Berlin Heidelberg. doi:10.1007/978-3-540-35488-8
19. Han, J., & Kamber, M. (2011). Data mining; Concepts and techniques. San Francisco, CA: Morgan Kaufmann Publisher.
20. Hassanien, A. E., Abraham, A., Peters, J. F., & Schaefer, G. (2009). Rough sets in medical informatics applications. Applications of Soft Computing Advances in Intelligent and Soft Computing, 58, 23-30. doi:10.1007/978-3-540- 89619-7-3
21. Hassanien, A. E., Ali, J. M., & Hajime, N. (2004). Detection of spiculated masses in mammograms based on fuzzy image processing. In Proceedings of the 7th Int. Conference on Artificial Intelligence and Soft Computing, 3070, 1002-1007. (Pubitemid 38835952)
22. Hassanien, A. E., Suraj, Z., Slezak, D., & Lingras, P. (2008). Rough computing: theories, technologies and applications. IGI Global.
23. Ilczuk, G., & Wakulicz-Deja, A. (2007). Visualization of rough set decision rules for medical diagnosis systems. Rough Sets, Fuzzy Sets, Data Mining and Granular Computing Lecture Notes in Computer Science, 4482, 371-378.
24. Inbarani, H. H., Azar, A. T., & Jothi, G. (2014). Supervised hybrid feature selection based on PSO and rough sets for medical diagnosis. Computer Methods and Programs in Biomedicine, 113(1), 175-185. doi:10.1016/j.cmpb.2013. 10.007 PMID:24210167
25. Jin, X., Xu, A., Bie, R., & Guo, P. (2006). Machine learning techniques and chi-square feature selection for cancer classification using SAGE gene expression profiles. Lecture Notes in Computer Science, 3916, 106-115. doi:10.1007/11691730-11 (Pubitemid 44021369)
26. Khushaba, R., Al-Ani, A., & Al-Jumaily, A. (2011). Feature subset selection using differential evolution and a statistical repair mechanism. Expert Systems with Applications, 38(9), 11515-11526. doi:10.1016/j.eswa.2011. 03.028
27. Kobashi, S., Kondo, K., & Hata, Y. (2004). Rough sets based medical image segmentation with connectedness. In Proceedings of the 5th Int. Forum on Multimedia and Image Processing (pp. 197-202). (Pubitemid 43252383)
28. Kohavi, R., & John, G. (1997). Wrappers for feature subset selection. Artificial Intelligence, 97(1-2), 273-324. doi:10.1016/S0004-3702(97)00043-X (Pubitemid 127401107)
29. Kononenko, I. (2001). Machine learning for medical diagnosis: History, state of the art and perspective. Artificial Intelligence in Medicine, 23(1), 89-109. doi:10.1016/S0933-3657(01)00077-X PMID:11470218 (Pubitemid 32677979)
30. Kotsiantis, S. B. (2007). Supervised machine learning: A review of classification techniques. Informatica, 31(3), 249-268. (Pubitemid 350208045)
31. Ladha, L., & Deepa, T. (2011). Feature selection methods and algorithms. Int. [IJCSE]. Journal on Computer Science and Engineering, 3(5), 1787-1797.
32. Lavrac, N. (1999). Selected techniques for data mining in medicine. Artificial Intelligence in Medicine, 16(1), 3-23. doi:10.1016/S0933-3657(98) 00062-1 PMID:10225344 (Pubitemid 29166882)
33. Liao, C., Li, S., & Luo, Z. (2007). Gene selection using Wilcoxon rank sum test and support vector machine for cancer. Lecture Notes in Computer Science, 4456, 57-66. doi:10.1007/978-3-540-74377-4-7
34. Liao, S.-H., Chu, P.-H., & Hsiao, P.-Y. (2011). Data mining techniques and applications - A decade review from 2000 to 2011. Expert Systems with Applications, 39(12), 11303-1131. doi:10.1016/j. eswa.2012.02.063
35. Lui, H., & Motoda, H. (2001). Instance selection and construction for data mining. Springer.
36. Mitra, S., Mitra, M., & Chaudhuri, B. B. (2006). A rough-set-based inference engine for ECG classification. IEEE Transactions on Instrumentation and Measurement, 55(6), 2198-2206. doi:10.1109/ TIM.2006.884279 (Pubitemid 46438204)
37. Munakata, T. (2008). Fundamentals of the new artificial intelligence. Springer.
38. Ningler, M., Stockmanns, G., Schneider, G., Kochs, H. D., & Kochs, E. (2009). Adapted variable precision rough set approach for EEG analysis. Artificial Intelligence in Medicine, 47(3), 239-261. doi:10.1016/j. artmed.2009.07.004 PMID:19729288
39. Ohrn, A. (1999). Discernibility and rough sets in medicine: Tools and applications. Unpublished doctoral dissertation, Department of Computer and Information Science, Norwegian University of Science and Technology.
40. Pawlak, Z. (1982). Rough sets. International Journal of Computer and Information Science, (a seminal article), 11, 341-356.
41. Pawlak, Z. (1991). Rough sets. Theoretical aspects of reasoning about data. Kluwer.
42. Pawlak, Z., Grzymala-Busse, J., Slowinski, R., & Ziarko, W. (1995). Rough sets. Communications of the ACM, 38(11), 89-95. doi:10.1145/219717.219791
43. Peng, H., Long, F., & Ding, C. (2005). Feature selection based on mutual information criteria of max-dependency, max-relevance, and min redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(8), 1226-1238. doi:10.1109/ TPAMI.2005.159 PMID:16119262 (Pubitemid 41245053)
44. Peng, Y., Wu, Z., & Jiang, J. (2010). A novel feature selection approach for biomedical data classification. Journal of Biomedical Informatics, 43(1), 15-23. doi:10.1016/j.jbi.2009.07.008 PMID:19647098
45. Polkowski, L. (2003). Rough sets. Mathematical foundations. Physica-Verlag/A Springer-Verlag Company.
46. Rocchi, L., Chiari, L., & Cappello, A. (2004). Feature selection of stabilometric parameters based on principal component analysis. Medical & Biological Engineering & Computing, 42(1), 71-79. doi:10.1007/BF02351013 PMID:14977225 (Pubitemid 38196280)
47. Ronen, M., & Jacob, Z. (2006). Using simulated annealing to optimize feature selection problem in marketing applications. European Journal of Operational Research, 171(3), 842-858. doi:10.1016/j. ejor.2004.09.010
48. Ruiz, R., Riquelme, J. C., Aguilar-Ruiz, J. S., & Garcia-Torres, M. (2012). Fast feature selection aimed at high-dimensional data via hybrid-sequential-ranked searches. Expert Systems with Applications, 39(12), 11094-11102. doi:10.1016/j.eswa.2012.03.061
49. Suguna, N., & Thanushkodi, K. (2010). A novel set reduct algorithm for medical domain based on bee colony optimization. Journal Of Computing, 2(6), 49-54.
50. Swiniarski, R. , & Skowron, A. (2003). Rough set methods in feature selection and recognition. Pattern Recognition Letters, 24, 833-849. doi:10.1016/ S0167-8655(02)00196-4 (Pubitemid 35391801)
51. Swiniarski, R. W., Lim, H. J., Shin, Y. H., & Skowron, A. (2006). Independent component analysis, princpal component analysis and rough sets in hybrid mammogram classification. In Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition (IPCV '06), Las Vegas, NV (Vol. 2, pp. 640-645).
52. Tsai, C.-F. (2009). Feature selection in bankruptcy prediction. Knowledge-Based Systems, 22(2), 120-127. doi:10.1016/j.knosys.2008.08.002
53. Tsumoto, S. (2004). Mining diagnostic rules from clinical databases using rough sets and medical diagnostic model. Information Sciences, an International Journal, 162(2), 65-80.
54. Veenman, C., & Bolck, A. (2011). A sparse nearest mean classifier for high dimensional multi-class problems. Pattern Recognition Letters, 32(6), 854-859. doi:10.1016/j.patrec.2011.01.011
55. Vieira, S. M., Sousa, M. C., & Runkler, T. A. (2007). Ant colony optimization applied to feature selection in fuzzy classifiers. Lecture Notes in Computer Science, 4529, 778-788. doi:10.1007/978-3-540- 72950-1-76 (Pubitemid 350270032)
56. Wang, X., Yang, J., Teng, X., Xia, W., & Richard, J. (2007). Feature selection based on rough sets and particle swarm optimization. Pattern Recognition Letters, 28(4), 459-471. doi:10.1016/j. patrec.2006.09.003 (Pubitemid 44920436)
57. Wang, Y. Z. (2005). A GA-based methodology to determine an optimal curriculum for schools. Expert Systems with Applications, 28(1), 163-174. doi:10.1016/j.eswa.2004.08.015
58. Wu, C.-H., Kao, S.-C., Su, Y.-Y., & Wu, C.-C. (2005). Targeting customers via discovery knowledge for the insurance industry. Expert Systems with Applications. Expert Systems with Applications, 29(2), 291-299. doi:10.1016/j.eswa.2005.04.002 (Pubitemid 40970639)
59. Yang, J., & Honavar, V. (1998). Feature subset selection using a genetic algorithm. IEEE Intelligent Systems and their Applications, 13(2), 44-49.
60. Yu, L., & Liu, H. (2004). Efficient feature selection via analysis of relevance and redundancy. Journal of Machine Learning Research, 5, 1205-1224.
61. Zhang, Z., Shi, Y., & Gao, G. (2009). A rough set-based multiple criteria linear programming approach for the medical diagnosis and prognosis. Expert Systems with Applications, 36, 8932-8937. doi:10.1016/j.eswa.2008.11.007
62. Zhao, J., Lu, K., & He, X. (2008). Locality sensitive semi-supervised feature selection. Neurocomputing, 71(10-12), 1842-1849. doi:10.1016/j.neucom. 2007.06.014