Differential Evolution for automatic rule extraction from medical databases

Applied Soft Computing Journal

Volumn 13, Issue 2, 2013, Pages 1265-1283

  Falco, Ivanoe De ^a  

^a CNR   (Italy)

Author keywords

Automatic rule extraction; Classification; Decision Support System; Differential Evolution; Medical diagnosis

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER AIDED DIAGNOSIS; DATABASE SYSTEMS; DECISION MAKING; DECISION SUPPORT SYSTEMS; DIAGNOSIS; EVOLUTIONARY ALGORITHMS; EXTRACTION; HYBRID SYSTEMS; MEDICAL COMPUTING; OPTIMIZATION;

AUTOMATIC CLASSIFICATION; AUTOMATIC RULE EXTRACTION; CLASSIFICATION ACCURACY; CLASSIFICATION TOOL; CROSS VALIDATION; DIFFERENTIAL EVOLUTION; EXPLICIT KNOWLEDGE; RULE-BASED CLASSIFICATION;

CLASSIFICATION (OF INFORMATION);

EID: 84881609308     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2012.10.022     Document Type: Article

References (79)

1. J.C. Wyatt, D.J. Spiegelhalter, Field trials of medical decision-aids: potential problems and solutions, in: Proceedings of the Annual Symposium on Computer Application in Medical Care, 1991, pp. 3-7.
2. L. Perreault, J. Metzger, A pragmatic framework for understanding clinical decision support, Journal of Healthcare Information Management 13 (2) (1999) 5-21.
3. J. Han, M. Kamber, Data Mining: Concept and Techniques, Morgan Kaufmann, San Francisco, CA/Berlin, 2001.
4. D.J. Hand, H. Mannila, P. Smyth, Principles of Data Mining, MIT Press, Cambridge, MA, 2001.
5. J.R. Koza, Genetic Programming: On Programming Computers by Means of Natural Selection and Genetics, MIT Press, Cambridge, MA, 1992.
6. M. Brameier, W. Banzhaf, A comparison of linear genetic programming and neural networks, IEEE Transactions on Evolutionary Computation 5 (1) (2001) 17-26. (Pubitemid 32330494)
7. C. Ferreira, Gene expression programming: a new adaptive algorithm for solving problems, Complex Systems 13 (2) (2001) 87-129.
8. R.C. Holte, Very simple classification rules perform well on most commonly used datasets, Machine Learning 11 (1993) 63-91.
9. E. Frank, I.H. Witten, Generating accurate rule sets without global optimization, in: Proceedings of the Fifteenth International Conference on Machine Learning, 1998, pp. 144-151.
10. P. Compton, R. Jansen, Knowledge in context: a strategy for expert system maintenance, in: Proceedings of AI'88, Springer-Verlag, 1988, pp. 292-306.
11. K. Price, R. Storn, Differential evolution: numerical optimization made easy, Dr. Dobb's Journal (1997) 18-24.
12. R. Storn, K. Price, Differential evolution - a simple and efficient heuristic for global optimization over continuous spaces, Journal of Global Optimization 11 (1997) 341-359. (Pubitemid 127502202)
13. S. Das, A. Konar, U. Chakraborty, A. Abraham, Differential evolution with a neighborhood-based mutation operator: a comparative study, IEEE Transactions on Evolutionary Computation 13 (3) (2009) 526-553.
14. K.V. Price, R.M. Storn, J.A. Lampinen, Differential Evolution - A Practical Approach to Global Optimization, Springer, Berlin, 2005.
15. H.A. Abbass, An evolutionary artificial neural networks approach for breast cancer diagnosis, Artificial Intelligence in Medicine 25 (3) (2002) 265-281. (Pubitemid 34586827)
16. J. Ilonen, J.-K. Kamarainen, J. Lampinen, Differential evolution training algorithm for feed forward neural networks, Neural Processing Letters 17 (1) (2003) 93-105.
17. N. Naveen, V. Ravi, C. Raghavendra Rao, Rule extraction from differential evolution trained radial basis function network using genetic algorithms, in: CASE'09 Proceedings of the Fifth Annual IEEE International Conference on Automation Science and Engineering, Piscataway, NJ, USA, IEEE Press, 2009, pp. 152-157.
18. N. Chauhan, V. Ravi, D.K. Chandra, Differential evolution trained wavelet neural networks: application to bankruptcy prediction in banks, Expert Systems with Application 36 (4) (2009) 7659-7665.
19. J.C. Fern?dez, C. Herv?-Martnez, F.J. Martnez-Estudillo, P.A. Guti?rez, M. Cruz-Ramrez, Memetic pareto differential evolution for designing artificial neural networks in multiclassification problems using cross-entropy versus sensitivity, in: Proceedings of the 4th International Conference on Hybrid Artificial Intelligence Systems in Lecture Notes in Artificial Intelligence, Springer, 2009, pp. 433-441.
20. L. Ozbakir, A. Baykasoǧlu, S. Kulluka, A soft computing-based approach for integrated training and rule extraction from artificial neural networks: DIFACONN-miner, Applied Soft Computing 10 (1) (2010) 304-317.
21. A. Baykasoglu, L. Ozbakir, S. Kulluk, Classifying defect factors in fabric production via DIFACONN-miner: a case study, Expert Systems with Applications 38 (9) (2011) 11321-11328.
22. M. Cruz-Ramíez, C. Hervá-Martínez, P.A. Gutiérez, M. de la Mata, Memetic pareto differential evolutionary neural network for donor-recipient matching in liver transplantation, in: International Work Conference on Artificial Neural Networks (IWANN2011) in Lecture Notes in Computer Science, Springer, 2011, pp. 129-136.
23. B. O'hora, J. Perera, A. Brabazon, Designing radial basis function networks for classification using differential evolution, International Joint Conference on Neural Networks - IJCNN (2006) 2932-2937. (Pubitemid 351369711)
24. J. Wu, Z. Cai, Attribute weighting via differential evolution algorithm for attribute weighted naive bayes (WNB), Journal of Computational Information Systems 7 (5) (2011) 1672-1679.
25. Z. Cai, H. Chengyu, Z. Kang, L. Yong, L. Xiaobo, Y. Chao, Differential evolution based band selection in hyperspectral data classification, in: Proceedings of ISICA 2010 in Lecture Notes in Computer Science, Springer, 2010, pp. 86-94.
26. R.A. Aliev, W. Pedrycz, B.G. Guirimov, R.R. Aliev, U. Ilhan, M. Babagil, S. Mammadli, Type-2 fuzzy neural networks with fuzzy clustering and differential evolution optimization, Information Sciences 181 (9) (2011) 1591-1608.
27. I. Triguero, S. Garca, F. Herrera, A preliminary study on the use of differential evolution for adjusting the position of examples in nearest neighbor classification, in: Proceedings of IEEE Congress on Evolutionary Computation (IEEE CEC 2010), IEEE Press, 2010, pp. 1-8.
28. I. Triguero, S. Garca, F. Herrera, Differential evolution for optimizing the positioning of prototypes in nearest neighbor classification, Pattern Recognition 44 (2011) 901-916.
29. M.G. Omran, A.P. Engelbrecht, A.A. Salman, Differential evolution methods for unsupervised image classification, in: Proceedings of the IEEE Congress on Evolutionary Computation - CEC, IEEE Press, 2005, pp. 966-973. (Pubitemid 41495956)
30. I. De Falco, A. Della Cioppa, E. Tarantino, Automatic classification of handsegmented image parts with differential evolution, in: Proceedings of EvoWorkshops 2006 in Lecture Notes in Computer Science, Springer, 2006, pp. 403-414.
31. U. Maulik, I. Saha, Automatic fuzzy clustering using modified differential evolution for image classification, IEEE Transactions on Geoscience and Remote Sensing 48 (9) (2010) 3503-3510.
32. P. Luukka, J. Lampinen, Differential evolution classifier in noisy settings and with interacting variables, Applied Soft Computing 11 (1) (2011) 891-899.
33. S. Das, A. Abraham, A. Konar, Automatic clustering using an improved differential evolution algorithm, IEEE Transactions on Systems, Man and Cybernetics Part A: Systems and Humans 38 (1) (2008) 218-237.
34. S. Das, P.N. Suganthan, Differential evolution: a survey of the state-of-the-art, IEEE Transactions on Evolutionary Computation 15 (1) (2011) 4-31.
35. F. Al-Obeidat, N. Belacel, J.A. Carretero, P. Mahanti, Differential evolution for learning the classification method PROAFTN, Knowledge-Based Systems 23 (5) (2010) 418-426.
36. A. AlSukker, R. Khushaba, A. Al-Ani, Optimizing the k-NN metric weights using differential evolution, in: Proceedings of the 2010 International Conference on Multimedia Computing and Information Technology (MCIT), IEEE Press, 2010, pp. 89-92.
37. B. Yu, X. He, Training radial basis function networks with differential evolution, in: 2006 IEEE International Conference on Granular Computing, IEEE Press, 2006, pp. 369-372.
38. L. Chen, Z. Cai, L. Chen, Q. Gu, A novel differential evolution-clustering hybrid resampling algorithm on imbalanced datasets, in: International Workshop on Knowledge Discovery and Data Mining, Los Alamitos, CA, USA, IEEE Press, 2010, pp. 81-85.
39. S. Paterlini, T. Krink, High performance clustering with differential evolution, in: CEC2004. Congress on Evolutionary Computation, vol. 2, IEEE Press, 2004, pp. 2004-2011.
40. M.G.H. Omran, A.P. Engelbrecht, Self-adaptive differential evolution methods for unsupervised image classification, in: 2006 IEEE Conference on Cybernetics and Intelligent Systems, IEEE Press, 2006, pp. 1-6.
41. U. Maulik, I. Saha, Modified differential evolution based fuzzy clustering for pixel classification in remote sensing imagery, Pattern Recognition 42 (9) (2009) 2135-2149.
42. D. Kundu, K. Suresh, S. Ghosh, S. Das, A. Abraham, Y. Badr, Automatic clustering using a synergy of genetic algorithm and multi-objective differential evolution, in: Hybrid Artificial Intelligence Systems in Lecture Notes in Computer Science, Springer, 2009, pp. 177-186.
43. I. De Falco, A. Della Cioppa, E. Tarantino, Discovering interesting classification rules with genetic programming, Applied Soft Computing 1 (4) (2002) 257-269.
44. V. Feoktistov, Differential evolution - in search of solutions Optimization and Its Applications, vol. 5, Springer, Berlin, 2006.
45. A. Frank, A. Asuncion, UCI Machine Learning Repository, http://archive.ics.uci.edu/ml, University of California, School of Information and Computer Science, Irvine, CA, 2010.
46. J. Alcal áFdez, A. Fernandez, J. Luengo, J. Derrac, S. Garca, L. Sáchez, F. Herrera, KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework, Journal of Multiple-Valued Logic and Soft Computing 17 (2-3) (2011) 255-287.
47. S.J. Haberman, Generalized residuals for log-linear models, in: Proceedings of the 9th International Biometrics Conference, 1976, pp. 104-122.
48. R.S. Forsyth, PC/BEAGLE User's Guide, May 1990.
49. J.W. Smith, J.E. Everhart, W.C. Dickson, W.C. Knowle, R.S. Johannes, Using the ADAP learning algorithm to forecast the onset of diabetes mellitus, in: Proceedings of the Symposium on Computer Applications and Medical Care, IEEE Computer Society Press, 1988, pp. 261-265.
50. L.A. Kurgan, K.J. Cios, R. Tadeusiewicz, M. Ogiela, L.S. Goodenday, Knowledge discovery approach to automated cardiac SPECT diagnosis, Artificial Intelligence in Medicine 23 (2) (2001) 149-169. (Pubitemid 32907282)
51. W.H. Wolberg, O.L. Mangasarian, Multisurface method of pattern separation for medical diagnosis applied to breast cytology, Proceedings of the National Academy of Sciences of the United States of America 87 (1990) 9193-9196. (Pubitemid 120030591)
52. J.R. Quinlan, Induction of decision trees, Machine Learning 1 (1986) 81-106.
53. G. Cestnik, I. Konenenko, I. Bratko, Assistant-86: a knowledge- elicitation tool for sophisticated users, in: I. Bratko, N. Lavrac (Eds.), Progress in Machine Learning, Sigma Press, Wilmslow, UK, 1987, pp. 31-45.
54. R. Detrano, A. Janosi, W. Steinbrunn, M. Pfisterer, J. Schmid, K. Sandhu, K. Guppy, S. Lee, V. Froelicher, International application of a new probability algorithm for the diagnosis of coronary artery disease, American Journal of Cardiology 64 (1989) 304-310. (Pubitemid 19187662)
55. D. Zaharie, Critical values for the control parameters of differential evolution algorithms, in: Proceedings of the 8th International Conference on Soft Computing MENDEL 2002, Brno, Czech Republic, 2002, pp. 62-67.
56. M.G.H. Omran, A. Salman, A.P. Engelbrecht, Self-adaptive differential evolution, in: Proc. Comput. Intell. Security in Lecture Notes in Artificial Intelligence, Springer, 2005, pp. 192-199. (Pubitemid 43775081)
57. J. Brest, S. Greiner, B. Bǒskovc, M. Mernik, V. Zumer, Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems, IEEE Transactions on Evolutionary Computation 10 (6) (2006) 646-657. (Pubitemid 46445554)
58. A.K. Qin, V.L. Huang, P.N. Suganthan, Differential evolution algorithm with strategy adaptation for global numerical optimization, IEEE Transactions on Evolutionary Computation 13 (2) (2009) 398-417.
59. J. Zhang, A.C. Sanderson, JADE: Adaptive differential evolution with optional external archive, IEEE Transactions on Evolutionary Computation 13 (5) (2009) 945-958.
60. J. Demsar, Statistical comparisons of classifiers over multiple data sets, Journal of Machine Learning Research 7 (2006) 1-30. (Pubitemid 43022939)
61. J. Derrac, S. Garci, D. Molina, F. Herrera, A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms, Swarm and Evolutionary Computation 1 (2011) 3-18.
62. S. Garca, A. Fernadez, J. Luengo, F. Herrera, Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power, Information Sciences 180 (2010) 2044-2064 (cited July 13, 2011) URL http://sci2s.ugr.es/ sicidm/
63. S. Garca, A. Fernadez, J. Luengo, F. Herrera, Statistical comparisons of classifiers over multiple data sets for all pairwise comparisons, Journal of Machine Learning Research 9 (2008) 2677-2694.
64. S. Garcia Lopez, Statistical inference in computational intelligence and data mining, http://sci2s.ugr.es/sicidm/, last checked october 11, 2011 (online) (June 2010) (cited October 11, 2011).
65. K. Doksum, K. Doksum, Robust procedures for some linear models with one observation per cell, Annals of Mathematical Statistics 38 (1967) 878-883.
66. M. Wineberg, F. Oppacher, The Underlying Similarity of Diversity Measures Used in Evolutionary Computation, vol. 2724 of Lecture Notes in Computer Science, Springer, Chicago, IL, USA, 2003.
67. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, I.H. Witten, The WEKA data mining software: an update, SIGKDD Explorations 11 (1) (2009) 10-18.
68. F. Jensen, An Introduction to Bayesian Networks, UCL Press/Springer- Verlag, New York, NY, 1996.
69. G.H. John, P. Langley, Estimating continuous distributions in Bayesian classifiers, in: Eleventh Conference on Uncertainty in Artificial Intelligence, San Mateo, CA, 1995, pp. 338-345.
70. D.E. Rumelhart, G.E. Hinton, R.J. Williams, Learning representation by backpropagation errors, Nature 323 (1986) 533-536.
71. M.H. Hassoun, Fundamentals of Artificial Neural Networks, MIT Press, Cambridge, MA, 1995.
72. J.G. Cleary, L.E. Trigg, K: an instance-based learner using an entropic distance measure, in: Proceedings of the 12th International Conference on Machine Learning, 1995, pp. 108-114.
73. D. Aha, D. Kibler, Instance-based learning algorithms, Machine Learning 6 (1991) 37-66. (Pubitemid 21727227)
74. Yoav Freund, E. Robert, Schapire, Experiments with a new boosting algorithm, in: Thirteenth International Conference on Machine Learning, San Francisco, CA, 1996, pp. 148-156.
75. L. Breiman, Bagging predictors, Machine Learning 24 (2) (1996) 123-140. (Pubitemid 126724382)
76. R. Quinlan, C4.5: Programs for Machine Learning, Morgan Kaufmann Publishers, San Mateo, CA, 1993.
77. R. Kohavi, Scaling up the accuracy of naive-Bayes classifiers: a decision tree hybrid, in: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, 1996.
78. I.N. Athanasiadis, V.G. Kaburlasos, P.A. Mitkas, V. Petridis, Applying machine learning techniques on air quality data for real-time decision support, in: Proceedings of the 1st Intl. NAISO Symposium on Information Technologies in Environmental Engineering (ITEE-2003), Gdansk, Poland, 2003.
79. G. Demiroz, A. Guvenir, Classification by voting feature intervals, in: Proceedings of ECML-97, 1997.