Rules extraction from constructively trained neural networks based on genetic algorithms

Neurocomputing

Volumn 74, Issue 17, 2011, Pages 3180-3192

  Mohamed, Marghny H ^a  

^a Assiut University   (Egypt)

Author keywords

Comprehensible; Convergent; Data mining classification; Genetic algorithms; Learning; Neural networks; Rules

Indexed keywords

COMPREHENSIBLE; CONVERGENT; LEARNING; MINING CLASSIFICATION; RULES;

ABILITY TESTING; DATA MINING; GENETIC ALGORITHMS;

NEURAL NETWORKS;

ACCURACY; ARTICLE; ARTIFICIAL NEURAL NETWORK; CHROMOSOME ANALYSIS; CLUSTER ANALYSIS; COMPUTER SIMULATION; CYTOARCHITECTURE; DATA EXTRACTION; GENETIC ALGORITHM; HUMAN; INTERMETHOD COMPARISON; LEARNING; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; NONLINEAR SYSTEM; OUTCOME VARIABLE; PREDICTION; PREDICTIVE VALUE; PRIORITY JOURNAL; PROCESS OPTIMIZATION; SYSTEMATIC ERROR; VALIDATION PROCESS;

EID: 80052945108     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.04.009     Document Type: Article

References (54)

1. Giles C.J., Chen D., Sun G., Chen H., Lee Y., Goudreau M.W. Constructive learning of recurrent neural networks: limitations of recurrent cascade correlation and a simple solution. IEEE Transactions on Neural Networks 1995, 6(1):829-836.
2. R. Parekh, J. Yang, V. Honavar, Constructive Neural Networks Learning Algorithms for Multi-category Pattern Classification, Technical Report TR95-15, Technical Report ISU-CS-TR97-06, vol. 3, AI Research Group, Department of Computer Science, Iowa State University, 1997, pp. 1924-1929.
3. Littmann E., Ritter H. Learning and generalization in cascade network architectures. Neural Computation 1996, 7(8):1521-1539.
4. Prechelt L. Investigation of the casCor family of learning algorithms. Neural Networks 1997, 5(10):885-896.
5. Smieja F.J. Neural network constructive algorithms: trading generalization for learning efficiency. Circuits, Systems and Signal Processing 1993, 2(12):331-374.
6. Goldberg D.E. Genetic Algorithm in Search, Optimization, and Machine Learning 2002, Addison-Wesley.
7. Mitchell M. An Introduction to Genetic Algorithms 2005, MIT Press.
8. Setiono R. Extracting M-of-N rules from trained neural networks. IEEE Transactions on Neural Networks 2000, 2(11):512-519.
9. Wotawa F., Wotawa G. Deriving qualitative rules from neural networks-a case study for Ozone forecasting. AI Communications 2001, 1(14):23-33.
10. A. Narayanan, E. Keedwell, D. Savic, Data Mining Neural Networks with Genetic Algorithms, 2008.
11. Goebel M., Gruenwald L. A survey of data mining and knowledge discovery software tools. SIGKDD Explorations 1999, 1(1):20-33.
12. Han J., Kamber M. Data Mining: Concepts and Techniques 2006, Morgan Kaufmann. second ed.
13. W. Craven, Extracting Comprehensible Models from Trained Neural Networks, Ph.D. Thesis, Department of Computer Sciences, University of Wisconsin-Madison, 1996.
14. Towell G., Shavlik J. The extraction of refined rules from knowledge-based neural networks. Machine Learning 1993, 1(13):71-101.
15. Andrews R., Diederich J., Tickle A. Survey and critique of techniques for extracting rules from trained artificial neural networks. Knowledge Based System 1995, 6(8):373-389.
16. J. Neumann, Classification and Evaluation of Algorithms for Rule Extraction from Artificial Neural Networks, Ph.D. summer project, University of Edingburgh, 1998.
17. A. Darbari, Rule Extraction from Trained ANN: A Survey, Technical Report, Department of Computer Science, Dresden University of Technology, Dresden, Germany, 2001.
18. Krishnan R., Sivakumar G., Bhattacharya P. A search technique for rule extraction from trained neural networks. Pattern Recognition Letters 1999, 3(20):273-280.
19. Tsukimoto H. Extracting rules from trained neural networks. IEEE Transactions on Neural Networks 2000, 2(11):377-389.
20. Setiono R. Extracting rules from neural networks by pruning and hidden-unit splitting. Neural Computation 1997, 1(9):205-225.
21. Setiono R., Leow W.K., Zurada J.M. Extraction of rules from artificial neural networks for nonlinear regression. IEEE Transactions on Neural Networks 2002, 3(13):564-577.
22. W. Craven, Extracting Comprehensible Models from Trained Neural Networks, Ph.D. Dissertation, University of Wisconsin, 1996.
23. Zhou Z.H., Jiang Y., Chen S.F. Extracting symbolic rules from trained neural network ensembles. AI Communications 2003, 1(16):3-15.
24. Markowska-Kaczmar U., Chumieja M. Discovering the mysteries of neural networks. International Journal of Hybrid Intelligent Systems 2004, 3,4(1):153-163.
25. U. Markowska-Kaczmar, The influence of parameters in evolutionary based rule extraction method from neural network, in: Proceedings of the Fifth International Conference on Intelligent Systems Design and Applications (ISDA 2005), 8-10 September, Wroclaw, Poland, IEEE Computer Society, 2005, pp. 106-111.
26. Markowska-Kaczmar U., Wnuk-Lipinski P. Rule Extraction from Neural Network by Genetic Algorithm with Pareto Optimization 2004, vol. 3070:450-455. Springer.
27. Elalfi I.E., Haque R., Elalami M.E. Extracting rules from trained neural network using GA for managing e-business. Applied Soft Computing 2004, 1(4):65-77.
28. R.T. Santos, J.C. Nievola, A.A. Freitas, Extracting comprehensible rules from neural network via genetic algorithms, in: Proceedings of the 2000 IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks, San Antonio, TX, USA, vol. 1, 2000, pp. 130-139.
29. A. Duygu Arbatli, H. Levent Aki, Rule extraction from trained neural networks using genetic algorithms, Nonlinear Analysis: Theory, Methods & Applications 3(30) (1997) 1639-1648.
30. Kwok T.-Y., Yeung D.-Y. Constructive algorithms for structure learning in feedforward neural networks for regression problems. IEEE Transactions on Neural Networks 1997, 3(8):630-645.
31. S.E. Fahlman, C. Lebiere, The Cascade-Correlation Learning Architecture, vol. 2, Morgan Kaufmann, 1990, pp. 524-532.
32. Kwok T.-Y., Yeung D.-Y. Objective functions for training new hidden units in constructive neural networks. IEEE Transactions on Neural Networks 1997, 5(8):1131-1148.
33. Ma L., Khorasani K. Input-Side training in constructive neural networks based on error scaling and pruning. Proceedings of the IJCNN, vol. VI 2000, 455-460.
34. L. Ma, K. Khorasani, A new strategy for adaptively constructing multilayer feedforward neural networks, Neurocomputing (51) (2003) 361-385.
35. Ma L., Khorasani K. New training strategies for constructive neural networks with application to regression problems. Neural Networks 2004, 4(17):589-609.
36. Potter M.A. A genetic cascade-correlation learning algorithm. International Workshop on Combinations of Genetic Algorithms and Neural Networks 1992, 123-133. IEEE Computer Society Press.
37. Salcedo-sanz S., Bousoo-calzn C. A hybrid neural-genetic algorithm for the frequency assignment problem in satellite communications. Applied Intelligence 2005, 3(22):207-217.
38. Branke J. Evolutionary algorithms for neural network design and training. Proceedings of the First Nordic Workshop on Genetic Algorithms and its Applications 1995, 145-163.
39. Hsieh J.C., Chang P.C., Chen S.H. Integration of genetic algorithm and neural network for financial early warning system: an example of Taiwanese Banking Industry. Proceedings of First International Conference on Innovative Computing Information and Control (I) 2006, 562-565.
40. Yao X. A review of evolutionary artificial neural networks. International Journal of Intelligent Systems 1996, 8(4):539-567.
41. Palmes P.P., Hayasaka T., Usui S. Mutation-based genetic neural network. IEEE Transactions on Neural Networks 2005, 3(16):587-600.
42. Reeves C.R., Rowe J.E. Genetic Algorithms-Principles and Perspectives, A Guide to GA Theory 2003, Kluwer Academic Publishers.
43. Andrews R., Diederich J., Tickle A.B. A survey and critique of techniques for extracting rules from trained artificial neural networks. Knowledge Based Systems 1995, 6(8):373-389.
44. A. Tickle, R. Andrews, M. Golea, J. Diederich, The truth is in there: directions and challenges in extracting rules from trained artificial neural networks, IEEE Transactions on Neural Networks (9) (1998) 1057-1068.
45. Setiono R. A penalty-function approach for pruning feedforward neural networks. Neural Computation 1997, 1(9):185-204.
46. I. Taha, J. Ghosh, Three techniques for extracting rules from feedforward networks, Intelligent Engineering Systems Through Artificial Neural Networks, vol. 6, 1996, pp. 5-10.
47. Liu H., Setiono R. Incremental feature selection. Journal of Applied Intelligence 1998, 3(9):217-230.
48. R. Santos, J.C. Nievola, A.A. Freitas, Extracting comprehensible rules from neural networks via genetic algorithms, in: Proceedings of the 2000 IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks (ECNN-2000), San Antonio, TX, USA, 2000.
49. Keedwell E., Narayanan A., Savic D. Creating rules from trained neural networks using genetic algorithms. International Journal of Computers, Systems and Signals (IJCSS) 2000, 1(1):30-42.
50. Bologna G. A model for single and multiple knowledge-based networks. Artificial Intelligence in Medicine 2003, 2(28):141-163.
51. J. Huysmans, B. Baesens, J. Vanthienen, Using Rule Extraction to Improve the Comprehensibility of Predictive Models, Technical Report KBI 0612, vol. 43, Katholieke Universiteit Leuven, Department of Decision Sciences and Information Management, Leuven, Belgium, 2006, pp. 1-55.
52. Cios K.J., William G. Uniqueness of medical data mining. Artificial Intelligence in Medicine 2002, 1(26):1-24.
53. S.B. Thrun, et al., The Monk's problems-A performance comparison of different learning algorithms, Department of Computer Science, Carnegie Mellon University, CMU-CS-91-197, 1991.
54. H.W. William, O.L. Mangasarian, Multisurface method of pattern separation for medical diagnosis applied to breast cytology, Proceedings of the National Academy of Sciences USA (87) (1990) 9193-9196.