Rule extraction from trained adaptive neural networks using artificial immune systems

Expert Systems with Applications

Volumn 36, Issue 2 PART 1, 2009, Pages 1513-1522

  Kahramanli, Humar ^a   Allahverdi, Novruz ^a  

^a SELCUK UNIVERSITY   (Turkey)

Author keywords

Adaptive neural networks; Artificial immune systems; Backpropagation; Opt aiNET; Optimization; Rule extraction

Indexed keywords

BACKPROPAGATION; CHEMICAL ACTIVATION; DATA MINING; DISEASES; ELECTROCARDIOGRAPHY; EXTRACTION; IMMUNE SYSTEM; LEARNING SYSTEMS; OPTIMIZATION; PROBLEM SOLVING;

ADAPTIVE NEURAL NETWORK MODELS; ADAPTIVE NEURAL NETWORKS; ARTIFICIAL IMMUNE SYSTEM; DATA MINING APPLICATIONS; MACHINE LEARNING REPOSITORY; NEURON ACTIVATION FUNCTION; OPT-AINET; RULE EXTRACTION;

NEURAL NETWORKS;

EID: 56349096960     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2007.11.024     Document Type: Article

References (36)

1. Ada G.L., and Nossal G.J.V. The clonal selection theory. Scientific American 257 2 (1987) 50-57
2. Alexander J.A., and Mozer M.C. Template-based algorithm for connectionist rule extraction. In: Tesauro G., Touetzky D., and Leen T. (Eds). Advances in neural information processing systems Vol. 7 (1995), MIT Press, Cambridge, MA
3. Andrews R., Diederich J., and Tickle A.B. A survey and critique of techniques for extracting rules from trained artificial neural networks. Knowledge-Based Systems 8 (1996) 373-389
4. Bologna G. Is the worth generating rules from neural network ensembles?. Journal of Applied Logic 2 (2004) 325-348
5. de Attux, R. R., Duarte, L. T., Ferrari, R., Panazio, C. M., de Castro, L. N., Von Zuben, F. J., & Romano, J.M.T. (2005). MLP-based equalization and pre-distortion using an artificial immune network. Machine learning for signal processing, 2005. IEEE Workshop (pp. 177-182).
6. de Castro L.N., and Timmis J. Artificial immune systems: A new computational intelligence approach (2002), Springer, UK
7. Elalfi A.E., Haque R., and Elalami M.E. Extracting rules from trained neural network using GA for managing E-business. Applied Soft Computing 4 (2004)
8. Gallant S.I. Connection expert systems. Communications of the ACM 31 2 (1988) 152-169
9. Garcez A.S.D., Broda K., and Gabbay D.M. Symbolic knowledge extraction from trained neural networks: A sound approach. Applied Intelligence 125 (2001) 155-207
10. Hou T., Su C., and Chang H. Using neural networks and immune algorithms to find the optimal parameters for an IC wire bonding process. Expert System with Applications 34 (2008) 427-436
11. Hruschka E.R., and Ebecken N.F.F. Extracting rules from multilayer perceptrons in classification problems: A clustering-based approach. Neurocomputing 70 (2006) 384-397
12. http://www.fizyka.umk.pl/kmk/projects/datasets.html. Last accessed: 3 March 2007.
13. Huang S.H., and Xing H. Extract intelligeble and concise fuzzy rules from neural networks. Fuzzy Sets and Systems 132 (2002) 233-243
14. Jiang, Y., Zhou, Z., & Chen, Z. (2002). Rule learning based on neural network ensemble. In Proceedings of the international joint conference on neural networks (pp. 1416-1420). Honolulu.
15. Kalinli A., and Karaboga N. Artificial immune algorithm for IIR filter design. Engineering Applications of Artificial Intelligence 18 (2005) 919-929
16. Keedwell, E., Narayanan, A., & Savic, D. (2000a). Evolving rules from neural networks trained on continuous data. Evolutionary Computation. In Proceedings of the 2000 congress on evolutionary computation.
17. Keedwell E., Narayanan A., and Savic D. Creating rules from trained neural networks using genetic algorithms. International Journal of Computers Systeming Signals (IJCSS) 1 1 (2000) 30-42
18. Kumar A., Prakash A., Shankar R., and Tiwari M.K. Psycho-clonal algorithm based approach to solve continuous flow shop scheduling problem. Expert System with Applications 31 (2006) 504-514
19. Loo C.K. Accurate and reliable diagnosis and classification using probabilistic ensemble simplified fuzzy ARTMAP. IEEE Transactions on Knowledge and Data Engineering 17 11 (2005)
20. Lu H., Setiono R., and Liu H. Effective data mining using neural networks. IEEE Transactions on Knowledge and Data Engineering 8 6 (1996) 957-961
21. Mantas C.J., Puche J.M., and Mantas J.M. Extraction of similarity based fuzzy rules from artificial neural networks. International Journal of Approximate Reasoning 43 (2006) 202-221
22. Musilek P., Lau A., Reformat M., and Wyard-Scott L. Immune programming. Information Sciences 176 (2006) 972-1002
23. Newman, D. J., Hettich, S., Blake, C. L., & Merz, C. J. (1998). UCI Repository of machine learning databases. Irvine, CA: University of California, Department of Information and Computer Science. (. Last accessed: 12 January 2007).
24. Palade, V., Neagu, D. & Puscasu, G. (2000). Rule extraction from neural networks by interval propagation. In Proceedings of the fourth IEEE international conference on knowledge-based intelligent engineering systems (pp. 217-220). Brighton, UK.
25. Rumelhart D.E., and McClelland J.L. Parallel distributed computing: Exploration in the microstructure of cognition (1986), MIT Press, Cambridge, MA
26. Saad E.W., and Wunsch II D.C. Neural network explanation using inversion. Neural Networks 20 (2007) 78-93
27. Seredynski F., and Bouvry P. Anomaly detection in TCP/IP networks using immune systems paradigm. Computer Communications 30 (2007) 740-749
28. Sethi I., and Yoo J. Multi-valued logic mapping of neurons in feed-forward networks. Engineering Intelligent Systems 4 4 (1996) 153-243
29. Setiono R., and Leow K. FERNN: An algorithm for fast extraction of rules from neural networks. Applied Intelligence 12 1-2 (2000) 15-25
30. Setiono R., Leow W.K., and Zuarada J.M. Extraction of rules from artificial neural networks for nonlinear regression. IEEE Transactions on Neural Networks 13 3 (2002) 564-577
31. Snyders, S., & Omlin, C. (2001). Rule extraction from knowledge-based neural networks with adaptive inductive bias. In Proceedings of the eighth international conference on neural information processing (ICONIP) (Vol. 1, pp. 143-148).
32. Tickle A.B., Andrews R., Golea M., and Diederich J. Rule extraction from trained artificial neural networks. Neural Networks Analysis, Architectures and Applications (1997) 61-69
33. Timmis J., and Edmonds C. A comment on Opt-aiNET: An immune network algorithm for optimization. Genetic and evolutionary computation. In: Kalyanmoy D., et al. (Ed). Lecture notes in computer science Vol. 3102 (2004), Springer 308-317
34. Towell G.G., and Shavlik J. Extracting refined rules from knowledge-based neural networks. Machine Learning 13 (1993) 71-101
35. Xu, S., & Zhang, M. (2000). Justification of a neuron-adaptive activation function. In Proceedings of the IEEE-INNS-ENNS international joint conference on neural networks (Vol. 3, pp. 465-470).
36. Xu, S., & Zhang, M. (2005). Data mining - An adaptive neural network model for financial analysis. In Proceedings of the third international conference on information technology and applications.