Extracting rules for classification problems: AIS based approach

Expert Systems with Applications

Volumn 36, Issue 7, 2009, Pages 10494-10502

  Kahramanli, Humar ^a   Allahverdi, Novruz ^a  

^a SELCUK UNIVERSITY   (Turkey)

Author keywords

Artificial Immune Systems; Hybrid neural networks; Opt aiNET; Optimization; Rule extraction

Indexed keywords

ARTIFICIAL IMMUNE SYSTEMS; ARTIFICIAL NEURAL NETWORKS; CLASSIFICATION ACCURACIES; CLEVELAND; DATA MINING APPLICATIONS; DATA-SETS; EXTRACTING RULES; HEART DISEASE; HEPATITIS DATASET; HYBRID NEURAL NETWORKS; MACHINE LEARNING REPOSITORIES; OPT-AINET; RULE EXTRACTION; UNIVERSITY OF CALIFORNIA; WEB SITES;

BACKPROPAGATION; CARDIOLOGY; HYBRID SYSTEMS; IMMUNOLOGY; INFORMATION MANAGEMENT; LEARNING SYSTEMS; MINING; PROBLEM SOLVING;

NEURAL NETWORKS;

EID: 67349236666     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2009.01.029     Document Type: Article

References (47)

1. Alexander J.A., and Mozer M.C. Template-based algorithm for connectionist rule extraction. In: Tesauro G., Touetzky D., and Leen T. (Eds). Advances in neural information processing systems Vol. 7 (1995), MIT Press, Cambridge, MA
2. Andrews R., Diederich J., and Tickle A.B. A survey and critique of techniques for extracting rules from trained Artificial Neural Networks. Knowledge-Based Systems 8 (1996) 373-389
3. Baron (1994). Knowledge extraction from neural networks: A survey. In: Report No. 94-17, Laboratoire de l'Informatique du Paralle'lisme, Ecole Normale Supe'rieure de Lyon.
4. Campelo F., Guimarães F.G., Igarashi H., Ramírez J., and Noguchi S. A modified immune network algorithm for multimodal electromagnetic problems. IEEE Transactions on Magnetics 42 4 (2006)
5. Das S., and Mozer M. Dynamic on-line clustering and state extraction: An approach to symbolic learning. Neural Networks 11 1 (1998) 53-64
6. de Attux, R. R., Duarte, L. T., Ferrari, R., Panazio, C. M., de Castro, L. N., Von Zuben, F. J., et al. (2005). MLP-based equalization and pre-distortion using an artificial immune network. Machine learning for signal processing, 2005. IEEE workshop (pp. 177-182).
7. de Castro L.N., and Timmis J. Artificial immune systems: A new computational intelligence approach (2002), Springer, UK
8. Dorado, J., Rabunal, J. R., Rivero, D., Santos, A. & Pazos, A. (2002). Automatic recurrent ANN rule extraction with genetic programming. In: Proceedings of the 2002 international joint conference on neural networks (pp. 1552-1557).
9. Duch W., Adamczak R., and Grabczwski K. A new methodology of extraction, optimization and application of crisp and fuzzy logical rules. IEEE Transactions on Neural Networks 11 2 (2000) 1-31
10. Elalfi, A. E., Haque, R., & Elalami, M. E. (2004). Extracting rules from trained neural network using GA for managing E-business. Applied Soft Computing, 4.
11. Gallant S.I. Connection expert systems. Communications of the ACM 31 2 (1988) 152-169
12. Garcez A.S.D., Broda K., and Gabbay D.M. Symbolic knowledge extraction from trained neural networks: A sound approach. Applied Intelligence 125 (2001) 155-207
13. Hou T., Su C., and Chang H. Using neural networks and immune algorithms to find the optimal parameters for an IC wire bonding process. Expert System with Applications 34 (2008) 427-436
14. Hruschka E.R., and Ebecken N.F.F. Extracting rules from multilayer perceptrons in classification problems: A clustering-based approach. Neurocomputing 70 (2006) 384-397
15. . Last Accessed March 2008.
16. Huang S.H., and Xing H. Extract intelligible and concise fuzzy rules from neural networks. Fuzzy Sets and Systems 132 (2002) 233-243
17. Jiang, Y., Zhou, Z., & Chen, Z. (2002). Rule learning based on neural network ensemble. In Proceedings of the international joint conference on neural networks, Honolulu (pp. 1416-1420).
18. Kahramanli, H. (2008). Developing a classification and rule extraction systems using hybrid fuzzy neural network. PhD thesis. Selcuk University.
19. Kahramanli H., and Allahverdi N. Design of a hybrid system for the diabetes and heart diseases. Expert Systems with Applications 35 1-2 (2008) 82-89
20. Kalinli A., and Karaboga N. Artificial immune algorithm for IIR filter design. Engineering Applications of Artificial Intelligence 18 (2005) 919-929
21. Keedwell, E., Narayanan, A., & Savic, D. (2000a). Evolving rules from neural networks trained on continuous data. Evolutionary Computation. In Proceedings of the 2000 congress on evolutionary computation.
22. Keedwell E., Narayanan A., and Savic D. Creating rules from trained neural networks using genetic algorithms. International Journal of Computers Systeming Signals (IJCSS) 1 1 (2000) 30-42
23. Kumar A., Prakash A., Shankar R., and Tiwari M.K. Psychoclonal algorithm based approach to solve continuous flow shop scheduling problem. Expert System with Applications 31 (2006) 504-514
24. Loo C.K. Accurate and reliable diagnosis and classification using probabilistic ensemble simplified fuzzy ARTMAP. IEEE Transactions on Knowledge and Data Engineering 17 11 (2005)
25. Lu H., Setiono R., and Liu H. Effective data mining using neural networks. IEEE Transactions on Knowledge and Data Engineering 8 6 (1996) 957-961
26. Mantas C.J., Puche J.M., and Mantas J.M. Extraction of similarity based fuzzy rules from artificial neural networks. International Journal of Approximate Reasoning 43 (2006) 202-221
27. McMillan M.C., Mozer P., and Smolenski P. Rule induction through integrated symbolic and subsymbolic processing. In: Moody J.E., Hanson S.J., and Lippmann R.P. (Eds). Advances in Neural Processing Systems Vol. IV (1992), Morgan Kaufmann Publishers, Los Allos 969-976
28. Mohamadi H., Habibi J., Abadeh M.S., and Sadi H. Data mining with a simulated annealing based fuzzy classification system. Pattern Recognition 41 (2008) 1824-1833
29. Mukhopadhyay, S., Tang, C., Huang, J., Yu, M., & Palakal, M. (2002). A comparative study of genetic sequence classification algorithms, Neural Networks for Signal Processing. In Proceedings of the 2002 12th IEEE workshop on 4-6 September, (pp. 57-66).
30. Musilek P., Lau A., Reformat M., and Wyard-Scott L. Immune programming. Information Sciences 176 (2006) 972-1002
31. Narazaki, H., Shigaki, I., Watanabe, T., (1995). A method for extracting approximate rules from neural network. In Proceedings of the fourth IEEE international conference on fuzzy systems and second international fuzzy engineering symposium, Yokohama, Japan.
32. Newman, D. J., Hettich, S., Blake, C. L., & Merz, C. J., (1998). UCI Repository of machine learning databases. Irvine, CA: University of California, Department of Information and Computer Science. . (Last Accessed January 2007).
33. Odajima K., Hayashi Y., Tianxia G., and Setiono R. Greedy rule generation from discrete data and its use in neural network rule extraction. Neural Networks (2008) 10.1016/j.neunet.2008.01.003
34. Palade, V., Neagu, D., Puscasu, G. (2000). Rule extraction from neural networks by interval propagation. In Proceedings of the fourth IEEE international conference on knowledge-based intelligent engineering systems. Brighton, UK. (pp. 217-220).
35. Saad E.W., and Wunsch D.C.I. Neural network explanation using inversion. Neural Networks 20 (2007) 78-93
36. Seredynski F., and Bouvry P. Anomaly detection in TCP/IP networks using immune systems paradigm. Computer Communications 30 (2007) 740-749
37. Sethi I., and Yoo J. Multi-valued logic mapping of neurons in feedforward networks. Engineering Intelligent Systems 4 4 (1996) 153-243
38. Setiono R., and Leow K. FERNN: An algorithm for fast extraction of rules from neural networks. Applied Intelligence 12 1-2 (2000) 15-25
39. Setiono R., Leow W.K., and Zuarada J.M. Extraction of rules from artificial neural networks for nonlinear regression. IEEE Transactions on Neural Networks 13 3 (2002) 564-577
40. Simpson P. Fuzzy min-max neural networks. Part 1. Classification. IEEE Transactions on Neural Networks 3 (1992) 776-786
41. Snyders, S., Omlin, C. (2001). Rule extraction from knowledge-based neural networks with adaptive inductive bias. In Proceedings of the eighth international conference on neural information processing (ICONIP), (Vol. 1, pp. 143-148).
42. Tickle A.B., Andrews R., Golea M., and Diederich J. Rule extraction from trained artificial neural networks. Neural Networks Analysis, Architectures and Applications (1997) 61-69
43. Timmis J., and Edmonds C. A comment on Opt-aiNET: An immune network algorithm for optimization. In: Kalyanmoy D., et al. (Ed). Genetic and Evolutionary Computation. Lecture Notes in Computer Science Vol. 3102 (2004), Springer 308-317
44. Towell G.G., and Shavlik J. Extracting refined rules from knowledge-based neural networks. Machine Learning 13 (1993) 71-101
45. Wang S. Classification with incomplete survey data: A Hopfield neural network approach. Computers and Operations Research 32 (2005) 2583-1594
46. Weijters, T., Bosh, A. V. D., Herik, J. V. D. (1997). Intelligible neural networks with BP-SOM. In: Proceedings of the ninth dutch conference on artificial intelligence. (pp. 27-36).
47. Zheng H., Zhang J., and Nahavandi S. Learning to detect texture objects by artificial immune approaches. Future Generation Computer Systems 20 (2004) 1197-1208