Extracting comprehensible rules from neural networks via genetic algorithms

Proceedings of the 1st IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks

Volumn , Issue , 2000, Pages 130-139

  Santos, R T ^a   Nievola, J C ^b   Freitas, A A ^b  

^a UNIVERSIDADE TECNOLÓGICA FEDERAL DO PARANÁ   (Brazil)

^b PONTIFICAL CATHOLIC UNIVERSITY OF PARANÁ   (Brazil)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; DECISION MAKING; GENETIC ALGORITHMS; NEURAL NETWORKS; TOPOLOGY;

HIGH-LEVEL RULES; HUMAN DECISION MAKING; KNOWLEDGE DISCOVERY IN DATABASE; NEURAL NETWORK TOPOLOGY; NOISY DATA; PUBLIC DOMAINS; RULE EXTRACTION ALGORITHMS;

EVOLUTIONARY ALGORITHMS;

EID: 84952764091     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ECNN.2000.886228     Document Type: Conference Paper

References (35)

1. R.J. Henery. Classification. In: D. Michie et al. (Eds.) Machine Learning, Neural and Statistical Classification. Ellis Horwood, 1994.
2. M. Bohanec and I. Bratko. Trading accuracy for simplicity in decision trees. Machine Learning 15, 223-250. 1994.
3. th Int. Joint Conf. on AI (IJCAI-91). Sidney, 1991.
4. L.A. Brewlow and D.W. Aha. Simplifying decision trees: a survey. The Knowledge Eng. Review 12(1), 1997, 1-40.
5. L. Fu. Neural Networks in computer intelligence. McGraw-Hill, 1994.
6. st Conf. on Very Large Databases. Zurich, 1995.
7. M. L. Vaughn. Interpretation and Knowledge discovery from a multilayer perceptron network: opening the black box. Neural Comput & Applic. 4, 72-82, 1996.
8. R. Andrews, J. Diederich, and A.B. Tickle. A Survey and Critique of Techniques for Extracting Rules from Trained Artificial Neural Networks. Site: http://157.225.15.98/Ken-pubs.html, Brisbane, Australia, 1998.
9. G.G. Towell, and J.W. Shavlik. The Extraction of Refined Rules from Knowledge-Based Neural Networks. Machine Learning, v. 31, n. 1, p. 71-101, 1993.
10. C. McMillan, M.C. Mozer, and P. Smolensky. The Connectionist Scientist Game: Rule Extraction and Refinement in a Neural Network. In: Proceedings of the Thirteenth Annual Conference of the Cognitive Science Society, Hillsdale, NJ, 1991.
11. th Australian Conference on Neural Networks, p. 9-12, Brisbane Queensland, 1994.
12. E. Pop, R. Hayward, and J. Diederich. RULENEG: Extracting Rules from a Trained ANN by Stepwise Negation. QUT NRC, 1994.
13. A.B. Tickle, M. Orlowski, and J. Diederich. DEDEC: Decision Detection by Rule Extraction from Neural Networks, QUT NRC, 1994.
14. Goldberg, D. E. Genetic algorithms in search, optimization and machine learning. Reading, MA: Addison Wesley, 1989.
15. Pan Z. & Kang L., Evolving Both the topology and weights of neural networks, Parallel Alogrithms and Applications, Vol. 9, pp. 299-307, 1996.
16. R. F. Albrecht, C. R. Regves, N. C. Steele, Representation and Evolution of Neural Networks., Procedings ICNNGA 93 - INNSBRUCK-Austria 1993. pp. 643-649.
17. J. W. Shavlik & D. W. Optiz, Using Genetic Search to Refine Knowledge-Based Neural Networks, 11° International Conference of Machine Learning-1994.
18. Y. Hayashi. A Neural Expert System Using Fuzzy Teaching Input. In: Proceedings of The IEEE International Conference on Fuzzy Systems, p. 485-491, San Diego, CA 1989.
19. Y. Hayashi and J.J. Buckley. Aproximation Between Fuzzy Expert Systems and Neural Networks. International Journal of Aproximate Reasoning, v. 10, n. 1, p. 63-73, 1994.
20. R. Matsuoka, N. Watanabe, A. Kawamura, Y. Owada, and K. Asakawa. Neurofuzzy Systems - Fuzzy Inference Using a Structured Neural Network. In: Proceedings of the International Conference on Fuzzy Logic and Neural Networks, p. 173-177, Lizuka, Japan, 1991.
21. H.R. Berenji. Refinement of Approximate Reasoning-based Controllers by Reinforcement Learning. In: Proceedings of the Eighth Machine Learning Workshop, p. 475-479, Evanston, IL, 1991.
22. S. Horikawa, T. Foruhashi, and Y. Uchikawa. On Fuzzy Modeling Using Fuzzy Neural Networks with the Back-Propagation Algorithm. IEEE Transactions on Neural Networks, v. 3, n. 5, p. 801-806, 1992.
23. L.M. Fu. Rule Learning by Searching on Adapted Nets. In: Proceeding of The International Conference on Artificial Intelligence, AAAI-91, p. 325-340, Anaheim, CA, 1991.
24. G.G. Towell, and J.W. Shavlik. Knowledge-based Artificial Neural Networks. Artificiail Intelligence, v. 69, n. 1, 1994.
25. K. Saito, and R. Nakano. Medical Diagnostic Expert System Based on PDP Model. In: Proceedings of the International Conference on Neural Networks, v. 1, p. 255-262, San Diego, CA, 1991.
26. S.B. Thrun. Extracting Probably Correct Rules from Artificial Neural Networks. Relatório Técnico IAI-TR-93-5, Institut für Informatik III, Universität Bonn, Germany, 1994.
27. M.W. Craven, and J.W. Shavlik. Extracting Tree-structured Representations of Trained Networks. Advances in Neural Information Processing Systems, v. 8, n. 1, 1996.
28. th International Conference on Expert Systems and Their Applications - AVIGNON'98, p. 317-328, Avignon, France, 1991.
29. Fayyad, V.M.et.al. From data mining to Knowledge Discovery: an overview. In:Gayyad, V.M.et.al. (Eds.) Advances in Knowledge Discovery and Data Mining, 1-34. AAAI/MIT, 1996.
30. D. Michie, D. J. Spiegelhalter and C. C. Taylor. Machine Learning, Neural and Statistical Classification. New York: Ellis Horwood, 1994.
31. D. Hand. Construction and assessment of classification rules. John Wiley & Sons, 1997
32. Zell, A., Mamier, G., Vogt, M., et al., SNNS - Stuttgart Neural Network Simulator - User Manual, Version 4.1, University of Stuttgart; 1995.
33. Braun, H., Ragg, T., ENZO - User Manual and Implementation Guide, Version 1.0, University of Karlsruhe; 1995.
34. R. Kohavi & M. Sahami. Error-based and entropy-based discretization of continuous features. Proc. 2nd Int. Conf. Knowledge Discovery & Data Mining, 114-119. AAAI Press, 1996.
35. J.R. Quinlan. C4.5: Programs for Machine Learning. Morgan Kaufmann, 1993.