Rule extraction: Using neural networks or for neural networks?

Journal of Computer Science and Technology

Volumn 19, Issue 2, 2004, Pages 249-253

  Zhou, Zhi Hua ^a  

^a NANJING UNIVERSITY   (China)

Author keywords

Accuracy; Fidelity; Machine learning; Neural network; Rule extraction

Indexed keywords

ALGORITHMS; FINITE AUTOMATA; KNOWLEDGE BASED SYSTEMS; LEARNING SYSTEMS; NEURAL NETWORKS;

FIDELITY ACCURACY DILEMMA; RULE EXTRACTION;

COMPUTATION THEORY;

EID: 1642327509     PISSN: 10009000     EISSN: None     Source Type: Journal    
DOI: 10.1007/BF02944803     Document Type: Article

References (34)

1. Andrews R, Diederich J, Tickle A B. Survey and critique of techniques for extracting rules from trained artificial neural networks. Knowledge-Based Systems, 1995, 8(6): 373-389.
2. Tickle A B, Andrews R, Golea M et al. The truth will come to light: Directions and challenges in extracting the knowledge embedded within trained artificial neural networks. IEEE Trans. Neural Networks, 1998, 9(6): 1057-1067.
3. Gallant S I. Connectionist expert systems. Communications of the ACM, 1988, 31(2): 152-169.
4. Fu L. Rule learning by searching on adapted nets. In Proc. the 9th National Conference on Artificial Intelligence, Anaheim, CA, 1991, pp.590-595.
5. Thrun S. Extracting rules from artificial neural networks with distributed representations. In Advances in Neural Information Processing Systems 7, Tesauro G, Touretzky D, Leen T (Eds.), Cambridge, MA, MIT Press, 1995, pp.505-512.
6. Craven M W, Shavlik J W. Extracting tree-structured representations of trained networks. In Advances in Neural Information Processing Systems 8, Touretzky D, Mozer M, Hasselmo M (Eds.), Cambridge, MA, MIT Press, 1996, pp.24-30.
7. Krishnan R. A systematic method for decompositional rule extraction from neural networks. In Proc. the NIPS'96 Workshop on Rule Extraction from Trained Artificial Neural Networks, Queensland, Australia, 1997, pp.38-45.
8. Setiono R. Extracting rules from neural networks by pruning and hidden-unit splitting. Neural Computation, 1997, 9(1): 205-225.
9. Zhou Z H, Chen S F, Chen Z Q. A statistics based approach for extracting priority rules from trained neural networks. In Proc. the IEEE-INNS-ENNS International Joint Conference on Neural Networks, Como, Italy, 2000, 3: 401-406.
10. Masuoka R, Watanabe N, Kawamura A et al. Neurofuzzy systems - Fuzzy inference using a structured neural network. In Proc. the International Conference on Fuzzy Logic and Neural Networks, Iizuka, Japan, 1990, pp.173-177.
11. Mitra S. Fuzzy MLP based expert system for medical diagnosis. Fuzzy Sets and Systems, 1994, 65(2-3): 285-296.
12. Castro J L, Mantas C J, Benitez J M. Interpretation of artificial neural networks by means of fuzzy rules. IEEE Trans. Neural Networks, 2002, 13(1): 101-116.
13. Giles C L, Miller C B, Chen D et al. Learning and extracting finite state automata with second-order recurrent neural networks. Neural Computation, 1992, 4(3): 393-405.
14. Omlin C W, Giles C L, Miller C B, Heuristics for the extraction of rules from discrete time recurrent neural networks. In Proc. the International Joint Conference on Neural Networks, Baltimore, MD, 1992, Vol.1, pp.33-38.
15. Giles C L, Omlin C W. Extraction, insertion, and refinement of symbolic rules in dynamically driven recurrent networks. Connection Science, 1993, 5(3-4): 307-328.
16. Saito K, Nakano R. Extracting regression rules from neural networks. Neural Networks, 2002, 15(10): 1279-1288.
17. Setiono R, Leow W K, Zurada J M. Extraction of rules from artificial neural networks for nonlinear regression. IEEE Trans. Neural Networks, 2002, 13(3): 564-577.
18. Tickle A B, Orlowski M, Diederich J. DEDEC: A methodology for extracting rule from trained artificial neural netwoks. In Proc. the AISB'96 Workshop on Rule Extraction from Trained Neural Networks, Brighton, UK, 1996, pp.90-102.
19. Craven M W, Shavlik J W. Using sampling and queries to extract rules from trained neural networks. In Proc. the 11th Int. Conf. Machine Learning, New Brunswick, NJ, 1994, pp.37-45.
20. Golea M. On the complexity of rule extraction from neural networks and network querying. In Proc. the AISB'96 Workshop on Rule Extraction from Trained Neural Networks, Brighton, UK, 1996, pp.51-59.
21. Roy A. On connectionism, rule extraction, and brain-like learning. IEEE Trans. Fuzzy Systems, 2000, 8(2): 222-227.
22. Duch W, Adamczak R, Grabczewski K. A new methodology of extraction, optimization and application of crisp and fuzzy logical rules. IEEE Trans. Neural Networks, 2001, 12(2): 277-306.
23. Zhou Z H, Jiang Y, Chen S F. Extracting symbolic rules from trained neural network ensembles. AI Communications, 2003, 16(1): 3-15.
24. Towell G, Shavlik, J. The extraction of refined rules from knowledge based neural networks. Machine Learning, 1993, 13(1): 71-101.
25. Fu L. Rule generation from neural networks. IEEE Trans. Systems, Man and Cybernetics, 1994, 24(8): 1114-1124.
26. Craven M W, Shavlik J W. Extracting comprehensible concept representations from trained neural networks. In Working Notes on the IJCAI'95 Workshop on Comprehensibility in Machine Learning, Montreal, Canada, 1995, pp.61-75.
27. Taha I A, Ghosh J. Symbolic interpretation of artificial neural networks. IEEE Trans. Knowledge and Data Engineering, 1999, 11(3): 448-463.
28. Setiono R. Extracting M-of-N rules from trained neural networks. IEEE Trans. Neural Networks, 2000, 11(2): 512-519.
29. Wolpert D H, Macready W G. No free lunch theorems for optimization. IEEE Trans. Evolutionary Computation, 1997, 1(1): 67-82.
30. Quinlan J R. Comparing connectionist and symbolic learning methods. In Computational Learning Theory and Natural Learning Systems, Rivest R L (Ed.), Vol.1, Cambridge, MA, MIT Press, 1994, pp.445-456.
31. Chalup S, Hayward R, Diederich J. Rule extraction from artificial neural networks trained on elementary number classification tasks. In Proc. the 9th Australian Conference on Neural Networks, Brisbane, Australia, 1998, pp.265-270.
32. Maire F. Rule-extraction by backpropagation of polyhedra. Neural Networks, 1999, 12(4-5): 717-725.
33. Bologna G. Rule extraction from a multi layer perceptron with staircase activation functions. In Proc. the IEEE-INNS-ENNS International Joint Conference on Neural Networks, Como, Italy, 2000, 3: 419-424.
34. Vahed A, Omlin C W. Rule extraction from recurrent neural networks using a symbolic machine learning algorithm. In Proc. the 6th International Conference on Neural Information Processing, Dunedin, New Zealand, 1999, pp.712-717.