Rule Extraction: From Neural Architecture to Symbolic Representation

Connection Science

Volumn 7, Issue 1, 1995, Pages 3-27

  Carpenter, Gail A ^a   Tan, Ah Hwee ^a  

^a BOSTON UNIVERSITY   (United States)

Author keywords

confidence factor; Fuzzy ARTMAP rule; pruning

Indexed keywords

EID: 21844488118     PISSN: 09540091     EISSN: 13600494     Source Type: Journal    
DOI: 10.1080/09540099508915655     Document Type: Article

References (24)

1. Carpenter, G.A. & Grossberg, S. (1987) A massively parallel architecture for a self-organizing neural pattern recognition machine. Computer Vision, Graphics, and Image Processing, 37, 54–115.
2. Carpenter, G.A. & Grossberg, S. (Eds) (1991) Pattern Recognition by Self-Organizing Neural Networks, Cambridge, MA: MIT Press.
3. Carpenter, G.A. & Ross, W.D. (1993) ART-EMAP: a neural network architecture for object recognition by evidence accumulation. In World Congress on Neural Networks, Portland, OR, Vol. III Hillsdale, NJ: Lawrence Erlbaum Associates, pp. 649–656.
4. Carpenter, G.A. & Tan, A.H. (1993) Fuzzy ARTMAP, rule extraction and medical databases. In World Congress on Neural Networks, Portland, OR, Vol. I. Hillsdale, NJ: Lawrence Erlbaurn Associates, pp. 501–506.
5. Carpenter, G.A., Grossberg, S. & Reynolds, J.H. (1991a) ARTMAP: supervised real-time learning and classification by a self-organizing neural network. Neural Networks, 4, 565–588.
6. Carpenter, G.A., Grossberg, S. & Rosen, D.B. (1991b) Fuzzy ART: fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural Networks, 4, 759–771.
7. Carpenter, G.A., Grossberg, S., Markuzon, N., Reynolds, J.H. & Rosen, D.B. (1992) Fuzzy ARTMAP: a neural network architecture for incremental supervised learning of analog multidimensional maps. IEEE Transactions on Neural Networks, 3, 698–713.
8. Craven, M.W. & Shavlik, J.W. (1993) Learning symbolic rules using artificial neural networks. In Proceedings of the 10th International Machine Learning Conference, Amherst, MA. San Mateo, CA: Morgan Kaufmann, pp. 73–80.
9. Craven, M.W. & Shavlik, J.W. (1994) Understanding neural networks via rule extraction and pruning. In M.C. Mazer P. Smolensky, D.S. Touretzky, J.L. Elrnan & A.S. Weigend (Eds), Proceedings of the 1993 Connectionist Models Summer School. Hillsdale, NJ: Lawrence Erlbaum Associates, pp. 184–191.
10. Fu, L.M. (1992) A neural network model for learning rule-based systems. In Proceedings of the International joint Conference on Neural Networks, Baltimore, MD, Vol. I. Piscataway, NJ: IEEE Service Center, pp. 343–348.
11. Grossberg, S. (1973) Contour enhancement, short term memory, and constancies in reverberating neural networks. Studies in Applied Mathematics, 52, 217–257.
12. Hartigan, J.A. (1975) Clustering Algorithms. New York, NY: Wiley
13. Kosko, B. (1986) Fuzzy entropy and conditioning. Information Science, 40, 165–174.
14. Moore, B. (1989) ART 1 and pattern clustering. In Proceedings of the 1988 Connectionist Models Summer School, pp. 174–185.
15. Murphy, P.M. & Aha, D.W. (1992) UCI repository of machine learning databases [machine-readable data repository]. Irvine, CA: University of California, Department of Information and Computer Science.
16. Nowlan, S.J. & Hinton, G.E. (1992) Simplifying neural networks by soft weight-sharing. Neural Computation, 4, 473–493.
17. Quinlan, J.R. (1993) C4.5: Programs for Machine Learning, San Mateo, CA: Morgan Kaufmann.
18. Salzberg, S.L. (1990) Learning with Nested Generalized Exemplars. Hingham, MA: Kluwer Academic.
19. Schlimmer, J.S. (1987) Concept acquisition through representational adjustment. PhD thesis, Department of Information and Computer Science, University of California, Irvine.
20. Smith, J.W., Everhart, J.E., Dickson, W.C., Knowler, W.C. & Johannes, R.S. (1988) Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. In Proceedings of the Symposium on Computer Applications and Medical Care. IEEE Computer Society Press, pp. 261–265.
21. Tan, A.H. (1994) Synthesizing neural network and symbolic knowledge processing. PhD thesis, Department of Cognitive and Neural Systems, Boston University.
22. Towell, G.G. & Shavlik, J.W. (1992) Interpretation of artificial neural networks: mapping knowledge-based neural networks into rules. In J.E. Moody, S.J. Hanson & R.P. Lippmann (Eds), Advances in Neural Information Processing Systems 4. San Mateo, CA: Morgan Kaufmann, pp. 977–984.
23. Towell, G.G., Shavlik, J.W. & Noordewier, M.O. (1990) Refinement of approximately correct domain theories by knowledge-based neural networks. In Proceedings of the 8th National Conference on AI, Boston, MA. AAAI Press/The MIT Press, pp. 861–866.
24. Zadeh, L. (1965) Fuzzy sets. Information Control, 8, 338–353.