Applying category theory to improve the performance of a neural architecture

Neurocomputing

Volumn 72, Issue 13-15, 2009, Pages 3158-3173

  Healy, Michael J ^a   Olinger, Richard D ^a   Young, Robert J ^a   Taylor, Shawn E ^a   Caudell, Thomas ^a   Larson, Kurt W ^b  

^a University of New Mexico   (United States)

^b SANDIA NATIONAL LABORATORIES   (United States)

Author keywords

ART 1; Category theory; Mathematical semantics; Multispectral imaging; Stack intervals

Indexed keywords

NEURAL NETWORKS; PRODUCT DESIGN; SEMANTICS;

ART 1; CATEGORY THEORY; MATHEMATICAL SEMANTICS; MULTISPECTRAL IMAGING; STACK INTERVALS;

NETWORK ARCHITECTURE;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CAMERA; CLASSIFICATION; EXPLANATORY VARIABLE; IMAGING SYSTEM; LEARNING ALGORITHM; MATHEMATICAL COMPUTING; PRIORITY JOURNAL; SYSTEMS THEORY; TELECOMMUNICATION;

EID: 79952741891     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2009.03.008     Document Type: Article

References (28)

1. R. Andrews, J. Diederich, A.B. Tickle, Survey and critique of techniques for extracting rules from trained artificial neural networks, Knowledge-Based Systems 8 (6) (1995) 373-389.
2. S. Bader, P. Hitzler, Dimensions of neural-symbolic integration-a structural survey, in: A., et al. (Eds.), We Will Show Them, vol. 1, 2005, pp. 167-194.
3. G. Bartfai, Hierarchical clustering with ART neural networks, in: Proceedings of the IEEE International Conference on Neural Networks, vol. II, IEEE, June 28-July 2, 1994.
4. A. Browne, R. Sun, Connectionist inference models, Neural Networks 14 (10) (2001) 1331-1355.
5. G.A. Carpenter, S. Grossberg, A massively parallel architecture for a self-organizing neural pattern recognition machine, Computer Vision, Graphics, and Image Processing 37 (1987) 54-115.
6. T.P. Caudell, Y. Xiao, M.J. Healy, eLoom and flatland: specification, simulation and visualization engines for the study of arbitrary hierarchical neural architectures, Neural Networks 16 (2003) 617-624.
7. M.W. Craven, J.W. Shavlik, Learning symbolic rules using artificial neural networks, in: Proceedings of the 10th International Machine Learning Conference, Amherst, MA, Morgan Kaufmann, San Mateo, CA, 1993.
8. R.L. Crole, Categories for Types, Cambridge University Press, Cambridge, 1993.
9. A.C. Ehresmann, J.-P. Vanbremeersch, Information processing and symmetry-breaking in memory evolutive systems, BioSystems 43 (1997) 25-40.
10. M. Georgiopoulos, G.L. Heileman, J. Huang, Properties of learning related to pattern diversity in ART1, Neural Networks 4 (1991) 751-757.
11. J.A. Goguen, R.M. Burstall, Institutions: abstract model theory for specification and programming, Journal of the Association for Computing Machinery 39 (1) (1992) 95-146.
12. H. Gust, K.U. Kühnberger, Learning symbolic inferences with neural networks, in: Proceedings of the XXVII Annual Conference of the Cognitive Science Society (CogSci2005), Cognitive Science Society, 2005.
13. M.J. Healy, A topological semantics for rule extraction with neural networks, Connection Science 11 (1) (1999) 91-113.
14. M.J. Healy, T.P. Caudell, Discrete stack interval representations and fuzzy ART1, in: Proceedings of the World Congress on Neural Networks, vol. II, Lawrence Erlbaum Associates, 1993.
15. M.J. Healy, T.P. Caudell, Acquiring rule sets as a product of learning in a logical neural architecture, IEEE Transactions on Neural Networks 8 (3) (1997) 461-474.
16. M.J. Healy, T.P. Caudell, A categorical semantic analysis of ART architectures, in: IJCNN'01: International Joint Conference on Neural Networks, vol. 1, IEEE, INNS, IEEE Press, Washington DC, 2001.
17. M.J. Healy, T.P. Caudell, Ontologies and worlds in category theory: implications for neural systems, Axiomathes 16 (1-2) (2006) 165-214.
18. M.J. Healy, R.D. Olinger, R.J. Young, T.P. Caudell, K.W. Larson, Modification of the ART-1 architecture based on category theoretic design principles, in: IJCNN 2005 Conference Proceedings: International Joint Conference on Neural Networks, IEEE, INNS, IEEE Press, Montreal, Quebec, Canada, (CD-ROM proceedings), 2005.
19. R. Jullig, Y.V. Srinivas, Diagrams for software synthesis, in: Proceedings of KBSE '93: The Eighth Knowledge-Based Software Engineering Conference, IEEE Computer Society Press, Silver Spring, MD, 1993.
20. N.K. Kasabov, Adaptable neuro production systems, Neurocomputing 13 (1996) 95-117.
21. F.W. Lawvere, S.H. Schanuel, Conceptual Mathematics: A First Introduction to Categories, Cambridge University Press, Cambridge, 1995.
22. S. Mac Lane, Categories for the Working Mathematician, Springer, Berlin, 1971.
23. J. Meseguer, General logics, in: H.D.E., et al (Ed.), Logic Colloquium '87, Science Publishers B.V., North-Holland, 1989.
24. B.C. Pierce, Basic Category Theory for Computer Scientists, MIT Press, Cambridge, MA, 1991.
25. R. Rosen, A relational theory of biological systems, Bulletin of Mathematical Biophysics 20 (1958) 245-260.
26. V. Stoltenberg-Hansen, I. Lindstroem, E.R. Griffor, Mathematical Theory of Domains, Cambridge University Press, Cambridge, 1994.
27. S. Vickers, Topology via Logic, Cambridge University Press, Cambridge, 1993.
28. K.E. Williamson, M.J. Healy, R.A. Barker, Industrial applications of software synthesis via category theory-case studies using Specware, Automated Software Engineering 8 (1) (2001) 7-30.