Learning and forgetting in generalized brain-state-in-a-box (BSB) neural associative memories

Neural Networks

Volumn 9, Issue 5, 1996, Pages 845-854

  Zak, Stanislaw H ^a   Lillo, Walter E ^b   Hui, Stefen ^c  

^a PURDUE UNIVERSITY   (United States)

^b AEROSPACE CORPORATION   (United States)

^c SAN DIEGO STATE UNIVERSITY   (United States)

Author keywords

Associative memories; Brain state in a box (BSB) model; Forgetting; Generalized inverse matrices; Learning

Indexed keywords

ASSOCIATIVE STORAGE; ITERATIVE METHODS; LEARNING SYSTEMS; MATHEMATICAL MODELS; MATRIX ALGEBRA; PATTERN RECOGNITION; VECTORS;

BRAIN STATE IN A BOX MODEL; FORGETTING; GENERALIZED INVERSE MATRIX; NEURAL NETWORK ASSOCIATIVE MEMORY;

NEURAL NETWORKS;

ARTICLE; ASSOCIATIVE MEMORY; COMPUTER MODEL; LEARNING; PRIORITY JOURNAL;

EID: 0030198796     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/0893-6080(95)00101-8     Document Type: Article

References (25)

1. Anderson, J.A. (1993). The BSB model: A simple nonlinear autoassociative neural network. In M.H. Hassoun (Ed.), Associative neural memories; theory and implementation (Chapter 4, pp. 77-103). New York: Oxford University Press.
2. Anderson J.A., Silverstein J.W., Ritz S.A., & Jones, R.S. (1977). Distinctive features, categorical perception, probability learning: some applications of a neural model. In J.A. Anderson, & E. Rosenfeld (Eds.), Neurocomputing; foundations of research (chapter 22, pp. 283-325). The MIT Press Cambridge, MA: Reprint from Psychological Review 1977, 84, 413-451.
3. Anderson J.A., Silverstein J.W., Ritz S.A., & Jones, R.S. (1977). Distinctive features, categorical perception, probability learning: some applications of a neural model. In J.A. Anderson, & E. Rosenfeld (Eds.), Neurocomputing; foundations of research (chapter 22, pp. 283-325). The MIT Press Cambridge, MA: Reprint from Psychological Review 1977, 84, 413-451.
4. Boullion, T.L., & Odell, P.L. (1971). Generalized inverses matrices. New York: Wiley-Interscience.
5. Campbell, S.L., & Meyer, C.D. Jr (1991). Generalized inverses of linear transformations. New York: Dover.
6. Golden R.M. The "brain-state-in-a-box" neural model as a gradient descent algorithm. Journal of Mathematical Psychology. 30:1986;73-80.
7. Golden R.M. Stability and optimization analyses of the generalized brain-state-in-a-box neural network model. Journal of Mathematical Psychology. 37:1993;282-298.
8. Greenberg H.J. Equilibria of the brain-state-in-a-box (BSB) neural model. Neural Networks. 1:1988;323-324.
9. Grossberg S. Nonlinear Neural networks: Principles, mechanisms, and architectures. Neural Networks. 1:1988;17-61.
10. Hahn W. Über die Anwendung der Methode von Ljapunov auf Differenzengleichungen. Mathematische Annalen. 136:1958;430-441.
11. Hopfield J.J. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences USA, Biophysics. 79:1982;2554-2558.
12. Hopfield J.J. Neurons with graded response have collective computational properties like those of two-state neurons. Proceedings of the National Academy of Sciences USA, Biophysics. 81:1984;3088-3092.
13. Hui S., Żak S.H. Dynamical analysis of the brain-state-in-a-box (BSB) neural models. IEEE Transactions on Neural Networks. 3:1992;86-100.
14. Hui, S., Lillo, W.E., &Żak, S.H. (1993). Dynamics and stability of the brain-state-in-a-box (BSB) neural models. In M.H. Hassoun (Ed.), Associative neural memories; theory and implementation (chapter 11, pp. 212-224). New York: Oxford University Press.
15. LaSalle, J.P. (1986). The stability and control of discrete processes. New York: Springer-Verlag.
16. Li J.-H., Michel A.N., Porod W. Analysis and synthesis of a class of neural networks: Linear systems operating on a closed hypercube. IEEE Transactions on Circuits and Systems. 36:1989;1405-1422.
17. Lillo W.E., Hui S., Zak S.H. Neural networks for constrained optimization problems. International Journal of Circuit Theory and Applications. 21:1993;385-399.
18. Lillo W.E., Miller D.C., Hui S., Żak SH Synthesis of brain-state-in-a-box (BSB) based associative memories. IEEE Transactions on Neural Networks. 5:1994;730-737.
19. Michel A.N., Farrell J.A. Associative memories via artificial neural networks. IEEE Control Systems Magazine. 10:1990;6-17.
20. Michel A.N., Farrell J.A., Porod W. Qualitative analysis of neural networks. IEEE Transactions on Circuits and Systems. 36:1989;229-243.
21. Michel A.N., Farrell J.A., Sun H.-F. Analysis and synthesis technique for Hopfield type synchronous discrete time neural networks with application to associative memory. IEEE Transactions on Circuits and Systems. 37:1990;1356-1366.
22. Perfetti R. A neural network to design neural networks. IEEE Transactions on Circuits and Systems. 38:1991;1099-1103.
23. Personnaz L., Guyon I., Dreyfus G. Information storage and retrieval in spin-glass like neural networks. Le Journal de Physique-Letters. 46:1985;L359-L365.
24. Personnaz L., Guyon I., Dreyfus G. Collective computational properties of neural networks: New learning mechanisms. Physical Review A. 34:1986;4217-4228.
25. Yen G., Michel A.N. A learning and forgetting algorithm in associative memories: Results involving pseudoinverses. IEEE Transactions on Circuits and Systems. 38:1991;1193-1205.