Associative Memories via Artificial Neural Networks

IEEE Control Systems Magazine

Volumn 10, Issue 3, 1990, Pages 6-17

  Michel, Anthony N ^a   Farrell, Jay A ^a  

^a UNIVERSITY OF NOTRE DAME   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CONTROL SYSTEMS, DISCRETE TIME; DATA STORAGE, DIGITAL--ASSOCIATIVE;

ASSOCIATIVE MEMORIES; NEURAL NETWORK MODELS;

SYSTEMS SCIENCE AND CYBERNETICS;

EID: 0025418943     PISSN: 02721708     EISSN: None     Source Type: Journal    
DOI: 10.1109/37.55118     Document Type: Article

References (40)

1. N. R. Franks, “Army Ants: A Collective Intelligence,” Amer. Scientist, vol. 77, no. 2, pp. 139–145, Mar./Apr. 1989.
2. G. E. Hinton and J. A. Anderson, Eds., Parallel Models of Associative Memory, New Jersey: Lawrence Erlbaum Assoc, 1981.
3. T. Kohonen, Self-Organization and Associative Memory, Berlin: Springer-Verlag, 1988 (2nd Ed.).
4. H. H. Chen et al., “High Order Correlation Model for Associative Memory,” in [34], pp. 86–99.
5. J. A. Farrell and A. N. Michel, “A Synthesis Procedure for Hopfield's Continuous-Time Associative Memory,” IEEE Trans. Circuits Syst. (to appear).
6. B. Gold, “Hopfield Model Applied to Vowel and Consonant Discrimination,” in [34], pp. 158–164.
7. J. J. Hopfield, “Neural Networks and Systems with Emergent Collective Computational Abilities,” Proc. Nat. Acad. Sci., U.S.A., vol. 79, pp. 2554–2558, Apr. 1982.
8. J. J. Hopfield, “Neurons with Graded Response Have Collective Computational Properties Like Those of Two-State Neurons,” Proc. Nat. Acad. Sci., U.S.A., vol. 81, pp. 3088–3092, May 1984.
9. J. J. Hopfield, D. I. Feinstein, and R. E. Palmer, “‘Unlearning’ Has a Stabilizing Effect in Collective Memories,” Nature, vol. 304, no. 5922, pp. 158–159, July 14, 1983.
10. J. H. Li, A. N. Michel, and W. Porod, “Qualitative Analysis and Synthesis of a Class of Neural Networks,” IEEE Trans. Circuits Syst., vol. 35, no. 8, pp. 976–986, Aug. 1988.
11. J. H. Li, A. N. Michel, and W. Porod, “Analysis and Synthesis of a Class of Neural Networks: Variable Structure Systems with Infinite Gains,” IEEE Trans. Circuits Syst., vol. 36, no. 5, pp. 713–731, May 1989.
12. J. H. Li, A. N. Michel, and W. Porod, “Analysis and Synthesis of a Class of Neural Networks: Linear Systems Operating on a Closed Hypercube,” IEEE Trans. Circuits Syst., vol. 36, no. 11, pp. 1405–1422, Nov. 1989.
13. W. A. Little, “The Existence of Persistent States in the Brain,” Math. Biosci., vol. 19, pp. 101–120, 1974.
14. W. A. Little and G. L. Shaw, “Analytic Study of the Memory Storage Capacity of aNeural Network,” Math. Biosci., vol. 39, pp. 281–290, 1978.
15. T. Maxwell et al., “Nonlinear Dynamics of Artificial Neural Systems,” in [34], pp. 299–304.
16. A. N. Michel, J. A. Farrell, and H. F. Sun, “Synthesis Techniques for Discrete Time Neural Network Models,” Proc. 1989 IEEE Conf. on Decision and Control, Tampa, FL, pp. 773–778, Dec. 1989.
17. L. Personnaz, I. Guyon, and G. Dreyfus, “Information Storage and Retrieval in Spin-Glass Like Neural Networks,” J. Phys. Lett., vol. 46, pp. L359-L365, Apr. 1985.
18. L. Personnaz, I. Guyon, and G. Dreyfus, “Collective Computational Properties of Neural Networks: New Learning Mechanism,” Phys. Rev. A, vol. 34, no. 5, pp. 4217–4228, Nov. 1986.
19. D. Psaltis and C. H. Park, “Nonlinear Discriminant Functions and Associative Memories,” in [34], pp. 370–375.
20. S. S. Venkatesh and D. Psaltis, “Information Storage and Retrieval in Two Associative Nets,” in [33].
21. Lj. T. Grujic, A. A. Martynyuk, and M. Ribbens-Pavella, Stability of Large-Scale Systems Under Structural and Singular Perturbations, Nauka Dumka, Kiev, 1984.
22. A. N. Michel and R. K. Miller, Qualitative Analysis of Large Scale Dynamical Systems, New York: Academic Press, 1977.
23. D. D. Siljak, Large Scale Dynamic Systems: Stability and Structure, Amsterdam: North-Holland, 1978.
24. R. K. Miller and A. N. Michel, Ordinary Differential Equations, New York: Academic Press, 1982.
25. L. O. Chua, “Cellular Neural Networks: Theory,” IEEE Trans. Circuits Syst., vol. 35, no. 10, pp. 1257–1272, Oct. 1988.
26. F. Rosenblatt, “Two Theorems of Statistical Separability in the Perception Mechanisation of Thought Processes,” Proc. Symp. Held at the National Physical Lab., vol. 1, HM Stationery Office, London, pp. 421–456, Nov. 1958.
27. F. R. Rosenblatt, Principles of Neurodynamics. New York: Spartan, 1961.
28. D. E. Rumelhart and K. L. McClelland, Parallel Distributed Processing, vol. 1, Cambridge, MA: MIT Press, 1986.
29. B. Widrow and R. Winter, “Neural Nets for Adaptive Filtering and Adaptive Pattern Recognition,” Computer, vol. 18, pp. 25–39, Mar. 1988.
30. W. S. McCullough and W. Pitts, “A Logical Calculus of the Ideas Immanent in Nervous Activity,” Bull. Math. Biophys., vol. 5, pp. 115–133, 1943.
31. G. A. Carpenter, M. A. Cohen, and S. Grossberg, “Computing with Neural Networks,” Science, vol. 235, pp. 1226–1227, 1987.
32. L. N. Cooper, F. Liberman, and E. Oja, “Theory for the Acquisition and Loss of Neuron Specificity in Visual Cortex,” Biolog. Cybern., vol. 33, pp. 9–28, 1979.
33. J. S. Denker, Ed., Neural Networks for Computing, AIP Conf. Proc., Santa Barbara, CA, Apr. 1985.
34. J. S. Denker, Ed., Neural Networks for Computing, AIP Conf. Proc. 151, Snowbird, UT, 1986.
35. D. O. Hebb, The Organization of Behavior, New York: Wiley, 1949.
36. D. W. Tank and J. J. Hopfield, “Simple ‘Neural’ Optimization Networks: An A/D Converter, Signal Decision Circuit, and a Linear Programming Circuit,” IEEE Trans. Circuits Syst., vol. 33, no. 5, pp. 533–541, May 1986.
37. A. Albert, Regression and the Moore-Pen-rose Pseudo-Inverse, New York: Academic Press, 1972.
38. M. Cohen and S. Grossberg, “Absolute Stability of Global Pattern Formation and Parallel Memory Storage by Competitive Neural Networks,” IEEE Trans. Syst., Man, Cybern., vol. 13, no. 5, pp. 815–816, Sept./Oct. 1983.
39. A. N. Michel, J. A. Farrell, and W. Porod, “Qualitative Theory of Neural Networks,” IEEE Trans. Circuits Syst., vol. 36, no. 2, pp. 229–243, Feb. 1989.
40. F. M. A. Salam and Y. Wang, “Some Properties of Dynamic Feedback Neural Nets,” Proc. 26th IEEE Conf. on Decision and Control, Austin, TX, pp. 337–342, Dec. 1988.