On the problem of spurious patterns in neural associative memory models

IEEE Transactions on Neural Networks

Volumn 8, Issue 6, 1997, Pages 1483-1491

  Athithan, Gopalasamy ^a   Dasgupta, Chandan ^b  

^a Defence Research and Development Organisation   (India)

^b INDIAN INSTITUTE OF SCIENCE   (India)

Author keywords

Associative memory; Asymmetric dilution; Basin of attraction; Learning rule; Neural network; Optimal learning; Self interaction; Spurious pattern

Indexed keywords

COMPUTER SIMULATION; LEARNING SYSTEMS; LINEAR PROGRAMMING; MATHEMATICAL MODELS; NEURAL NETWORKS;

HEBB LEARNING RULE; HOPFIELD ASSOCIATIVE NEURAL NETWORK;

ASSOCIATIVE STORAGE;

EID: 0031272558     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.641470     Document Type: Article

References (31)

1. J. J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities," in Proc. Nat. Academy Sci., vol. 79, 1982, pp. 2554-2559.
2. J. L. van Hemmen and R. Kuhn, "Collective phenomena in neural networks," in Models of Neural Networks, E. Domany, J. L. van Hemmen, and K. Shulten, Eds. Berlin: Springer-Verlag, 1991, pp. 1-105.
3. G. Venkataraman and G. Athithan, "Spin glass, the travelling salesman problem, neural networks, and all that," Pramana J. Phys., vol. 36, no. 1, pp. 1-77, 1991.
4. D. J. Amit, Modeling Brain Functions. Cambridge, U.K.: Cambridge Univ. Press, 1989.
5. D. O. Hebb, Organization of Behavior. New York: Wiley, 1949, p. 62.
6. W. Krauth and M. Mezard, "Learning algorithms with optimal stability in neural networks," J. Phys. A: Math. and Gen., vol. 20, pp. L745-L752, 1987.
7. M. Verleysen, B. Sirletti, A. Vandemeulebroecke, and P. G. A. Jespers, "A high-storage capacity content-addressable memory and its learning algorithm," IEEE Trans. Circuits Syst., vol. 36, p. 762, 1989.
8. G. Athithan, "A comparative study of two learning rules," Pramana J. Phys., vol. 45, no. 6, pp. 569-582, 1995.
9. E. Gardner, "The space of interactions in neural-network models," J. Phys. A: Math. and Gen., vol. 21, pp. 257-270, 1988.
10. G. Parisi, "Asymmetric neural networks and the process of learning," J. Phys. A: Math. and Gen., vol. 19, pp. L675-L680, 1986.
11. J. A. Hertz, G. Grinstein, and S. A. Solla, Heidelberg Colloquium on Glassy Dynamics, J. L. van Hemmen and I. Morgenstern, Eds. Berlin: Springer-Verlag, 1987, pp. 538-546.
12. A. Treves and D. J. Amit, J. Phys. A, vol. 21, pp. 3155-3169, 1988.
13. M. P. Singh, Z. Chengxiang, and C. Dasgupta, "Analytic study of the effects of synaptic asymmetry," Phys. Rev. E, vol. 52, pp. 5261-5272, 1995.
14. Z. Chengxiang, C. Dasgupta, and M. P. Singh, in preparation, 1996.
15. M. H. Hassoun and P. B. Watta, "Alternatives to energy function-based analysis of recurrent neural networks," in Computational Intelligence: A Dynamical System Perspective, M. Palaniswami et al., Eds. New York: IEEE Press, 1995, pp. 46-67.
16. F. Crick and G. Mitchison, Nature, vol. 304, pp. 111-114, 1983.
17. Y. Smetanin, "A Las Vegas method of region-of-attraction enlargement in neural networks," in Proc. 5th Int. Wkshp. Image Processing Computer Opt. (DIP-94), SPIE, vol. 2363, 1994, pp. 77-81.
18. D. J. Amit, H. Gutfreund, and H. Sompolinsky, "Statistical mechanics of neural networks near saturation," Ann. Phys., New York, vol. 173, pp. 30-67, 1987.
19. B. M. Forrest and D. J. Wallace, "Storage capacity of learning in Ising-spin neural networks," in Models of Neural Networks, E. Domany, J. L. van Hemmen, and K. Shulten, Eds. Berlin: Springer-Verlag, 1991, pp. 121-148.
20. J. Hertz, A. Krogh, and R. G. Palmer, Introduction to the Theory of Neural Computation. Reading, MA: Addison-Wesley, 1991, p. 40.
21. S. Bos, R. Kuhn, and J. L. van Hemmen, Z. Phys. B, Condens. Matter vol. 71, pp. 261-271, 1988.
22. M. V. Feigel'man and L. B. Ioffe, Int. J. Modern Phys. B, vol. 1, pp. 51-68, 1987.
23. C. R. Noback and R. J. Demarest, The Human Nervous System: Basic Principles of Neurobiology. New York: McGraw-Hill, 1975, p. 87.
24. D. Marr, "A theory of cerebellar cortex," J. Physiology, vol. 202, p. 437, 1969.
25. D. Bowsher, Introduction to the Anatomy and Physiology of the Nervous System, 4th ed. Oxford, U.K.: Blackwell, 1979, p. 31.
26. I. Guyon, L. Personnaz, J. P. Nadal, and G. Dreyfus, "Storage and retrieval of complex sequences in neural networks," Phys. Rev. A, vol. 38, p. 6365, 1988.
27. A. V. M. Herz, Z. Li, and J. L. van Hemmen, "Statistical mechanics of temporal association in neural networks with transmission delays," Phys. Rev. Lett., vol. 66, no. 10, p. 1370, 1991.
28. G. Athithan, "Neural-network models for spatio-temporal associative memory," Current Sci., vol. 68, no. 9, pp. 917-929, 1995.
29. G. Athithan, "Associative storage of complex sequences in recurrent neural networks," in Proc. IEEE Int. Conf. Neural Networks, vol. 4, 1995, pp. 1971-1976.
30. D. W. Tank and J. J. Hopfield, "Collective computation in neuron like circuits," Sci. Amer., pp. 62-70, Dec. 1987.
31. B. W. Lee and B. J. Sheu, "Modified Hopfield neural networks for retrieving the optimal solution," IEEE Trans. Neural Networks, vol. 2, p. 137, 1991.