A study of pattern recovery in recurrent correlation associative memories

IEEE Transactions on Neural Networks

Volumn 14, Issue 3, 2003, Pages 506-519

  Wilson, Richard C ^a   Hancock, Edwin R ^a  

^a UNIVERSITY OF YORK   (United Kingdom)

Author keywords

Associative memory; Error rates; Recurrent correlation associative memory (RCAM); Storage capacity

Indexed keywords

APPROXIMATION THEORY; ASSOCIATIVE STORAGE; BIT ERROR RATE; FUNCTIONS; ITERATIVE METHODS; MATHEMATICAL MODELS; PROBABILITY DISTRIBUTIONS; STORAGE ALLOCATION (COMPUTER);

BINOMIAL DISTRIBUTION; EXCITATION FUNCTION; FISHER DISCRIMINANT; GAUSSIAN APPROXIMATION; HAMMING DISTANCE; ITERATIVE UPDATE RULE; PATTERN RECOVERY; RECURRENT CORRELATION ASSOCIATIVE MEMORY;

RECURRENT NEURAL NETWORKS;

EID: 0038521297     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2003.811559     Document Type: Article

References (29)

1. K. Steinbuch, "Das lern matrix," Kybernetik, vol. 1, p. 36, 1961.
2. D. J. Willshaw, Nature, vol. 222, p. 960, 1969.
3. J. J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities," in Proc. Nat. Academy Science USA, vol. 79, 1982, pp. 2554-2558.
4. E. Gardner, "Structure of metastable states in the Hopfield model," J. Phys. A, vol. 19, no. 16, pp. 1047-1052, 1986.
5. T. D. Chiueh and R. M. Goodman, "Recurrent correlation associative memories," IEEE Trans. Neural Networks, vol. 2, pp. 275-284, Mar. 1991.
6. ____, "VLSI implementation of a high-capacity neural network associative memory," in Advances in Neural Information Processing Systems 2, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann, 1990, pp. 793-800.
7. C. C. Wang and H. S. Don, "An analysis of high-capacity discrete exponential BAM," IEEE Trans. Neural Networks, vol. 6, pp. 492-496, Mar. 1995.
8. T. D. Chiueh and H. K. Tsai, "Multi-valued associative memories based on recurrent networks," IEEE Trans. Neural Networks, vol. 4, pp. 364-366, Mar. 1993.
9. P. Kanerva, Sparse Distributed Memory. Cambridge, MA: MIT Press, 1988.
10. D. Milun and D. Sher, "Improving sampled probability distributions for Markov random fields," Pattern Recognition Lett., vol. 14, pp. 781-788, 1993.
11. P. A. Chou, "The capacity of the Kanerva associative memory is exponential," in Neural Information Processing Systems, D. Z. Anderson, Ed. New York: AIP, 1988, pp. 184-191.
12. P. Whittle, "Artificial memories: Capacity, basis rate and inference," Neural Networks, vol. 10, pp. 1619-1626, 1997.
13. C. C. Wang, S. M. Hwang, and J. P. Lee, "Capacity analysis of the asymptotically stable multi-valued exponential directional associative memory," IEEE Trans. Syst., Man, Cybern., vol. 26, pp. 733-743, June 1996.
14. Z. B. Xu, G. Q. Huy, and C. P. Kwong, "Asymmetric Hopfield-type networks; Theory and applications," Neural Networks, vol. 9, pp. 483-501, 1996.
15. Z. Y. Chen, C. P. Kwong, and Z. B. Xu, "Multiple valued feedback and recurrent correlation neural networks," Neural Comput. Applicat., vol. 3, pp. 242-250, 1995.
16. C. C. Wang and J. P. Lee, "The decision making properties of discrete multiple exponential bi-directional associative memories," IEEE Trans. Neural Networks, vol. 6, pp. 993-999, July 1995.
17. H. C. Shi, Y. X. Zhao, and X. H. Zhuang, "A general model for bidirectional associative memories," IEEE Trans. Syst., Man, Cybern. B, vol. 128, pp. 511-519, June 1998.
18. C. C. Wang, C. F. Tsai, and J. P. Lee, "Analysis of radix searching of exponential bidirectional associative memory," Proc. Inst. Elect. Eng. Comput. Digital Techniques, vol. 145, pp. 279-285, 1998.
19. C. C. Wang, "The majority theorem of centralized multiple BAM's networks," Inform. Sci., vol. 110, pp. 179-193, 1998.
20. E. R. Hancock and M. Pelillo, "The Bayesian interpretation of the exponential correlation associative memory," Pattern Recognition Lett., vol. 19, pp. 149-159, 1998.
21. E. R. Hancock and J. Kittler, "Discrete relaxation," Pattern Recognition, vol. 23, pp. 711-733, 1990.
22. C. Mazza, "On the storage capacity of nonlinear neural networks," Neural Networks, vol. 10, pp. 593-597, 1997.
23. R. J. Eleice, E. C. Posner, E. R. Rodemich, and S. S. Venkatesh, "The capacity of the Hopfield associative memory," IEEE Trans. Inform. Theory, vol. IT-33, pp. 461-482, Apr. 1987.
24. F. T. Sommer and P. Dayan, "Bayesian retrieval in associative memories with storage errors," IEEE Trans. Neural Networks, vol. 9, pp. 705-713, July 1998.
25. A. Jagota, G. Narasimhan, and K. W. Regan, "Information capacity of binary weights associative memories," Neurocomputing, vol. 19, pp. 35-58, 1998.
26. D. Burshtein, "Typical error pattern recovery of the Hopfield memory under error tolerant conditions," IEEE Trans. Inform. Theory, vol. 44, pp. 861-865, Apr. 1998.
27. D. Casasent and B. Telfer, "High-capacity pattern-recognition associative-processors," Neural Networks, vol. 5, no. 4, pp. 687-698, 1992.
28. M. Lowe, "On the storage capacity of the Hopfield model with biased patterns," IEEE Trans. Inform. Theory, vol. 45, pp. 314-318, Feb. 1999.
29. W. Feller, An Introduction to Probability Theory and Its Applications, 3rd ed. New York: Wiley, 1971, vol. 2, pp. 257-258.