High capacity, small world associative memory models

Connection Science

Volumn 18, Issue 3, 2006, Pages 247-264

  Davey, Neil ^a   Calcraft, Lee ^a   Adams, Rod ^a  

^a UNIVERSITY OF HERTFORDSHIRE   (United Kingdom)

Author keywords

Associative memory; Connectivity; Genetic algorithm; Small world

Indexed keywords

ASSOCIATIVE MEMORY; ASSOCIATIVE MEMORY MODELS; BIOLOGICAL NEURAL SYSTEMS; CONNECTIVITY; CONNECTIVITY GRAPH; FULL CONNECTIVITIES; PERCEPTRON LEARNING RULES; SMALL WORLDS;

ASSOCIATIVE STORAGE; GENETIC ALGORITHMS;

ASSOCIATIVE PROCESSING;

EID: 33748876829     PISSN: 09540091     EISSN: 13600494     Source Type: Journal    
DOI: 10.1080/09540090600639339     Document Type: Article

References (44)

1. R. Adams, L. Calcraft and N. Davey, "Evolving high capacity associative memories with efficient wiring," in International Joint Conference on Neural Networks, 2005.
2. D.J. Amit, Modeling Brain Function: The World of Attractor Neural Networks, Cambridge: Cambridge University Press, 1989.
3. D.J. Amit, H. Gutfreund and H. Sompolinsky, "Storing infinite numbers of patterns in a spin-glass model of neural networks", Phys. Rev. Lett., 55, pp. 1530-1533, 1985.
4. A. Anishchenko, E. Bienenstock and A. Treves, "Autoassociative memory retrieval and spontaneous activity bumps in small-world networks of integrate-and-fire neurons", Neural Comput., submitted 2005.
5. A. Barabasi, R. Albert and H. Leong, "Scale-free characteristics of random networks: the topology of the world wide web", Physica A, 272, pp. 173-187, 1999.
6. J. Bohland and A. Minai, "Efficient associative memory using small-world architecture", Neurocomputing, 38-40, pp. 489-496, 2001.
7. B. Bollobas, Random Graphs, Cambridge: Cambridge University Press, 2001.
8. V. Braitenberg and A. Schüz, Cortex: Statistics and Geometry of Neuronal Connectivity, Berlin: Springer, 1998.
9. L. Calcraft, "Measuring the performance of associative memories". Report No. 420, University of Hertfordshire (2005).
10. Z. Chengxiang, C. Dasgupta and M.P. Singh, "Retrieval properties of a Hopfield model with random asymmetric interactions", Neural Comput., 12, pp. 865-880, 2000.
11. C. Cherniak, "Component placement optimization in the brain", J. Neurosci., 14, pp. 2418-2427, 1994.
12. C. Cherniak, Z. Mokhtarzada, R. Rodriguez-Esteban and K. Changizi, "Global optimization of cerebral cortex layout", PNAS, 101, pp. 1081-1086, 2004.
13. T.M. Cover, "Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition", IEEE Trans. Election. Comput., EC-14, pp. 326-334, 1965.
14. N. Davey and R. Adams, "High capacity associative memories and connection constraints", Connection Sci., 16, pp. 47-66, 2004.
15. N. Davey, S.P. Hunt and R.G. Adams, "High capacity recurrent associative memories", Neurocomputing, 62, pp. 459-491, 2004.
16. W. de Nooy, A. Mrvar and V. Batagelj, "Exploratory social network analysis with Pajek", in Structural Analysis in the Social Sciences, Cambridge: Cambridge University Press, 2005.
17. V.M. Eguiluz, D.R. Chialvo, G. A. Cecchi, M. Baliki and A.V. Apkarian, "Scale-free brain functional networks", Phys. Rev. Lett., 94, 018102, 2005.
18. P. Floréan and P. Orponen, "Attraction radii in binary Hopfield nets are hard to compute", Neural Comput., 5, pp. 812-821, 1993.
19. E. Gardner, "The space of interactions in neural network models", J. Phys. A, 21, pp. 257-270, 1988.
20. D.O. Gorodnichy, "The optimal value of self-connection", in International Joint Conference on Neuml Networks, 1999.
21. J. Hertz, A. Krogh and R.G. Palmer, Introduction to the Theory of Neural Computation, Redwood City, CA: Addison-Wesley, 1991.
22. C. Hilgetag and M. Kaiser, "Clustered organization of cortical connectivity", Neuminfoimatics, 2, pp. 353-360, 2004.
23. J.J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities", in Proc. Natl Acad. Sci. USA, 79, pp. 2554-2558, 1982.
24. I. Kanter and H. Sompolinsky, "Associative recall of memory without errors", Phys. Rev. A, 35, pp. 380-392, 1987.
25. E.F. Keller, "Revisiting 'scale-free' networks", BioEssays, 27, pp. 1060-1068, 2005.
26. T.B. Kepler and L.F. Abbott, "Domains of attraction in neural networks", J. Phys. Ft:, 49, pp. 1657-1662, 1988.
27. B.J. Kim, "Performance of networks of artificial neurons: the role of clustering", Phys. Rev. E, 69, 045101, 2004.
28. J. Komlos and R. Paturi, "Effect of connectivity in an associative memory model", J. Comput. Syst. Sci., 47, pp. 350-373, 1993.
29. R. A. Kosinski and M.M. Sinolecka, "Memory properties of artificial neural networks with different types of dilutions and damages", Acta Phys. Polon. B, 30, pp. 2589-2594, 1999.
30. S.B. Laughlin and T.J. Sejnowski, "Communication in neuronal networks", Science, 301, pp. 1870-1874, 2003.
31. P. McGraw and M. Menzinger, "Topology and computational performance of attractor neural networks", Phys. Rev. E, 68, 047102, 2003.
32. S. Milgram, "The small world problem", Psychol. Today, 2, pp. 60-67, 1967.
33. L.G. Morrelli, G. Abramson and M.N. Kuperman, "Associative memory on a small-world neural network", Eur. Phys. J. B, 38, pp. 495-500, 2004.
34. G. Nardulli and G. Pasquariello, "Domains of attraction of neural networks at finite temperature", J. Phys. A, 24, p. 1103, 1991.
35. M.E.J. Newman, "Models of the small world", J. Statist. Phys., 101, p. 819, 2000.
36. A.J. Noest, "Domains in neural networks with restricted-range interactions", Phys. Rev. Lett., 63, pp. 1739-1742, 1989.
37. I. Perez Castillo, B. Wemmenhove, J.P.L. Hatchett, A.C.C. Coolen, N.S. Skantzos and T. Nikoletopoulos, "Analytic solution of attractor neural networks on scale-free graphs", J. Phys. A, 37, p. 8789-8799, 2004.
38. L. Personnaz, I. Guyon and G. Dreyfus, "Collective computational properties of neural networks: new learning mechanisms", Phys. Rev. A, 34, pp. 4217-4228, 1986.
39. O. Shefi, I. Golding, R. Segev, E. Ben-Jacob and A. Ayali, "Morphological characterization of in vitro neuronal networks", Phys. Rev. E, 66, 021905, 2002.
40. O. Sporns and J.D. Zwi, "The small world of the cerebral cortex", Neuroinformatics, 2, pp. 145-162, 2004.
41. D. Stauffer, A. Aharony, L. da Fontoura Costa and J. Adler, "Efficient Hopfield pattern recognition on a scale-free neural network", Eur. Phys. J. B, 32, pp. 395-399, 2003.
42. A. Storkey and R. Valabregue, "The basins of attraction of a new Hopfield learning rule", Neural Net., 12, pp. 869-876, 1999.
43. J.J. Torres, M.A. Munoz, J. Marro and PL. Garrido, "Influence of topology on the performance of a neural network", Neurocomputing, 58-60, pp. 229-234, 2004.
44. D. Watts and S. Strogatz, "Collective dynamics of 'small-world' networks", Nature, 393, pp. 440-442, 1998.