Clustering of stored memories in an attractor network with local competition

International Journal of Neural Systems

Volumn 16, Issue 6, 2006, Pages 393-403

  Johansson, Christopher ^a   Ekeberg, Örjan ^a   Lansner, Anders ^a  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

Attractor neural network; Hierarchical clustering; Hypercolumn; Local competition; Memory clustering

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; CLUSTER ANALYSIS; HUMAN; MEMORY; NERVE CELL NETWORK; PHYSIOLOGY;

CLUSTER ANALYSIS; HUMANS; MEMORY; MODELS, NEUROLOGICAL; NERVE NET; NEURAL NETWORKS (COMPUTER);

EID: 33846695887     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065706000809     Document Type: Article

References (37)

1. S. I. Amari, Neural theory of association and concept-formation, Biol. Cybern. 26 (1977) 175-185.
2. M. Cohen and S. Grossberg, Absolute stability of global pattern formation and parallel memory storage by competitive neural networks, IEEE Trans. Syst., Man, Cybern. 13 (1983) 815-826.
3. A. A. Frolov and I. P. Murav'ev, Informational characteristics of neural networks capable of associative learning based on Hebbian plasticity, Network: Comp. in Neur. Sys. 4(4) (1993) 495-536.
4. I. Kanter, Potts-glass models of neural networks, Phys. Rev. A 37(7) (1988) R2739-2742.
5. C. Peterson and B. Söderberg, A new method for mapping optimization problems onto neural networks, Int. J. Neural Systems 1(1) (1989) 3-22.
6. F. Waugh and R. Westervelt, Analog neural networks with local competition. II. Application to associative memory, Phys. Rev. E 47(6) (1993) 4537-4551.
7. F. Waugh and R. Westervelt, Analog neural networks with local competition. I. Dynamics and star bility, Phys. Rev. E 47(6) (1993) 4524-4536.
8. G. Johansson and A. Lansner, Imposing biological constraints onto an abstract neocortical attractor network model, Neural Computation, 2006 (in press).
9. C. Johansson, M. Renn and A. Lansner, Attractor neural networks with patchy connectivity, Neuro-computing 69(7-9) (2006) 627-633.
10. C. Johansson and A. Lansner, Towards cortex sized artificial neural systems, Neural Networks 2006 (in press).
11. C. Johansson and A. Lansner, Attractor memory with self-organizing input, in The Second International Workshop on Biologically Inspired Approaches to Advanced Information, Bio-ADIT 2006 (2006, Osaka, Japan): LNCS 3853, Springer-Verlag.
12. K. Toya, et al., Bistability of mixed states in a neural network storing hierarchical patterns, J. Phys. A: Math. Gen. 33(14) (2000) 2725-2737.
13. E. Ruppin and M. Usher, An attractor neural network model of semantic fact retrieval, Network: Comp. in Neur. Sys. 1 (1990) 325-344.
14. S. Bacci, G. Mato and N. Parga, The organization of metastable states in a neural network with hierarchical patterns, Int. J. Neural Systems 1(1) (1989) 69-76.
15. S. Bacci, G. Mato and N. Parga, Dynamics of a neural network with hierarchically stored patterns, J. Phys. A: Math. Gen. 23 (1990) 1801-1810.
16. V. S. Dotsenko, 'Ordered' spin glass: A hierarchical memory machine, J. Phys. C: Solid State Phys. 18(31) (1985) L1017.
17. H. Gutfreund, Neural networks with hierarchically correlated patterns, Phys. Rev. E 37(2) (1988) 570-577.
18. M. Mézard, et al., Nature of the spin-glass phase, Phys. Rev. E 52(13) (1984) 1156-1159.
19. M. V. Feigelman and L. B. Ioffe, The augmented models of associative, memory: asymmetric interaction and hierarchy of patterns, Int. J. Mod. Phys. B 1(1) (1987) 51-68.
20. M. Hirahara, N. Oka and T. Kindo, Associative memory with a sparse encoding mechanism for storing correlated patterns, Neural Networks 10(9) (1997) 1627-1636.
21. N. Parga and M. A. Virasoro, The ultrametric ogranization of memories in a neural network, J. Physique 47(11) (1986) 1857-1864.
22. D. Bolle, et al., Mean-field theory for the Q-state Potts-glass neural network with biased patterns, J. Phys. A: Math. Gen. 26(3) (1993) 549-562.
23. D. Bollé, P. Dupont and J. Huyghebaert, On the phase diagram of the Q-state Potts-glass neural network, Physica A 185 (1992) 363-368.
24. D. Bollé, P. Dupont and J. V. Mourik, Stability properties of Potts neural networks with biased patterns and low loading, Journal of Physics A 24(5) (1991) 1065-1081.
25. D. Bollé, P. Dupont and J. Huyghebaert, Thermodynamic properties of the Q-state Potts-glass neural network, Phys. Rev. E 45(6) (1992) 4194-4197.
26. D. Bollé, P. Dupont and B. Vinck, On the overlap dynamics of multi-state neural networks with a finite number of patterns, J. Phys. A: Math. Gen. 25(10) (1992) 2859-2872.
27. H Vogt and A. Zippelius, Invariant recognition in Potts glass neural networks, J. Phys. A: Math. Gen. 25(8) (1992) 2209-2226.
28. A. Sandberg and A. Lansner, Selective enhancement of recall through plasticity modulation in an autoassociative memory, Neurocomputing 38-40 (2001) 867-873.
29. A. Sandberg and A. Lansner, Synaptic depression as an intrinsic driver of reinstatement dynamics in an attractor network, Neurocomputing 44-46 (2002) 615-622.
30. A. Sandberg, et al., A palimpsest memory based on an incremental Bayesian learning rule, Neurocomputing 32-33 (2000) 987-994.
31. A. Sandberg, et al., A Bayesian attractor network with incremental learning, Network: Comp. in Neur. Sys. 13(2) (2002) 179-194.
32. A. Sandberg, J. Tegnér and A. Lansner, A working memory model based on fast learning, Network: Comp. in Neur. Sys. 14(4) (2003) 789-802.
33. J. Hertz, A. Krogh and R. G. Palmer, Introduction to the Theory of Neural Computation (1991, Addison-Wesely).
34. A. Lansner and Ö. Ekeberg, A one-layer feedback artificial neural network with a Bayesian learning rule, Int. J. Neural Systems 1(1) (1989) 77-87.
35. A. Lansner and A. Holst, A higher order Bayesian neural network with spiking units, Int. J. Neural Systems 7(2) (1996) 115-128.
36. R. Orre, et al., Bayesian neural networks with confidence estimations applied to data mining, Comp. Stat. and Data Analysis 34(8) (2000) 473-493.
37. A. K. Jain and R. C. Dubes, Algorithms for clustering data (Prentice Hall Advanced Reference Series. 1988, Englewood Cliffs, New Jersey, Prentice Hall).