Optimal matrix compression yields storage capacity 1 for binary Willshaw associative memory

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2714, Issue , 2003, Pages 325-332

  Knoblauch, Andreas ^a  

^a UNIVERSITY OF ULM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ASSOCIATIVE PROCESSING; BINS; MATRIX ALGEBRA; MEMORY ARCHITECTURE; NEURAL NETWORKS; OPTIMAL SYSTEMS;

ASSOCIATIVE MEMORY; ASYMPTOTIC CAPACITIES; MATRIX COMPRESSION; OPTIMAL COMPRESSION; OPTIMAL VALUES; PRACTICAL USE; STORAGE CAPACITY; WILLSHAW MODEL;

ASSOCIATIVE STORAGE;

EID: 21144438832     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-44989-2_39     Document Type: Article

References (17)

1. Bentz, H.J., Hagstroem, M., Palm, G.: Information storage and effective data retrieval in sparse matrices. Neural Networks 2 (1989) 289-293
2. Cover, T.M, Thomas, J.A.: Elements of information theory. Wiley, New York, 1991
3. Golomb, S.W.: Run-length encodings. IEEE Transactions on Information Theory 12 (1966) 399-401
4. Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. USA 79 (1982) 2554-2558
5. Hopfield, J.J., Tank, D.W.: Computing with neural circuits. Science 233 (1986) 625-633
6. Huffman, D.A.: A method for the construction of minimum redundancy codes. Proceedings of the Institute of Radio Engineers 40 (1952) 1098-1101
7. Knoblauch, A., Palm, G.: Pattern separation and synchronization in spiking associative memories and visual areas. Neural Networks 14 (2001) 763-780
8. Knoblauch, A., Palm, G.: Scene segmentation by spike synchronization in reciprocally connected visual areas. II. Global assemblies and synchronization on larger space and time scales. Biological Cybernetics 87 (2002) 168-184
9. Knoblauch, A., Sommer, F.T., Palm, G.: Willshaw associative memory and matrix compression. in preparation
10. Kosko, B.: Bidirectional associative memories. IEEE Transactions on Systems, Man, and Cybernetics 18 (1988) 49-60
11. Palm, G.: On associative memories. Biological Cybernetics 36 (1980) 19-31
12. Palm, G.: Memory capacities of local rules for synaptic modification. A comparative review. Concepts in Neuroscience 2 (1991) 97-128
13. Rachkovskij, D.A., Kussul, E.M.: Binding and normalization of binary sparse distributed representations by context-dependent thinning. Neural Computation 13 (2001) 411-452
14. Schwenker, F., Sommer, F.T., Palm, G.: Iterative retrieval of sparsely coded associative memory patterns. Neural Networks 9 (1996) 445-455
15. Sommer, F.T., Palm, G.: Improved bidirectional retrieval of sparse patterns stored by Hebbian learning. Neural Networks 12 (1999) 281-297
16. Steinbuch, K.: Die Lernmatrix. Kybernetik 1 (1961) 36-45
17. Willshaw, D.J., Buneman, O.P., Longuet-Higgins, H.C.: Non-holographic associative memory. Nature 222 (1969) 960-962