A modular attractor associative memory with patchy connectivity and weight pruning

Network: Computation in Neural Systems

Volumn 24, Issue 4, 2013, Pages 129-150

  Meli, Cristina ^a   Lansner, Anders ^a,b  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^b STOCKHOLM UNIVERSITY   (Sweden)

Author keywords

Hebbian learning; Sparse coding; Storage capacity; Structural plasticity

Indexed keywords

ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; COMPUTER SIMULATION; CYTOLOGY; HUMAN; LEARNING; MEMORY; NEOCORTEX; NERVE CELL; PHYSIOLOGY;

ANIMALS; ASSOCIATION LEARNING; COMPUTER SIMULATION; HUMANS; MEMORY; MODELS, NEUROLOGICAL; NEOCORTEX; NEURAL NETWORKS (COMPUTER); NEURONS;

EID: 84888633087     PISSN: 0954898X     EISSN: 13616536     Source Type: Journal    
DOI: 10.3109/0954898X.2013.859323     Document Type: Article

References (48)

1. Amirikian B, Georgopoulos AP. 2003. Modular organization of directionally tuned cells in the motor cortex: Is there a short-range order?. Proc. Natl. Acad. Sci. 100:12474-12479.
2. Amit D. 1989. Modeling brain function: The world of attractor neural networks New York: Cambridge University Press.
3. Bailey CH, Kandel ER. 1993. Structural Changes Accompanying Memory Storage. Ann. Review of Physiology 55:397-426.
4. Binzegger T, Douglas RJ, Martin KAC. 2007. Stereotypical Bouton Clustering of Individual Neurons in Cat Primary Visual Cortex. Journal of Neuroscience 27(45):12242-12254.
5. Bosch H, Kurfess FJ. 1998. Information storage capacity of incompletely connected associative memories. Neural Networks 11(5):869-876.
6. Boyd J, Matsubara J. 1991. Intrinsic connections in cat visual cortex: a combined anterograde and retrograde tracing study. Brain Res. 560:207-215.
7. Buxhoeveden DP, Casanova MF. 2002. The minicolumn hypothesis in neuroscience. Brain 125(5):935-951.
8. Cheng K, Waggoner RA, Tanaka K. 2001. Human Ocular Dominance Columns as Revealed by High-Field Functional Magnetic Resonance Imaging. Neuron 32(2):359-374.
9. Compte A, Brunel N, Goldman-Rakic PS, Wang X-J. 2000. Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. Cerebral Cortex 10:910-923.
10. Cossart R, Aronov D, Yuste R. 2003. Attractor dynamics of network Up states in the neocortex. NATURE 423(6937):283-288.
11. Djurfeldt M, Lundqvist M, Johansson C, Rehn M, Ekeberg Ö and Lansner A. (2008) Brain-Scale simulation of the neocortex on the IBM Blue Gene/L supercomputer. IBM J. RES. & DEV. 52(1/2).
12. Fransén E, Lansner A. 1995. Low spiking rates in a population of mutually exciting pyramidal cells. Network: Computation in Neural Systems 6:271-288.
13. Fulvi Mari C. 2004. Extremely Dilute Modular Neuronal Networks: Neocortical Memory Retrieval Dynamics. J. Comp: NeuroSci. 17:57-59.
14. Fulvi Mari C, Treves A. 1998. Modeling neocortical areas with a modular neural network. BioSystems 48:47-55.
15. Gilbert CD, Wiesel TN. 1989. Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex. J. Neurosci. 9:2432-2442.
16. Hebb DO. 1949. The Organization of Behaviour New York: John Wiley.
17. Hopfield JJ. 1982. Neural networks and physical systems with emergent collective computational properties. PNAS 81:3088-3092.
18. Houzel JC, Milleret C, Innocenti G. 1994. Morphology of Callosal Axons Interconnecting Areas 17 and 18 of the Cat. European Journal of Neuroscience 6:898-917.
19. Hubel DH, Wiesel TN. 1977. Functional architecture of macaque monkey visual cortex. Proceedings of the Royal Society of London B 198:1-59.
20. Johansson C, Lansner A. 2006. On the Storage Capacity of an Abstract Cortical Model with Silent Hypercolumns. Tech Rep KTH, TRITA-NA-P0501.
21. Knoblauch A, Palm G, Sommer FT. 2010. Memory Capacities for Synaptic and Structural Plasticity. Neural Computation 22:289-341.
22. Lamprecht R, LeDoux J. 2004. Structural Plasticity and Memory. Nature Reviews Neuroscience 5:45-54.
23. Lansner A. 2009. Associative memory models: from the cell-assembly theory to biophysically detailed cortex simulations. TINS-673.
24. Lansner A, EkbergÖ. 1989. A one layer feedback artificial Neural network with bayesian Learning Rule. International Journal of Neural Systems 1(1):77-87.
25. Lansner A, Holst A. 1996. A higher order Bayesian neural network with spiking units. International Journal of Neural Systems 7(2):115-128.
26. Lennie P. 2003. The Cost of Cortical Computation. Current Biology 13(6):493-497.
27. Lundqvist M, Rehn M, Djurfeldt M, Lansner A. 2006. Attractor dynamics in a modular network model of neocortex. Network: Computation in Neural Systems 17(3):253-276.
28. Martin KA, Whitteridge D. 1984. Form, function and intracortical projections of spiny neurons in the striate visual cortex of the cat. J. Physiol. 353:463-504.
29. Mountcastle VB. 1997. The columnar organization of the cortex. Brain 120:701-722.
30. Muller D, Nikonenko I, Jourdain P, Alberi S. 2002. LTP, Memory and Structural Plasticity. Current Molecular Medicine 2(7):605-611.
31. Palm G. 1980. On Associative Memory. Biol. Cybernetics 36:19-31.
32. Palm G. 1981. Towards a theory of cell assemblies. Biol. Cybernetics 39(3):181-194.
33. Palm G. 1982. Neural Assemblies An alternative approach to artificial intelligence Berlin, Heidelberg, New York: Springer.
34. Palm G. 1988. On the asymptotic information storage capacity of neural networks. Neural Computers New York: Springer-Verlag. pp 271-280.
35. Palm G. 1991. Memory capacities of local rules for synaptic modification. A comparative review. Concepts in Neuroscience 2:97-128.
36. Palm G. 1992. On the Information Storage Capacity of Local Learning Rules. Neural Computation 4:703-711.
37. Palm G. 2013. Neural associative memories and sparse coding. Neural Networks 37:165-171.
38. Palm G, Sommer FT. 1992. Information capacity in recurrent McCulloch-Pitts networks with sparsely coded memory states. Network 3:177-186.
39. Rolls ET. 2008. Memory, attention and decision-making. A Unifying Computational Neuroscience Approach Oxford: Oxford University Press.
40. Rolls ET. 2012. Advantages of dilution in the connectivity of attractor networks in the brain. Biologically Inspired Cognitive Architectures 1:44-54.
41. Rolls ET, Treves A. 1998. Neural Networks and Brain Function New York: Oxford University Press.
42. Schwenker F, Sommer FT, Palm G. 1996. Iterative retrieval of Sparsely Coded Associative Memory Patterns. Neural Networks 9(3):445-455.
43. Shu Y, Hasenstaub A, Mccormick DA. 2003. Turning on and off recurrent balanced cortical activity. Nature 423(6937):288-293.
44. Treves A, Rolls ET. 1991. What determines the capacity of autoassociative memories in the brain? Network 2:371-397.
45. Tsunoda K, Yamane Y, Nishizaki M, Tanifuji M. 2001. Complex objects are represented in macaque inferotemporal cortex by the combination of feature columns. Nature NeuroSci. 4(8):832-838.
46. Voges N, Guijarro C, Aertsen A, Rotter S. 2009. Models of cortical networks with long-range patchy projections. J Comput Neurosci 28:137-154.
47. Waydo S, Kraskov A, Quiroga RQ, Fried I, Koch C. 2006. Sparse Representation in the Human Medial Temporal Lobe. Journal of Neuroscience 26(40):10232-10234.
48. Willshaw DJ, Buneman OP, Longuet-Higgins HC. 1969. Non-holographic associative memory. Nature 222:960-962.