Advantages of dilution in the connectivity of attractor networks in the brain

Biologically Inspired Cognitive Architectures

Volumn 1, Issue , 2012, Pages 44-54

  Rolls, Edmund T ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Attractor network; Competitive network; Cortical network; Diluted connectivity; Hippocampus; Memory capacity

Indexed keywords

ATTRACTOR NETWORKS; COMPETITIVE NETWORK; CORTICAL NETWORK; DILUTED CONNECTIVITY; HIPPOCAMPUS; MEMORY CAPACITY;

BRAIN; COMPUTER SIMULATION; NEURONS;

NEURAL NETWORKS;

EID: 84868279636     PISSN: 2212683X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.bica.2012.03.003     Document Type: Article

References (34)

1. Amit D.J. Modeling brain function. The world of attractor neural networks 1989, Cambridge University Press, Cambridge.
2. Amit D.J., Gutfreund H., Sompolinsky H. Statistical mechanics of neural networks near saturation. Annals of Physics (New York) 1987, 173:30-67.
3. Bovier A., Gayrard V. Rigorous bounds on the storage capacity of the dilute Hopfield model. Journal of Statistical Physics 1992, 69:597-627.
4. Carpenter G.A. Distributed learning, recognition and prediction by ART and ARTMAP neural networks. Neural Networks 1997, 10(8):1473-1494.
5. Deco G., Rolls E.T. Neurodynamics of biased competition and cooperation for attention: A model with spiking neurons. Journal of Neurophysiology 2005, 94:295-313.
6. Deco, G., Rolls, E.T., Albantakis, L. & Romo, R. (2012). Brain mechanisms for perceptual and reward-related decision-making. Progress in Neurobiology [Epub 2 February].
7. Desimone R., Duncan J. Neural mechanisms of selective visual attention. Annual Review of Neuroscience 1995, 18:193-222.
8. Franco L., Rolls E.T., Aggelopoulos N.C., Jerez J.M. Neuronal selectivity, population sparseness, and ergodicity in the inferior temporal visual cortex. Biological Cybernetics 2007, 96:547-560.
9. Grabenhorst F., Rolls E.T. Attentional modulation of affective vs sensory processing: Functional connectivity and a top down biased activation theory of selective attention. Journal of Neurophysiology 2010, 104:1649-1660.
10. Hertz J., Krogh A., Palmer R.G. Introduction to the theory of neural computation 1991, Addison Wesley, Wokingham, UK.
11. Hopfield J.J. Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. USA 1982, 79:2554-2558.
12. Kohonen T., Oja E., Lehtio P. Storage and processing of information in distributed memory systems. Parallel models of associative memory 1981, 105-113. Erlbaum, Hillsdale, NJ. G.E. Hinton, J.A. Anderson (Eds.).
13. McClelland J.L., McNaughton B.L., O'Reilly R.C. Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychological Review 1995, 102:419-457.
14. O'Kane D., Treves A. Why the simplest notion of neocortex as an autoassociative memory would not work. Network 1992, 3:379-384.
15. Perez Castillo I., Skantzos N.S. The Little-Hopfield model on a sparse random graph. Journal of Physics A: Mathematical and General 2004, 37:9087-9099.
16. Rolls E.T. Functions of neuronal networks in the hippocampus and neocortex in memory. Neural models of plasticity: Experimental and theoretical approaches 1989, 240-265. Academic Press, San Diego, CA. J.H. Byrne, W.O. Berry (Eds.).
17. Rolls E.T. A theory of hippocampal function in memory. Hippocampus 1996, 6:601-620.
18. Rolls E.T. Memory, attention, and decision-making. A Unifying Computational Neuroscience Approach 2008, Oxford University Press, Oxford.
19. Rolls E.T. A computational theory of episodic memory formation in the hippocampus. Behavioural Brain Research 2010, 215:180-196.
20. Rolls E.T., Deco G. The noisy brain: Stochastic dynamics as a principle of brain function 2010, Oxford University Press, Oxford.
21. Rolls E.T., Kesner R.P. A theory of hippocampal function, and tests of the theory. Progress in Neurobiology 2006, 79:1-48.
22. Rolls E.T., Stringer S.M. On the design of neural networks in the brain by genetic evolution. Progress in Neurobiology 2000, 61:557-579.
23. Rolls E.T., Tovee M.J. Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. Journal of Neurophysiology 1995, 73:713-726.
24. Rolls E.T., Treves A. Neural networks and brain function 1998, Oxford University Press, Oxford.
25. Rolls E.T., Treves A. The neuronal encoding of information in the brain. Progress in Neurobiology 2011, 95:448-490.
26. Rolls E.T., Webb T.J. Cortical attractor network dynamics with diluted connectivity. Brain Research 2012, 1434:212-225.
27. Rolls E.T., Treves A., Foster D., Perez-Vicente C. Simulation studies of the CA3 hippocampal subfield modelled as an attractor neural network. Neural Networks 1997, 10:1559-1569.
28. Rolls E.T., Stringer S.M., Elliot T. Entorhinal cortex grid cells can map to hippocampal place cells by competitive learning. Network: Computation in Neural Systems 2006, 17:447-465.
29. Treves A. Graded-response neurons and information encodings in autoassociative memories. Physical Review, A 1990, 42:2418-2430.
30. Treves A. Dilution and sparse coding in threshold-linear nets. Journal of Physics A: Mathematical and General 1991, 24(1):327-335.
31. Treves A., Rolls E.T. What determines the capacity of autoassociative memories in the brain?. Network 1991, 2:371-397.
32. Treves A., Rolls E.T. Computational constraints suggest the need for two distinct input systems to the hippocampal CA3 network. Hippocampus 1992, 2:189-199.
33. Treves A., Panzeri S., Rolls E.T., Booth M., Wakeman E.A. Firing rate distributions and efficiency of information transmission of inferior temporal cortex neurons to natural visual stimuli. Neural Computation 1999, 11:601-631.
34. Wang X.-J. Decision making in recurrent neuronal circuits. Neuron 2008, 60:215-234.