Optimal learning rules for discrete synapses

PLoS Computational Biology

Volumn 4, Issue 11, 2008, Pages

  Barrett, Adam B ^a   Van Rossum, M C W ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BIOLOGICAL SYNAPSE; CRITICAL NUMBERS; LEARNING CAPACITY; LEARNING RULES; LOW-STORAGE; MEMORY STORAGE; SHANNON INFORMATION; STORAGE CAPACITY;

ARTIFICIAL INTELLIGENCE;

ARTICLE; COMPUTER MODEL; COMPUTER SIMULATION; LEARNING; MEMORY CONSOLIDATION; NERVE CELL GROWTH; NERVE CELL NETWORK; SIGNAL NOISE RATIO; SYNAPSE; THEORETICAL MODEL; ALGORITHM; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; MEMORY; NERVE CELL; NERVE CELL PLASTICITY; PHYSIOLOGY; SYNAPTIC TRANSMISSION;

ALGORITHMS; LEARNING; MEMORY; MODELS, NEUROLOGICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONAL PLASTICITY; NEURONS; SYNAPSES; SYNAPTIC TRANSMISSION;

EID: 57149119078     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1000230     Document Type: Article

References (24)

1. Willshaw DJ, Buneman OP, Longuet-Higgins HC (1969) Non-holographic associative memory. Nature 222: 960-993.
2. Dayan P, Willshaw DJ (1991) Optimising synaptic learning rules in linear associative memories. Biol Cybern 65: 253-265.
3. Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci U S A 79: 2554-2558.
4. Meunier C, Nadal JP (1995) Sparsely coded neural networks. In: Arbib MA, ed. The handbook of brain theory, 1st edition. Cambridge, MA: MIT press. pp 899-901.
5. Crick F (1984) Memory and molecular turnover. Nature 312: 101.
6. Petersen CCH, Malenka RC, Nicoll RA, Hopfield JJ (1998) All-or-none potentiation at CA3-CA1 synapses. Proc Natl Acad Sci U S A 95: 4732-4737.
7. O'Connor DH, Wittenberg GM, Wang SSH (2005) Graded bidirectional synaptic plasticity is composed of switch-like unitary events. Proc Natl Acad Sci U S A 102: 9679-9684.
8. Parisi G (1986) A memory which forgets. J Phys A: Math Gen 19: L617-L620.
9. Amit D, Fusi S (1994) Learning in neural networks with material synapses. Neural Comput 6: 957-982.
10. Fusi S, Drew PJ, Abbott LF (2005) Cascade models of synaptically stored memories. Neuron 45: 599-611.
11. Senn W, Fusi S (2005) Learning only when necessary: better memories of correlated patterns in networks with bounded synapses. Neural Comput 17: 2106-2138.
12. Braunstein A, Zecchina R (2006) Learning by message passing in networks of discrete synapses. Phys Rev Lett 96: 030201.
13. Baldassi C, Braunstein A, Brunel N, Zecchina R (2007) Efficient supervised learning in networks with binary synapses. Proc Natl Acad Sci U S A 104: 11079-11084.
14. Ben Dayan Rubin DD, Fusi S (2007) Long memory lifetimes require complex synapses and limited sparseness. Frontiers Comput Neurosci 1: 7. doi:10.3389/neuro.10/007.2007.
15. Leibold C, Kempter R (2008) Sparseness constrains the prolongation of memory lifetime via synaptic metaplasticity. Cerebral Cortex 18: 67-77.
16. Nadal J, Toulouse G, Changeux J, Dehaene S (1986) Networks of Formal Neurons and Memory Palimpsests. Europhysics Letters (EPL) 1: 535-542.
17. Sterratt DC, Willshaw D (2008) Inhomogeneities in heteroassociative memories with linear learning rules. Neural Comput 20: 311-344.
18. Fusi S, Abbott LF (2007) Limits on the memory storage capacity of bounded synapses. Nat Neurosci 10: 485-493. doi:10.1038/nn1859.
19. Fusi S (2002) Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates. Biol Cybern 87: 459-470.
20. Brunel N (1994) Storage capacity of neural networks: effect of the fluctuations of the number of active neurons per memory. Phys A 27: 4783-4789.
21. Fusi S, Senn W (2006) Eluding oblivion with smart stochastic selection of synaptic updates. Chaos 16: 026112.
22. Attwell D, Laughlin SB (2001) An energy budget for signaling in the grey matter of the brain. Journal of Cerebral Blood Flow and Metabolism 21: 1133-1145.
23. Poirazi P, Brannon T, Mel B (2003) Pyramidal Neuron as Two-Layer Neural Network. Neuron 37: 989-999.
24. Clark P, van Rossum MC (2006) The optimal synapse for sparse, binary signals in the rod pathway. Neural Comput 18: 26-44.