Learning only when necessary: Better memories of correlated patterns in networks with bounded synapses

Neural Computation

Volumn 17, Issue 10, 2005, Pages 2106-2138

  Senn, Walter ^a   Fusi, Stefano ^a  

^a UNIVERSITY OF BERN   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BIOLOGICAL MODEL; COMPARATIVE STUDY; DIFFERENTIAL THRESHOLD; HUMAN; LEARNING; NERVE CELL; NERVE CELL INHIBITION; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NONLINEAR SYSTEM; PERCEPTION; PERCEPTIVE DISCRIMINATION; PHYSIOLOGY; SYNAPSE; TIME;

DIFFERENTIAL THRESHOLD; DISCRIMINATION (PSYCHOLOGY); HUMANS; LEARNING; MODELS, NEUROLOGICAL; NERVE NET; NEURAL INHIBITION; NEURONAL PLASTICITY; NEURONS; NONLINEAR DYNAMICS; PERCEPTION; SYNAPSES; TIME FACTORS;

EID: 23944472208     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/0899766054615644     Document Type: Article

References (38)

1. Amit, D. J., & Brunel, N. (1997). A model of spontaneous activity and local delay activity during delay periods in the cerebral cortex. Cerebral Cortex, 7, 237-252.
2. Amit, D. J., & Fusi, S. (1992). Constraints on learning in dynamic synapses. Network: Computation in Neural Systems, 3, 443-464.
3. Amit, D. J., & Fusi, S. (1994). Learning in neural networks with material synapses. Neural Computation, 6, 957-982.
4. Amit, D. J., & Mongillo, G. (2003). Spike-driven synaptic dynamics generating working memory states. Neural Computation, 15, 565-596.
5. Amit, D. J., Wong, K., & Campbell, C. (1989). Perceptron learning with signconstrained weights. J. Phys., A22, 2039-2045.
6. Amit, Y., & Mascaro, M. (2001). Attractor networks for shape recognition. Neural Computation, 3, 1415-1442.
7. Amitai, Y., Gibson, J., Beierlein, M., Patrick, S., Ho, A., Connors, B., & Golomb, D. (2002). The spatial dimensions of electrically coupled networks of interneurons in the neocortex. Journal of Neuroscience, 22, 4142-4152.
8. Arbib, M. (1987). Brains, machines, and mathematics. Berlin: Springer Verlag.
9. Block, H. (1962). The perceptron: A model for brain functioning. Reviews of Modern Physics, 34, 123-135.
10. Braitenberg, V., & Schütz, A. (1991). Anatomy of the cortex. Berlin: Springer Verlag.
11. Brunei, N., Carusi, F., & Fusi, S. (1998). Slow stochastic learning in attractor neural networks. Network: Computation in Neural Systems, 9, 123-152.
12. Cho, K., Aggleton, J., Brown, M., & Bashir, Z. (2001). An experimental test of the role of postsynaptic calcium levels in determining synaptic strength using perirhinal cortex of rat. J. Physiology, 532(2), 459-466.
13. Cover, T. M. (1965). Geometrical and statistical properties of systems of linear inequalities with application in pattern recognition. IEEE Transaction on Electronic Computers, 14(3), 326-334.
14. Desai, N., Cudmore, R., Nelson, S., & Turrigiano, G. (2002). Critical periods for experience-dependent synaptic scaling in visual cortex. Nature Neuroscience, 5(8), 783-789.
15. Diederich, S., & Opper, M. (1987). Learning of correlated patterns in spin-glass networks by local learning rules. Phys. Rev. Lett., 58, 929-952.
16. Erikson, C., & Desimone, R. (1999). Responses of macaque perirhinal neurons during and after visual stimulus association learning. J. Neurosci, 19, 10404-10416.
17. Fiorillo, C., Tobler, P., & Schultz, W. (2003). Discrete coding of reward probability and uncertainty by dopamine neurons. Science, 299, 1898-1902.
18. Fusi, S. (1995). Prototype extraction in material attractor neural networks with stochastic dynamic learning. In S. K. Rogers & D. W. Ruck (Eds.), Proceedings of SPIE 95, Applications and Science of Artificial Neural Networks (Vol. 2, pp. 1027-1038).
19. Fusi, S. (2002). Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates. Biol. Cybernetics, 87, 459-470.
20. Fusi, S. (2003). Spike-driven synaptic plasticity for learning correlated patterns of mean firing rates. Reviews in the Neurosciences, 24, 73-84.
21. Fusi, S., Annunziato, M., Badoni, D., Salamon, A., & Amit, D. J. (2000). Spike-driven synaptic plasticity: Theory, simulation, VLSI implementation. Neural Computation, 12, 2227-2258.
22. Fusi, S., Drew, P., & Abbott, L. (2005). Cascade models of synaptically stored memories. Neuron, 45, 599-611.
23. Hertz, J., Krogh, A., & Palmer, R. G. (1991). Introduction to the theory of neural computation. Reading, MA: Addison-Wesley.
24. Köhler, H., Diederich, S., Kinzel, W., & Opper, M. (1990). Learning algorithm for a neural network with binary synapses. Z. Phys. B - Condensed Matter, 78, 333-342.
25. Minsky, M. L., & Papert, S. A. (1969). Perceptrons. Cambridge, MA: MIT Press.
26. Miyashita, Y. (1993). Inferior temporal cortex: Where visual perception meets memory. Ann. Rev. Neurosci., 26, 245-263.
27. Parisi, G. (1986). A memory which forgets. Journal of Physics A - Mathematical & General, 19(10), L617-620.
28. Rainer, G., Lee, H., & Logothetis, N. (2004). The effect of learning on the function of monkey extrastriate visual cortex. PLoS Biol, 2(2), E44.
29. Rosenblatt, F. (1962). Principles of neurodynamics. New York: Spartan Books.
30. Rubin, J., Lee, D., & Sompolinsky, H. (2001). Equilibrium properties of temporally asymmetric Hebbian plasticity. Phys. Rev. Lett., 86(2), 364-367.
31. Rumsey, C., & Abbott, L. (2003). Equalization of synaptic efficacy by activity- and timing-dependent synaptic plasticity. Journal of Neurophysiology, 91(5), 2273-2280.
32. Senn, W., & Fusi, S. (2004). Slow stochastic learning with global inhibition: A biological solution to the binary perceptron problem. Neurocomputing, 58-60, 321-326.
33. Senn, W., & Fusi, S. (2005). Convergence of stochastic learning in perceptrons with binary synapses. Phys. Rev. E, 7(5).
34. Sompolinsky, H. (1987). The theory of neural networks: The Hebb rule and beyond. In L. Van Hemmen & J. Morgestern (Eds.), Heidelberg Colloquium on Glassy Dynamics. Berlin: Springer.
35. Tsodyks, M. (1990). Associative memory in neural networks with binary synapses. Modern Physics Letters, B4, 713.
36. van Rossum, M., Bi, G., & Turrigiano, G. (2000). Stable Hebbian learning from spike timing-dependent plasticity. Journal of Neuroscience, 20, 8812-8821.
37. van Vreeswijk, C., & Sompolinsky, H. (1996). Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science, 274, 1724-1726.
38. Yakovlev, V., Fusi, S., Berman, E., & Zohary, E. (1998). Inter-trial neuronal activity in infero-temporal cortex: A putative vehicle to generate long term associations. Nature Neuroscience, 1, 310-317.