Long memory lifetimes require complex synapses and limited sparseness

Frontiers in Computational Neuroscience

Volumn 1, Issue NOV, 2007, Pages

  Rubin, Daniel D Ben Dayan ^a,b   Fusi, Stefano ^a,b  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b ETH ZURICH   (Switzerland)

Author keywords

Learning; Sparseness; Synaptic plasticity

Indexed keywords

DEGREE OF COMPLEXITY; LEARNING; NEURAL REPRESENTATIONS; SPARSE REPRESENTATION; SPARSENESS; SYNAPTIC DYNAMICS; SYNAPTIC MODIFICATION; SYNAPTIC PLASTICITY;

BRAIN; NEURONS;

COMPUTER ARCHITECTURE;

EID: 77953334034     PISSN: 16625188     EISSN: None     Source Type: Journal    
DOI: 10.3389/neuro.10/007.2007     Document Type: Article

References (37)

1. Amit, D. J., and Fusi, S. (1992). Constraints on learning in dynamic synapses. Network 3, 443-464.
2. Amit, D. J., and Fusi, S. (1994). Learning in neural networks with material synapses. Neural Comput. 6, 957-982.
3. Asaad, W. F., Rainer, G., and Miller, E. K. (1998). Neural activity in the primate prefrontal cortex during associative learning. Neuron 21, 1399-1407.
4. Baldassi, C., Braunstein, A., Brunel, N., and Zecchina, R. (2007). Efficient supervised learning in networks with binary synapses. Proc. Natl. Acad. Sci. USA 104, 11079-11084.
5. Barnes, C. A., McNaughton, B. L., Mizumori, S. J., Leonard, B. W., and Lin, L. H. (1990). Comparison of spatial and temporal characteristics of neuronal activity in sequential stages of hippocampal processing. Prog. Brain Res. 83, 287-300.
6. Brader, J. M., Senn, W., and Fusi, S. (2007). Learning real-world stimuli in a neural network with spike-driven synaptic dynamics. Neural Comput. 19, 2881-2912.
7. Brecht, M., Roth, A., and Sakmann, B. (2003). Dynamic receptive fields of reconstructed pyramidal cells in layers 3 and 2 of rat somatosensory barrel cortex. J. Physiol. 553, 243-265.
8. Brunel, N., Carusi, F., and Fusi, S. (1998). Slow stochastic learning of classes of stimuli in a recurrent neural network. Netw. Comput. Neural Syst. 9, 123-152.
9. DeWeese, M. R., Wehr, M., and Zador, A. M. (2003). Binary spiking in auditory cortex. J. Neurosci. 23, 7940-7949.
10. Eccles, J. C., Ito, M., and Szentagothai, J. (1967). The cerebellum as a neuronal machine (Berlin, Springer-Verlag).
11. Fusi, S. (2002). Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates. Biol. Cybern. 17, 305-317.
12. Fusi, S., and Abbott, L. F. (2007). Limits on the memory storage capacity of bounded synapses. Nat. Neurosci. 10, 485-493.
13. Fusi, S., and Senn, W. (2006). Eluding oblivion with smart stochastic selection of synaptic updates. Chaos 16, 026112.
14. Fusi, S., Badoni, D., Salamon, A., and Amit, D. J. (2000). Spike-driven synaptic plasticity: theory, simulation, VLSI implementation. Neural Comput. 12, 2227-2258.
15. Fusi, S., Drew, P. J., and Abbott, L. F. (2005). Cascade models of synaptically stored memories. Neuron 45, 599-611.
16. Gütig, R., and Sompolinsky, H. (2006). The tempotron: a neuron that learns spike timingbased decisions. Nat. Neurosci. 9, 420-428.
17. Jung, M. W., and McNaughton, B. L. (1993). Spatial selectivity of unit activity in the hippocampal granular layer. Hippocampus 3, 165-182.
18. Leibold, C., and Kempter, R. (2007). Sparseness constrains the prolongation of memory lifetime via synaptic meta-plasticity. Cereb. Cortex. 18, 67-77.
19. Mongillo, G., Curti, E., Romani, S., and Amit, D. J. (2005). Learning in realistic networks of spiking neurons and spike-driven plastic synapses. Eur. J. Neurosci. 21, 3143-3160.
20. Montgomery, J. M., and Madison, D. V. (2004). Discrete synaptic states define a major mechanism of synapse plasticity. Trends Neurosci. 27, 744-750.
21. O'Connor, D., Wittenberg, G., and Wang, S.-H. (2005). Graded bidirectional synaptic plasticity is composed of switch-like unitary events. Proc. Natl. Acad. Sci. USA 102, 9679-9684.
22. O'Kane, C., and Treves, A. (1992). Short-and long-range connections in associative memory. J. Phys. A: Math. Gen. 25, 5055-5069.
23. Parisi, G. (1986). A memory which forgets. J. Phys. A: Math. Gen. 19, 617-619.
24. Quiroga, R. Q., Reddy, L., Kreiman, G., Koch, C., and Fried, I. (2005). Invariant visual representation by single neurons in the human brain. Nature 435, 1102-1107.
25. Reynolds, J. N. J., and Wickens, J. R. (2002). Dopamine-dependent plasticity of corticostriatal synapses. Neural Netw. 15, 507-521.
26. Rolls, E. T., and Tovee, M. J. (1995). Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. J. Neurophysiol. 73, 713-726. Comparative Study.
27. Rosenblatt, F. (1958). The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 65, 386-408.
28. Rosenblatt, F. (1962). Principles of neurodynamics (Washington, DC, Spartans Books).
29. Sato, T., Uchida, G., and Tanifuji, M. (2007). The nature of neuronal clustering in inferotemporal cortex of macaque monkey revealed by optical imaging and extracellular recording. 34th Ann. Meet. of Soc. for Neuroscience, San Diego, USA.
30. Standing, L. (1973). Learning 10,000 pictures. Q. J. Exp. Psychol. 25, 207-222.
31. Treves, A. (1990). Graded-response neurons and information encodings in autoassociative memories. Phys. Rev. A 42, 2418-2430.
32. Tsodyks, M. (1990). Associative memory in neural networks with binary synapses. Mod. Phys. Lett. B B4, 713-716.
33. Tsodyks, M., and Feigelman, M. (1988). Enhanced storage capacity in neural networks with low level of activity. Europhys. Lett. 6, 101.
34. Tsunoda, K., Yamane, Y., Nishizaki, M., and Tanifuji, M. (2001). Complex objects are represented in macaque inferotemporal cortex by the combination of feature columns. Nat. Neurosci. 4, 832-838.
35. Wang, G., Tanaka, K., and Tanifuji, M. (1996). Optical imaging of functional organization in the monkey inferotemporal cortex. Science 272, 1665-1668.
36. Willshaw, D. J., Buneman, O. P., and Longuet-Higgins, H. C. (1969). Non-holographic associative memory. Nature 222, 960-962.
37. Zhou, Q., Tao, H. W., and Poo, M. (2003). Reversal and stabilization of synaptic modifications in a developing visual system. Science 300, 1953-1957.