Capacity analysis in multi-state synaptic models: A retrieval probability perspective

Journal of Computational Neuroscience

Volumn 30, Issue 3, 2011, Pages 699-720

  Huang, Yibi ^a   Amit, Yali ^b  

^a University of Chicago   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

Author keywords

Hebbian learning; Inhibition; Network dynamics; Sparse coding

Indexed keywords

NETWORK CODING; NEURONS;

BINARY NEURONS; CAPACITY ANALYSIS; CAPACITY-OF-NETWORK; FINITE-STATE; HEBBIAN LEARNING; INHIBITION; MEMORY CAPACITY; MULTI-STATE; NETWORK DYNAMICS; SPARSE CODING;

PROBABILITY;

ARTICLE; ASSOCIATIVE MEMORY; FALSE POSITIVE RESULT; LEARNING; NERVE CELL NETWORK; PREDICTION; PRIORITY JOURNAL; PROBABILITY; SIGNAL NOISE RATIO; STIMULUS RESPONSE; SYNAPSE; SYNAPTIC POTENTIAL; WORKING MEMORY;

EID: 79960084745     PISSN: 09295313     EISSN: 15736873     Source Type: Journal    
DOI: 10.1007/s10827-010-0287-7     Document Type: Article

References (28)

1. WC Abraham MF Bear 1996 Metaplasticity: The plasticity of synaptic plasticity Trends in Neurosciences 19 4 126 130 10.1016/S0166-2236(96)80018-X 8658594 10.1016/S0166-2236(96)80018-X 1:CAS:528:DyaK28XhvFGgt70%3D (Pubitemid 26086492)
2. DJ Amit N Brunel 1997 Dynamics of recurrent network of spiking neurons before and following learning Network 8 373 404 10.1088/0954-898X/8/4/003 (Pubitemid 127717691)
3. DJ Amit N Brunel 1997 Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex Cerebral Cortex 7 237 252 9143444 10.1093/cercor/7.3.237 1:STN:280:DyaK2s3ovVCltA%3D%3D (Pubitemid 27184484)
4. DJ Amit S Fusi 1994 Learning in neural networks with material synapses Neural Computation 6 957 982 10.1162/neco.1994.6.5.957
5. DJ Amit G Mongillo 2003 Selective delay activity in the cortex: Phenomena and interpretation Cerebral Cortex 13 1139 1150 14576206 10.1093/cercor/bhg103 (Pubitemid 37336436)
6. Y Amit Y Huang 2010 Precise capacity analysis in binary networks with multiple coding level inputs Neural Computation 22 3 660 688 10.1162/neco.2009.02-09-967 19842984 10.1162/neco.2009.02-09-967
7. D Attwell SB Laughlin 2001 An energy budget for signaling in the grey matter of the brain Journal of Cerebral Blood Flow and Metabolism 21 10 1133 1145 11598490 1:CAS:528:DC%2BD3MXot1Ggsbc%3D (Pubitemid 32947479)
8. CA Barnes BL McNaughton SJ Mizumori BW Leonard LH Lin 1990 Comparison of spatial and temporal characteristics of neuronal activity in sequential stages of hippocampal processing Progress in Brain Research 83 287 300 2392566 10.1016/S0079-6123(08)61257-1 1:STN:280:DyaK3czmsVWlsQ%3D%3D (Pubitemid 20205287)
9. AB Barret MC van Rossum 2008 Optimal learning rules for discrete synapses PLoS Computational Biology 4 1 7 10.1371/journal.pcbi.1000230
10. DD Ben Dayan Rubin S Fusi 2007 Long memory lifetimes require complex synapses and limited sparseness Frontiers in Computational Neuroscience 1 1 14 10.3389/neuro.10.007.2007
11. N Brunel 2003 Dynamics and plasticity of stimulus-selective persistent activity in cortical network models Cerebral Cortex 13 1151 1161 14576207 10.1093/cercor/bhg096 (Pubitemid 37322992)
12. E Curti G Mongillo G La Camera DJ Amit 2004 Mean-field and capacity in realistic networks of spiking neurons storing sparsely coded random memories Neural Computation 16 2597 2637 15516275 10.1162/0899766042321805 (Pubitemid 39620307)
13. P Del Giudice S Fusi M Mattia 2003 Modelling the formation of working memory with networks of integrate-and-fire neurons connected by plastic synapses Journal of Physiology Paris 97 4-6 659 681 10.1016/j.jphysparis.2004.01.021 10.1016/j.jphysparis.2004.01.021 (Pubitemid 38447009)
14. S Fusi LF Abbott 2007 Limits on the memory storage capacity of bounded synapses Nature Neuroscience 10 485 493 17351638 1:CAS:528:DC%2BD2sXjsVOhs7w%3D (Pubitemid 46494580)
15. S Fusi PJ Drew L Abbott 2005 Cascade models of synaptically stored memories Neuron 45 4 599 611 10.1016/j.neuron.2005.02.001 15721245 10.1016/j.neuron.2005.02.001 1:CAS:528:DC%2BD2MXitFOktrs%3D (Pubitemid 40253583)
16. Fuster, J. (1995). Memory in the cerebral cortex: An empirical approach to neural networks in the human and nonhuman primate. Cambridge, MA: MIT Press.
17. MW Jung BL McNaughton 1993 Spatial selectivity of unit activity in the hippocampal granular layer Hippocampus 3 0 165 182 8353604 10.1002/hipo. 450030209 1:STN:280:DyaK3szlvVSmsQ%3D%3D (Pubitemid 23342781)
18. C Leibold R Kempter 2008 Sparseness constrains the prolongation of memory lifetime via synaptic metaplasticity Cerebral Cortex 18 67 77 17490993 10.1093/cercor/bhm037 (Pubitemid 350233057)
19. P Lennie 2003 The cost of cortical computation Current Biology 13 6 493 497 10.1016/S0960-9822(03)00135-0 12646132 10.1016/S0960-9822(03)00135-0 1:CAS:528:DC%2BD3sXit12nur0%3D (Pubitemid 36345724)
20. Y Miyashita T Hayashi 2000 Neural representation of visual objects: Encoding and top-down activation Current Opinion in Neurobiology 10 2 187 194 10753793 10.1016/S0959-4388(00)00071-4 1:CAS:528:DC%2BD3cXivFWnsbg%3D (Pubitemid 30201110)
21. BA Olshausen DJ Field 2004 Sparse coding of sensory inputs Current Opinion in Neurobiology 14 4 481 487 10.1016/j.conb.2004.07.007 15321069 10.1016/j.conb.2004.07.007 1:CAS:528:DC%2BD2cXmsVKmtr8%3D (Pubitemid 39078497)
22. RQ Quiroga L Reddy G Kreiman C Koch I Fried 2005 Invariant visual representation by single neurons in the human brain Nature 435 1102 1107 15973409 10.1038/nature03687 1:CAS:528:DC%2BD2MXltl2nt74%3D (Pubitemid 40910517)
23. Robertson, T., Wright, F. T., & Dykstra, R. L. (1988). Order restricted statistical inference. Wiley.
24. ET Rolls MJ Tovee 1995 Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex Journal of Physiology 73 2 713 726 1:STN:280:DyaK2M3otVSrtA%3D%3D
25. S Romani D Amit Y Amit 2008 Optimizing one-shot learning with binary synapses Neural Computation 20 1928 1950 18386988 10.1162/neco.2008.10-07-618
26. Sato, T., Uchida, G., & Tanifuji, M. (2007). The nature of neuronal clustering in inferotemporal cortex of macaque monkey revealed by optical imaging and extracellular recording. In 34th Ann. meet. of soc. for neuroscience. San Diego, USA.
27. XJ Wang 2001 Synaptic reverberation underlying mnemonic persistent activity Trends in Neurosciences 24 8 455 463 10.1016/S0166-2236(00)01868-3 11476885 10.1016/S0166-2236(00)01868-3 1:CAS:528:DC%2BD3MXltlymsL0%3D (Pubitemid 32695357)
28. D Willshaw OP Buneman H Longuet-Higgins 1969 Non-holographic associative memory Nature (London) 222 960 962 10.1038/222960a0 1:STN:280: DyaF1M3hslyltg%3D%3D