메뉴 건너뛰기




Volumn 11, Issue 8, 2015, Pages

A Three-Threshold Learning Rule Approaches the Maximal Capacity of Recurrent Neural Networks

Author keywords

[No Author keywords available]

Indexed keywords

HOPFIELD NEURAL NETWORKS; LEARNING ALGORITHMS;

EID: 84940763076     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1004439     Document Type: Article
Times cited : (20)

References (50)
  • 1
    • 0020118274 scopus 로고
    • Neural networks and physical systems with emergent collective computational abilities
    • Hopfield JJ, Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci USA. 1982;79:2554–2558. doi: 10.1073/pnas.79.8.2554 6953413
    • (1982) Proc Natl Acad Sci USA , vol.79 , pp. 2554-2558
    • Hopfield, J.J.1
  • 4
    • 0030947941 scopus 로고    scopus 로고
    • Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex
    • Amit DJ, Brunel N, Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cerebral Cortex. 1997;7:237–252. doi: 10.1093/cercor/7.3.237 9143444
    • (1997) Cerebral Cortex , vol.7 , pp. 237-252
    • Amit, D.J.1    Brunel, N.2
  • 5
    • 0034814469 scopus 로고    scopus 로고
    • Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition
    • Brunel N, Wang XJ, Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. J Comput Neurosci. 2001;11:63–85. doi: 10.1023/A:1011204814320 11524578
    • (2001) J Comput Neurosci , vol.11 , pp. 63-85
    • Brunel, N.1    Wang, X.J.2
  • 6
    • 40849102598 scopus 로고    scopus 로고
    • Synaptic Theory of Working Memory
    • Mongillo G, Barak O, Tsodyks M, Synaptic Theory of Working Memory. Science. 2008;319:1543. doi: 10.1126/science.1150769 18339943
    • (2008) Science , vol.319 , pp. 1543
    • Mongillo, G.1    Barak, O.2    Tsodyks, M.3
  • 7
    • 84889569838 scopus 로고    scopus 로고
    • Working models of working memory
    • Barak O, Tsodyks M, Working models of working memory. Curr Opin Neurobiol. 2014;25:20–24. doi: 10.1016/j.conb.2013.10.008 24709596
    • (2014) Curr Opin Neurobiol , vol.25 , pp. 20-24
    • Barak, O.1    Tsodyks, M.2
  • 8
    • 0019505236 scopus 로고
    • Inferotemporal neurons distinguish and retain behaviourally relevant features of visual stimuli
    • Fuster JM, Jervey JP, Inferotemporal neurons distinguish and retain behaviourally relevant features of visual stimuli. Science. 1981;212:952–955. doi: 10.1126/science.7233192 7233192
    • (1981) Science , vol.212 , pp. 952-955
    • Fuster, J.M.1    Jervey, J.P.2
  • 9
    • 0023812211 scopus 로고
    • Neuronal correlate of visual associative long-term memory in the primate temporal cortex
    • Miyashita Y, Neuronal correlate of visual associative long-term memory in the primate temporal cortex. Nature. 1988;335:817–820. doi: 10.1038/335817a0 3185711
    • (1988) Nature , vol.335 , pp. 817-820
    • Miyashita, Y.1
  • 10
    • 0023849447 scopus 로고
    • Neuronal correlate of pictorial short-term memory in the primate temporal cortex
    • Miyashita Y, Chang HS, Neuronal correlate of pictorial short-term memory in the primate temporal cortex. Nature. 1988;331:68–70. doi: 10.1038/331068a0 3340148
    • (1988) Nature , vol.331 , pp. 68-70
    • Miyashita, Y.1    Chang, H.S.2
  • 11
    • 0029082829 scopus 로고
    • Mnemonic firing of neurons in the monkey temporal pole during a visual recognition memory task
    • Nakamura K, Kubota K, Mnemonic firing of neurons in the monkey temporal pole during a visual recognition memory task. J Neurophysiol. 1995;74:162–178. 7472321
    • (1995) J Neurophysiol , vol.74 , pp. 162-178
    • Nakamura, K.1    Kubota, K.2
  • 12
    • 0015222118 scopus 로고
    • Neuron activity related to short-term memory
    • Fuster JM, Alexander G, Neuron activity related to short-term memory. Science. 1971;173:652–654. doi: 10.1126/science.173.3997.652 4998337
    • (1971) Science , vol.173 , pp. 652-654
    • Fuster, J.M.1    Alexander, G.2
  • 13
    • 0024574176 scopus 로고
    • Mnemonic coding of visual space in the monkey’s dorsolateral prefrontal cortex
    • Funahashi S, Bruce CJ, Goldman-Rakic PS, Mnemonic coding of visual space in the monkey’s dorsolateral prefrontal cortex. J Neurophysiol. 1989;61:331–349. 2918358
    • (1989) J Neurophysiol , vol.61 , pp. 331-349
    • Funahashi, S.1    Bruce, C.J.2    Goldman-Rakic, P.S.3
  • 14
    • 0033519704 scopus 로고    scopus 로고
    • Neuronal correlates of parametric working memory in the prefrontal cortex
    • Romo R, Brody CD, Hernández A, Lemus L, Neuronal correlates of parametric working memory in the prefrontal cortex. Nature. 1999;399:470–474. doi: 10.1038/20939 10365959
    • (1999) Nature , vol.399 , pp. 470-474
    • Romo, R.1    Brody, C.D.2    Hernández, A.3    Lemus, L.4
  • 15
    • 4244216476 scopus 로고
    • Storing infinite numbers of patterns in a spin-glass model of neural networks
    • Amit DJ, Gutfreund H, Sompolinsky H, Storing infinite numbers of patterns in a spin-glass model of neural networks. Phys Rev Lett. 1985;55:1530–1531. doi: 10.1103/PhysRevLett.55.1530 10031847
    • (1985) Phys Rev Lett , vol.55 , pp. 1530-1531
    • Amit, D.J.1    Gutfreund, H.2    Sompolinsky, H.3
  • 16
    • 0001157470 scopus 로고
    • Neural networks with nonlinear synapses and a static noise
    • Sompolinsky H, Neural networks with nonlinear synapses and a static noise. Phys Rev A. 1986;34:2571–2574. doi: 10.1103/PhysRevA.34.2571 9897569
    • (1986) Phys Rev A , vol.34 , pp. 2571-2574
    • Sompolinsky, H.1
  • 17
    • 84956135322 scopus 로고
    • An exactly solvable asymmetric neural network model
    • Derrida B, Gardner E, Zippelius A, An exactly solvable asymmetric neural network model. Europhys Lett. 1987;4:167–173. doi: 10.1209/0295-5075/4/2/007
    • (1987) Europhys Lett , vol.4 , pp. 167-173
    • Derrida, B.1    Gardner, E.2    Zippelius, A.3
  • 18
    • 84956108236 scopus 로고
    • The enhanced storage capacity in neural networks with low activity level
    • Tsodyks M, Feigel’man MV, The enhanced storage capacity in neural networks with low activity level. Europhys Lett. 1988;6:101–105. doi: 10.1209/0295-5075/6/2/002
    • (1988) Europhys Lett , vol.6 , pp. 101-105
    • Tsodyks, M.1    Feigel’man, M.V.2
  • 19
    • 0000438941 scopus 로고
    • Associative memory with high information content
    • Buhmann J, Divko R, Schulten K, Associative memory with high information content. Phys Rev A. 1989;39:2689–2692. doi: 10.1103/PhysRevA.39.2689 9901541
    • (1989) Phys Rev A , vol.39 , pp. 2689-2692
    • Buhmann, J.1    Divko, R.2    Schulten, K.3
  • 20
    • 36149029786 scopus 로고
    • The space of interactions in neural network models
    • Gardner EJ, The space of interactions in neural network models. J Phys A: Math Gen. 1988;21:257–270. doi: 10.1088/0305-4470/21/1/030
    • (1988) J Phys A: Math Gen , vol.21 , pp. 257-270
    • Gardner, E.J.1
  • 22
    • 0014526073 scopus 로고
    • A theory of cerebellar cortex
    • Marr D, A theory of cerebellar cortex. J Physiol. 1969;202:437–470. doi: 10.1113/jphysiol.1969.sp008820 5784296
    • (1969) J Physiol , vol.202 , pp. 437-470
    • Marr, D.1
  • 23
    • 49649148257 scopus 로고
    • A theory of cerebellar function
    • Albus JS, A theory of cerebellar function. Mathematical Biosciences. 1971;10:26–51. doi: 10.1016/0025-5564(71)90051-4
    • (1971) Mathematical Biosciences , vol.10 , pp. 26-51
    • Albus, J.S.1
  • 24
    • 0020005065 scopus 로고
    • Climbing fibre induced depression of both mossy fibre responsiveness and glutamate sensitivity of cerebellar Purkinje cells
    • Ito M, Sakurai M, Tongroach P, Climbing fibre induced depression of both mossy fibre responsiveness and glutamate sensitivity of cerebellar Purkinje cells. J Physiol. 1982;324:113–134. doi: 10.1113/jphysiol.1982.sp014103 7097592
    • (1982) J Physiol , vol.324 , pp. 113-134
    • Ito, M.1    Sakurai, M.2    Tongroach, P.3
  • 25
    • 84861179600 scopus 로고    scopus 로고
    • Storage of correlated patterns in standard and bistable Purkinje cell models
    • Clopath C, Nadal JP, Brunel N, Storage of correlated patterns in standard and bistable Purkinje cell models. PLoS Comput Biol. 2012;8:e1002448. doi: 10.1371/journal.pcbi.1002448 22570592
    • (2012) PLoS Comput Biol , vol.8
    • Clopath, C.1    Nadal, J.P.2    Brunel, N.3
  • 26
    • 0022810581 scopus 로고
    • The ultrametric organization of memories in a neural network
    • Parga N, Virasoro MA, The ultrametric organization of memories in a neural network. J Phys France. 1986;47:1857–1864. doi: 10.1051/jphys:0198600470110185700
    • (1986) J Phys France , vol.47 , pp. 1857-1864
    • Parga, N.1    Virasoro, M.A.2
  • 27
    • 0042255141 scopus 로고    scopus 로고
    • Slow stochastic Hebbian learning of classes in recurrent neural networks
    • Brunel N, Carusi F, Fusi S, Slow stochastic Hebbian learning of classes in recurrent neural networks. Network. 1998;9:123–152. doi: 10.1088/0954-898X/9/1/007 9861982
    • (1998) Network , vol.9 , pp. 123-152
    • Brunel, N.1    Carusi, F.2    Fusi, S.3
  • 28
    • 4444234075 scopus 로고    scopus 로고
    • Optimal information storage and the distribution of synaptic weights: perceptron versus Purkinje cell
    • Brunel N, Hakim V, Isope P, Nadal JP, Barbour B, Optimal information storage and the distribution of synaptic weights: perceptron versus Purkinje cell. Neuron. 2004;43:745–57. doi: 10.1016/S0896-6273(04)00528-8 15339654
    • (2004) Neuron , vol.43 , pp. 745-757
    • Brunel, N.1    Hakim, V.2    Isope, P.3    Nadal, J.P.4    Barbour, B.5
  • 29
    • 40749088917 scopus 로고    scopus 로고
    • Lapicque’s 1907 paper: from frogs to integrate-and-fire
    • Brunel N, van Rossum MC, Lapicque’s 1907 paper: from frogs to integrate-and-fire. Biol Cybern. 2007;97:337–339. doi: 10.1007/s00422-007-0190-0 17968583
    • (2007) Biol Cybern , vol.97 , pp. 337-339
    • Brunel, N.1    van Rossum, M.C.2
  • 30
    • 84874762088 scopus 로고    scopus 로고
    • Optimal properties of analog perceptrons with excitatory weights
    • Clopath C, Brunel N, Optimal properties of analog perceptrons with excitatory weights. PLoS Comput Biol. 2013;9:e1002919. doi: 10.1371/journal.pcbi.1002919 23436991
    • (2013) PLoS Comput Biol , vol.9
    • Clopath, C.1    Brunel, N.2
  • 31
    • 0013402675 scopus 로고
    • Solvable models of working memories
    • Mézard M, Nadal JP, Toulouse G, Solvable models of working memories. J Physique. 1986;47:1457– doi: 10.1051/jphys:019860047090145700
    • (1986) J Physique , vol.47 , pp. 1457
    • Mézard, M.1    Nadal, J.P.2    Toulouse, G.3
  • 32
    • 36149035600 scopus 로고
    • A memory which forgets
    • Parisi G, A memory which forgets. J Phys A: Math Gen. 1986;19:L617. doi: 10.1088/0305-4470/19/11/005
    • (1986) J Phys A: Math Gen , vol.19 , pp. 617
    • Parisi, G.1
  • 33
    • 0001101723 scopus 로고
    • Dynamic learning in neural networks with material synapses
    • Amit DJ, Fusi S, Dynamic learning in neural networks with material synapses. Neural Computation. 1994;6:957–982. doi: 10.1162/neco.1994.6.5.957
    • (1994) Neural Computation , vol.6 , pp. 957-982
    • Amit, D.J.1    Fusi, S.2
  • 34
    • 0020074887 scopus 로고
    • Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex
    • Bienenstock E, Cooper L, Munro P, Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J Neurosci. 1982;2:32–48. 7054394
    • (1982) J Neurosci , vol.2 , pp. 32-48
    • Bienenstock, E.1    Cooper, L.2    Munro, P.3
  • 35
    • 0036355886 scopus 로고    scopus 로고
    • Synaptic plasticity, metaplasticity and BCM theory
    • Jedlicka P, Synaptic plasticity, metaplasticity and BCM theory. Bratislavské lekárske listy. 2002;103(4/5):137–143. 12413200
    • (2002) Bratislavské lekárske listy , vol.103 , Issue.4-5 , pp. 137-143
    • Jedlicka, P.1
  • 36
    • 0026610208 scopus 로고
    • Intracellular injection of Ca2+ chelators blocks induction of long-term depression in rat visual cortex
    • Bröcher S, Artola A, Singer W, Intracellular injection of Ca2+ chelators blocks induction of long-term depression in rat visual cortex. Proceedings of the National Academy of Sciences. 1992;89(1):123–127. doi: 10.1073/pnas.89.1.123
    • (1992) Proceedings of the National Academy of Sciences , vol.89 , Issue.1 , pp. 123-127
    • Bröcher, S.1    Artola, A.2    Singer, W.3
  • 37
    • 0027517104 scopus 로고
    • Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation
    • Artola A, Singer W, Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation. Trends in neurosciences. 1993;16(11):480–487. doi: 10.1016/0166-2236(93)90081-V 7507622
    • (1993) Trends in neurosciences , vol.16 , Issue.11 , pp. 480-487
    • Artola, A.1    Singer, W.2
  • 38
    • 0035380079 scopus 로고    scopus 로고
    • Attractor networks for shape recognition
    • Amit Y, Mascaro M, Attractor networks for shape recognition. Neural Comput. 2001;13:1415–1442. doi: 10.1162/08997660152002906 11387051
    • (2001) Neural Comput , vol.13 , pp. 1415-1442
    • Amit, Y.1    Mascaro, M.2
  • 39
    • 13844266723 scopus 로고    scopus 로고
    • Cascade models of synaptically stored memories
    • Fusi S, Drew PJ, Abbott LF, Cascade models of synaptically stored memories. Neuron. 2005;45:599–611. doi: 10.1016/j.neuron.2005.02.001 15721245
    • (2005) Neuron , vol.45 , pp. 599-611
    • Fusi, S.1    Drew, P.J.2    Abbott, L.F.3
  • 40
    • 36248934673 scopus 로고    scopus 로고
    • Learning real-world stimuli in a neural network with spike-driven synaptic dynamics
    • Brader JM, Senn W, Fusi S, Learning real-world stimuli in a neural network with spike-driven synaptic dynamics. Neural Comput. 2007;19:2881–2912. doi: 10.1162/neco.2007.19.11.2881 17883345
    • (2007) Neural Comput , vol.19 , pp. 2881-2912
    • Brader, J.M.1    Senn, W.2    Fusi, S.3
  • 41
    • 0034175485 scopus 로고    scopus 로고
    • Synaptic activity modulates the induction of bidirectional synaptic changes in adult mouse hippocampus
    • Ngezahayo A, Schachner M, Artola A, Synaptic activity modulates the induction of bidirectional synaptic changes in adult mouse hippocampus. J Neurosci. 2000;20:2451–2458. 10729325
    • (2000) J Neurosci , vol.20 , pp. 2451-2458
    • Ngezahayo, A.1    Schachner, M.2    Artola, A.3
  • 42
    • 0029941251 scopus 로고    scopus 로고
    • Experience-dependent modification of synaptic plasticity in visual cortex
    • Kirkwood A, Rioult MC, Bear MF, Experience-dependent modification of synaptic plasticity in visual cortex. Nature. 1996;381:526–528. doi: 10.1038/381526a0 8632826
    • (1996) Nature , vol.381 , pp. 526-528
    • Kirkwood, A.1    Rioult, M.C.2    Bear, M.F.3
  • 43
    • 0032823363 scopus 로고    scopus 로고
    • Priming-induced shift in synaptic plasticity in the rat hippocampus
    • Wang H, Wagner JJ, Priming-induced shift in synaptic plasticity in the rat hippocampus. J Neurophysiol. 1999;82:2024–2028. 10515995
    • (1999) J Neurophysiol , vol.82 , pp. 2024-2028
    • Wang, H.1    Wagner, J.J.2
  • 44
    • 36048983236 scopus 로고    scopus 로고
    • What can we learn from synaptic weight distributions?
    • Barbour B, Brunel N, Hakim V, Nadal JP, What can we learn from synaptic weight distributions? Trends Neurosci. 2007;30:622–629. doi: 10.1016/j.tins.2007.09.005 17983670
    • (2007) Trends Neurosci , vol.30 , pp. 622-629
    • Barbour, B.1    Brunel, N.2    Hakim, V.3    Nadal, J.P.4
  • 45
    • 84871390357 scopus 로고    scopus 로고
    • Efficient associative memory storage in cortical circuits of inhibitory and excitatory neurons
    • Chapeton J, Fares T, LaSota D, Stepanyants A, Efficient associative memory storage in cortical circuits of inhibitory and excitatory neurons. Proc Natl Acad Sci USA. 2012;109:E3614–3622. doi: 10.1073/pnas.1211467109 23213221
    • (2012) Proc Natl Acad Sci USA , vol.109 , pp. 3614-3622
    • Chapeton, J.1    Fares, T.2    LaSota, D.3    Stepanyants, A.4
  • 46
    • 14144250629 scopus 로고    scopus 로고
    • The neocortical microcircuit as a tabula rasa
    • Kalisman N, Silberberg G, Markram H, The neocortical microcircuit as a tabula rasa. Proc Natl Acad Sci U S A. 2005;102:880–885. doi: 10.1073/pnas.0407088102 15630093
    • (2005) Proc Natl Acad Sci U S A , vol.102 , pp. 880-885
    • Kalisman, N.1    Silberberg, G.2    Markram, H.3
  • 47
    • 18044383304 scopus 로고    scopus 로고
    • Highly nonrandom features of synaptic connectivity in local cortical circuits
    • Song S, Sjostrom PJ, Reigl M, Nelson S, Chklovskii DB, Highly nonrandom features of synaptic connectivity in local cortical circuits. PLoS Biol. 2005;3:e68. doi: 10.1371/journal.pbio.0030068 15737062
    • (2005) PLoS Biol , vol.3
    • Song, S.1    Sjostrom, P.J.2    Reigl, M.3    Nelson, S.4    Chklovskii, D.B.5
  • 49
    • 58549118757 scopus 로고    scopus 로고
    • The excitatory neuronal network of the C2 barrel column in mouse primary somatosensory cortex
    • Lefort S, Tomm C, Floyd Sarria JC, Petersen CC, The excitatory neuronal network of the C2 barrel column in mouse primary somatosensory cortex. Neuron. 2009;61:301–316. doi: 10.1016/j.neuron.2008.12.020 19186171
    • (2009) Neuron , vol.61 , pp. 301-316
    • Lefort, S.1    Tomm, C.2    Floyd Sarria, J.C.3    Petersen, C.C.4
  • 50
    • 51249194645 scopus 로고
    • A logical calculus of the ideas immanent in nervous activity
    • McCulloch WS, Pitts WA, A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys. 1943;5:115–133. doi: 10.1007/BF02478259
    • (1943) Bull Math Biophys , vol.5 , pp. 115-133
    • McCulloch, W.S.1    Pitts, W.A.2


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.