Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks V: Self-organization schemes and weight dependence

Biological Cybernetics

Volumn 103, Issue 5, 2010, Pages 365-386

  Gilson, Matthieu ^a,b   Burkitt, Anthony N ^a,b   Grayden, David B ^a,b   Thomas, Doreen A ^a   Van Hemmen, J Leo ^c  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b BIONIC EAR INSTITUTE   (Australia)

^c TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Learning; Recurrent neuronal network; Self organization; Spike time correlation; Weight dependent STDP

Indexed keywords

LEARNING; NEURONAL NETWORKS; SELF-ORGANIZATIONS; TIME CORRELATIONS; WEIGHT-DEPENDENT STDP;

LAKES; LOCOMOTIVES; PLASTICITY; RAILROAD CARS; SCALES (WEIGHING INSTRUMENTS); SIGNAL ENCODING; TIME MEASUREMENT;

NEURAL NETWORKS;

ACTION POTENTIAL; ANIMAL; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; CYTOLOGY; DENDRITE; HUMAN; METHODOLOGY; NERVE CELL; NERVE CELL INHIBITION; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NERVE TRACT; PHYSIOLOGY; SYNAPTIC TRANSMISSION; TIME;

ACTION POTENTIALS; ANIMALS; ARTIFICIAL INTELLIGENCE; DENDRITES; HUMANS; MODELS, NEUROLOGICAL; NERVE NET; NEURAL INHIBITION; NEURAL NETWORKS (COMPUTER); NEURAL PATHWAYS; NEURONAL PLASTICITY; NEURONS; PATTERN RECOGNITION, AUTOMATED; SYNAPTIC TRANSMISSION; TIME FACTORS;

EID: 78649316465     PISSN: 03401200     EISSN: 14320770     Source Type: Journal    
DOI: 10.1007/s00422-010-0405-7     Document Type: Article

References (84)

1. VA Alvarez BL Sabatini 2007 Anatomical and physiological plasticity of dendritic spines Annu Rev Neurosci 30 79 97 1:CAS:528:DC%2BD2sXptFKntbs%3D 17280523 10.1146/annurev.neuro.30.051606.094222 (Pubitemid 47218752)
2. PA Appleby T Elliott 2006 Stable competitive dynamics emerge from multispike interactions in a stochastic model of spike-timing-dependent plasticity Neural Comput 18 10 2414 2464 16907632 10.1162/neco.2006.18.10.2414 (Pubitemid 44511770)
3. CC Bell VZ Han Y Sugawara K Grant 1997 Synaptic plasticity in a cerebellum-like structure depends on temporal order Nature 387 6630 278 281 1:CAS:528:DyaK2sXjtlSgsL0%3D 9153391 10.1038/387278a0 (Pubitemid 27220761)
4. GQ Bi MM Poo 1998 Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type J Neurosci 18 24 10464 10472 1:CAS:528:DyaK1MXjsFOjsg%3D%3D 9852584
5. GQ Bi MM Poo 2001 Synaptic modification by correlated activity: Hebb's postulate revisited Annu Rev Neurosci 24 139 166 1:CAS:528:DC%2BD3MXls1Shsr0%3D 11283308 10.1146/annurev.neuro.24.1.139 (Pubitemid 32695226)
6. EL Bienenstock LN Cooper PW Munro 1982 Theory for the development of neuron selectivity-orientation specificity and binocular interaction in visual-cortex J Neurosci 2 1 32 48 1:STN:280:DyaL387gtValsA%3D%3D 7054394
7. CA Boettiger AJ Doupe 2001 Developmentally restricted synaptic plasticity in a songbird nucleus required for song learning Neuron 31 5 809 818 1:CAS:528:DC%2BD3MXnt1Oqsb4%3D 11567618 10.1016/S0896-6273(01)00403-2 (Pubitemid 32907375)
8. AN Burkitt 2006 A review of the integrate-and-fire neuron model: I. Homogeneous synaptic input Biol Cybern 95 1 1 19 1:STN:280: DC%2BD28zpsVSlug%3D%3D 16622699 10.1007/s00422-006-0068-6 (Pubitemid 43999784)
9. AN Burkitt H Meffin DB Grayden 2004 Spike-timing-dependent plasticity: the relationship to rate-based learning for models with weight dynamics determined by a stable fixed point Neural Comput 16 5 885 940 15070504 10.1162/089976604773135041 (Pubitemid 38483045)
10. AN Burkitt M Gilson JL van Hemmen 2007 Spike-timing-dependent plasticity for neurons with recurrent connections Biol Cybern 96 5 533 546 1:STN:280:DC%2BD2s3kvFOjtw%3D%3D 17415586 10.1007/s00422-007-0148-2 (Pubitemid 46675291)
11. DA Butts PO Kanold CJ Shatz 2007 A burst-based "Hebbian" learning rule at retinogeniculate synapses links retinal waves to activity-dependent refinement PLoS Biol 5 3 651 661 1:CAS:528: DC%2BD2sXjtleitrc%3D 10.1371/journal.pbio.0050061 (Pubitemid 46422981)
12. DA Butts C Weng J Jin CI Yeh NA Lesica JM Alonso GB Stanley 2007 Temporal precision in the neural code and the timescales of natural vision Nature 449 92 95 1:CAS:528:DC%2BD2sXpvFWrs7o%3D 17805296 10.1038/nature06105 (Pubitemid 47373774)
13. M Butz F Wörgötter A van Ooyen 2009 Activity-dependent structural plasticity Brain Res Rev 60 2 287 305 19162072 10.1016/j.brainresrev. 2008.12.023
14. N Caporale Y Dan 2008 Spike timing-dependent plasticity: a Hebbian learning rule Annu Rev Neurosci 31 25 46 1:CAS:528:DC%2BD1cXpt12gu7c%3D 18275283 10.1146/annurev.neuro.31.060407.125639
15. H Câteau K Kitano T Fukai 2008 Interplay between a phase response curve and spike-timing-dependent plasticity leading to wireless clustering Phys Rev E 77 5 051909 10.1103/PhysRevE.77.051909 (Pubitemid 351705636)
16. Y Choe R Miikkulainen 1998 Self-organization and segmentation in a laterally connected orientation map of spiking neurons Neurocomputing 21 1-3 139 157 10.1016/S0925-2312(98)00040-X (Pubitemid 28526818)
17. JC Dahmen DE Hartley AJ King 2008 Stimulus-timing-dependent plasticity of cortical frequency representation J Neurosci 28 50 13629 13639 1:CAS:528:DC%2BD1cXhsFCqsb7L 19074036 10.1523/JNEUROSCI.4429-08.2008
18. Y Dan MM Poo 2006 Spike timing-dependent plasticity: from synapse to perception Physiol Rev 86 3 1033 1048 16816145 10.1152/physrev.00030.2005 (Pubitemid 44033388)
19. D Debanne BH Gahwiler SM Thompson 1998 Long-term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures J Physiol (Lond) 507 1 237 247 1:CAS:528:DyaK1cXhslyjtrY%3D 10.1111/j.1469-7793.1998.237bu.x (Pubitemid 28102688)
20. RC deCharms A Zador 2000 Neural representation and the cortical code Annu Rev Neurosci 23 613 647 1:CAS:528:DC%2BD3cXjs1Gms7s%3D 10845077 10.1146/annurev.neuro.23.1.613 (Pubitemid 30350056)
21. A Delorme L Perrinet SJ Thorpe 2001 Networks of integrate-and-fire neurons using rank order coding B: Spike timing dependent plasticity and emergence of orientation selectivity Neurocomputing 38 539 545 10.1016/S0925-2312(01)00403-9 (Pubitemid 35276680)
22. V Egger D Feldmeyer B Sakmann 1999 Coincidence detection and changes of synaptic efficacy in spiny stellate neurons in vat barrel cortex Nat Neurosci 2 12 1098 1105 1:CAS:528:DyaK1MXnslKqtL8%3D 10570487 10.1038/16026 (Pubitemid 30126368)
23. T Elliott 2003 An analysis of synaptic normalization in a general class of Hebbian models Neural Comput 15 4 937 963 12689393 10.1162/08997660360581967 (Pubitemid 37049813)
24. T Elliott NR Shadbolt 1999 A neurotrophic model of the development of the retinogeniculocortical pathway induced by spontaneous retinal waves J Neurosci 19 18 7951 7970 1:CAS:528:DyaK1MXlvFahtb8%3D 10479696
25. DE Feldman 2000 Timing-based LTP and LTD at vertical inputs to layer II/III pyramidal cells in rat barrel cortex Neuron 27 1 45 56 1:CAS:528:DC%2BD3cXls1Kmu7s%3D 10939330 10.1016/S0896-6273(00)00008-8
26. RC Froemke Y Dan 2002 Spike-timing-dependent synaptic modification induced by natural spike trains Nature 416 6879 433 438 1:CAS:528: DC%2BD38Xislams7c%3D 11919633 10.1038/416433a (Pubitemid 34272878)
27. S Fusi 2002 Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates Biol Cybern 87 5-6 459 470 12461635 10.1007/s00422-002-0356-8 (Pubitemid 135689606)
28. W Gerstner R Ritz JL van Hemmen 1993 Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns Biol Cybern 69 5-6 503 515 1:STN:280:DyaK2c7gtVaqsg%3D%3D 7903867
29. W Gerstner R Kempter JL van Hemmen H Wagner 1996 A neuronal learning rule for sub-millisecond temporal coding Nature 383 6595 76 78 1:CAS:528: DyaK28XlsV2jsbs%3D 8779718 10.1038/383076a0 (Pubitemid 26296463)
30. M Gilson AN Burkitt DB Grayden DA Thomas JL van Hemmen 2009 Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks I: input selectivity-strengthening correlated input pathways Biol Cybern 101 2 81 102 19536560 10.1007/s00422-009-0319-4
31. M Gilson AN Burkitt DB Grayden DA Thomas JL van Hemmen 2009 Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks II: input selectivity-symmetry breaking Biol Cybern 101 2 103 114 19536559 10.1007/s00422-009-0320-y
32. M Gilson AN Burkitt DB Grayden DA Thomas JL van Hemmen 2009 Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks III: Partially connected neurons driven by spontaneous activity Biol Cybern 101 5-6 411 426 19937071 10.1007/s00422-009-0343-4
33. M Gilson AN Burkitt DB Grayden DA Thomas JL van Hemmen 2009 Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks IV: structuring synaptic pathways among recurrent connections Biol Cybern 101 5-6 427 444 19937070 10.1007/s00422-009-0346-1
34. J Gjorgjieva T Toyoizumi SJ Eglen 2009 Burst-time-dependent plasticity robustly guides ON/OFF segregation in the lateral geniculate nucleus PLoS Comput Biol 5 12 e1000618 20041207 10.1371/journal.pcbi.1000618
35. GJ Goodhill 2007 Contributions of theoretical modeling to the understanding of neural map development Neuron 56 2 301 311 1:CAS:528: DC%2BD2sXht12jsrrE 17964247 10.1016/j.neuron.2007.09.027
36. GJ Goodhill HG Barrow 1994 The role of weight normalization in competitive learning Neural Comput 6 2 255 269 10.1162/neco.1994.6.2.255
37. M Graupner N Brunel 2007 STDP in a bistable synapse model based on CaMKII and associated signaling pathways PLoS Comput Biol 3 11 2299 2323 1:CAS:528:DC%2BD2sXhsVersrnF 10.1371/journal.pcbi.0030221 (Pubitemid 350241953)
38. R Gütig R Aharonov S Rotter H Sompolinsky 2003 Learning input correlations through nonlinear temporally asymmetric Hebbian plasticity J Neurosci 23 9 3697 3714 12736341
39. AG Hawkes 1971 Point spectra of some mutually exciting point processes J R Statist Soc Ser B 33 3 438 443
40. TK Hensch 2005 Critical period plasticity in local cortical circuits Nat Rev Neurosci 6 11 877 888 1:CAS:528:DC%2BD2MXhtFKls7bM 16261181 10.1038/nrn1787 (Pubitemid 41568729)
41. JA Hirsch LM Martinez 2006 Circuits that build visual cortical receptive fields Trends Neurosci 29 30 39 1:CAS:528:DC%2BD28XksVSnsw%3D%3D 16309753 10.1016/j.tins.2005.11.001 (Pubitemid 43063128)
42. A Holtmaat K Svoboda 2009 Experience-dependent structural synaptic plasticity in the mammalian brain Nat Rev Neurosci 10 9 647 658 1:CAS:528:DC%2BD1MXhtVWhsb7O 19693029 10.1038/nrn2699
43. DH Hubel TN Wiesel 1962 Receptive fields, binocular interaction and functional architecture in cats visual cortex J Physiol (Lond) 160 1 106 164
44. J Iglesias J Eriksson F Grize M Tomassini A Villa 2005 Dynamics of pruning in simulated large-scale spiking neural networks Biosystems 79 1-3 11 20 15649585 10.1016/j.biosystems.2004.09.016 (Pubitemid 40093032)
45. EM Izhikevich NS Desai 2003 Relating STDP to BCM Neural Comput 15 7 1511 1523 12816564 10.1162/089976603321891783 (Pubitemid 37035559)
46. LC Katz JC Crowley 2002 Development of cortical circuits: lessons from ocular dominance columns Nat Rev Neurosci 3 1 34 42 1:CAS:528: DC%2BD38XhsVyhsr0%3D 11823803 10.1038/nrn703 (Pubitemid 135706563)
47. R Kempter W Gerstner JL van Hemmen 1999 Hebbian learning and spiking neurons Phys Rev E 59 4 4498 4514 1:CAS:528:DyaK1MXit1ymsro%3D 10.1103/PhysRevE.59.4498
48. T Kohonen 1982 Self-organized formation of topologically correct feature maps Biol Cybern 43 1 59 69 10.1007/BF00337288 (Pubitemid 12139984)
49. B Kriener T Tetzlaff A Aertsen M Diesmann S Rotter 2008 Correlations and population dynamics in cortical networks Neural Comput 20 9 2185 2226 18439141 10.1162/neco.2008.02-07-474
50. C Leibold R Kempter JL van Hemmen 2002 How spiking neurons give rise to a temporal-feature map: from synaptic plasticity to axonal selection Phys Rev E 65 5 051915 10.1103/PhysRevE.65.051915 (Pubitemid 40618335)
51. EV Lubenov AG Siapas 2008 Decoupling through synchrony in neuronal circuits with propagation delays Neuron 58 1 118 131 1:CAS:528: DC%2BD1cXltVOis7s%3D 18400168 10.1016/j.neuron.2008.01.036 (Pubitemid 351467030)
52. JC Magee D Johnston 1997 A synaptically controlled, associative signal for Hebbian plasticity in hippocampal neurons Science 275 5297 209 213 1:CAS:528:DyaK2sXksF2jug%3D%3D 8985013 10.1126/science.275.5297.209 (Pubitemid 27034761)
53. CV Malsburg 1973 Self-organization of orientation sensitive cells in striate cortex Kybernetik 14 2 85 100 4786750 10.1007/BF00288907
54. M Marinaro S Scarpetta M Yoshioka 2007 Learning of oscillatory correlated patterns in a cortical network by a STDP-based learning rule Math Biosci 207 2 322 335 17306840 10.1016/j.mbs.2006.10.001 (Pubitemid 46764347)
55. H Markram J Lübke M Frotscher B Sakmann 1997 Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs Science 275 5297 213 215 1:CAS:528:DyaK2sXksF2ntg%3D%3D 8985014 10.1126/science.275.5297.213 (Pubitemid 27034762)
56. T Masquelier R Guyonneau SJ Thorpe 2008 Spike timing dependent plasticity finds the start of repeating patterns in continuous spike trains PLoS ONE 3 1 e1377 18167538 10.1371/journal.pone.0001377 (Pubitemid 351223139)
57. L Massoulie 1998 Stability results for a general class of interacting point processes dynamics, and applications Stoch Proc Appl 75 1 1 30 10.1016/S0304-4149(98)00006-4
58. H Meffin J Besson AN Burkitt DB Grayden 2006 Learning the structure of correlated synaptic subgroups using stable and competitive spike-timing- dependent plasticity Phys Rev E 73 4 041911 1:STN:280:DC%2BD283osVyktQ%3D%3D 10.1103/PhysRevE.73.041911
59. KD Miller 1996 Synaptic economics: competition and cooperation in synaptic plasticity Neuron 17 3 371 374 1:CAS:528:DyaK28XlvFagu7s%3D 8816700 10.1016/S0896-6273(00)80169-5 (Pubitemid 26322208)
60. KD Miller DJC Mackay 1994 The role of constraints in Hebbian learning Neural Comput 6 1 100 126 10.1162/neco.1994.6.1.100
61. R Moreno-Bote A Renart N Parga 2008 Theory of input spike auto- and cross-correlations and their effect on the response of spiking neurons Neural Comput 20 7 1651 1705 18254697 10.1162/neco.2008.03-07-497
62. A Morrison A Aertsen M Diesmann 2007 Spike-timing-dependent plasticity in balanced random networks Neural Comput 19 6 1437 1467 17444756 10.1162/neco.2007.19.6.1437
63. A Morrison M Diesmann W Gerstner 2008 Phenomenological models of synaptic plasticity based on spike timing Biol Cybern 98 6 459 478 18491160 10.1007/s00422-008-0233-1 (Pubitemid 351706395)
64. G Neves SF Cooke TVP Bliss 2008 Synaptic plasticity, memory and the hippocampus: a neural network approach to causality Nat Rev Neurosci 9 65 75 1:CAS:528:DC%2BD2sXhsVGjsbbI 18094707 10.1038/nrn2303 (Pubitemid 350295694)
65. JP Pfister W Gerstner 2006 Triplets of spikes in a model of spike timing-dependent plasticity J Neurosci 26 38 9673 9682 1:CAS:528: DC%2BD28XhtVCgu7jJ 16988038 10.1523/JNEUROSCI.1425-06.2006 (Pubitemid 44427706)
66. JP Pfister T Toyoizumi D Barber W Gerstner 2006 Optimal spike-timing-dependent plasticity for precise action potential firing in supervised learning Neural Comput 18 6 1318 1348 16764506 10.1162/neco.2006.18. 6.1318 (Pubitemid 43765446)
67. A Renart J de la Rocha P Bartho L Hollender N Parga A Reyes KD Harris 2010 The asynchronous state in cortical circuits Science 327 5965 587 590 1:CAS:528:DC%2BC3cXhtVGmur0%3D 20110507 10.1126/science.1179850
68. JE Rubin RC Gerkin GQ Bi CC Chow 2005 Calcium time course as a signal for spike-timing-dependent plasticity J Neurophysiol 93 5 2600 2613 15625097 10.1152/jn.00803.2004 (Pubitemid 40570842)
69. 2+ ions in dendritic spines Neuron 33 3 439 452 1:CAS:528:DC%2BD38XjtlWntr0%3D 11832230 10.1016/S0896-6273(02)00573-1 (Pubitemid 34158846)
70. W Senn 2002 Beyond spike timing: the role of nonlinear plasticity and unreliable synapses Biol Cybern 87 5-6 344 355 12461625 10.1007/s00422-002-0350- 1 (Pubitemid 135689596)
71. MN Shadlen WT Newsome 1998 The variable discharge of cortical neurons: implications for connectivity, computation, and information coding J Neurosci 18 10 3870 3896 1:CAS:528:DyaK1cXjtVWqtbg%3D 9570816
72. PJ Sjöström GG Turrigiano SB Nelson 2001 Rate, timing, and cooperativity jointly determine cortical synaptic plasticity Neuron 32 6 1149 1164 11754844 10.1016/S0896-6273(01)00542-6 (Pubitemid 34075403)
73. S Song LF Abbott 2001 Cortical development and remapping through spike timing-dependent plasticity Neuron 32 2 339 350 1:CAS:528:DC%2BD3MXosVKmur4%3D 11684002 10.1016/S0896-6273(01)00451-2 (Pubitemid 33030200)
74. S Song KD Miller LF Abbott 2000 Competitive Hebbian learning through spike-timing-dependent synaptic plasticity Nat Neurosci 3 9 919 926 1:CAS:528:DC%2BD3cXmtlGjt7g%3D 10966623 10.1038/78829
75. NV Swindale 1996 The development of topography in the visual cortex: a review of models Network 7 2 161 247 1:STN:280:DC%2BD28zktFyitA%3D%3D 16754382 10.1088/0954-898X/7/2/002
76. T Tzounopoulos Y Kim D Oertel LO Trussell 2004 Cell-specific, spike timing-dependent plasticities in the dorsal cochlear nucleus Nat Neurosci 7 7 719 725 1:CAS:528:DC%2BD2cXltF2htbo%3D 15208632 10.1038/nn1272 (Pubitemid 38859056)
77. van Hemmen JL (2001) Theory of synaptic plasticity. In: Moss F, Gielen S (eds), Handbook of biological physics, vol 4. Neuro-informatics and neural modelling. Elsevier, Amsterdam, pp 771-823
78. MCW van Rossum GG Turrigiano 2001 Correlation based learning from spike timing dependent plasticity Neurocomputing 38 409 415 10.1016/S0925-2312(01) 00360-5 (Pubitemid 35276664)
79. MCW van Rossum GQ Bi GG Turrigiano 2000 Stable Hebbian learning from spike timing-dependent plasticity J Neurosci 20 23 8812 8821 11102489
80. HX Wang RC Gerkin DW Nauen GQ Bi 2005 Coactivation and timing-dependent integration of synaptic potentiation and depression Nat Neurosci 8 2 187 193 1:CAS:528:DC%2BD2MXnslKltg%3D%3D 15657596 10.1038/nn1387 (Pubitemid 40194049)
81. OG Wenisch J Noll JL van Hemmen 2005 Spontaneously emerging direction selectivity maps in visual cortex through STDP Biol Cybern 93 4 239 247 16195915 10.1007/s00422-005-0006-z (Pubitemid 41500506)
82. RO Wong 1999 Retinal waves and visual system development Annu Rev Neurosci 22 29 47 1:CAS:528:DyaK1MXhvFemsr8%3D 10202531 10.1146/annurev.neuro. 22.1.29 (Pubitemid 29144880)
83. LI Zhang MM Poo 2001 Electrical activity and development of neural circuits Nat Neurosci 4 1207 1214 1:CAS:528:DC%2BD3MXot1Wrt7g%3D 11687831 10.1038/nn753
84. Q Zou A Destexhe 2007 Kinetic models of spike-timing dependent plasticity and their functional consequences in detecting correlations Biol Cybern 97 1 81 97 17530277 10.1007/s00422-007-0155-3 (Pubitemid 47149656)