Limits to the development of feed-forward structures in large recurrent neuronal networks

Frontiers in Computational Neuroscience

Volumn , Issue FEBRUARY, 2011, Pages

  Kunkel, Susanne ^a   Diesmann, Markus ^b,c,d   Morrison, Abigail ^a,b  

^a UNIVERSITY OF FREIBURG   (Germany)

^b RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^c FORSCHUNGSZENTRUM JÜLICH   (Germany)

^d RIKEN   (Japan)

Author keywords

Feed forward structure; Random recurrent network; Spike timing dependent plasticity

Indexed keywords

FEED-FORWARD; FUNCTIONAL STRUCTURE; LARGE SCALE SIMULATIONS; LEVEL OF INTEREST; NEURONAL NETWORKS; RANDOM NETWORK; RANDOM NETWORK MODELS; RECURRENT NETWORKS; SPIKE-TIMING-DEPENDENT PLASTICITY; SYMMETRY-BREAKING; UNCONSTRAINED SYSTEMS; UNSTABLE FIXED POINT;

FUNCTIONAL POLYMERS; IMAGE RECORDING;

NEURAL NETWORKS;

ADAPTATION; ARTICLE; CONTROLLED STUDY; HOMEOSTASIS; NERVE CELL NETWORK; NERVE CELL PLASTICITY; POSITIVE FEEDBACK; PREDICTION; SIMULATION; SPIKE TIMING DEPENDENT PLASTICITY;

EID: 84855214183     PISSN: 16625188     EISSN: None     Source Type: Journal    
DOI: 10.3389/fncom.2010.00160     Document Type: Article

References (75)

1. Abbott, L. F., and Nelson, S. B. (2000). Synaptic plasticity: taming the beast. Nat. Neurosci. 3(Suppl.), 1178-1183.
2. Abeles, M. (1991). Corticonics: Neural Circuits of the Cerebral Cortex, 1st Edn. Cambridge: Cambridge University Press.
3. Abeles, M., Bergman, H., Margalit, E., and Vaadia, E. (1993). Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. J. Neurophysiol. 70, 1629-1638.
4. Bi, G.-Q., and Poo, M.-M. (1998). Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci. 18, 10464-10472.
5. Bienenstock, E. (1995). A model of neocortex. Network 6, 179-224.
6. Bienenstock, E. L., Cooper, L. N., and Munro, P. W. (1982). Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J. Neurosci. 2, 32-48.
7. Binzegger, T., Douglas, R. J., and Martin, K. A. C. (2004). A quantitative map of the circuit of cat primary visual cortex. J. Neurosci. 39, 8441-8453.
8. Brunel, N. (2000). Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J. Comput. Neurosci. 8, 183-208.
9. Clopath, C., Ziegler, L., Vasilaki, E., Büsing, L., and Gerstner, W. (2008). Tag-trigger-consolidation: a model of early and late long-term-potentiation and depression. PLoS Comput. Biol. 4, e1000248. doi: 10.1371/journal. pcbi.1000248
10. Debanne, D., Gähwiler, B. H., and Thompson, S. M. (1996). Cooperative interactions in the induction of longterm potentiation and depression of synaptic excitation between hippocampal CA3-CA1 cell pairs in vitro. Proc. Natl. Acad. Sci. U.S.A. 93, 11225-11230.
11. Debanne, D., Gähwiler, B. H., and Thompson, S. M. (1999). Heterogeneity of synaptic plasticity at unitary CA1- CA3 and CA3-CA3 connections in rat hippocampal slice cultures. J. Neurosci. 19, 10664-10671.
12. Diesmann, M., Gewaltig, M.-O., and Aertsen, A. (1999). Stable propagation of synchronous spiking in cortical neural networks. Nature 402, 529-533.
13. Doursat, R., and Bienenstock, E. (2006). "Neocortical self-structuration as a basis for learning," in 5th International Conference on Development and Learning (ICDL 2006), Indiana University, Bloomington, IN.
14. Eckhorn, R., Bauer, R., Jordan, W., Brosch, M., Kruse, W., Munk, M., and Reitböck, H. J. (1988). Coherent oscillations: a mechanism of feature linking in the visual cortex? Biol. Cybern. 60, 121-130
15. Fiete, I. R., Senn, W., Wang, C. Z. H., and Hahnloser, R. H. R. (2010). Spike-time-dependent plasticity and heterosynaptic competition organize networks to produce long scale-free sequences of neural activity. Neuron 65, 563-576.
16. Frey, U., and Morris, R. (1997). Synaptic tagging and long-term potentiation. Nature 385, 533-536.
17. Gerstner, W., Ritz, R., and van Hemmen, J. (1993). Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns. Biol. Cybern. 69, 503-515.
18. Gewaltig, M.-O., and Diesmann, M. (2007). NEST (Neural Simulation Tool). Scholarpedia 2, 1430.
19. Gewaltig, M.-O., Diesmann, M., and Aertsen, A. (2001). Propagation of cortical synfire activity: survival probability in single trials and stability in the mean. Neural Netw. 657-673.
20. Gilson, M., Burkitt, A. N., Grayden, D. B., Thomas, D. A., and van Hemmen, J. L. (2009a). Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. I. Input selectivity - strengthening correlated input pathways. Biol. Cybern. 101, 81-102.
21. Gilson, M., Burkitt, A. N., Grayden, D. B., Thomas, D. A., and van Hemmen, J. L. (2009b). Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. II. Input selectivity - symmetry breaking. Biol. Cybern. 101, 103-114.
22. Gilson, M., Burkitt, A. N., Grayden, D. B., Thomas, D. A., and van Hemmen, J. L. (2009c). Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks IV. Structuring synaptic pathways among recurrent connections. Biol. Cybern. 101, 427-444.
23. Gilson, M., Burkitt, A. N., and van Hemmen, J. L. (2010). STDP in recurrent neuronal networks. Front. Comput. Neurosci. 4:23. doi: 10.3389/fncom.2010.00023
24. Gray, C. M., and Singer, W. (1989). Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. Proc. Natl. Acad. Sci. U.S.A. 86, 1698-1702.
25. Gustafsson, B., Wigstrom, H., Abraham, W. C., and Huang, Y.-Y. (1987). Longterm potentiation in the hippocampus using depolarizing current pulses as the conditioning stimulus to single volley synaptic potentials. J. Neurosci. 7, 774-780.
26. Gütig, R., Aharonov, R., Rotter, S., and Sompolinsky, H. (2003). Learning input correlations through nonlinear temporally asymmetric Hebbian plasticity. J. Neurosci. 23, 3697-3714.
27. Hahnloser, R. H., Kozhevnikov, A. A., and Fee, M. S. (2002). An ultra-sparse code underlies the generation of neural sequences in a songbird. Nature 419, 65-70.
28. Hayon, G., Abeles, M., and Lehmann, D. (2004). Modeling compositionality by dynamic binding of synfire chains. J. Comput. Neurosci. 17, 179-201.
29. Hebb, D. O. (1949). The Organization of Behavior: A Neuropsychological Theory. New York: John Wiley and Sons.
30. Hennequin, G., Gerstner, W., and Pfister, J.-P. (2010). STDP in adaptive neurons gives close-to-optimal information transmission. Front. Comput. Neurosci. 4:143. doi: 10.3389/fncom.2010.00143
31. Hertz, J., and Prügel-Bennet, A. (1996). Learning synfire-chains by self-organization. Network 7, 357-363.
32. Hosaka, R., Araki, O., and Ikeguchi, T. (2008). STDP provides the substrate for igniting synfire chains by spatiotemporal input patterns. Neural Comput. 20, 415-435.
33. Iglesias, J., Eriksson, J., Grize, F., Tomassini, M., and Villa, A. (2005). Dynamics of pruning in simulated large-scale spiking neural networks. Biosystems 79, 11-20.
34. Ikegaya, Y., Aaron, G., Cossart, R., Aronov, D., Lampl, I., Ferster, D., and Yuste, R. (2004). Synfire chains and cortical songs: temporal modules of cortical activity. Science 5670, 559-564.
35. Izhikevich, E. M., Gally, J. A., and Edelman, G. M. (2004). Spike-timing dynamics of neuronal groups. Cereb. Cortex 14, 933-944.
36. Jun, J. K., and Jin, D. Z. (2007). Development of neural circuitry for precise temporal sequences through spontaneous activity, axon remodeling, and synaptic plasticity. PLoS ONE 2, e723. doi: 10.1371/journal.pone.0000723
37. Kempter, R., Gerstner, W., and van Hemmen, J. L. (1999). Hebbian learning and spiking neurons. Phys. Rev. E 59, 4498-4514.
38. Kempter, R., Gerstner, W., and van Hemmen, J. L. (2001). Intrinsic stabilization of output rates by spike-based Hebbian learning. Neural Comput. 12, 2709-2742.
39. Kistler, W. M., and van Hemmen, J. L. (2000). Modeling synaptic plasticity in conjunction with the timing of preand postsynaptic action potentials. Neural Comput. 12, 385-405.
40. Kozhevnikov, A., and Fee, M. S. (2007). Singing-related activity of identified HVC neurons in the zebra finch. J. Neurophysiol. 97, 4271-4283.
41. Kozloski, J., and Cecchi, G. A. (2010). A theory of loop formation and elimi-cooperativnation by spike timing-dependent plasticity. Front. Neural Circuits 4:7.doi: 10.3389/fncir.2010.00007
42. Kuhn, A., Aertsen, A., and Rotter, S. (2003). Higher-order statistics of input ensembles and the response of simple model neurons. Neural Comput. 1, 67-101.
43. Kumar, A., Rotter, S., and Aertsen, A. (2008). Conditions for propagating synchronous spiking and asynchronous firing rates in a cortical network model. J. Neurosci. 28, 5268-5280.
44. Levy, N., Horn, D., Meilijson, I., and Ruppin, E. (2001). Distributed synchrony in a cell assembly of spiking neurons. Neural Netw. 14, 815-824.
45. Lewis, D., Melchitzky, D., and Burgos, G.-G. (2002). Specificity in the functional architecture of primate prefontal cortex. J. Neurocytol. 31, 265-276.
46. Liu, J. K., and Buonomano, D. V. (2009). Embedding multiple trajectories in simulated recurrent neural networks in a self-organizing manner. J. Neurosci. 29, 13172-13181.
47. Lubenov, E. V., and Siapas, A. G. (2008). Decoupling through synchrony in neuronal circuits with propagation delays. Neuron 58, 118-131.
48. Markram, H., Lübke, J., Frotscher, M., and Sakmann, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275, 213-215.
49. Markram, H., and Sakmann, B. (1995). Action potentials propagating back into dendrites trigger changes in efficacy of single-axon synapses between layer V pyramidal neurons. Soc. Neurosci. Abstr. 21, 2007.
50. Masuda, N., and Kori, H. (2007). Formation of feedforward networks and frequency synchrony by spike-timing-dependent plasticity. J. Comput. Neurosci. 22, 327-345.
51. Mehring, C., Hehl, U., Kubo, M., Diesmann, M., and Aertsen, A. (2003). Activity dynamics and propagation of synchronous spiking in locally connected random networks. Biol. Cybern. 88, 395-408.
52. Migliore, M., Cannia, C., Lytton, W. W., Markram, H., and Hines, M. (2006). Parallel network simulations with neuron. J. Comput. Neurosci. 21, 119-223.
53. Montgomery, J., Pavlidis, P., and Madison, D. (2001). Pair recordings reveal allsilent synaptic connections and the postsynaptic expression of long-term potentiation. Neuron 29, 691-701.
54. Morrison, A., Aertsen, A., and Diesmann, M. (2007). Spike-timing dependent plasticity in balanced random networks. Neural Comput. 19, 1437-1467.
55. Morrison, A., Diesmann, M., and Gerstner, W. (2008). Phenomenological models of synaptic plasticity based on spiketiming. Biol. Cybern. 98, 459-478.
56. Morrison, A., Mehring, C., Geisel, T., Aertsen, A., and Diesmann, M. (2005). Advancing the boundaries of high connectivity network simulation with distributed computing. Neural Comput. 17, 1776-1801.
57. Nordlie, E., Plesser, H. E., and Gewaltig, M.-O. (2009). Towards reproducible descriptions of neuronal network models. PLoS Comput. Biol. 5, e1000456. doi: 10.1371/journal.pcbi.1000456
58. Pawlak, V., Wickens, J. R., Kirkwood, A., and Kerr, J. N. D. (2010). Timing is not everything: neuromodulation opens the STDP gate. Front. Syn. Neurosci. 2:146. doi: 10.3389/fnsyn.2010.00146
59. Pecevski, D., Natschläger, T., and Schuch, K. (2009). PCSIM: a parallel simulation environment for neural circuits fully integrated with python. Front. Neuroinform. 3:11. doi: 10.3389/neuro.11.011.2009
60. Pfister, J.-P., and Gerstner, W. (2006). Triplets of spikes in a model of spike timing-dependent plasticity. J. Neurosci. 26, 9673-9682.
61. Prut, Y., Vaadia, E., Bergman, H., Haalman, I., Hamutal, S., and Abeles, M. (1998). Spatiotemporal structure of cortical activity: Properties and behavioral relevance. J. Neurophysiol. 79, 2857-2874.
62. Pulvermüller, F., and Shtyrov, Y. (2009). Spatiotemporal signatures of largescale synfire chains for speech processing as revealed by MEG. Cereb. Cortex 19, 79-88.
63. Reymann, K. G., and Frey, J. U. (2007). The late maintenance of hippocampal LTP: Requirements, phases, "synaptic tagging," "late-associativity" and implications. Neuropharmacology 52, 24-40.
64. Rubin, J., Lee, D., and Sompolinsky, H. (2001). Equilibrium properties of temporally asymmetric Hebbian plasticity. Phys. Rev. Lett. 86, 364-367.
65. Schüz, A., and Braitenberg, V. (2002). "The human cortical white matter: quantitative aspects of cortico-cortical longrange connectivity," in Cortical Areas: Unity and Diversity, Chapter 16, eds A. Schüz and R. Miller (London: Taylor and Francis), 377-385.
66. Seol, G., Ziburkus, J., Huang, S., Song, L., Kim, I., Takamiya, K., Huganir, R., Lee, H.-K., and Kirkwood, A. (2007). Neuromodulators control the polarity of spike-timing-dependent plasticity. Neuron 55, 919-929.
67. Sjöström, P., Turrigiano, G., and Nelson, S. (2001). Rate, timing, and cooperativnation ity jointly determine cortical synaptic plasticity. Neuron 32, 1149-1164.
68. Song, S., Miller, K. D., and Abbott, L. F. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat. Neurosci. 3, 919-926.
69. Song, S., Sjöström, P. J., Reigl, M., Nelson, S., and Chklovskii, D. B. (2005). Highly nonrandom features of synaptic connectivity in local cortical circuits. PLoS Biol. 3, e350. doi: 10.1371/journal. pbio.0030350
70. Standage, D., Jalil, S., and Trappenberg, T. (2007). Computational consequences of experimentally derived spike-time and weight dependent plasticity rules. Biol. Cybern. 96, 615-623.
71. Thomson, A. M., and Bannister, P. (2003). Interlaminar connections in the neocortex. Cereb. Cortex 13, 5-14.
72. Turrigiano, G. G., Leslie, K. R., Desai, N. S., Rutherford, L. C., and Nelson, S. B. (1998). Activity-dependent scaling of quantal amplitude in neocortical neurons. Nature 391, 892-896.
73. van Rossum, M. C. W., Bi, G.-Q., and Turrigiano, G. G. (2000). Stable Hebbian learning from spike timingdependent plasticity. J. Neurosci. 20, 8812-8821.
74. Wang, H.-X., Gerkin, R. C., Nauen, D. W., and Bi, G.-Q. (2005). Coactivation and timing-dependent integration of synaptic potentiation and depression. Nat. Neurosci. 8, 187-193.
75. Zou, Q., and Destexhe, A. (2007). Kinetic models of spike-timing dependent plasticity and their functional consequences in detecting correlations. Biol. Cybern. 97, 81-97.