A mathematical analysis of the effects of Hebbian learning rules on the dynamics and structure of discrete-time random recurrent neural networks

Neural Computation

Volumn 20, Issue 12, 2008, Pages 2937-2966

  Siri, Benoît ^a   Berry, Hugues ^a   Cessac, Bruno ^b,c,d   Delord, Bruno ^e   Quoy, Mathias ^f  

^a INRIA   (France)

^b INRIA   (France)

^c UNIVERSITÉ CÔTE D'AZUR   (France)

^d INSTITUT NON LINÉAIRE DE NICE   (France)

^e INSERM   (France)

^f UNIVERSITÉ DE CERGY PONTOISE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 57349192097     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2008.05-07-530     Document Type: Article

References (47)

1. Abraham, B., Christe, W. C., Logan, B., Lawlor, P., & Dragunow, M. (1994). Immediate early gene expression associated with the persistence of heterosynaptic long-term depression in the hippocampus. Proceedings of the National Academy of the Sciences of the USA, 91, 10049-10053.
2. Abraham, W. C., & Bear, M. F. (1996). Metaplasticity: The plasticity of synaptic plasticity. Trends in Neuroscience, 19, 126-130.
3. Abraham, W., Logan, B., Greenwood, J., & Dragunow, M. (2002). Induction and experience-dependent consolidation of stable long-term potentiation lasting months in the hippocampus. Journal of Neuroscience, 22, 9626-9634.
4. Atay, E., Biyikouglu, T. & Jost, J. (2006). Network synchronization: Spectral versus statistical properties. Physica D, 224, 35-41.
5. Barahona, M., & Pecora, L. (2002). Synchronization in small-world systems. Physics Review Letters, 89, 054101.
6. Bear, M., & Abraham, W. (1996). Long-term depression in hippocampus. Annual Review of Neuroscience, 19, 437-462.
7. Berry, H., & Quoy, M. (2006). Structure and dynamics of random recurrent neural networks. Adaptive Behavior, 14, 129-137.
8. Boccaletti, S., Latora, V., Moreno, Y., Chavez, M., & Hwang, D. U. (2006). Complex networks: Structure and dynamics. Physics Reports, 424, 175-308.
9. Bowen, R. (1975). Equilibrium states and the ergodic theory of Anosov diffeomorphisms. Berlin: Springer-Verlag.
10. Brager, D., Cai, X., & Thompson, S. (2003). Activity-dependent activation of presynaptic protein kinase c mediates post-tetanic potentiation. Nature Neuroscience, 6, 551-552.
11. Cessac, B. (1994). Absolute stability criteria for random asymmetric neural networks. Journal of Physics A. 27, 927-930.
12. Cessac, B. (1995). Increase in complexity in random neural networks. Journal de Physique, 5, 409-432.
13. Cessac, B., & Samuelides, M. (2007). From neuron to neural networks dynamics. European Physical Journal Special topics: Topics in Dynamical Neural Networks, 142, 7-88.
14. Cessac, B., & Sepulchre, J. (2004). Stable resonances and signal propagation in a chaotic network of coupled units. Physical Review E. 70, 056111.
15. Cessac, B., & Sepulchre, J. (2006). Transmitting a signal by amplitude modulation in a chaotic network. Chaos, 16, 013104.
16. Cessac, B., & Sepulchre, J. (2007). Linear response, susceptibility and resonances in chaotic toy models. Physica D, 225, 13-28.
17. Chung, F. R. K. (1997). Spectral graph theory. Providence, RI: American Mathematical Society.
18. Daoudal, G., & Debanne, D. (2003). Long-term plasticity of intrinsic excitability: Learning rules and mechanisms. Learning and Memory, 10, 456-465.
19. Dauce, E., Quoy, M., Cessac, B., Doyon, B., & Samuelides, M. (1998). Self-organization and dynamics reduction in recurrent networks: Stimulus presentation and learning. Neural Networks, 11, 521-533.
20. Dauce, E., Quoy, M., & Doyon, B. (2002). Resonant spatio-temporal learning in large random neural networks. Biological Cybernetics, 87, 185-198.
21. Delord, B., Berry, H., Guigon, E., & Genet, S. (2007). A new principle for information storage in an enzymatic pathway model. PLoS Computational Biology, 3, e124.
22. Doyon, B., Cessac, B., Quoy, M., & Samuelides, M. (1993). Control of the transition to chaos in neural networks with random connectivity. International Journal of Bifurcation and Chaos, 3, 279-291.
23. Freeman, W. (1987). Simulation of chaotic EEG pattern with a dynamic model of the olfactory system. Biological Cybernetics, 56, 139-150.
24. Freeman, W., Yao, Y., & Burke, B. (1988), Central pattern generating and recognizing in olfactory bulb: A correlation learning rule. Neural Networks, 1, 277-288.
25. Gaspard, P. (1998). Chaos, scattering and statistical mechanics. Cambridge: Cambridge University Press.
26. Girko, V. (1984). Circular law. Theory of Probability and its Applications, 29, 694-706.
27. Gouze, J. (1998). Positive and negative circuits in dynamical systems. Journal of Biological Systems, 6, 11-15.
28. Grinstern, G., & Linsker, R. (2005). Synchronous neural activity in scale-free network models versus random network models. Proceedings of the National Academy of the Sciences of the USA, 28, 9948-9953.
29. Hasegawa, H. (2005). Synchronisations in small-world networks of spiking neurons: Diffusive versus sigmoid couplings. Physical Review E, 72, 056139.
30. Hebb, D. (1948). The organization of behaviour. New York: Wiley.
31. Hirsch, M. (1989). Convergent activation dynamics in continuous time networks. Neural Networks, 2, 331-349.
32. Hong, H., Kim, B., Choi, M., & Park, H. (2002). Factors that predict better synchronizability on complex networks. Physical Review E, 65, 067105.
33. Hoppensteadt, F., & Izhikevich, E. (1997). Weakly connected neural networks. Berlin: Springer-Verlag.
34. Jaeger, H., & Haas, H. (2004). Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication. Science, 304, 78-80.
35. Kim, S., & Linden, D. (2007). Ubiquitous plasticity and memory storage. Neuron, 56, 582-592.
36. Lago-Fernández, L. E. Huerta, R., Corbacho, E. & Sigüienza, J. A. (2000). Fast response and temporal coherent oscillations in small-world networks. Physical Review Letters, 84, 2758-2761.
37. Langton, C. (1990). Computation at the edge of chaos. Physica D. 42, 12-37.
38. Nishikawa, T., Motter, A. E., Lai, Y. C., & Hoppensteadt, E C. (2003). Heterogeneity in oscillator networks: Are smaller worlds easier to synchronize? Physical Review Letters, 91, 014104.
39. Ruelle, D. (1978). Thermodynamic formalism. Reading, MA: Addison-Wesley.
40. Ruelle, D. (1999). Smooth dynamics and new theoretical ideas in nonequilibrium statistical mechanics. Journal of Statistical Physics, 95, 393-468.
41. Sinai, Y. G. (1972). Equilibrium states and the ergodic theory of Anosov diffeomorphisms. Berlin: Springer.
42. Siri, B., Berry, H., Cessac, B., Delord, B., & Quoy, M. (2006). Topological and dynamical structures induced by Hebbian learning in random neural networks. In International Conference on Complex Systems. Boston: New England Complex Systems Institute.
43. Siri, B., Quoy, M., Cessac, B., Delord, B., & Berry, H. (2007). Effects of Hebbian learning on the dynamics and structure of random networks with inhibitory and excitatory neurons. Journal of Physiology (Paris), 101, 136-148.
44. Thomas, R. (1981). On the relation between the logical structure of systems and their ability to generate multistationarity or sustained oscillations. In J. Delladora, J. Demongeot, & B. Lacolle (Eds.), Numerical methods in the study of critical phenomena (pp. 180-193). Berlin: Springer-Verlag.
45. Tsuda, I. (2001). Towards an interpretation of dynamic neural activity in terms of chaotic dynamical systems. Behavioral and Brain Sciences, 24, 793-810.
46. Turrigiano, G., Leslie, K., Desai, N., Rutherford, L., & Nelson, S. (1998). Activitydependent scaling of quantal amplitude in neocortical neurons. Nature, 391, 892-896.
47. Volchenkov, D., & Blanchard, P. (2007). Markov chain methods for analyzing complex transport networks. arXiv:0710.3566vl.