Randomly connected networks have short temporal memory

Neural Computation

Volumn 25, Issue 6, 2013, Pages 1408-1439

  Wallace, Edward ^a,b   Maei, Hamid Reza ^c   Latham, Peter E ^d  

^a UNIVERSITY OF CHICAGO   (United States)

^b HARVARD UNIVERSITY   (United States)

^c Stanford University   (United States)

^d UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; BRAIN; CYTOLOGY; HUMAN; LONG TERM MEMORY; NERVE CELL; NERVE CELL NETWORK; NONLINEAR SYSTEM; PHYSIOLOGY; PROBABILITY; SHORT TERM MEMORY; STATISTICAL MODEL; TIME;

ACTION POTENTIALS; BRAIN; HUMANS; LINEAR MODELS; MEMORY, LONG-TERM; MEMORY, SHORT-TERM; MODELS, NEUROLOGICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS; NONLINEAR DYNAMICS; PROBABILITY; TIME FACTORS;

EID: 84877832983     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00449     Document Type: Article

References (30)

1. Ashwin, P., Buescu, J., & Stewart, I. (1996). From attractor to chaotic saddle: A tale of transverse instability. Nonlinearity, 9, 703-737.
2. Banerjee, A. (2006).On the sensitive dependence on initial conditions of the dynamics of networks of spiking neurons. J. Comput. Neurosci., 20, 321-348.
3. Bertschinger, N., & Natschläger, T. (2004). Real-time computation at the edge of chaos in recurrent neural networks. Neural Comput., 16, 1413-1436.
4. Borst, J. (2010). The low synaptic release probability in vivo. Trends Neurosci., 33, 259-266.
5. Braitenberg, V., & Schüz, A. (1991). Anatomy of the cortex. Berlin: Springer-Verlag.
6. Branco, T.,&Staras,K. (2009). The probability of neurotransmitter release:Variability and feedback control at single synapses. Nat. Rev. Neurosci., 10, 373-383.
7. Brody, C., Romo, R., & Kepecs, A. (2003). Basic mechanisms for graded persistent activity: Discrete attractors, continuous attractors, and dynamic representations. Curr. Opin. Neurobiol., 13, 204-211.
8. Buonomano, D.,&Maass,W. (2009). State-dependent computations: Spatiotemporal processing in cortical networks. Nat. Rev. Neurosci., 10, 113-125.
9. Büsing, L., Schrauwen, B., & Legenstein, R. (2010). Connectivity, dynamics, and memory in reservoir computing with binary and analog neurons. Neural Comput., 22, 1272-1311.
10. Del Castillo, J., & Katz, B. (1954). Quantal components of the end-plate potential. J. Physiol. (London), 124, 560-573.
11. Diesmann, M.,Gewaltig,M.,&Aertsen, A. (1999). Stable propagation of synchronous spiking in cortical neural networks. Nature, 402, 529-533.
12. Ganguli, S.,Huh,D.,&Sompolinsky, H. (2008).Memory traces in dynamical systems. Proc. Natl. Acad. Sci. USA, 105, 18970-18975.
13. Izhikevich, E. (2006). Polychronization: Computation with spikes. Neural Comput, 18, 245-282.
14. Izhikevich, E., & Edelman, G. (2008). Large-scale model of mammalian thalamocortical systems. Proc. Natl. Acad. Sci. USA, 105, 3593-3598.
15. Jaeger, H. (2001). The "echo state" approach to analysing and training recurrent neural networks. Biol. Cybern., 81, 211-225.
16. Jaeger, H., & Haas, H. (2004). Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication. Science, 304, 78-80.
17. Kauffman, S., & Johnsen, S. (1991). Co-evolution to the edge of chaos: Coupled fitness landscapes, poised states, and co-evolutionary avalanches. J. Theor. Biol., 149, 467-505.
18. Koulakov, A., Raghavachari, S., Kepecs, A., & Lisman, J. (2002). Model for a robust neural integrator. Nature Neurosci., 5, 775-782.
19. Langton,C. (1990).Computation at the edge of chaos: Phase transitions and emergent computation. Physica D: Nonlinear Phenomena, 42, 12-37.
20. Legenstein, R., & Maass, W. (2007). Edge of chaos and prediction of computational performance for neural circuit models. Neural Networks, 20, 323-334.
21. Litwin-Kumar, A., & Doiron, B. (2012). Slow dynamics and high variability in balanced cortical networks with clustered connections. Nat. Neurosci., 15(11), 1498-1505.
22. London, M., Roth, A., Beeren, L., Häusser, M., & Latham, P. E. (2010). Sensitivity to perturbations in vivo implies high noise and suggests rate coding in cortex. Nature, 466, 123-127.
23. Maass, W., Legenstein, R., & Bertschinger, N. (2005). Methods for estimating the computational power and generalization capability of neural microcircuits. In L. K. Saul, Y. Weiss, & L. Bottou (Eds.), Advances in neural information processing systems, 17 (pp. 865-872). Cambridge, MA: MIT Press.
24. Maass, W., Natschläger, T., & Markram, H. (2002). Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Comput., 14, 2531-2560.
25. Monteforte, M., & Wolf, F. (2010). Dynamical entropy production in spiking neuron networks in the balanced state. Phys. Rev. Lett., 105, 268104.
26. Rajan, K., Abbott, L., & Sompolinsky, H. (2010). Stimulus-dependent suppression of chaos in recurrent neural networks. Phys Rev. E Stat Nonlin. Soft Matter Phys., 82, 011903.
27. Seung, H. (1996). How the brain keeps the eyes still. Proc. Natl. Acad. Sci. USA, 93, 13339-13344.
28. Sussillo,D.,&Abbott, L. (2009). Generating coherent patterns of activity fromchaotic neural networks. Neuron, 63, 544-557.
29. van Vreeswijk, C., & Sompolinsky, H. (1996). Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science, 274, 1724-1726.
30. van Vreeswijk, C., & Sompolinsky, H. (1998). Chaotic balanced state in a model of cortical circuits. Neural Comput., 10, 1321-1371.