Dynamic flux tubes form reservoirs of stability in neuronal circuits

Physical Review X

Volumn 2, Issue 4, 2012, Pages

  Monteforte, Michael ^a,b,c,d   Wolf, Fred ^a,b,c,d  

^a MAX PLANCK INSTITUTE FOR DYNAMICS AND SELF ORGANIZATION   (Germany)

^b Bernstein Focus Neurotechnology   (Germany)

^c BERNSTEIN CENTER FOR COMPUTATIONAL NEUROSCIENCE   (Germany)

^d UNIVERSITY OF GÖTTINGEN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE FUNCTIONS; ELECTRICAL IMPULSE; FLUX TUBES; HIGH NOISE; IN-VIVO; MINIMAL MODEL; NEURON NUMBER; NEURONAL CIRCUITS; PHASE SPACES; RATE RESPONSE; SENSORY PROCESSING; SMALL PERTURBATIONS; STATE SEQUENCES; UNSTABLE DYNAMICS; WORKING MEMORIES;

DYNAMICS; PHASE SPACE METHODS; TUBES (COMPONENTS);

NEURONS;

EID: 84872392824     PISSN: None     EISSN: 21603308     Source Type: Journal    
DOI: 10.1103/PhysRevX.2.041007     Document Type: Article

References (62)

1. G. F. Striedter, Principles of Brain Evolution (Sinauer Associates, Sunderland, 2004), p. 436.
2. E. Kandel, J. Schwartz, and Thomas Jessell, Principles of Neural Science (McGraw-Hill Medical, New York, 2000), p. 1414.
3. B. D. Burns and A. C. Webb, The Spontaneous Activity of Neurones in the Cat's Cerebral Cortex, Proc. R. Soc. B 194, 211 (1976).
4. W. R. Softky and C. Koch, The Highly Irregular Firing of Cortical Cells is Inconsistent with Temporal Integration of Random EPSPs, J. Neurosci. 13, 334 (1993).
5. M. N. Shadlen and W. T. Newsome, The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding, J. Neurosci. 18, 3870 (1998).
6. A. Compte, C. Constantinidis, J. Tegner, S. Raghavachari, M.V. Chafee, P. S. Goldman-Rakic, and X.-J. Wang, Temporally Irregular Mnemonic Persistent Activity in Prefrontal Neurons of Monkeys During a Delayed Response Task, J. Neurophysiol. 90, 3441 (2003).
7. Shigeru Shinomoto, Hideaki Kim, Takeaki Shimokawa, Nanae Matsuno, Shintaro Funahashi, Keisetsu Shima, Ichiro Fujita, Hiroshi Tamura, Taijiro Doi, Kenji Kawano, Naoko Inaba, Kikuro Fukushima, Sergei Kurkin, Kiyoshi Kurata, Masato Taira, Ken-Ichiro Tsutsui, Hidehiko Komatsu, Tadashi Ogawa, Kowa Koida, Jun Tanji, and Keisuke Toyama, Relating Neuronal Firing Patterns to Functional Differentiation of Cerebral Cortex, PLoS Comput. Biol. 5, e1000433 (2009).
8. Mark M. Churchland, Byron M. Yu, John P. Cunningham, Leo P. Sugrue, Marlene R. Cohen, Greg S. Corrado, William T. Newsome, Andrew M. Clark, Paymon Hosseini, Benjamin B. Scott, David C. Bradley, Matthew A. Smith, Adam Kohn, J. Anthony Movshon, Katherine M. Armstrong, Tirin Moore, Steve W. Chang, Lawrence H. Snyder, Stephen G. Lisberger, Nicholas J. Priebe, Ian M. Finn, David Ferster, Stephen I. Ryu, Gopal Santhanam, Maneesh Sahani, and Krishna V. Shenoy, Stimulus Onset Quenches Neural Variability: A Widespread Cortical Phenomenon, Nat. Neurosci. 13, 369 (2010).
9. M. N. Shadlen and W. T. Newsome, Noise, Neural Codes, and Cortical Organization, Curr. Opin. Neurobiol. 4, 569 (1994).
10. M.V. Tsodyks and T. Sejnowski, Rapid State Switching in Balanced Cortical Network Models, Network 6, 111 (1995).
11. Carl van Vreeswijk and Haim Sompolinsky, Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity, Science 274, 1724 (1996); Chaotic Balanced State in a Model of Cortical Circuits, Neural Comput. 10, 1321 (1998).
12. Moshe Abeles, Corticonics: Neural Circuits of the Cerebral Cortex (Cambridge University Press, Cambridge, 1991), p. 296.
13. Christoph von der Malsburg, in Models of Neural Networks II, edited by Eytan Domany, Jan Leonard Hemmen, and K. Schulten (Springer, Berlin, 1994), Chap. 2, pp. 95-119.
14. Fred Rieke, DavidWarland, Rob de Ruyter van Steveninck, and William Bialek, Spikes: Exploring the Neural Code (The MIT Press, Cambridge, MA, 1996), p. 395.
15. John Hertz and Adam Prügel-Bennett, Learning Short Synfire Chains by Self-Organization, Network 7, 357 (1996)
16. Robert Gütig and Haim Sompolinsky, The Tempotron: A Neuron that Learns Spike Timing-Based Decisions, Nat. Neurosci. 9, 420 (2006).
17. David Sussillo and L. F. Abbott, Generating Coherent Patterns of Activity from Chaotic Neural Networks, Neuron 63, 544 (2009).
18. N. H. Packard, in Dynamic Patterns in Complex Systems, edited by A. J. Mandell, J. A. S. Kelso, and M. F. Shlesinger (World Scientific, Singapore, 1988) pp. 293-301.
19. C. G. Langton, Computation at the Edge of Chaos: Phase Transitions and Emergent Computation, Physica (Amsterdam) 42D, 12 (1990).
20. Melanie Mitchell, Peter T. Hraber, and J. P. Crutchfield, Revisiting the Edge of Chaos: Evolving Cellular Automata to Perform Computations, Complex Syst. 7, 89 (1993).
21. H. Jaeger, The "Echo State"Approach to Analysing and Training Recurrent Neural Networks, GMD Report No. 148 (2001).
22. Wolfgang Maass, Thomas Natschläger, and Henry Markram, Real-Time Computing without Stable States: A New Framework for Neural Computation Based on Perturbations, Neural Comput. 14, 2531 (2002).
23. J. J. Steil, in IEEE International Joint Conference on Neural Networks (IEEE, New York, 2004), Vol. 2, pp. 843-848.
24. Mantas Lukoševičius and Herbert Jaeger, Reservoir Computing Approaches to Recurrent Neural Network Training, Computer Science Review 3, 127 (2009)
25. Herbert Jaeger, Mantas Lukoševičius, Dan Popovici, and Udo Siewert, Optimization and Applications of Echo State Networks with Leaky-Integrator Neurons, Neural Netw. 20, 335 (2007).
26. Robert Legenstein and Wolfgang Maass, Edge of Chaos and Prediction of Computational Performance for Neural Circuit Models, Neural Netw. 20, 323 (2007).
27. Prashant Joshi, From Memory-Based Decisions to Decision-Based Movements: A Model of Interval Discrimination Followed by Action Selection, Neural Netw. 20, 298 (2007).
28. Wolfgang Maass, Prashant Joshi, and Eduardo D. Sontag, Computational Aspects of Feedback in Neural Circuits, PLoS Comput. Biol. 3, e165 (2007).
29. D. Verstraeten, B. Schrauwen, M. D'Haene, and D. Stroobandt, An Experimental Unification of Reservoir Computing Methods, Neural Netw. 20, 391 (2007).
30. Tayfun Gü rel, Stefan Rotter, and Ulrich Egert, Functional Identification of Biological Neural Networks Using Reservoir Adaptation for Point Processes, J. Comput. Neurosci. 29, 279 (2009).
31. Surya Ganguli, Dongsung Huh, and Haim Sompolinsky, Proc. Natl. Acad. Sci. U.S.A. 105, 18970 (2008).
32. T. Toyoizumi and L. F. Abbott, Beyond the Edge of Chaos: Amplification and Temporal Integration by Recurrent Networks in the Chaotic Regime, Phys. Rev. E 84, 051908 (2011).
33. Michael London, Arnd Roth, Lisa Beeren, Michael Häusser, and Peter E Latham, Sensitivity to Perturbations In Vivo Implies High Noise and Suggests Rate Coding in Cortex, Nature (London) 466, 123 (2010)
34. Michael Monteforte and Fred Wolf, Dynamical Entropy Production in Spiking Neuron Networks in the Balanced State, Phys. Rev. Lett. 105, 268104 (2010).
35. Marc Timme, Fred Wolf, and Theo Geisel, Prevalence of Unstable Attractors in Networks of Pulse-Coupled Oscillators, Phys. Rev. Lett. 89, 154105 (2002).
36. Peter Ashwin and Marc Timme, Unstable Attractors: Existence and Robustness in Networks of Oscillators with Delayed Pulse Coupling, Nonlinearity 18, 2035 (2005)
37. Marc Timme, Fred Wolf, and Theo Geisel, Topological Speed Limits to Network Synchronization, Phys. Rev. Lett. 92, 074101 (2004).
38. Alexander Zumdieck, Marc Timme, Theo Geisel, and Fred Wolf, Long Chaotic Transients in Complex Networks, Phys. Rev. Lett. 93, 244103 (2004).
39. Louis Lapicque, Quantitative Investigations of Electrical Nerve Excitation Treated as Polarization. 1907, Biol. Cybern. 97, 3419 (2007).
40. A. N. Burkitt, A Review of the Integrate-and-Fire Neuron Model: I. Homogeneous Synaptic Input, Biol. Cybern. 95, 1 (2006); A Review of the Integrate-and-Fire Neuron Model: II. Inhomogeneous Synaptic Input and Network Properties, Biol. Cybern. 95, 97 (2006).
41. A. Politi, R. Livi, G. L. Oppo, and R. Kapral, Unpredictable Behaviour in Stable Systems, Europhys. Lett. 22, 571 (1993).
42. Antonio Politi and Alessandro Torcini, in Nonlinear Dynamics and Chaos: Advances and Perspectives, Understanding Complex Systems, Understanding Complex Systems, edited by Marco Thiel, Jürgen Kurths, M. Carmen Romano, György Károlyi, and Alessandro Moura (Springer, Berlin, 2010), p. 103.
43. Sven Jahnke, Raoul-Martin Memmesheimer, and Marc Timme, Stable Irregular Dynamics in Complex Neural Networks, Phys. Rev. Lett. 100, 048102 (2008); How Chaotic is the Balanced State?, Front. Comput. Neurosci. 3, 13 (2009).
44. Rüdiger Zillmer, Roberto Livi, Antonio Politi, and Alessandro Torcini, Desynchronization in Diluted Neural Networks, Phys. Rev. E 74, 036203 (2006).
45. Rüdiger Zillmer, Nicolas Brunel, and David Hansel, Very Long Transients, Irregular Firing, and Chaotic Dynamics in Networks of Randomly Connected Inhibitory Integrateand-Fire Neurons, Phys. Rev. E 79, 031909 (2009).
46. M. Tsodyks, I. Mitkov, and H. Sompolinsky, Pattern of Synchrony in Inhomogeneous Networks of Oscillators with Pulse Interactions, Phys. Rev. Lett. 71, 1280 (1993).
47. U. Ernst, K. Pawelzik, and T. Geisel, Synchronization Induced by Temporal Delays in Pulse-Coupled Oscillators, Phys. Rev. Lett. 74, 1570 (1995).
48. Marc Timme, Fred Wolf, and Theo Geisel, Topological Speed Limits to Network Synchronization, Phys. Rev. Lett. 92, 074101 (2004).
49. See Supplemental Material at http://link.aps.org/ supplemental/10.1103/PhysRevX.2.041007 for more details on the analytical derivations of the phase map and the single spike Jacobians, the random matrix approximation of the mean Lyapunov exponent, the numerical convergence and the extensivity of the Lyapunov spectra, and additional distance calculations.
50. N. Brunel and V. Hakim, Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates, Neural Comput. 11, 1621 (1999).
51. Giancarlo Benettin, Luigi Galgani, Antonio Giorgilli, and Jean-Marie Strelcyn, Lyapunov Characteristic Exponents for Smooth Dynamical Systems and for Hamiltonian Systems; A Method for Computing all of them. Part 1: Theory, Meccanica 15, 9 (1980); Lyapunov Characteristic Exponents for Smooth Dynamical Systems and for Hamiltonian Systems; A Method for Computing all of them. Part 2: Numerical Application, Meccanica 15, 21 (1980).
52. J. P. Eckmann and D. Ruelle, Ergodic Theory of Chaos and Strange Attractors, Rev. Mod. Phys. 57, 617 (1985).
53. Takuya Yokozawa, Daisuke Takahashi, Taisuke Boku, and Mitsuhisa Sato, in Proceedings of the Fourth International Workshop on Parallel Matrix Algorithms and Applications (2006), p. 37 (unpublished).
54. Michael Brecht, Miriam Schneider, Bert Sakmann, and Troy W. Margrie, Whisker Movements Evoked by Stimulation of Single Pyramidal Cells in Rat Motor Cortex, Nature (London) 427, 704 (2004).
55. Daniel Huber, Leopoldo Petreanu, Nima Ghitani, Sachin Ranade, Tomás Hromádka, Zach Mainen, and Karel Svoboda, Sparse Optical Microstimulation in Barrel Cortex Drives Learned Behaviour in Freely Moving Mice, Nature (London) 451, 61 (2008)
56. Arthur R. Houweling and Michael Brecht, Behavioural Report of Single Neuron Stimulation in Somatosensory Cortex, Nature (London) 451, 65 (2007).
57. Benjamin Lindner and Lutz Schimansky-Geier, Transmission of Noise Coded versus Additive Signals through a Neuronal Ensemble, Phys. Rev. Lett. 86, 2934 (2001).
58. Bruce W. Knight, Dynamics of Encoding in a Population of Neurons, J. Gen. Physiol. 59, 734 (1972).
59. R. O. Dror, C. C. Canavier, R. J. Butera, J.W. Clark, and J. H. Byrne, A Mathematical Criterion Based on Phase Response Curves for Stability in a Ring of Coupled Oscillators, Biol. Cybern. 80, 11 (1999).
60. Marc Timme and Fred Wolf, The Simplest Problem in the Collective Dynamics of Neural Networks: Is Synchrony Stable?, Nonlinearity 21, 1579 (2008)
61. Michael Monteforte and Fred Wolf, (unpublished)
62. Misha Rabinovich, Ramon Huerta, and Gilles Laurent, Neuroscience. Transient Dynamics for Neural Processing, Science 321, 48 (2008).