Real-time computation at the edge of chaos in recurrent neural networks

Neural Computation

Volumn 16, Issue 7, 2004, Pages 1413-1436

  Bertschinger, Nils ^a   Natschläger, Thomas ^b  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

^b SOFTWARE COMPETENCE CENTER HAGENBERG   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; COMPARATIVE STUDY; COMPUTER SIMULATION; FEEDBACK SYSTEM; MEMORY; NONLINEAR SYSTEM; TIME;

ANIMALS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; FEEDBACK; MEMORY; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; TIME FACTORS;

EID: 2942552269     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976604323057443     Document Type: Article

References (21)

1. Bak, P., Tang, C., & Wiesenfeld, K. (1987). Self-organized criticality: An explanation of 1/f noise. Physical Review Letters, 59(4), 381-384.
2. Bak, P., Tang, C., & Wiesenfeld, K. (1988). Self-organized criticality. Physical Review A, 38(1), 364-374.
3. Bornholdt, S., & Röhlf, T. (2003). Self-organized critical neural networks. Physical Review E, 67, 066118.
4. Bornholdt, S., & Röhlf, T. (2000). Topological evolution of dynamical networks: Global criticality from local dynamics. Physical Review Letters, 84(26), 6114-6117.
5. Boyd, S., & Chua, L. O. (1985). Fading memory & the problem of approximating nonlinear operators with Voltera series. IEEE Trans. on Circuits and Systems, 32, 1150.
6. Dauce, E., Quoy, M., Cessac, B., Doyon, B., & Samuelides, M. (1998). Self-organization & dynamics reduction in recurrent networks: Stimulus presentation and learning. Neural Networks, 11, 521-533.
7. Derrida, B. (1987). Dynamical phase transition in non-symmetric spin glasses. J. Phys. A: Math. Gen., 20, 721-725.
8. Derrida, B., & Pomeau, Y. (1986). R&om networks of automata: A simple annealed approximation. Europhys. Lett., 1, 45-52.
9. Derrida, B., & Weisbuch, G. (1986). Evolution of overlaps between configurations in random Boolean networks. J. Physique, 47, 1297.
10. Hertz, J., Krogh, A., & Palmer, R. G. (1991). Introduction to the theory of neural computation. Cambridge, MA: Perseus Books.
11. Jaeger, H. (2002). Tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the "echo state network" approach (GMD Tech. Rep. 159). Berlin: German National Research Center for Information Technology.
12. Kauffman, S. A. (1993). The origins of order: Self-organization and selection in evolution. New York: Oxford University Press.
13. Langton, C. G. (1990). Computation at the edge of chaos. Physica D, 42.
14. Luque, B., & Sole, R. (2000). Lyapunov exponents in random boolean networks. Physica A, 284, 33-45.
15. Maass, W., Natschläger, T., & Markram, H. (2002). Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Computation, 14(11), 2531-2560.
16. Mitchell, M., Hraber, P. T., & Crutchfield, J. P. (1993). Revisiting the edge of chaos: Evolving cellular automata to perform computations. Complex Systems, 7, 89-130.
17. Natschläger, T., & Maass, W. (2004). Information dynamics and emergent computation in recurrent circuits of spiking neurons. In S. Thrun, L. Saul, B. Schölkopf (Eds.), Advances in neural information processing systems, 16. Cambridge, MA: MIT Press.
18. Packard, N. (1988). Adaptation towards the edge of chaos. In J. A. S. Kelso, A. J. Mandell, & M. F. Shlesinger (Eds.), Dynamic patterns in complex systems (pp. 293-301). Singapore: World Scientific.
19. Röhlf, T., & Bornholdt, S. (2002). Criticality in random threshold networks: annealed approximation and beyond. Physica A, 310, 245-259.
20. Siu, K.-Y., Roychowdhury, V., & Kailath, T. (1995). Discrete neural computation: A theoretical foundation. Upper Saddle River, NJ: Prentice Hall.
21. van Vreeswijk, C. A., & Sompolinsky, H. (1996). Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science, 274, 1724-1726.