Information processing capacity of dynamical systems

Scientific Reports

Volumn 2, Issue , 2012, Pages

  Dambre, Joni ^a   Verstraeten, David ^a   Schrauwen, Benjamin ^a   Massar, Serge ^b  

^a GHENT UNIVERSITY   (Belgium)

^b UNIVERSITÉ LIBRE DE BRUXELLES   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; INFORMATION PROCESSING; THEORETICAL MODEL;

ARTIFICIAL INTELLIGENCE; AUTOMATIC DATA PROCESSING; COMPUTER SIMULATION; MODELS, THEORETICAL;

EID: 84864147615     PISSN: None     EISSN: 20452322     Source Type: Journal    
DOI: 10.1038/srep00514     Document Type: Article

References (27)

1. Arbib, M. (Ed.) The handbook of brain theory and neural networks, second edition. The MIT Press, Cambridge MA (2003).
2. Maass, W., Natschläger, T. & Markram H. Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comp. 14, 2531-2560 (2002).
3. Jaeger, H. & Haas H. Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304, 78-80 (2004). (Pubitemid 38455427)
4. Verstraeten, D., Schrauwen, B., D'Haene, M. & Stroobandt, D. An experimental unification of reservoir computing methods. Neural Networks 20, 391-403 (2007). (Pubitemid 46856109)
5. Vandoorne, K. et al. Toward optical signal processing using Photonic Reservoir Computing. Optics Express 16(15), 11182-11192 (2008).
6. Appeltant, L. et al. Information processing using a single dynamical node as complex system. Nat. Commun. 2, 468-472 (2011).
7. Paquot, Y. et al. Optoelectronic Reservoir Computing. Nat. Sci. Rep. In press (2011).
8. Larger, L. et al. Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing. Optics Express 20(3), 3241-3249 (2012).
9. Dale, K. & Husbands, P. The evolution of Reaction-Diffusion Controllers for Minimally Cognitive Agents. Artificial Life 16, 1-19 (2010).
10. Pfeifer, R., Iida, F. & Bongard, J. C.New Robotics:Design Principles for Intelligent Systems. Artificial Life 11, 1-2 (2005).
11. Hauser, H., Ijspeert, A. J., Füchslin, R. M., Pfeifer, R. & Maass, W. Towards a theoretical foundation for morphological computation with compliant bodies. Biol. Cyber. 105, 355-370 (2011).
12. Jaeger, H. Short Term Memory in Echo State Networks. Fraunhofer Institute for Autonomous Intelligent Systems, Tech. rep. 152 (2002).
13. White, O., Lee, D. & Sompolinsky, H. Short-term memory in orthogonal neural networks. Phys. Rev. Lett. 92(14), 148102 (2002).
14. Hermans, M. & Schrauwen B. Memory in linear recurrent neural networks in continuous time. Neural Networks 23(3), 341-355 (2010).
15. Gangulia, S., Huhc, D. & Sompolinsky, H. Memory traces in dynamical systems Proc. Natl. Acad. Sci. USA 105, 18970-18975 (2008).
16. Buonomano, D. & Maass, W. State-dependent computations: Spatiotemporal processing in cortical networks. Nat. Rev. Neurosci. 10(2), 113-125 (2009).
17. Boyd, S. & Chua, L. Fading memory and the problem of approximating nonlinear operators with Volterra series. IEEE Trans. Circuits Syst. 32, 1150-1161 (1985). (Pubitemid 16539237)
18. Wiener, N. Nonlinear Problems in Random Theory. John Wiley, New York (1958).
19. Lee, Y. W. & Schetzen, M. Measurement of the Wiener kernels of a nonlinear system by cross-correlation. Int. J. Control 2, 237-254 (1965).
20. Jaeger, H. The ''echo state'' approach to analysing and training recurrent neural networks. Fraunhofer Institute for Autonomous Intelligent Systems, Tech. rep. 148 (2001).
21. Lukosevicius, M. & Jaeger, H. Reservoir computing approaches to recurrent neural network training. Comp. Sci. Rev. 3, 127-149 (2009).
22. May, R. M. Simple mathematicalmodels with very complicated dynamics. Nature 261, 459-467 (1976).
23. Buehner, M. & Young, P. A tighter bound for the echo state property. IEEE Trans. Neural Netw. 17, 820-824 (2006).
24. Ozturk, M. C., Xu, D. & Principe, J. C. Analysis and Design of Echo State Networks. Neural Comp. 19, 111-138 (2006).
25. Gray, P. & Scott, S. K. Sustained oscillations and other exotic patterns of behavior in isothermal reactions. J. Phys. Chem. 89, 22-32 (1985).
26. Pearson, J. Complex patterns in a simple system. Science 261, 189-192 (1993).
27. Langton, C. G. Computation at the edge of chaos. Physica D 42, 12-37 (1990)