Memory versus non-linearity in reservoirs

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2010, Pages

  Verstraeten, David ^a   Dambre, Joni ^a   Dutoit, Xavier ^b   Schrauwen, Benjamin ^a  

^a GHENT UNIVERSITY   (Belgium)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

PATTERN RECOGNITION;

BRUTE-FORCE SEARCHING; LINEAR REGIME; MEMORY MAPPING; NONLINEAR MAPPINGS; PROPERTIES MAPPINGS; RESERVOIR COMPUTING; RESERVOIR OPERATION; RESERVOIR PROPERTY; SIMPLE++; TEMPORAL PROCESSING;

RECURRENT NEURAL NETWORKS;

EID: 79959400804     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2010.5596492     Document Type: Conference Paper

References (20)

1. Lars Buesing, Benjamin Schrauwen, and Robert Legenstein. Connectivity, dynamics, and memory in reservoir computing with binary and analog neurons. Neural Computation, 22(5):1272-1311, 2010.
2. T.M. Cover. Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition. IEEE transactions on electronic computers, 14(3):326-334, 1965.
3. S. Ganguli, D. Huh, and H. Sompolinsky. Memory traces in dynamical systems. Proceedings of the National Academy of Sciences, 105(48):18970, 2008.
4. M.A. Hajnal and A. Lorincz. Critical Echo State Networks. Lecture notes in Computer Science, 4131:658, 2006.
5. Michiel Hermans and Benjamin Schrauwen. Memory in linear recurrent neural networks in continuous time. Neural Networks, 2010.
6. H. Jaeger, M. Lukosevicius, and D. Popovici. Optimization and applications of echo state networks with leaky integrator neurons. Neural Networks, 20:335-352, 2007. (Pubitemid 46876638)
7. Herbert Jaeger. The "echo state" approach to analysing and training recurrent neural networks. Technical Report GMD Report 148, German National Research Center for Information Technology, 2001.
8. Herbert Jaeger. Short term memory in echo state networks. Technical Report GMD Report 152, German National Research Center for Information Technology, 2001.
9. Herbert Jaeger and Harald Haas. Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless telecommunication. Science, 308:78-80, April 2 2004.
10. M. Lukoševičius and H. Jaeger. Reservoir computing approaches to recurrent neural network training. Computer Science Review, 3(3):127-149, 2009.
11. W. Maass, T. Natschläger, and H. Markram. Realtime computing without stable states: A new framework for neural computation based on perturbations. Neural Computation, 14(11):2531-2560, 2002.
12. M. Minsky and S. Papert. Perceptrons: An Introduction to Computational Geometry. MIT Press, Cambridge, MA, 1969.
13. M. C. Ozturk, D. Xu, and J. C. Principe. Analysis and design of echo state networks. Neural Computation, 19:111-138, 2006.
14. B. Schrauwen, L. Busing, and R. Legenstein. On Computational Power and the Order-Chaos Phase Transition in Reservoir Computing. In Proceedings of NIPS, 2008.
15. B. Schrauwen, M. Warderman, D. Verstraeten, J. J. Steil, and D. Stroobandt. Improving reservoirs using intrinsic plasticity. Neurocomputing, 71:1159-1171, 2008.
16. Benjamin Schrauwen, Jeroen Defour, David Verstraeten, and Jan Van Campenhout. The introduction of time-scales in reservoir computing, applied to isolated digits recognition. In Proceedings of the International Conference on Artificial Neural Networks (ICANN), 2007.
17. Udo Siewert and Welf Wustlich. Echo-state networks with band-pass neurons: Towards generic time-scale-independent reservoir structures. Technical report, Planet GmbH, October 2007.
18. D. Verstraeten, B. Schrauwen, and D. Stroobandt. Reservoir-based techniques for speech recognition. In Proceedings of the World Conference on Computational Intelligence, pages 1050-1053, 2006.
19. David Verstraeten, Benjamin Schrauwen, Michiel D'Haene, and Dirk Stroobandt. A unifying comparison of reservoir computing methods. Neural Networks, 20:391-403, 2007.
20. O.L. White, D.D. Lee, and H. Sompolinsky. Short-term memory in orthogonal neural networks. Neural Comput Phys Rev Lett, 92:148102, 2002.