Liquid state machines: Motivation, theory, and applications

Computability in Context: Computation and Logic in the Real World

Volumn , Issue , 2011, Pages 275-296

  Maass, Wolfgang ^a  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

MOTIVATION;

BIOLOGICAL NETWORKS; COMPUTATIONAL MODEL; COMPUTATIONAL POWER; COMPUTATIONAL SYSTEM; COMPUTING DEVICES; LIQUID STATE MACHINES; PHYSICAL OBJECTS;

TURING MACHINES;

EID: 84986578247     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1142/9781848162778_0008     Document Type: Chapter

References (37)

1. U. Alon, An Introduction to Systems Biology: Design Principles of Biological Circuits. Chapman & Hall, Netherlands, (2007).
2. P. L. Bartlett andW. Maass. Vapnik-Chervonenkis dimension of neural nets. In ed., M. A. Arbib, The Handbook of Brain Theory and Neural Networks, pp. 1188-1192. MIT Press, Cambridge, 2nd edition, (2003).
3. S. Boyd and L. O. Chua, Fading memory and the problem of approximat ing nonlinear oparators with Volterra series, IEEE Trans. on Circuits and Systems. 32, 1150-1161, (1985).
4. M. S. Branicky, Universal computation and other capabilities of hybrid and continuous dynamical systems, Theoret. Comput. Sci. 138, 67-100, (1995).
5. D. Buonomano and W. Maass, State-dependent computations: Spatiotemporal processing in cortical networks. Nature Reviews Neuroscience. 10(2), 113-125, (2009).
6. K. Bush and C. Anderson. Modeling reward functions for incomplete state representations via echo state networks. In Proceedings of the International Joint Conference on Neural Networks, Montreal, Quebec, (2005).
7. C. Fernando and S. Sojakka. Pattern recognition in a bucket: a real liquid brain. In Proceedings of ECAL. Springer, Berlin-Heidelberg, (2003).
8. S. Ganguli, D. Huh, and H. Sompolinsky, Memory traces in dynamical systems, Proc. Natl. Acad. Sci. USA. 105, 18970-18975, (2008).
9. S. Haeusler and W. Maass, A statistical analysis of information processing properties of lamina-specific cortical microcircuit models, Cereb. Cortex. 17 (1), 149-162, (2007).
10. S. Haeusler, K. Schuch, andW. Maass, Motif distribution and computational performance of two data-based cortical microcircuit templates, J. Physiology-Paris. (2009). in press.
11. J. Hertzberg, H. Jäger, and F. Schönherr. Learning to ground fact symbols in behavior-based robot. In ed. F. van Harmelen ed., Proc. of the 15th European Conference on Artificial Intelligence, pp. 708-712, IOS Press, Amsterdam, (2002).
12. J. J. Hopfield and C. D. Brody, What is a moment? Transient synchrony as a collective mechanism for spatio-temporal integration, Proc. Natl. Acad. Sci. USA. 98(3), 1282-1287, (2001).
13. H. Jaeger and D. Eck. Can't get you out of my head: A connectionist model of cyclic rehearsal. In eds., I. Wachsmuth and G. Knoblich, Modeling Com-munication with Robots and Virtual Humans, (2008).
14. H. Jaeger and H. Haas, Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication, Science. 304, 78-80, (2004).
15. H. Jaeger, W. Maass, and J. Principe, Introduction to the special issue on echo state networks and liquid state machines, Neural Networks. 20(3), 287-289, (2007).
16. B. Jones, D. Stekel, J. Rowe, and C. Fernando, Is there a liquid state machine in the bacterium escherichia coli?, Artif. Life. ALIFE'07, IEEE Symposium, 187-191, (2007).
17. P. Joshi and W. Maass, Movement generation with circuits of spiking neurons, Neural Comput. 17(8), 1715-1738, (2005).
18. S. Klampfl, S. V. David, P. Yin, S. A. Shamma, and W. Maass, Integration of stimulus history in information conveyed by neurons in primary auditory cortex in response to tone sequences, 39th Annual Conference of the Society for Neuroscience, Program 163. 8, Poster T6. (2009).
19. S. Klampfl and W. Maass, A neuron can learn anytime classification of trajectories of network states without supervision, submitted for publication. (Feb. 2009).
20. R. Legenstein and W. Maass. What makes a dynamical system computationally powerful? In eds., S. Haykin, J. C. Principe, T. Sejnowski, and J. McWhirter, New Directions in Statistical Signal Processing: From Sys-tems to Brains, pp. 127-154. MIT Press, Cambridge, MA, (2007).
21. R. Legenstein and W. Maass, Edge of chaos and prediction of computational performance for neural microcircuit models, Neural Networks. 20(3), 323-334, (2007).
22. R. Legenstein, D. Pecevski, and W. Maass, A learning theory for rewardmodulated spike-timing-dependent plasticity with application to biofeedback, PLoS Computational Biology. 4(10), 1-27, (2008).
23. W. Maass, P. Joshi, and E. D. Sontag, Computational aspects of feedback in neural circuits, PLoS Computational Biology. 3(1), e165, 1-20, (2007).
24. W. Maass and H. Markram, On the computational power of recurrent circuits of spiking neurons, J. Comput. System Sci. 69(4), 593-616, (2004).
25. W. Maass and H. Markram. Theory of the computational function of microcircuit dynamics. In eds. S. Grillner and A. M. Graybiel, The Interface between Neurons and Global Brain Function, Dahlem Workshop Report 93, pp. 371-390. MIT Press, (2006).
26. W. Maass, T. Natschlaeger, and H. Markram, Real-time computing without stable states: A new framework for neural computation based on perturbations, Neural Comput. 14(11), 2531-2560, (2002).
27. W. Maass, T. Natschlaeger, and H. Markram, Fading memory and kernel properties of generic cortical microcircuit models, J. Physiology-Paris. 98 (4-6), 315-330, (2004).
28. D. Nikolic, S. Haeusler, W. Singer, and W. Maass, Distributed fading memory for stimulus properties in the primary visual cortex, PLoS Biology. 7(12), 1-19, (2009).
29. A. Nugent, Physical neural network liquid state machine utilizing nanotech-nology. (US-Patent 7 392 230 32, June 2008).
30. M. Rabinovich, R. Huerta, and G. Laurent, Transient dynamics for neural processing, Science. 321, 45-50, (2008).
31. B. Schrauwen, L. Buesing, and R. Legenstein. On computational power and the order-chaos phase transition in reservoir computing. In Proceeding of NIPS 2008, Advances in Neural Information Processing Systems. MIT Press, Cambridge, MA, (2009). In press.
32. B. Schrauwen, M. D'Haene, D. Verstraeten, and D. Stroobandt, Compact hardware liquid state machines on FPGA for real-time speech recognition, Neural Networks. 21, 511-523, (2008).
33. A. M. Thomson, D. C. West, Y. Wang, and A. P. Bannister, Synaptic connections and small circuits involving excitatory and inhibitory neurons in layers 2-5 of adult rat and cat neocortex: triple intracellular recordings and biocytin labelling in vitro, Cereb. Cortex. 12(9), 936-953, (2002).
34. M. Tong, A. Bickett, E. Christiansen, and G. Cotrell, Learning grammatical structure with echo state networks, Neural Networks. 20(3), 424-432, (2007).
35. K. Vandoorne, W. Dierckx, B. Schrauwen, D. Verstraeten, R. Baets, P. Bi enstman, and J. V. Campenhout, Toward optical signal processing using photonic reservoir computing, Opt. Express. 16(15), 11182-11192, (2008).
36. D. Verstraeten, B. Schrauwen, D. Stroobandt, and J. V. Campenhout, Isolated word recognition with the liquid state machine: a case study., Inform. Process. Lett. 95(6), 521-528, (2005).
37. O. L. White, D. D. Lee, and H. Sompolinsky, Short-term memory in orthogonal neural networks, Phys. Rev. Letters. 92(14), 148102, (2004).