Improving liquid state machines through iterative refinement of the reservoir

Neurocomputing

Volumn 73, Issue 16-18, 2010, Pages 2893-2904

  Norton, David ^a   Ventura, Dan ^a  

^a 3361 TMCB   (United States)

Author keywords

Liquid state machine; Recurrent network; Spiking neural network

Indexed keywords

DATA SETS; HEBBIAN; ITERATIVE REFINEMENT; LIQUID STATE MACHINES; MACHINE LEARNERS; NOVEL ALGORITHM; PATTERN RECOGNITION PROBLEMS; RECURRENT NETWORKS; SPIKING NEURAL NETWORKS;

CONTOUR FOLLOWERS; INTELLIGENT AGENTS; LIQUIDS; PATTERN RECOGNITION; REFINING;

RECURRENT NEURAL NETWORKS;

ACCURACY; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; CONTROLLED STUDY; DIGITAL FILTERING; INTERMETHOD COMPARISON; LEARNING ALGORITHM; PERCEPTRON; PHASE SEPARATION; PRIORITY JOURNAL; PROCESS DEVELOPMENT; QUALITY CONTROL; REFERENCE DATABASE; REINFORCEMENT; RESERVOIR;

EID: 78650307382     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.08.005     Document Type: Article

References (28)

1. W. Gerstner, W. Kistler (Eds.), Spiking Neuron Models, Cambridge University Press, New York, 2002.
2. S.M. Bohte, Spiking neural networks, Ph.D. Thesis, Centre for Mathematics and Computer Science, 2003.
3. Maass W. Networks of spiking neurons: the third generation of neural network models. Neural Networks 1997, 10(9):1659-1671.
4. Bohte S.M., Kok J.N., Poutré H.L. Error-backpropagation in temporally encoded networks of spiking neurons. Neurocomputing 2001, 48:17-37.
5. Booij O., Nguyen H.T. A gradient descent rule for spiking neurons emitting multiple spikes. Information Processing Letters 2005, 95:552-558.
6. T. Natschläger, Neural micro circuits, 2005. http://www.lsm.tugraz.at/index.html.
7. Natschläger T., Maass W., Markram H. Computer models and analysis tools for neural microcircuits. Neuroscience Databases. A Practical Guide 2003, 123-138. Kluwer Academic Publishers, (Chapter 9).
8. H. Jaeger, A tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the "echo state network" approach, Technical Report, International University Bremen, 2005.
9. Maass W. Networks of spiking neurons: the third generation of neural network models. Transactions of the Society for Computer Simulation International 1997, 14:1659-1671.
10. Maass W., Joshi P., Sontag E.D. Computational aspects of feedback in neural circuits. PLoS Computational Biology 2007, 3(1:e165):1-20.
11. Maass W., Natschläger T., Markram H. Real-time computing without stable states: a new framework for neural computations based on perturbations. Neural Computation 2002, 14(11):2531-2560.
12. Jaeger H., Haas H. Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 2004, 78-80.
13. Verstraeten D., Schrauwen B., D'Haene M., Stroobandt D. An experimental unification of reservoir computing methods. Neural Networks 2007, 20:391-403.
14. Goodman E., Ventura D. Effectively using recurrently connected spiking neural networks. Proceedings of the International Joint Conference on Neural Networks 2005, vol. 3:1542-1547.
15. Verstraeten D., Schrauwen B., Stroobandt D. Adapting reservoirs to get Gaussian distributions. European Symposium on Artificial Neural Networks 2007, 495-500.
16. Goodman E., Ventura D. Spatiotemporal pattern recognition via liquid state machines. Proceedings of the International Joint Conference on Neural Networks 2006, 3848-3853.
17. Verstraeten D., Schrauwen B., Stroobandt D., Campenhout J.V. Isolated word recognition with liquid state machine: a case study. Information Processing Letters 2005, 95:521-528.
18. Fisher R.A. The use of multiple measurements in taxonomic problems. Annals of Eugenics 1936, 7:179-188.
19. Maass W., Bertschinger N., Legenstein R. Methods for estimating the computational power and generalization capability of neural microcircuits. Advances in Neural Information Processing Systems 2005, 17:865-872.
20. Bornholdt S., Röhl T. Self-organized critical neural networks. Physical Review E 2003, 67.
21. Brodu N. Quantifying the effect of learning on recurrent spiking neurons. Proceedings of the International Joint Conference on Neural Networks 2007, 512-517.
22. Bertschinger N., Natschläger T. Real-time computation at the edge of chaos in recurrent neural networks. Neural Computation 2004, 16(7):1413-1436.
23. Natschläger T., Bertschinger N., Legenstein R. At the edge of chaos: real-time computations and self-organized criticality in recurrent neural networks. Advances in Neural Information Processing Systems 2005, 17:145-152.
24. Jim K., Giles C.L., Horne B.G. An analysis of noise in recurrent neural networks: convergence and generalization. IEEE Transactions on Neural Networks 1996, 7:1424-1438.
25. J.S. Garofolo, et al., Timit acoustic-phonetic continuous speech corpus, linguistic Data Consortium, Philadelphia, 1993. http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC93S1.
26. ETSI ES 202 212STQ: DSR, Extended advanced front-end feature extraction algorithm; compression algorithms; back-end speech reconstruction algorithm, Technical Report, European Telecommunications Standards Institute (ETSI), 2003.
27. Learning to Learn 1998, Kluwer Academic Publishers. S. Thrun, L. Pratt (Eds.).
28. K. Yu, V. Tresp, Learning to learn and collaborative filtering, Neural Information Processing Systems workshop "Inductive Transfer: 10 Years Later", 2005.