One step backpropagation through time for learning input mapping in reservoir computing applied to speech recognition

ISCAS 2010 - 2010 IEEE International Symposium on Circuits and Systems: Nano-Bio Circuit Fabrics and Systems

Volumn , Issue , 2010, Pages 521-524

  Hermans, Michiel ^a   Schrauwen, Benjamin ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

BACK-PROPAGATION THROUGH TIME; COMPUTATIONAL COSTS; DIGIT RECOGNITION; ERROR BACK-PROPAGATION; ONE STEP; POWERFUL ENGINES; RANDOM NETWORK; RESERVOIR COMPUTING; SMALL NETWORKS; TRAINING ALGORITHMS;

BACKPROPAGATION ALGORITHMS; FABRICS; SPEECH RECOGNITION;

RECURRENT NEURAL NETWORKS;

EID: 77955992239     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISCAS.2010.5537568     Document Type: Conference Paper

References (14)

1. J. J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities." Proc Natl Acad Sci USA, vol. 79, no. 8, pp. 2554-2558, Apr 1982.
2. D. Rumelhart, G. Hinton, and R. Williams, Learning internal representations by error propagation. MIT Press, Cambridge, MA, 1986.
3. B. Hammer and J. J. Steil, "Perspectives on learning with recurrent neural networks," in Proceedings of the European Symposium on Artificial Neural Networks (ESANN), 2002.
4. M. H. Hayes, Statistical Digital Signal Processing and Modeling. Wiley, 1996, ch. Recursive Least Squares, p. 541.
5. H. Jaeger, "The "echo state" approach to analysing and training recurrent neural networks," German National Research Center for Information Technology, Tech. Rep. GMD Report 148, 2001.
6. W. Maass, T. Natschläger, and H. Markram, "Real-time computing without stable states: A new framework for neural computation based on perturbations," Neural Computation, vol. 14, no. 11, pp. 2531-2560, 2002.
7. D. Verstraeten, B. Schrauwen, and D. Stroobandt, "Reservoir-based techniques for speech recognition," in Proceedings of the World Conference on Computational Intelligence, 2006, pp. 1050-1053.
8. E. A. Antonelo, B. Schrauwen, and D. Stroobandt, "Event detection and localization for small mobile robots using reservoir computing," Neural Networks, vol. 21, pp. 862-871, 2008.
9. H. Jaeger and H. Haas, "Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless telecommunication," Science, vol. 308, pp. 78-80, April 2 2004.
10. H. Jaeger, "Short term memory in echo state networks," German National Research Center for Information Technology, Tech. Rep. GMD Report 152, 2001.
11. J. Elman, "Finding structure in time," Cognitive Science, vol. 14, pp. 179-211, 1990.
12. R. Lyon, "A computational model of filtering, detection and compression in the cochlea," in Proceedings of the IEEE ICASSP, May 1982, pp. 1282-1285.
13. C. C. Aggarwal, A. Hinneburg, and D. A. Keim, "On the surprising behavior of distance metrics in high dimensional space," in Lecture Notes in Computer Science. Springer, 2001, pp. 420-434.
14. D. Sussillo and L. F. Abbott, "Generating coherent patterns of activity from chaotic neural networks," Neuron, vol. 63, no. 4, pp. 544-557, August 2009. [Online]. Available: http://dx.doi.org/10.1016/j.neuron. 2009.07.018