Pruning reservoirs with random static projections

Proceedings of the 2010 IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2010

Volumn , Issue , 2010, Pages 250-255

  Butcher, J B ^a   Day, C R ^a   Haycock, P W ^a   Verstraeten, D ^b   Schrauwen, B ^b  

^a KEELE UNIVERSITY   (United Kingdom)

^b GHENT UNIVERSITY   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

EXTREME LEARNING MACHINE; GRADIENT DESCENT ALGORITHMS; NON-LINEARITY; NONLINEAR MAPPINGS; PRUNING ALGORITHMS; REAL WORLD DATA; RESERVOIR CHARACTERISTIC; RESERVOIR COMPUTING; SHORT TERM MEMORY; TRAINING PROCESS;

LEARNING SYSTEMS; NETWORK ARCHITECTURE; SIGNAL PROCESSING;

RECURRENT NEURAL NETWORKS;

EID: 78449293605     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MLSP.2010.5589251     Document Type: Conference Paper

References (18)

1. H. Jaeger, "The "echo state" approach to analysing and training recurrent neural networks," Tech. Rep., German National Research Institute for Computer Science, 2001.
2. D. Verstraeten, B. Schrauwen, and D. Stroobandt, "Reservoir-based techniques for speech recognition," in Proceedings of the International Joint Conference on Neural Networks (IJCNN), 2006.
3. D. Verstraeten, B. Schrauwen, M. D'Haene, and D. Stroobandt, "An experimental unification of reservoir computing methods," Neural Networks, vol. 20, pp. 391-403, 2007.
4. H. Jaeger, "Adaptive nonlinear system identification with echo state networks," in Neural Information Processing Systems (NIPS), 2002.
5. W. Maass, T. Natchschlager, and H. Markram, "Real-time computing without stable states: A new framework for neural computation based on perturbations," Neural Computation, vol. 14, pp. 2531-2560, 2002.
6. M. Lukoševičius and H. Jaeger, "Reservoir computing approaches to recurrent neural network training," Computer Science Review, vol. 3, no. 3, pp. 127-149, 2009.
7. B. Noris, M. Nobile, L. Piccinini, M. Berti, E. Mani, M. Molteni, F. Keller, D. Campolo, and A.G. Billard, "Gait analysis of autistic children with echo-state networks," in Neural Information Processing Systems Conference, 2006,
8. X. Dutoit, Reservoir Computing for Intelligent Mobile Systems, Ph.D. thesis, Department of Mechanical Engineering, Katholleke Universiteit Leuven, Belgium, 2009.
9. G.B. Huang, Q.Y. Zhu, and C.H. Siew, "Extreme learning machines: Theory and applications," Neurocomputing, vol. 70, pp. 489-501, 2006.
10. J.B. Butcher, D. Verstraeten, B. Schrauwen, C.R. Day, and P.W. Haycock, "Extending reservoir computing with random static projections: a hybrid between OP-ELM and RC," in European Symposium on Artificial Neural Networks (ESANN), 2010.
11. Y. Miche, A. Sorajamaa, and A. Lendasse, "OP-ELM: Theory, experiments and a toolbox," in Artificial Neural Networks - ICANN 2008, V. Kurkova, R. Neruda, and J. Koutnik, Eds., Berlin / Heidelberg, 2008, LNCS 5163, pp. 145-154, Springer.
12. X. Dutoit, B. Schrauwen, J. Van Campenhout, D. Stroobandt, H. Van Brussel, and M. Nuttin, "Pruning and regularization in reservoir computing," Neurocomputing, vol. 72, pp. 1534-1546, 2009.
13. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani, "Least angle regression," Annals of Statistics, vol. 32, pp. 407-499, 2004.
14. T. Similä and J. Tikka, International Conference on Artificial Neural Networks, chapter Multiresponse sparse regression with application to mulidimensional scaling, pp. 97-102, Springer, 2005.
15. G. Doddington and T. Schalk, "Speech recognition: Turning theory to practice," IEEE Spectrum, vol. 18, no. 9, pp. 26-32, 1981.
16. R. Lyon, "A computational model of filtering, detection and compression in the cochlea," in IEEE ICASSP, 1982, pp. 1282-1285.
17. D. Verstraeten, J. Dambre, X. Dutoit, and B. Schrauwen, "Memory versus non-linearity in reservoirs," To appear in World Congress on Neural Networks (WCNN) 2010, 2010.
18. H. Jaeger, "Short term memory in echo state networks," Tech. Rep., German National Research Centre for Information Technology, 2002.