An effective criterion for pruning reservoir's connections in Echo State Networks

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2014, Pages 1205-1212

  Scardapane, Simone ^a   Nocco, Gabriele ^a   Comminiello, Danilo ^a   Scarpiniti, Michele ^a   Uncini, Aurelio ^a  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ECHO STATE NETWORKS; EFFECTIVE ALGORITHMS; OPTIMIZATION PROBLEMS; RECURRENT NEURAL NETWORK (RNNS); REDUNDANT CONNECTIONS; STANDARD PRACTICES; SYNTHETIC DATASETS;

RECURRENT NEURAL NETWORKS;

EID: 84908474620     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2014.6889600     Document Type: Conference Paper

References (21)

1. M. Lukoševičius and H. Jaeger, "Reservoir computing approaches to recurrent neural network training", Computer Science Review, vol. 3, no. 3, pp. 127-149, Aug. 2009.
2. H. Jaeger, "The echo state approach to analysing and training recurrent neural networks", Technical Report GMD Report 148, German National Research Center for Information Technology, Tech. Rep., 2001.
3. W. Maass, T. Natschl, and H. Markram, "A Model for Real-Time Computation in Generic Neural Microcircuits", in Advances in Neural Information Processing Systems, 2002.
4. D. Verstraeten, J. Dambre, X. Dutoit, and B. Schrauwen, "Memory versus non-linearity in reservoirs", 2010 International Joint Conference on Neural Networks (IJCNN), pp. 1-8, Jul. 2010.
5. I. B. Yildiz, H. Jaeger, and S. J. Kiebel, "Re-visiting the echo state property", Neural Networks, vol. 35, pp. 1-9, 2012.
6. B. Schrauwen, M. Wardermann, D. Verstraeten, J. J. Steil, and D. Stroobandt, "Improving reservoirs using intrinsic plasticity", Neurocomputing, vol. 71, no. 7-9, pp. 1159-1171, Mar. 2008.
7. J. Butcher, D. Verstraeten, B. Schrauwen, C. Day, and P. Haycock, "Reservoir computing and extreme learning machines for non-linear time-series data analysis." Neural networks, vol. 38, pp. 76-89, Feb. 2013.
8. C. Omlin and C. Giles, "Pruning recurrent neural networks for improved generalization performance." IEEE transactions on neural networks, vol. 5, no. 5, pp. 848-51, Jan. 1994.
9. M. Salmen and P. G. Ploger, "Echo state networks used for motor control", in Proceedings of the 2005 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2005, pp. 1953-1958.
10. G. Chechik, I. Meilijson, and E. Ruppin, "Synaptic pruning in development: a computational account." Neural computation, vol. 10, no. 7, pp. 1759-77, Oct. 1998.
11. G. Orlandi, F. Piazza, A. Uncini, and A. Ascone, "A biological approach to plasticity in artificial neural networks", in 1991 International Joint Conference on Neural Networks (IJCNN), vol. ii, 1991, pp. 583-586.
12. X. Dutoit, B. Schrauwen, J. Van Campenhout, D. Stroobandt, H. Van Brussel, and M. Nuttin, "Pruning and regularization in reservoir computing", Neurocomputing, vol. 72, no. 7-9, pp. 1534-1546, Mar. 2009.
13. D. Montgomery, E. A. Peck, and G. Vining, Introduction to linear regression analysis. Wiley, 2012, vol. 821.
14. J. B. Butcher, C. R. Day, P. W. Haycock, D. Verstraeten, and B. Schrauwen, "Pruning reservoirs with random static projections", in 2010 IEEE International Workshop on Machine Learning for Signal Processing (MLSP), 2010, pp. 250-255.
15. J. Iglesias, J. Eriksson, F. Grize, M. Tomassini, and A. Villa, "Dynamics of pruning in simulated large-scale spiking neural networks." Biosystems, vol. 79, no. 1-3, pp. 11-20, 2005.
16. G. A. Kochenberger et al., Handbook in Metaheuristics. Springer, 2003.
17. B. Schrauwen and J. Defour, "The introduction of time-scales in reservoir computing, applied to isolated digits recognition", in International Conference on Artificial Neural Networks (ICANN 2007), 2007, pp. 471-479.
18. H. Jaeger, "Adaptive nonlinear system identification with echo state networks", in Advances in Neural Information Processing Systems, 2003.
19. M. Marchesi, G. Orlandi, F. Piazza, and A. Uncini, "Neural networks with self-adaptive topology", IEEE Transactions on Circuits and Systems, pp. 1-6, 1991.
20. Y. Nourani and B. Andresen, "A comparison of simulated annealing cooling strategies", Journal of Physics A: Mathematical and General, vol. 31, no. 41, p. 8373, 1998.
21. A. Berman and X.-D. Zhang, "On the spectral radius of graphs with cut vertices", Journal of Combinatorial Theory, Series B, vol. 83, no. 2, pp. 233-240, 2001.