Extending stability through hierarchical clusters in Echo State Networks

Frontiers in Neuroinformatics

Volumn 4, Issue JUL, 2010, Pages

  Jarvis, Sarah ^a   Rotter, Stefan ^a   Egert, Ulrich ^a  

^a UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Clustered networks; Feedforward; Reservoir networks

Indexed keywords

EID: 79959690003     PISSN: 16625196     EISSN: None     Source Type: Journal    
DOI: 10.3389/fninf.2010.00011     Document Type: Article

References (25)

1. Albert, R., and Barabási, A.-L. (2002). Statistical mechanics of complex networks. Rev. Mod. Phys. 74, 47-97.
2. Buehner, M., and Young, P. (2006). A tighter bound for the echo state property. IEEE Trans. Neural Netw. 17, 820-824.
3. Deng, Z., and Zhang, Y. (2007). Collective behavior of a small-world recurrent neural system with scale-free distribution. IEEE Trans. Neural Netw. 18, 1364-1375.
4. Dutoit, X., Schrauwen, B., Van Campenhout, J., Stroobandt, D., Van Brussel, H., and Nuttin, M. (2009). Pruning and regularization in reservoir computing. Neurocomputing 72, 1534-1546.
5. Jaeger, H. (2001). The "Echo State" Approach to Analysing and Training Recurrent Neural Networks, Technical Report 148. Bremen: German National Research Center for Information Technology.
6. Jaeger, H. (2002). Short Term Memory in Echo State Networks, Technical Report 152. Bremen: German National Research Center for Information Technology.
7. Jaeger, H. (2007). Discovering Multiscale Dynamical Features with Hierarchical Echo State Networks, Technical Report 10. Bremen: Jacobs University Bremen.
8. Jaeger, H., Lukosevicius, M., Popovici, D., and Siewert, U. (2007). Optimization and applications of echo state networks with leaky-integrator neurons. Neural Netw. 20, 335-352.
9. Kaiser, M., Görner, M., and Hilgetag, C. C. (2007). Criticality of spreading dynamics in hierarchical cluster networks without inhibition. New J. Phys. 9, 110.
10. Lukosevicius, M., and Jaeger, H. (2007). Overview of Reservoir Recipes, Technical Report 11. Bremen: Jacobs University Bremen.
11. Mueller-Linow, M., Hilgetag, C. C., and Huett, M. T. (2008). Organization of excitable dynamics in hierarchical biological networks. PLoS Comput. Biol. 4, e1000190. doi: 10.1371/journal.pcbi.1000190.
12. Ozturk, M., and Principe, J. (2005). "Computing with transiently stable states," in Proceedings of the IEEE International Joint Conference on Neural Networks, 2005 (IJCNN '05) (Houston: IEEE), Vol. 3. 1467-1472.
13. Ozturk, M., Xu, D., and Principe, J. (2007). Analysis and design of echo state networks. Neural Comput. 19, 111-138.
14. Ravasz, E., and Barabasi, A. L. (2003). Hierarchical organization in complex networks. Phys. Rev. E. Stat. Nonlin. Soft Matter Phys. 67, 026112.
15. Ravasz, E., Somera, A. L., Mongru, D. A., Oltvai, Z. N., and Barabasi, A. L. (2002). Hierarchical organization of modularity in metabolic networks. Science 297, 1551-1555.
16. Schrauwen, B., Verstraeten, D., and Van Campenhout, J. (2007). "An overview of reservoir computing: theory, applications and implementations," in Proceedings of the 15th European Symposium on Artificial Neural Networks (Bruges: ESANN). 471-482.
17. Skowronski, M. D., and Harris, J. G. (2007). Automatic speech recognition using a predictive echo state network classifier. Neural Netw. 20, 414-423.
18. Sporns, O. (2006). Small-world connectivity, motif composition, and complexity of fractal neuronal connections. BioSystems 85, 55-64.
19. Sporns, O., Honey, C. J., and Kotter, R. (2007). Identification and classification of hubs in brain networks. PLoS ONE 2, e1049. doi: 10.1371/journal.pone.0001049.
20. Sussillo, D., and Abbott, L. F. (2009). Generating coherent patterns of activity from chaotic neural networks. Neuron 63, 544-557.
21. Tong, M. H., Bickett, A. D., Christiansen, E. M., and Cottrell, G. W. (2007). Learning grammatical structure with Echo State Networks. Neural Netw. 20, 424-432.
22. Venayagamoorthy, G. K., and Shishir, B. (2009). Effects of spectral radius and settling time in the performance of echo state networks. Neural Netw. 22, 861-863.
23. Verstraeten, D., Schrauwen, B., D'Haene, M., and Stroobandt, D. (2007). An experimental unification of reservoir computing methods. Neural Netw. 20, 391-403.
24. Wolf, A., Swift, J., Swinney, H., and Vastano, J. (1985). Determining Lyapunov exponents from a time series. Physica D 16, 285.
25. Xue, Y., Yang, L., and Haykin, S. (2007). Decoupled echo state networks with lateral inhibition. Neural Netw. 20, 365-376.