Information dynamics based self-adaptive reservoir for delay temporal memory tasks

Evolving Systems

Volumn 4, Issue 4, 2013, Pages 235-249

  Dasgupta, Sakyasingha ^a   Wörgötter, Florentin ^a   Manoonpong, Poramate ^a  

^a UNIVERSITY OF GÖTTINGEN   (Germany)

Author keywords

Information theory; Intrinsic plasticity; Recurrent neural networks; Self adaptation; Temporal memory

Indexed keywords

DELAYED-RESPONSE TASK; EXTENDED PERFORMANCE; INFORMATION DYNAMICS; INTRINSIC PLASTICITY; MUTUAL INFORMATIONS; RESERVOIR COMPUTING; SELF ADAPTATION; TEMPORAL MEMORY;

BENCHMARKING; INFORMATION THEORY; NEURONS; RECURRENT NEURAL NETWORKS; ROBOTS;

COMPLEX NETWORKS;

EID: 84887488068     PISSN: 18686478     EISSN: 18686486     Source Type: Journal    
DOI: 10.1007/s12530-013-9080-y     Document Type: Article

References (34)

1. Antonelo E, Schrauwen B, Stroobandt D (2008) Mobile robot control in the road sign problem using reservoir computing networks. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp 911-916.
2. Bertschinger N, Natschläger T (2004) Real-time computation at the edge of chaos in recurrent neural networks. Neural Comput 16: 1413-1436.
3. Bernacchia A, Seo H, Lee D, Wang XJ (2011) A reservoir of time constants for memory traces in cortical neurons. Nat Neurosci 14(3): 366-372.
4. Boedecker J, Obst O, Mayer MN, Asada M (2009) Initialization and self-organized optimization of recurrent neural network connectivity. HFSP J 5: 340-349.
5. Buonomano DV, Laje R (2010) Population clocks: motor timing with neural dynamics. Trends Cogn Sci 14: 520-527.
6. Büsing L, Schrauwen B, Legenstein R (2010) Connectivity, dynamics, and memory in reservoir computing with binary and analog neurons. Neural Comput 22: 1272-1311.
7. Desai NS, Rutherford LC, Turrigiano GG (1999) Plasticity in the intrinsic excitability of cortical pyramidal neurons. Nat Neurosci 2: 515-520.
8. Ganguli S, Dongsung H, Sompolinsky H (2008) Memory traces in dynamical systems. Proc Natl Acad Sci USA 105: 18970-18975.
9. Jaeger H (2001) Short term memory in echo state networks. GMD Report 152, German National Research Center for Information Technology.
10. Jaeger H (2003) Adaptive nonlinear system identification with echo state networks. In: Advances in Neural Information Processing Systems, pp 593-600.
11. Jaeger H, Haas H (2004) Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 2: 78-80.
12. Jaeger H, Lukosevicius M, Popovici D, Siewert U (2007) Optimization and applications of echo state networks with leaky-integrator neurons. Neural Netw 20: 335-352.
13. Jaeger H (2007) Discovering multiscale dynamical features with hierarchical echo state networks (Tech. Rep. No. 10). Jacobs University, Bremen.
14. Li C (2011) A model of neuronal intrinsic plasticity. IEEE Trans Auton Ment Dev 3: 277-284.
15. Lizier TJ, Pritam M, Prokopenko M (2011) Information dynamics in small-world boolean networks. Artif Life 17: 293-314.
16. Lizier JT (2012) JIDT: an information-theoretic toolkit for studying the dynamics of complex systems. http://code. google. com/p/information-dynamics-toolkit/.
17. Lizier TJ, Prokopenko M, Zomaya AY (2012) Local measures of information storage in complex distributed computation. Inf Sci 208: 39-54.
18. Lukosevicius M, Jaeger H (2009) Reservoir computing approaches to recurrent neural network training. Comput Sci Rev 3: 127-149.
19. Maass W, Natschläger T, Markram H (2004) Computational models for generic cortical microcircuits. In: Computational neuroscience: a comprehensive approach, chapter 18, pp 575-605.
20. Manoonpong P, Kolodziejski C, Wörgötter F, Morimoto J (2013a) Combining correlation-based and reward-based learning in neural control for policy improvement. Adv Complex Syst (in press).
21. Manoonpong P, Parlitz U, Wörgötter F (2013b) Neural control and adaptive neural forward models for insect-like, energy-efficient, and adaptable locomotion of walking machines. Front Neural Circuits 7: 12. doi: 10. 3389/fncir. 2013. 00012.
22. Ozturk MC, Xu D, Prncipe JC (2007) Analysis and design of echo state networks. Neural Comput 19: 111-138.
23. Paleologu C, Benesty J, Ciochino S (2008) A robust variable forgetting factor recursive least-squares algorithm for system identification. IEEE Signal Process Lett 15: 597-600.
24. Ren G, Chen W, Kolodziejski C, Wörgötter F, Dasgupta S, Manoonpong P (2012) Multiple chaotic central pattern generators for locomotion generation and leg damage compensation in a hexapod robot. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp 2756-2761.
25. Schrauwen B, Wardermann M, Verstraeten D, Steil JJ, Stroobandt D (2008) Improving reservoirs using intrinsic plasticity. Neurocomputing 71: 1159-1171.
26. Shi Z, Han M (2007) Support vector echo-state machine for chaotic time-series prediction. IEEE Trans Neural Netw 18: 359-372.
27. Sompolinsky H, Crisanti A, Sommers HJ (1988) Chaos in random neural networks. Phys Rev Lett 61: 259-262.
28. Steingrube S, Timme M, Wörgötter F, Manoonpong P (2010) Self-organized adaptation of a simple neural circuit enables complex robot behaviour. Nat Phys 6: 224-230.
29. Sussillo D, Abbott LF (2009) Generating coherent patterns of activity from chaotic neural networks. Neuron 4: 544-557.
30. Tetzlaff C, Kolodziejski C, Markelic I, Wörgötter F (2012) Time scales of memory, learning, and plasticity. Biol Cybern 6: 715-26.
31. Triesch J (2007) Synergies between intrinsic and synaptic plasticity mechanisms. Neural Comput 4: 885-909.
32. Turrigiano G, Abbott LF, Marder E (1994) Activity-dependent changes in the intrinsic properties of cultured neurons. Science 264: 974-977.
33. Ungerleider LG, Courtney SM, Haxby JV (1998) A neural system for human visual working memory. Proc Natl Acad Sci USA 95: 883-890.
34. Yamashita Y, Tani J (2008) Emergence of Functional hierarchy in a multiple timescale neural network model: a humanoid robot experiment. PLoS Comput Biol 4(11): e1000220. doi: 10. 1371/journal. pcbi. 1000220.