Information Theoretic Self-organised Adaptation in Reservoirs for Temporal Memory Tasks

Communications in Computer and Information Science

Volumn 311, Issue , 2012, Pages 31-40

  Dasgupta, Sakyasingha ^a   Wörgötter, Florentin ^a   Manoonpong, Poramate ^a  

^a UNIVERSITY OF GÖTTINGEN   (Germany)

Author keywords

Information theory; Intrinsic plasticity; Recurrent neural networks; Self adaptation

Indexed keywords

ADAPTATION RULES; DELAYED-RESPONSE TASK; EXTENDED PERFORMANCE; INTRINSIC PLASTICITY; RESERVOIR COMPUTING; SELF ADAPTATION; SELF-ORGANISED; TEMPORAL MEMORY;

ARTIFICIAL INTELLIGENCE; BENCHMARKING; RECURRENT NEURAL NETWORKS;

INFORMATION THEORY;

EID: 84880588748     PISSN: 18650929     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-642-32909-8_4     Document Type: Conference Paper

References (11)

1. Schrauwen, B., Wardermann, M., Verstraeten, D., Steil, J.J., Stroobandt, D.: Improving Reservoirs using Intrinsic Plasticity. Neurocomputing 71, 1159-1171 (2008)
2. Jaeger, H., Lukosevicius, M., Popovici, D., Siewert, U.: Optimization and Applications of Echo State Networks with Leaky-integrator Neurons. Neural Networks 20, 335-352 (2007)
3. Lukošsevičcius, M., Jaeger, H.: Reservoir Computing Approaches to Recurrent Neural Network Training. Computer Science Review 3, 127-149 (2009)
4. Li, C.: A model of Neuronal Intrinsic Plasticity. IEEE Trans. on Autonomous Mental Development 3, 277-284 (2011)
5. Antonelo, E., Schrauwen, B., Stroobandt, D.: Mobile Robot Control in the Road Sign Problem using Reservoir Computing Networks. In: Proceedings of the IEEE Int. Conf. on Robotics and Automation, ICRA (2008)
6. Triesch, J.: Synergies between Intrinsic and Synaptic Plasticity Mechanisms. Neural Computation 4, 885-909 (2007)
7. Lizier, T.J., Pritam, M., Prokopenko, M.: Information Dynamics in Small-world Boolean Networks. Artificial Life 17, 293-314 (2011)
8. Boedecker, J., Obst, O., Mayer, M.N., Asada, M.: Initialization and Self-Organized Optimization of Recurrent Neural Network Connectivity. HFSP Journal 5, 340-349 (2009)
9. Ganguli, S., Dongsung, H., Sompolinsky, H.: Memory Traces in Dynamical Systems. PNAS 105, 18970-18975 (2008)
10. Steingrube, S., Timme, M., Wörgötter, F., Manoonpong, P.: Self-Organized Adaptation of a Simple Neural Circuit Enables Complex Robot Behaviour. Nature Physics 6, 224-230 (2010)
11. Jaeger, H.: Adaptive Nonlinear System Identification with Echo State Networks. In: Advances in Neural Information Processing Systems, vol. 15 (2003)