Self constructing neural network robot controller based on on-line task performance feedback

ICINCO 2008 - Proceedings of the 5th International Conference on Informatics in Control, Automation and Robotics

Volumn ICSO, Issue , 2008, Pages 326-333

  Huemer, Andreas ^a   Gongora, Mario ^a   Elizondo, David ^a  

^a DE MONTFORT UNIVERSITY   (United Kingdom)

Author keywords

Reinforcement learning; Robot controller development; Spiking neural network

Indexed keywords

DESIGN EFFORT; MANUAL ANALYSIS; NOVEL METHODOLOGY; ROBOT ACTIONS; ROBOT CONTROLLER; SELF-CONSTRUCTING; SPIKING NEURAL NETWORK; SPIKING NEURAL NETWORKS; TASK PERFORMANCE;

CONTROLLERS; MACHINE DESIGN; REINFORCEMENT; REINFORCEMENT LEARNING; ROBOTICS; ROBOTS; SENSORY FEEDBACK;

NEURAL NETWORKS;

EID: 55849113039     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Daucé, E. and Henry, F. (2006). Hebbian learning in large recurrent neural networks. Technical report, Movement and Perception Lab, Marseille.
2. Elizondo, D., Fiesler, E., and Korczak, J. (1995). Non-ontogenetic sparse neural networks. In International Conference on Neural Networks 1995, IEEE, volume 26, pages 290-295.
3. Florian, R. V. (2005). A reinforcement learning algorithm for spiking neural networks. In Proceedings of the Seventh International Symposium on Symbolic and Numeric Algorithms for Scientific Computing, pages 299-306.
4. Gers, F. A., Schraudolph, N. N., and Schmidhuber, J. (2002). Learning precise timing with LSTM recurrent networks. Journal of Machine Learning Research, 3:115-143.
5. Gómez, G., Lungarella, M., Hotz, P. E., Matsushita, K., and Pfeifer, R. (2004). Simulating development in a real robot: On the concurrent increase of sensory, motor, and neural complexity. In Proceedings of the Fourth International Workshop on Epigenetic Robotics, pages 119-122.
6. Hebb, D. O. (1949). The Organization of Behaviour: A Neuropsychological Approach. John Wiley & Sons, New York.
7. Izhikevich, E. M. (2006). Polychronization: Computation with spikes. Neural Computation, 18:245-282.
8. Izhikevich, E. M. (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral Cortex, 10:1093-1102.
9. Katic, D. (2006). Leaky-Integrate-and-Fire und Spike Response Modell. Technical report, Institut fï¿1/2r Tech-nische Informatik, Universitï¿1/2t Karlsruhe.
10. Liu, J. and Buller, A. (2005). Self-development of motor abilities resulting from the growth of a neural network reinforced by pleasure and tension. In Proceedings of the 4th International Conference on Development and Learning 2005, pages 121-125.
11. Liu, J., Buller, A., and Joachimczak, M. (2006). Self-motivated learning agent: Skill-development in a growing network mediated by pleasure and tensions. Transactions of the Institute of Systems, Control and Information Engineers, 19(5): 169-176.
12. van Leeuwen, M. (2004). Spike timing dependent structural plasticity in a single model neuron. Master's thesis, Intelligent Systems Group, Institute for Information and Computing Sciences, Utrecht University.
13. Vreeken, J. (2003). Spiking neural networks, an introduction. Technical report, Intelligent Systems Group, Institute for Information and Computing Sciences, Utrecht University.