An integrated learning approach to environment modelling in mobile robot navigation

Neurocomputing

Volumn 57, Issue 1-4, 2004, Pages 215-238

  Šter, Branko ^a  

^a UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

Mobile robot navigation; Recurrent neural networks; Reinforcement learning

Indexed keywords

NEURAL NETWORKS; PHYSIOLOGY; PROXIMITY SENSORS; VIDEO CAMERAS;

DECISION POINTS; REACTIVE BEHAVIOR;

MOBILE ROBOTS;

ADAPTATION; ARTICLE; ARTIFICIAL NEURAL NETWORK; BEHAVIOR; CAMERA; CONTROLLED STUDY; DECISION MAKING; ENVIRONMENT; EXPERIMENTATION; INFORMATION SCIENCE; LEARNING; MATHEMATICAL MODEL; PRIORITY JOURNAL; PSYCHOLOGICAL ASPECT; REINFORCEMENT; ROBOTICS; SENSOR; SIMULATION; VIDEORECORDING;

EID: 1642446952     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2003.10.005     Document Type: Article

References (40)

1. M. Ahlander, Reinforcement learning for a mobile service robot, M.Sc. Thesis, Royal Institute of Technology, Stockholm, Sweden.
2. C. Anderson, Q-learning with hidden-unit restarting, in: S. Hanson, J. Cowan, C. Giles (Eds.), Advances in Neural Information Processing Systems, Vol. 5, Morgan Kaufmann Publishers, San Mateo, CA, 1993, pp. 81-88.
3. C. Anderson, Z. Hong, Reinforcement learning with modular neural networks for control, in: Proceedings of the NNACIP'94, the IEEE International Workshop on Neural Networks Applied to Control and Image Processing, 1994.
4. Arai K. Nakano R. Stable behavior in a recurrent neural network for a finite state machine Neural Networks 13 6 2000 667-680
5. Arleo A. Gerstner W. Spatial orientation in navigating agents: modeling head-direction cells Neurocomputing 38-40 2001 1059-1065
6. Bachelder I. Waxman A. Mobile robot visual mapping and localization: a view-based neurocomputational architecture that emulates hippocampal place learning Neural Networks 7 6/7 1994 1083-1099
7. Berlyne D. Conflict, Arousal, and Curiosity 1960 McGraw-Hill New York
8. Bertsekas D. Tsitsiklis J. Neuro-Dynamic Programming 1996 Athena Scientific Belmont, MA
9. D. Bostow, B. Tompkins, Glossary for behavior analysis, University of South Florida, http://www.coedu.usf.edu/abaglossary
10. Brooks R. Intelligence without representation Artif. Intell. 47 1991 262-276
11. Burgess N. Recce M. O'Keefe J. A model of hippocampal function neural networks Neural Networks 7 6/7 1994 1065-1081
12. Casey M. The dynamics of discrete-time computation, with application to recurrent neural networks and finite-state machine extraction Neural Comput. 8 6 1996 1135-1178
13. Cleeremans A. Servan-Schreiber D. McClelland J. Finite state automata and simple recurrent networks Neural Comput. 1 3 1989 372-381
14. Dobnikar A. Evolutionary design of application-specific neural networks: a genetic approach Neural Network World 1 1995 41-50
15. Eysenck M. Principles of Cognitive Psychology 2001 Psychology Press Hove, East Sussex, UK
16. I. Gabrijel, A. Dobnikar, On-line identification and rule extraction of finite state automata with recurrent neural networks, in: Proceedings of the ICANNGA'2001, Prague, Czech Republic, Springer, Wien, New York, 2001, pp. 78-81.
17. Giles C. Horne B. Lin T. Learning a class of large finite state machines with a recurrent neural network Neural Networks 8 9 1995 1359-1365
18. Haykin S. Neural Networks: A Comprehensive Foundation 1994 Macmillan College Publishing Company New York
19. W. Huitt, Educational psychology interactive, http://chiron.valdosta.edu/whuitt
20. Jacobs R. Jordan M. Nowlan S. Hinton G. Adaptive mixtures of local experts Neural Comput. 3 1991 79-87
21. J. Karlsson, Learning to solve multiple goals, Ph.D. Thesis, TR 646, University of Rochester, Rochester, New York, 1997.
22. G. Kearsley, The theory into practice database, http://tip.psychology.org/arousal.html
23. B. Kröse, M. Eecen, A self-organizing representation of sensor space for mobile robot navigation, in: Proceedings of the IEEE/RSJ/GI International Conference on Intelligent Robots and Systems, IEEE, New York, 1994, pp. 9-14.
24. Mahadevan S. Connell J. Automatic programming of behavior-based robots using reinforcement learning Artif. Intell. 55 1992 311-365
25. Mak M. Ku K. Lu Y. On the improvement of the real time recurrent learning algorithm for recurrent neural networks Neurocomputing 24 1999 13-36
26. Mataric M.J. Integration of representation into goal-driven behavior-based robots IEEE Trans. Robotics Autom. 8 3 1992 304-312
27. D. Miles, http://luna.cas.usf.edu/~miles/envpsych.htm
28. Narendra K. Thathachar M. Learning Automata: An Introduction 1989 Prentice-Hall Englewood Cliffs, NJ
29. Omlin C. Giles C. Stable encoding of large finite-state automata in recurrent neural networks with sigmoid discriminants Neural Comput. 8 4 1996 675-696
30. Samejima K. Omori T. Adaptive internal state space construction method for reinforcement learning of a real-world agent Neural Networks 12 7-8 1999 1143-1155
31. B. Šter, Recurrent neural networks in a mobile robot navigation task, in: Proc. ICANNGA'2001, Prague, Czech Republic, Springer, Wien, New York, 2001, 169-172.
32. Sundareshan M. Condarcure T. Recurrent neural network training by a learning automaton approach for trajectory learning and control system design IEEE Trans. Neural Networks 9 3 1998 354-368
33. Sutton R. Barto A. Reinforcement Learning: An Introduction 1998 MIT Press Cambridge, MA
34. Tani J. Model-based learning for mobile robot navigation from the dynamical systems perspective IEEE Trans. Systems Man Cybernet. B 26 3 1996 421-436
35. Tani J. Nolfi S. Learning to perceive the world as articulated: an approach for hierarchical learning in sensory-motor systems Neural Networks 12 1999 1131-1141
36. M. Trebar, A. Dobnikar, Time series prediction using modular recurrent neural network, in: Proc. CESA'96, IMACS Multiconference, Lille, France, Cité Scientifique, Lille, 1996, pp. 160-165.
37. Trullier O. Wiener S. Berthoz A. Meyer J. Biologically based artificial navigation systems: review and prospects Prog. Neurobiol. 51 5 1997 483-544
38. E. Uchibe, M. Asada, K. Hosoda, Behavior coordination for a mobile robot using modular reinforcement learning, in: Proceedings of the International Conference on Intelligent Robots and Systems, IEEE Press, New York, 1996, pp. 1329-1336.
39. Watkins J. Dayan P. Technical note: Q-learning Mach. Learning 8 1992 279-292
40. Williams R. Zipser D. A learning algorithm for continually running fully recurrent neural networks Neural Comput. 1 2 1989 270-280