Reinforcement learning algorithms for robotic navigation in dynamic environments

ISA Transactions

Volumn 43, Issue 2, 2004, Pages 217-230

  Yen, Gary G ^a   Hickey, Travis W ^a  

^a Oklahoma State University   (United States)

Author keywords

Dynamic environment; Navigation; Obstacle avoidance; Reinforcement learning

Indexed keywords

COLLISION AVOIDANCE; COMPUTATION THEORY; COMPUTER SIMULATION; FUZZY CONTROL; HIERARCHICAL SYSTEMS; LEARNING ALGORITHMS; NAVIGATION;

DYNAMIC ENVIRONMENT; HIERARCHICAL STRUCTURE; REINFORCEMENT LEARNING;

ROBOTICS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; ENVIRONMENT; EVALUATION; LEARNING; LOCOMOTION; METHODOLOGY; ORIENTATION; PHYSIOLOGY; REINFORCEMENT; ROBOTICS; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; ENVIRONMENT; LEARNING; LOCOMOTION; MODELS, THEORETICAL; ORIENTATION; PATTERN RECOGNITION, AUTOMATED; REINFORCEMENT (PSYCHOLOGY); ROBOTICS;

EID: 2142647859     PISSN: 00190578     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0019-0578(07)60032-9     Document Type: Article

References (22)

1. Watkins, C. J. C. H., Learning from Delayed Rewards. Ph.D dissertation, Cambridge University, Cambridge, England, 1989.
2. Sutton, R. S. and Barto, A. G., Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
3. Whitehead, S. D., Sutton, R. S., and Ballard, D. H., Advances in reinforcement learning and their implications for intelligent control. Proceedings of IEEE International Symposium on Intelligent Control, 1990, pp. 1289-1297.
4. Tesauro, G. J., Temporal difference learning and TD-Gammon. Commun. ACM 38, 58-68 (1995).
5. Nie, J. and Haykin, S., A dynamic channel assignment policy through Q-learning. IEEE Trans. Neural Netw. 10, 1443-1455 (1999).
6. Beom, H. R. and Cho, H. S., A sensor-based navigation for a mobile robot using fuzzy logic and reinforcement learning. IEEE Trans. Syst. Man Cybern. 25, 464-477 (1995).
7. Coelho, J. A., Araujo, E. G., Huber, M., and Grupen, R. A., Dynamical categories and control policy selection. Proceedings of IEEE International Symposium on Intelligent Control, 1998, pp. 459-464.
8. Wirten, I. H., The apparent conflict between estimation and control - A survey of the two-armed problem. J. Franklin Inst. 301, 161-189 (1976).
9. Malak, R. J. and Khosla, P. K., A framework for the adaptive transfer of robot skill knowledge using reinforcement learning agents. Proceedings of IEEE International Conference on Robotics and Automation, 2001, pp. 1994-2001.
10. Bertsekas, D. P. and Tsitsiklis, J. N., Neural Dynamic Programming. Athena Scientific, Belmont, MA, 1996.
11. Kaelbling, L. P., Learning in Embedded Systems. MIT Press, Cambridge, MA, 1993.
12. Sutton, R. S., editor, A Special Issue of Machine Learning on Reinforcement Learning, Volume 8. Machine Learning, 1992, Also published as Reinforcement Learning, Kluwer Academic Press, Boston, MA, 1992.
13. Sutton, R. S., editor, A Special Issue of Machine Learning on Reinforcement Learning, Volume 8. Machine Learning, 1992, Also published as Reinforcement Learning, Kluwer Academic Press, Boston, MA, 1992.
14. Kaelbling, L. P., editor A Special Issue of Machine Learning on Reinforcement Learning, Vol. 22, 1996.
15. Davesne, F. and Barret, C., Reactive navigation of a mobile robot using a hierarchical set of learning agents. Proceedings of Intelligent Robots and Systems Conference, 1999, pp. 482-487.
16. Buschka, P., Saffiotti, A., and Wasik, Z., Fuzzy landmark-based localization for a legged robot. Proceedings of Intelligent Robots and Systems Conference, 2000, pp. 1205-1210.
17. Song, K. T. and Chang, C. C., Reactive navigation in dynamic environment using a multisensor predictor. IEEE Trans. Syst. Man Cybern. 29, 870-880 (1999).
18. Ng, K. C. and Trivedi, M. M., A neuro-fuzzy controller for mobile robot navigation and multirobot convoying. IEEE Trans. Syst. Man Cybern. 28, 829-840 (1998).
19. Russell, S. and Norvig, P., Artificial Intelligence: A Modern Approach. Prentice Hall, Upper Saddle River, NJ, 1995.
20. Kirley, M. and Green, D. G., An empirical investigation of optimization in dynamic environments using the cellular genetic algorithm. Proceedings of the Genetic and Evolutionary Computation Conference, 2000, pp. 11-18.
21. Godbole, D., Samad, T., and Gopal, V., Active multimodel control for dynamic maneuver optimization in unmanned air vehicles. Proceedings of IEEE International Conference on Robotics and Automation, 2000, pp. 1257-1262.
22. Bellman, R. E., Dynamic Programming. Princeton University Press, Princeton, NJ, 1957.