Using Policy Gradient Reinforcement Learning on Autonomous Robot Controllers

IEEE International Conference on Intelligent Robots and Systems

Volumn 1, Issue , 2003, Pages 406-411

  Grudic, Gregory Z ^a   Kumar, Vijay ^b   Ungar, Lyle ^b  

^a UCB 450   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGEBRA; ALGORITHMS; APPROXIMATION THEORY; CONTROL EQUIPMENT; CONTROL SYSTEM ANALYSIS; ESTIMATION; FEEDBACK; LEARNING SYSTEMS; ROBOT PROGRAMMING; ROBUSTNESS (CONTROL SYSTEMS);

CONTINOUS CONTROLLERS; REINFORCEMENT FEEDBACK;

ROBOTICS;

EID: 0347410594     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. R. Arkin and T. Balch, Artificial Intelligence and Mobile Robots, ch. Cooperative Multiagent Robot Systems. MIT Press, 1998.
2. M. Mataric, "Issues and approaches in the design of collective autonomous a gents," Robotics and Autonoumous Systems, vol. 16, pp. 321-331, Dec 1995.
3. J.Lygeros, C.J.Tomlin, and S.Sastry, "Multiobjective hybrid control synthisis," in Proceedings of hybrid and realtime systems, vol. 1201 of Lecture Notes in Computer Science, Grenoble: Springer-Verlag, March 1997.
4. D. Liberzon and A. S. Morse, "Basic problems in stability and design of switched systems," IEEE Control Systems, vol. 19, pp. 59-70, Oct. 1999.
5. M. Branicky, Studies in Hybrid Systems: Modeling, Analysis and Control. PhD thesis, MIT, Cambridge, MA, 1995.
6. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
7. L. P. Kaelbling, M. L. Littman, and A. W. Moore, "Reinforcement learning: A survey," Journal of Artificial Intelligence Research, vol. 4, pp. 237-285, 1996.
8. F. Michaud and M. J. Mataric, "Representation of behavioral history for learning in nonstationary conditions," Robotics and Autonomous Systems, vol. 29, no. 2, pp. 187-200, 1999.
9. W. D. Smart and L. P. Kaelbling, "Practical reinforcement learning in continuous spaces," in Proceedings of the Seventeenth International Conference on Machine Learning, vol. 17, pp. 903-910, Morgan Kaufmann, June 29 - July 2 2000.
10. S. Mahadevan, "Enhancing transfer in reinforcement learning by building stochastic models of robot actions," in Proceedings of the Ninth International Conference on Machine Learning, vol. 9, pp. 290-299, Morgan Kaufmann, 1992.
11. L. J. Lin, "Self-improving reactive agents based on reinforcement learning, planning and teaching," Machine Learning, vol. 8, pp. 293-321, 1992.
12. M. Asada, S. Noda, S. Tawaratsumida, and K. Hosoda, "Purposive behaviour aquisition for a real robot by vision-based reinforcement learning," Machine Learning, vol. 23, pp. 279-303, 1996.
13. W. D. Smart and L. P. Kaelbling, "Effective reinforcement learning for mobile robots," in IEEE Int. Conf. on Robotics and Automation, ICRA 02, 2002. IEEE Intl. Conf. on Robot, and Automat., 2002.
14. A. S. E. Martinson and R. C. Arkin, "Robot behavioral selection using q-learning," in In the Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2002.
15. A. H. F. Y. Wang, B. Thibodeau and R. Grupen, "Learning optimal switching policies for path tracking tasks on a mobile robot," in In the Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2002.
16. S. Mahadevan, "Continuous-time hierarchical reinforcement learning," in Proceedings of the Eighteenth International Conference on Machine Learning, vol. 18, pp. 186-193, Morgan Kaufmann, 2002.
17. G. Z. Grudic and L. H. Ungar, "Localizing search in reinforcement learning," in Proceedings of the Seventeenth National Conference on Artificial Intelligence, vol. 17, pp. 590-595, Menlo park, CA: AAAI Press / Cambridge, MA: MIT Press, July 30 - August 3 2000.
18. L. Baird and A. W. Moore, "Gradient descent for general reinforcement learning," in Advances in Neural Information Processing Systems (M. I. Jordan, M. J. Kearns, and S. A. Solla, eds.), vol. 11, (Cambridge, MA), MIT Press, 1999.
19. R. J. Williams, "Simple statistical gradient-following algorithms for connectionist reinforcement learning," Machine Learning, vol. 8, no. 3, pp. 229-256, 1992.
20. G. Z. Grudic, V. Kumar, and L. H. Ungar, "Refining autonomous robot controllers using reinforcemnt learning," Submitted, 2003.
21. D. Lee, The map-building and exploration strategies of a simple sonar-equipped robot: an experimental, quantitative evaluation. Cambridge; New York: Cambridge University Press, 1996.