Reinforcement learning for robot control

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 4573, Issue , 2001, Pages 92-103

  Smart, William D ^a   Kaelbling, Leslie Pack ^a  

^a WASHINGTON UNIVERSITY   (United States)

Author keywords

Learning by demonstration; Learning control; Machine learning; Mobile robots; Reinforcement learning

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; CONTROL SYSTEM ANALYSIS; MOBILE ROBOTS; PROBLEM SOLVING;

REINFORCEMENT LEARNING;

ROBOT LEARNING;

EID: 0035763997     PISSN: 0277786X     EISSN: None     Source Type: Journal    
DOI: 10.1117/12.457434     Document Type: Article

References (22)

1. C.J.C.H. Watkins and P. Dayan, "Q-learning," Machine Learning 8, pp. 279-292, 1992.
2. R.S. Sutton and A.G. Barto, Reinforcement Learning: An Introduction, Adaptive Computations and Machine Learning, MIT Press, Cambridge, MA, 1998.
3. L.P. Kaelbling, M.L. Littman, and A.W. Moore, "Reinforcement learning: A survey," Journal of Artificial Intelligence Research 4, pp. 237-285, 1996.
4. J.A. Boyan and A.W. Moore, "Generalization in reinforcement learning: Safely approximating the value function," in Advances in Neural Information Processing Systems, G. Tesauro, D.S. Touretzky, and T. Leen, eds., 7, pp. 369-376, MIT Press, 1995.
5. G.J. Gordon, Approximate Solutions to Markov Decision Processes. PhD thesis, School of Computer Science, Carnegie Mellon University, June 1999. Also available as technical report CMU-CS-99-143.
6. C.G. Atkeson, A.W. Moore, and S. Schaal, "Locally weighted learning," Artificial Intelligence Review 11, pp. 11-73, 1997.
7. R.D. Cook, "Influential observations in linear regression," Journal of the American Statistical Association 74, pp. 169-174, March 1979.
8. W.D. Smart, Making Reinforcement Learning Work on Real Robots. PhD thesis, Department of Computer Science, Brown University, May 2002.
9. W.D. Smart and L.P. Kaelbling, "Practical reinforcement learning in continuous spaces," in Proceedings of the Seventeenth International Conference on Machine Learning (ICML-2000), pp. 903-910, 2000.
10. S. Mahadevan, "Machine learning for robots: A comparison of different paradigms," in Proceedings of the Workshop on Towards Real Autonomy, IEEE/RSJ Internaltional Conference on Intelligent Robots and Systems (IROS '96), 1996.
11. D.A. Pomerleau, Neural Network Perception for Mobile Robot Guidance, Kluwer Academic Publishers, Boston, MA, 1993.
12. S. Schaal and C.G. Atkeson, "Robot learning by nonparametric regression," in Proceedings of Intelligent Robots and Systems 1994 (IROS '94), V. Graefe, ed., pp. 137-154, 1995.
13. Y. Kuniyoshi, M. Inaba, and H. Inoue, "Learning by watching: Extracting reusable task knowledge from visual observation of human performance," IEEE Transactions on Robotics and Automation 10, pp. 799-822, December 1994.
14. M. Kaiser, "Transfer of elementary skills via human-robot interaction," Adaptive Behavior 5(3/4), pp. 249-280, 1997.
15. J. Demiris and G. Hayes, "Imitative learning mechanisms in robots and humans," in Proceedings of the 5th European Workshop on Learning Robots, V. Klingspor, ed., (Bari, Italy), July 1996.
16. P. Bakker and Y. Kinuyoshi, "Robot see, robot do: An overview of robot imitation," in Proceedings of the AISB96 Workshop on Learning in Robots and Animals, pp. 3-11, 1996.
17. P. Maes and R.A. Brooks, "Learning to coordinate behaviors," in Proceedings of the Eighth National Conference on Artificial Intelligence (AAAI '90), pp. 796-802, AAAI Press, (Menlo Park, CA), 1990.
18. S. Mahadevan and J. Connell, "Automatic programming of behavior-based robots using reinforcement learning," Machine Learning 55, pp. 311-365, June 1992.
19. L.-J. Lin, "Self-improving reactive agents based on reinforcement learning, planning and teaching," Machine Learning 8, pp. 293-321, 1992.
20. M. Asada, S. Noda, S. Tawaratsumida, and K. Hosoda, "Purposive behavior acquisition for a real robot by vision-based reinforcement learning," Machine Learning 23, pp. 279-303, 1996.
21. S.P. Singh and R.S. Sutton, "Reinforcement learning with replacing eligibility traces," Machine Learning 22, pp. 123-158, 1996.
22. M. Dorigo and M. Colombetti, "Robot shaping: Developing autonomous agents through learning," Artificial Intelligence 71(2), pp. 321-370, 1994.