Advice taking and transfer learning: Naturally inspired extensions to reinforcement learning

AAAI Fall Symposium - Technical Report

Volumn FS-08-06, Issue , 2008, Pages 103-110

  Torrey, Lisa ^a   Walker, Trevor ^a   Maclin, Richard ^b   Shavlik, Jude ^a  

^a University of Wisconsin Madison   (United States)

^b UNIVERSITY OF MINNESOTA DULUTH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MACHINE LEARNING ALGORITHMS; MACHINE LEARNING TECHNIQUES; ROBOCUP; SPECIFIC PROBLEMS; STRONG LINK; TRANSFER LEARNING; WORK FOCUS;

ARTIFICIAL INTELLIGENCE; REINFORCEMENT; REINFORCEMENT LEARNING;

LEARNING ALGORITHMS;

EID: 77952176586     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Croonenborghs, T.; Driessens, K.; and Bruynooghe, M. 2007. Learning relational skills for inductive transfer in relational reinforcement learning. In 2007 International Conference on Inductive Logic Programming.
2. Driessens, K., and Dzeroski, S. 2002. Integrating experimentation and guidance in relational reinforcement learning. In 2002 International Conference on Machine Learning.
3. Fernandez, F., and Veloso, M. 2006. Policy reuse for transfer learning across tasks with different state and action spaces. In 2006 ICML Workshop on Structural Knowledge Transfer for Machine Learning.
4. Gill, A. 1962. Introduction to the Theory of Finite-state Machines. McGraw-Hill.
5. Kok, S.; Singla, P.; Richardson, M.; and Domingos, P. 2005. The Alchemy system for statistical relational AI. Technical report, University of Washington.
6. Kuhlmann, G.; Stone, P.; Mooney, R.; and Shavlik, J. 2004. Guiding a reinforcement learner with natural language advice: Initial results in RoboCup soccer. In 2004 AAAI Workshop on Supervisory Control of Learning and Adaptive Systems.
7. Lowd, D., and Domingos, P. 2007. Efficient weight learning for Markov logic networks. In 2007 Conference on Knowledge Discovery in Databases.
8. Maclin, R., and Shavlik, J. 1996. Creating advice-taking reinforcement learners. Machine Learning 22:251-281.
9. Maclin, R.; Shavlik, J.; Torrey, L.; Walker, T.; and Wild, E. 2005a. Giving advice about preferred actions to reinforcement learners via knowledge-based kernel regression. In 2005 AAAI Conference on Artificial Intelligence.
10. Maclin, R.; Shavlik, J.; Torrey, L.; and Walker, T. 2005b. Knowledge-based support vector regression for reinforcement learning. In 2005 IJCAI Workshop on Reasoning, Representation, and Learning in Computer Games.
11. Noda, I.; Matsubara, H.; Hiraki, K.; and Frank, I. 1998. Soccer server: A tool for research on multiagent systems. Applied Artificial Intelligence 12:233-250. (Pubitemid 127619180)
12. Richardson, M., and Domingos, P. 2005. Markov logic networks. Machine Learning 62:107-136.
13. Srinivasan, A. 2001. The Aleph manual (available online).
14. Stone, P., and Sutton, R. 2001. Scaling reinforcement learning toward RoboCup soccer. In 2007 International Conference on Machine Learning.
15. Sutton, R., and Barto, A. 1998. Reinforcement Learning: An Introduction. MIT Press.
16. Sutton, R. 1988. Learning to predict by the methods of temporal differences. Machine Learning 3:9-44.
17. Taylor, M., and Stone, P. 2007. Cross-domain transfer for reinforcement learning. In 2007 International Conference on Machine Learning.
18. Taylor, M.; Stone, P.; and Liu, Y. 2005. Value functions for RL-based behavior transfer: A comparative study. In 2005 AAAI Conference on Artificial Intelligence.
19. Torrey, L.; Shavlik, J.; Walker, T.; and Maclin, R. 2006a. Relational skill transfer via advice taking. In 2006 ICML Workshop on Structural Knowledge Transfer for Machine Learning.
20. Torrey, L.; Shavlik, J.; Walker, T.; and Maclin, R. 2006b. Skill acquisition via transfer learning and advice taking. In 2006 European Conference on Machine Learning.
21. Torrey, L.; Shavlik, J.; Walker, T.; and Maclin, R. 2007. Relational macros for transfer in reinforcement learning. In 2007 International Conference on Inductive Logic Programming.
22. Torrey, L.; Shavlik, J.; Natarajan, S.; Kuppili, P.; and Walker, T. 2008. Transfer in reinforcement learning via Markov logic networks. In 2008 AAAI Workshop on Transfer Learning for Complex Tasks.
23. Watkins, C. 1989. Learning from delayed rewards. Ph.D. Dissertation, University of Cambridge.