Value functions for RL-based behavior transfer: A comparative study

Proceedings of the National Conference on Artificial Intelligence

Volumn 2, Issue , 2005, Pages 880-885

  Taylor, Matthew E ^a   Stone, Peter ^a   Liu, Yaxin ^a  

^a University of Texas at Austin   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIOR TRANSFER; TEMPORAL DIFFERENCE (TD);

ALGORITHMS; APPROXIMATION THEORY; FUNCTIONS; LEARNING SYSTEMS;

BEHAVIORAL RESEARCH;

EID: 29444435242     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Albus, J. S. 1981. Brains, Behavior, and Robotics. Peterborough, NH: Byte Books.
2. Andre, D., and Russell, S. J. 2002. State abstraction for programmable reinforcement learning agents. In Proceedings of the Eighteenth National Conference on Artificial Intelligence, 119-125.
3. Andre, D., and Teller, A. 1999. Evolving team Darwin United. In Asada, M., and Kitano, H., eds., RoboCup-98: Robot Soccer World Cup II. Berlin: Springer Verlag.
4. Asada, M.; Noda, S.; Tawaratsumida, S.; and Hosoda, K. 1994. Vision-based behavior acquisition for a shooting robot by using a reinforcement learning. In Proc. of IAPK/IEEE Workshop on Visual Behaviors-1994, 112-118.
5. Colombetti, M., and Dorigo, M. 1993. Robot Shaping: Developing Situated Agents through Learning. Technical Report TR-92-040, International Computer Science Institute, Berkeley, CA.
6. Crites, R. H., and Barto, A. G. 1996. Improving elevator performance using reinforcement learning. In Touretzky, D. S.; Mozer, M. C.; and Hasselmo, M. E., eds., Advances in Neural Information Processing Systems 8. Cambridge, MA: MIT Press.
7. de Boer, R., and Kok, J. R. 2002. The incremental development of a synthetic multi-agent system: The uva trileam 2001 robotic soccer simulation team. Master's thesis, University of Amsterdam, The Netherlands.
8. Drummond, C. 2002. Accelerating reinforcement learning by composing solutions of automatically identified subtasks. Journal of Artificial Intelligence Research 16:59-104.
9. Dzeroski, S.; Raedt, L. D.; and Driessens, K. 2001. Relational reinforcement learning. Machine Learning 43:7-52.
10. Fern, A.; Yoon, S.; and Givan, R. 2004. Approximate policy iteration with a policy language bias. In Thrun, S.; Saul, L.; and Schölkopf, B., eds., Advances in Neural Information Processing Systems 16. Cambridge, MA: MIT Press.
11. Guestrin, C.; Koller, D.; Gearhart, C.; and Kanodia, N. 2003. Generalizing plans to new environments in relational mdps. In International Joint Conference on Artificial Intelligence (IJCAI-03).
12. Mataric, M. J. 1994. Reward functions for accelerated learning. In International Conference on Machine Learning, 181-189.
13. Morales, E. F. 2003. Scaling up reinforcement learning with a relational representation. In Proc. of the Workshop on Adaptability in Multi-agent Systems.
14. Ng, A. Y.; Harada, D.; and Russell, S. 1999. Policy invariance under reward transformations: Theory and application to reward shaping. In Proc. 16th International Conf. on Machine Learning.
15. Price, B., and Boutilier, C. 2003. Accelerating reinforcement learning through implicit imitation. Journal of Artificial Intelligence Research 19:569-629.
16. Puterman, M. L. 1994. Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley & Sons, Inc.
17. Riedmiller, M.; Merke, A.; Meier, D.; Hoffman, A.; Sinner, A.; Thate, O.; and Ehrmann, R. 2001. Karlsruhe brainstormers - a reinforcement learning approach to robotic soccer. In Stone, P.; Balch, T.; and Kraetszchmar, G., eds., RoboCup-2000: Robot Soccer World Cup IV. Berlin: Springer Verlag.
18. Selfridge, O.; Sutton, R. S.; and Barto, A. G. 1985. Training and tracking in robotics. Proceedings of the Ninth International Joint Conference on Artificial Intelligence 670-672.
19. Singh, S. P. 1992. Transfer of learning by composing solutions of elemental sequential tasks. Machine Learning 8:323-339.
20. Stone, P.; Kuhlmann, G.; Taylor, M.; and Liu, Y. 2005. Keepaway soccer: From machine learning testbed to benchmark. In Proceedings of RoboCup International Symposium. To appear.
21. Stone, P.; Riley, P.; and Veloso, M. 2000. The CMUnited-99 champion simulator team. In Veloso, M.; Pagello, E.; and Kitano, H., eds., RoboCup-99: Robot Soccer World Cup III. Berlin: Springer. 35-48.
22. Stone, P.; Sutton, R. S.; and Kuhlmann, G. 2005. Reinforcement learning for RoboCup-soccer keepaway. Adaptive Behavior. To appear.
23. Sutton, R. S., and Barto, A. G. 1998. Introduction to Reinforcement Learning. MIT Press.
24. Taylor, M. E., and Stone, P. 2005. Behavior transfer for value-function-based reinforcement learning. In The Fourth International Joint Conference on Autonomous Agents and Multiagent Systems. To appear.
25. Tesauro, G. 1994. TD-Gammon, a self-teaching backgammon program, achieves master-level play. Neural Computation 6(2):215-219.