On experiences in a complex and competitive gaming domain: Reinforcement learning meets RoboCup

Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007

Volumn , Issue , 2007, Pages 17-23

  Riedmiller, Martin ^a   Gabel, Thomas ^a  

^a UNIVERSITY OF OSNABRÜCK   (Germany)

Author keywords

Neural networks; Reinforcement learning; RoboCup; Robotic soccer simulation; Single and multi agent learning

Indexed keywords

ANIMATION; COMPUTER SIMULATION; LEARNING ALGORITHMS; NEURAL NETWORKS; REINFORCEMENT LEARNING; ROBOTICS;

COMPETITIVE GAMING DOMAINS; MULTI AGENT LEARNING; ROBOTIC SOCCER SIMULATION;

MULTI AGENT SYSTEMS;

EID: 34548787715     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIG.2007.368074     Document Type: Conference Paper

References (23)

1. H. Kitano, M. Asada, Y. Kuniyoshi, I. Noda, E. Osawa, and H. Mat-subara, "RoboCup: A Challenge Problem for AI," AI Magazine, vol. 18, no. 1, pp. 73-85, 1997.
2. R. Sutton and A. Barto, Reinforcement Learning. An Introduction. Cambridge, USA: MIT Press/A Bradford Book, 1998.
3. P. Stone and M. Veloso, "Layered Learning," in Machine Learning: ECML 2000. Proceedings of the 11th European Conference on Machine Learning. Barcelona, Spain: Springer, 2000, pp. 369-381.
4. P. Stone, R. Sutton, and G. Kuhlmann, "Reinforcement Learning for RoboCup-Soccer Keepaway," Adaptive Behavior, vol. 13, no. 3, pp. 165-188, 2005.
5. J. Kok, M. Spaan, and N. Vlassis, "Non-Communicative Multi-Robot Coordination in Dynamic Environments," Robotics and Autonomous Systems, vol. 50, no. 2-3, pp. 99-114, 2005.
6. Y.Takahashi, K. Edazawa, K. Noma, and M. Asada, "Simultaneous Learning to Acquire Competitive Behaviors in Multi-Agent System based on a Modular Learning System," in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2005). IEEE Computer Society, 2005, pp. 153-159.
7. T. Gabel, R. Hafner, S. Lange, M. Lauer, and M. Riedmiller, "Bridging the Gap: Learning in the RoboCup Simulation and Midsize League," in Proceedings of the 7th Portuguese Conference on Automatic Control (Controlo 2006). Porto, Portugal: Portuguese Society of Automatic Control, 2006.
8. M. Veloso, T. Balch, and P. Stone, "RoboCup 2001: The Fifth Robotic Soccer World Championships," AI Magazine, vol. 1, no. 23, pp. 55-68, 2002.
9. I. Noda, H. Matsubara, K. Hiraki, and I. Frank, "Soccer Server: A Tool for Research on Multi-Agent Systems," Applied Artificial Intelligence, vol. 12, no. 2-3, pp. 233-250, 1998.
10. M. Riedmiller, A. Merke, and W. Nowak, "Brainstormers 2003 - Team Description," in RoboCup 2003: Robot Soccer World Cup VII, LNCS. Springer, 2003.
11. A. Merke and M. Riedmiller, "Karlsruhe Brainstormers - A Reinforcement Learning Way to Robotic Soccer II," in RoboCup-2001, LNCS. Springer, 2001.
12. M. Riedmiller, T. Gabel, J. Knabe, and H. Strasdat, "Brainstormers 2D - Team Description 2005," in RoboCup 2005: Robot Soccer World Cup IX (CD). Springer, 2005.
13. M. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. USA: Wiley-Interscience, 2005.
14. R. S. Sutton, "Learning to Predict by the Methods of Temporal Differences," Machine Learning, vol. 3, pp. 9-44, 1988.
15. K. Hornick, M. Stinchcombe, and H. White, "Multilayer Feedforward Networks Are Universal Approximators," Neural Networks, vol. 2, pp. 359-366, 1989.
16. D. Bertsekas and J. Tsitsiklis, Neuro Dynamic Programming. Belmont, USA: Athena Scientific, 1996.
17. T. Gabel and M. Riedmiller, "CBR for State Value Function Approximation in Reinforcement Learning," in Proceedings of the 6th International Conference on Case-Based Reasoning (ICCBR 2005). Chicago: Springer, 2005, pp. 206-221.
18. M. Riedmiller, "Neural Fitted Q Iteration - First Experiences with a Data Efficient Neural Reinforcement Learning Method," in Machine Learning: ECML 2005. Proceedings of the 16th European Conference on Machine Learning. Porto, Portugal: Springer, 2005.
19. A. Y. Ng, D. Harada, and S. J. Russell, "Policy Invariance Under Reward Transformations: Theory and Application to Reward Shaping," in Proceedings of the 16th International Conference on Machine Learning (ICML 1999), I. Bratko and S. Dzeroski, Eds. Bled, Slovenia: Morgan Kaufmann, 1999, pp. 278-287.
20. T. Gabel and M. Riedmiller, "Learning a Partial Behavior for a Competitive Robotic Soccer Agent," KI Zeitschrift, vol. 20, no. 2.
21. C. Watkins and P. Dayan, "Q-Learning," Machine Learning, vol. 8, pp. 279-292, 1992.
22. M. Riedmiller and H. Braun, "A Direct Adaptive Method for Faster Backpropagation Learning: The RPROP Algorithm," in Proceedings of the International Conference on Neural Networks (ICNN 1993), San Francisco, USA, 1993, pp. 586-591.
23. M. Lauer, "Ego-Motion Estimation and Collision Detection for Omnidirectional Robots," in In RoboCup 2006: Robot Soccer World Cup X, LNCS. Bremen, Germany: Springer, 2006.