Simulation and reinforcement learning with soccer agents

Multiagent and Grid Systems

Volumn 4, Issue 4, 2008, Pages 415-436

  Leng, Jinsong ^a   Fyfe, Colin ^b   Jain, Lakhmi ^a  

^a UNIVERSITY OF SOUTH AUSTRALIA   (Australia)

^b UNIVERSITY OF THE WEST OF SCOTLAND   (United Kingdom)

Author keywords

Agent; Decision making; Simulation

Indexed keywords

AGENTS; APPROXIMATION ALGORITHMS; ARTIFICIAL INTELLIGENCE; AUTONOMOUS AGENTS; COOPERATIVE COMMUNICATION; DECISION MAKING; DISTRIBUTED COMPUTER SYSTEMS; EFFICIENCY; INTELLIGENT AGENTS; MULTI AGENT SYSTEMS; OPTIMIZATION; REINFORCEMENT LEARNING; SPORTS; STOCHASTIC SYSTEMS;

COMMUNICATION AND COLLABORATIONS; CONTINUOUS STATE-ACTION SPACES; COOPERATIVE LEARNING; DYNAMIC ENVIRONMENTS; OPTIMISATION TECHNIQUES; SIMULATION; SIMULATION ENVIRONMENT; UNCERTAIN ENVIRONMENTS;

LEARNING ALGORITHMS;

EID: 85006272607     PISSN: 15741702     EISSN: 18759076     Source Type: Journal    
DOI: 10.3233/MGS-2008-4407     Document Type: Article

References (34)

1. The MathWorks. http://www.mathworks.com.
2. InfoGrames Epic Games and Digital Entertainment. Technical report, Unreal Tournament Manual, 2000.
3. Teambots, 2000. http://www.cs.cmu.edu/-trb/Teambots/Domains/SoccerBots.
4. Humaniod Kid and Medium Size League, Rules and Setup for Osaka 2005. Technical report, Robocup, 2005.
5. J.S. Albus, A Theory of Cerebellar Function, Mathematical Biosciences 10 (1971), 25-61.
6. R. Bellman, A Markovian Decision Process, Journal of Mathematics and Mechanics 6 (1957).
7. R. Bellman, Dynamic Programming, Princeton University Press, Princeton, NJ, 1957.
8. Peter Dayan and Terrence J. Sejnowski, TD(λ) Converges with Probability 1, Machine Learning 14(1) (1994), 295-301.
9. Thomas Gabel and Martin A. Riedmiller, Learning a Partial Behavior for a Competitive Robotic Soccer Agent, KI 20(2) (2006), 18-23.
10. Abhijit Gosavi, Simulation-based Optimization: parametric optimization techniques and reinforcement learning, Kluwer Academic Publishers, 2003.
11. R.A. Howard, Dynamic Programming and Markov Processes, MIT Press, Cambridge, 1960.
12. Nicholas R. Jennings, Katia Sycara and Michael Wooldridge, A Roadmap of Agent Research and Development, Autonomous Agents and Multi-Agent Systems 1(1) (1998), 7-38.
13. A. Kleiner, M. Dietl and B. Nebel, Towards a Life-Long Learning Soccer Agent, In Proc. Int. RoboCup Symposium 02, pages 119-127, Fukuoka, Japan, 2002.
14. Jinsong Leng, Colin Fyfe and Lakhmi Jain, Teamwork and Simulation in Hybrid Cognitive Architecture, in: Proceeding in 10th Knowledge-Based Intelligent Information and Engineering Systems, LNCS 4252, B. Gabrys et al., Springer-Verlag Berlin Heidelberg, 2006, pp. 472-478.
15. Jinsong Leng, Colin Fyfe and Lakhmi Jain, Reinforcement Learning of Competitive Skills with Soccer Agents, in:Proceeding in 11th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems, LNAI 4692, B. Apolloni et al., Springer-Verlag Berlin Heidelberg, 2007.
16. Jinsong Leng, Lakhmi Jain and Colin Fyfe, Convergence Analysis on Temporal Difference Learning, International Journal of Innovative computing, Information and Control 5(2) (2009), in press.
17. David J. C. Mackay, Information Theory, Inference, and Learning Algorithms, Cambridge University Press, 2003.
18. A. Merke and M. Riedmiller, Karlsruhe Brainstormers - A Reinforcement Learning Approach to Robotic Soccer, RoboCup 2001, volume LNAI 2377, pages 435-440. Springer Berlin / Heidelberg, 2002.
19. M.L. Puterman, Markovian Decision Problems, John Wiley & Sons Inc, 1994.
20. Azam Rabiee and Nasser Ghasem-Aghaee, A Scoring Policy for Simulated Soccer Agents using Reinforcement Learning, 2nd International Conference on Autonomous Robots and Agents, New Zealand, 2004.
21. Reuven Y. Rubinstein, Simulation and the Monte Carlo Method, New York: Wiley, 1981.
22. S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, Prentice-Hall, Englewood Cliffs, NJ, 1995.
23. Alexander A. Sherstov and Peter Stone, Function Approximation via Tile Coding: Automating Parameter Choice, SARA 2005. LNCS 3607, pages 194-205, Berlin, 2005. Springer-Verlag.
24. Christos Sioutis, Reasoning and Learning for Intelligent Agents, PhD thesis, School of Electrical and Information Engineering, University of South Australia, 2005.
25. P. Stone and M. Veloso, TPOT-RL: Team-partitioned, opaque-transition reinforcement learning, RoboCup 98: Robot Soccer World Cup II, pages 221-236, Berlin, 1998. Springer Verlag.
26. Peter Stone, GregoryKuhlmann, MatthewE. Taylor andYaxin Liu, Keepaway Soccer: From Machine Learning Testbed to Benchmark, in: RoboCup-2005: Robot Soccer World Cup IX, (Vol. 4020,) Itsuki Noda, Adam Jacoff, Ansgar Bredenfeld and Yasutake Takahashi, eds, Berlin, 2006. Springer Verlag, pp. 93-105.
27. Peter Stone and Richard S. Sutton, Scaling Reinforcement Learning Toward RoboCup Soccer, Proc. 18th International Conf. on Machine Learning, pages 537-544. Morgan Kaufmann, San Francisco, CA, 2001.
28. R.S. Sutton, Learning to Predict by the Method of Temporal Differences, Machine Learning 3 (1988), 9-44.
29. R.S. Sutton, Generalization in Reinforcement Learning: Successful Examples using Sparse Coarse Coding, in: Advances in Neural Information Processing Systems: Proceedings of the 1995 Conference, D.S. Touretzky, M.C. Mozer and M.E. Hasselmo, eds, Cambridge, MA. MIT Press, 1995, pp. 1038-1044.
30. R.S. Sutton and A.G. Barto, Reinforcement Learning: An Introduction, MIT Press, 1998.
31. C. J. C. H. Watkins, Learning from Delayed Rewards, PhD thesis, Cambridge University, Cambridge, England, 1989.
32. Shimon Whiteson and Peter Stone, Concurrent Layered Learning, In Proceeding of the Second International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS 03), pages 193-200, Australia, 2003.
33. Shimon Whiteson and Peter Stone, Evolutionary Function Approximation for Reinforcement Learning, Journal of Machine Learning Research 7 (2006), 877-917.
34. Michael Wooldridge and Nick Jennings, Intelligent Agents: Theory and Practice, Knowledge Engineering Review 10(2) (1995), 115-152.