Connectionist reinforcement learning for intelligent unit micro management in StarCraft

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2011, Pages 1794-1801

  Shantia, Amirhosein ^a   Begue, Eric ^a   Wiering, Marco ^a  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

CORE STRATEGY; DYNAMIC ENVIRONMENTS; ENVIRONMENT DATA; GAME SCHEME; INCREMENTAL LEARNING; INTELLIGENT UNIT; INTERACTING AGENTS; REAL-TIME STRATEGY GAMES; RESOURCE MANAGEMENT; REWARD FUNCTION; SENSING SYSTEMS; SHORT TERM MEMORY; SIMULATION RESULT; SYSTEM USE; SYSTEM-BASED; TRAINED NEURAL NETWORKS;

INTELLIGENT AGENTS; REINFORCEMENT LEARNING; SENSORS;

NEURAL NETWORKS;

EID: 80054721180     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2011.6033442     Document Type: Conference Paper

References (20)

1. J. Polvichai, M. Lewis, P. Scerri, and K. Sycara, Using Dynamic Neural Network to Model Team Performance for Coordination Algorithm Configuration and Reconfiguration of Large Multi-Agent Teams, C. H. Dagli, A. L. Buczak, D. L. Enke, M. Embrechts, and O. Ersoy, Eds. New York, NY: ASME Press, 2006.
2. M. R. Khojasteh and A. Kazimi, "Agent Coordination and Disaster Prediction in Persia 2007, A RoboCup Rescue Simulation Team based on Learning Automata," in Proceedings of the World Congress on Engineering 2010 Vol I., ser. WCE 2010. Lecture Notes in Engineering and Computer Science, 2010, pp. 122-127.
3. I. Martinez, D. Ojeda, and E. Zamora, "Ambulance decision support using evolutionary reinforcement learning in robocup rescue simulation league," in RoboCup 2006: Robot Soccer World Cup X, ser. Lecture Notes in Computer Science, G. Lakemeyer, E. Sklar, D. Sorrenti, and T. Takahashi, Eds. Springer Berlin / Heidelberg, 2007, vol. 4434, pp. 556-563.
4. S. C. Bakkes, P. H. Spronck, and H. J. van den Herik, "Opponent modelling for case-based adaptive game AI," Entertainment Computing, vol. 1, no. 1, pp. 27 - 37, 2009.
5. M. Wittkamp, L. Barone, and P. Hingston, "Using NEAT for continuous adaptation and teamwork formation in pacman," in Computational Intelligence and Games, 2008. CIG 2008. IEEE Symposium On, december 2008, pp. 234-242.
6. M. van der Heijden, S. Bakkes, and P. Spronck, "Dynamic formations in real-time strategy games," in Computational Intelligence and Games, 2008. CIG '08. IEEE Symposium On, december 2008, pp. 47-54.
7. L. P. Kaelbling, M. L. Littman, and A. W. Moore, "Reinforcement learning: A survey," Journal of Artificial Intelligence Research, vol. 4, pp. 237-285, 1996.
8. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. The MIT press, Cambridge MA, A Bradford Book, 1998.
9. A. C. Chapman, R. A. Micillo, R. Kota, and N. R. Jennings, "Decentralised dynamic task allocation: a practical game: theoretic approach," in Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 2, ser. AAMAS '09. Richland, SC: International Foundation for Autonomous Agents and Multiagent Systems, 2009, pp. 915-922.
10. O. Aghazadeh, M. Sharbafi, and A. Haghighat, "Implementing parametric reinforcement learning in robocup rescue simulation," in RoboCup 2007: Robot Soccer World Cup XI, ser. Lecture Notes in Computer Science, U. Visser, F. Ribeiro, T. Ohashi, and F. Dellaert, Eds. Springer Berlin / Heidelberg, 2008, vol. 5001, pp. 409-416.
11. E. Alpaydin, Introduction to Machine Learning. The MIT Press, 2004.
12. M. Riedmiller, "Neural fitted Q iteration: first experiences with a data efficient neural reinforcement learning method," in 16th European Conference on Machine Learning. Springer, 2005, pp. 317-328.
13. G. Rummery and M. Niranjan, "On-line Q-learning using connectionist sytems," Cambridge University, UK, Tech. Rep. CUED/F-INFENGTR 166, 1994.
14. R. S. Sutton, "Generalization in reinforcement learning: Successful examples using sparse coarse coding," in Advances in Neural Information Processing Systems 8, D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, Eds. MIT Press, Cambridge MA, 1996, pp. 1038-1045.
15. ESA, "Essential facts about the computer and video game industry," 2010.
16. U. of Santa Cruz, "StarCraft AI Competition," http://eis.ucsc.edu/StarCraftAICompetition, 2010, [Online].
17. L.-J. Lin, "Reinforcement learning for robots using neural networks," Ph.D. dissertation, Carnegie Mellon University, Pittsburgh, January 1993.
18. S. Thrun, "Efficient exploration in reinforcement learning," Carnegie-Mellon University, Tech. Rep. CMU-CS-92-102, January 1992.
19. C. J. C. H. Watkins, "Learning from delayed rewards," Ph.D. dissertation, King's College, Cambridge, England, 1989.
20. C. J. C. H. Watkins and P. Dayan, "Q-learning," Machine Learning, vol. 8, pp. 279-292, 1992.