Hierarchical controller learning in a first-person shooter

CIG2009 - 2009 IEEE Symposium on Computational Intelligence and Games

Volumn , Issue , 2009, Pages 294-301

  Van Hoorn, Niels ^b   Togelius, Julian ^a   Schmidhuber, Jürgen ^b  

^a IT UNIVERSITY OF COPENHAGEN   (Denmark)

^b DALLE MOLLE INSTITUTE FOR ARTIFICIAL INTELLIGENCE IDSIA   (Switzerland)

Author keywords

Action selection; Behaviour based robotics; Evolutionary algorithms; First person shooters; FPS; Neural networks; Subsumption architecture

Indexed keywords

ACTION SELECTION; BEHAVIOUR-BASED ROBOTICS; FIRST PERSON SHOOTER; FIRST-PERSON SHOOTERS; SUBSUMPTION ARCHITECTURE;

CONTROLLERS; RECURRENT NEURAL NETWORKS; ROBOTICS; ROBOTS;

EVOLUTIONARY ALGORITHMS;

EID: 71549132227     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIG.2009.5286463     Document Type: Conference Paper

References (24)

1. D. Isla, "Probabilistic target tracking and search using occupancy maps," in AI Game Programming Wisdom 3. Charles River Media, 2006.
2. C. Overholtzer and S. Levy, "Adding smart opponents to a first-person shooter video game through evolutionary design," aaai.org, 2005. [Online]. Available: http://www.aaai.org/Papers/AIIDE/ 2005/AIIDE05-028.pdf
3. R. Kadlec, "Evolution of intelligent agent behaviour in computer games," Master's thesis, Charles University in Prague, p. 75, Sep 2008.
4. I. Karpov, T. D'Silva, C. Varrichio, K. Stanley, and R. Miikkulainen, "Integration and evaluation of exploration-based learning in games," Proceedings of the IEEE Symposium on Computational Intelligence and Games, 2006.
5. M. Parker and B. D. Bryant, "Neuro-visual control in the quake ii game engine," Neural Networks, Jan 2008. [Online]. Available: http://ieeexplore.ieee.org/xpls/abs all.jsp?arnumber=4634348
6. S. Priesterjahn, Kramer, A. Weimer, and A. Goebels, "Evolution of human-competitive agents in modern computer games," in Proceedings of the IEEE Congress on Evolutionary Computation (CEC), 2007.
7. C. Thurau, C. Bauckhage, and G. Sagerer, "Learning human-like movement behavior for computer games," Proceedings of the 8th International Conference on the Simulation of Adaptive Behavior (SAB'04), 2004.
8. N. Cole, S. J. Louis, and C. Miles, "Using a genetic algorithm to tune first-person shooter bots," in Proceedings of the IEEE Congress on Evolutionary Computation, 2004, pp. 139-145.
9. R. Small and C. B. Congdon, "Agent smith: Towards an evolutionary rule-based agent for real-time strategy games," pp. 1-7, Nov 2008.
10. J. Westra, "Evolutionary neural networks applied in first person shooters," Master's thesis, Utrecht University, Jan 2007. [Online]. Available: http://people.cs.uu.nl/westra/articles/scriptie.pdf
11. M. McPartland and M. Gallagher, "Creating a multi-purpose first person shooter bot with reinforcement learning," IEEE Symposium on Computational Intellegence and Games, 2008. [Online]. Available: http://www.csse.uwa.edu.au/cig08/Proceedings/papers/8017.pdf
12. R. Arkin, Behavior-based robotics. The MIT Press, 1998.
13. J. Togelius, "Evolution of a subsumption architecture neurocontroller," Journal of Intelligent and Fuzzy Systems, vol. 15, pp. 15-20, 2004.
14. F. Gomez and R. Miikkulainen, "Incremental evolution of complex general behavior," Adaptive Behavior, vol. 5, pp. 317-342, 1997.
15. T. Thompson and J. Levine, "Scaling-up behaviours in evotanks: Applying subsumption principles to artificial neural networks," in Proceedings of the IEEE Symposium Computational Intelligence and Games (CIG), 2008.
16. S. Nolfi and D. Floreano, Evolutionary robotics. Cambridge, MA: MIT Press, 2000.
17. J. Denzinger, K. Loose, D. Gates, and J. Buchanan, "Dealing with parameterized actions in behavior testing of commercial computer games," Proceedings of the IEEE 2005 Symposium on Computational Intelligence and Games CIG05, pp. 37-43, 2005.
18. R. Adobbati, A. Marshall, A. Scholer, and S. Tejada, "Gamebots: A 3d virtual world test-bed for multi-agent research," Proceedings of the Second International Workshop on . . . , Jan 2001. [Online]. Available: http://ironman.srv.cs.cmu.edu/~galk/Publications/01/gamebots.pdf
19. R. Kadlec, J. Gemrot, O. Burkert, M. Bida, J. Havlicek, and C. Brom, "Pogamut 2 - a platform for fast development of virtual agents' behavior," CGames07, pp. 1-5, Oct 2007.
20. J. Elman, "Finding structure in time," Cognitive Science, vol. 14, pp. 179-211, 1990.
21. F. A. Gers and J. Schmidhuber, "Lstm recurrent networks learn simple context free and context sensitive languages," IEEE Transactions on Neural Networks, vol. 12, pp. 1333-1340, 2001.
22. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: Nsga-ii," IEEE Transactions on Evolutionary Computation, vol. 6, pp. 182-197, 2002.
23. N. van Hoorn, J. Togelius, D. Wierstra, and J. Schmidhuber, "Robust player imitation using multiobjective evolution," in Proceedings of the IEEE Congress on Evolutionary Computation (in press), 2009.
24. A. Agapitos, J. Togelius, S. M. Lucas, J. Schmidhuber, and A. Konstantinides, "Generating diverse opponents with multiobjective evolution," in Proceedings of the IEEE Symposium on Computational Intelligence and Games, 2008.