Online action adaptation in interactive computer games

Computers in Entertainment

Volumn 7, Issue 2, 2009, Pages

  Hartley, Thomas ^a   Mehdi, Quasim ^a  

^a UNIVERSITY OF WOLVERHAMPTON   (United Kingdom)

Author keywords

Action prediction; K d trees; Nonplayer characters (NPCS); Online learning and adaptation; Unreal Tournament

Indexed keywords

ACTION PREDICTION; K-D TREES; NONPLAYER CHARACTERS (NPCS); ONLINE LEARNING AND ADAPTATION; UNREAL TOURNAMENT;

APPLICATION PROGRAMMING INTERFACES (API); ARTIFICIAL INTELLIGENCE; COMPUTER ARCHITECTURE; E-LEARNING; INTERNET;

GAME THEORY;

EID: 67949094183     PISSN: 15443574     EISSN: 15443981     Source Type: Journal    
DOI: 10.1145/1541895.1541908     Document Type: Article

References (36)

1. Adobbati, R., Marshall, A. N., Scholer, A., Tejada, S.,. Kaminka, G., Schaffer, S., and Sollitto, C. 2001. Gamebots: a 3D virtual world test-bed for multi-agent research. In Proceedings of the 2nd International Workshop on Infrastructure, MAS and MAS Scalability.
2. Andrade, G. D., Santana, H. P., Furtado, A. W. B., Leito, A. R. G. A., and Ramalho, G. L. 2004. Online adaptation of computer games agents: A reinforcement learning approach. In Proceedings of the 1st Brazilian Symposium on Computer Games and Digital Entertainment (SBGames2004).
3. Baekkelund, C. 2006. A brief comparison of machine learning methods. In AI Game Programming Wisdom 3, S. Rabin (ed.), Charles River Media, 617-631.
4. Bentley, J. and Friedman, J. 1979. Data structures for range searching. Computing Surveys 11, 4, 397-409.
5. Carmel, D. and Markovitch, S. 1993. Learning models of the opponent's strategy in game playing. In Proceedings of the AAAI Fall Symposium on Games: Planning and Learning, 140-147.
6. Cunningham, P. and Zenobi, G. 2001. Case representation issues for case-based reasoning from ensemble research. Submitted to ICCBR 2001.
7. Davies, N. and Mehdi, Q. 2006. BDI for intelligent agents in computer games. In Proceedings of the 8th International Conference on Computer Games: AI and Mobile Systems (CGAIMS 2006).
8. Demasi, P. and de Cruz, A. J. 2003. Anticipating opponent behaviour using sequential prediction and real-time fuzzy rule learning. In Proceedings of the 4th International Conference on Intelligent Games and Simulation, 101-105.
9. Dinerstein, J., Ventura, D., and Egbert, P. 2005. Fast and robust incremental action prediction for interactive agents. Computational Intelligence 21, 1, 90-110.
10. Fagan, M. and Cunningham, P. 2003. Case-based recognition in computer games. Tech. Rep, TCD-CS-2003-01, Computer Science Department, Trinity College Dublin.
11. Fairclough C., Fagan, M., MacNamee, B., and Cunningham, P. 2001. Research directions for AI in computer games. Tech. Rep., Trinity College Dublin.
12. Hartley, T. 2005. Online learning and adaptation in computer games. In Proceedings of the 7th International Conference on Computer Games (CGAMES 2005), 299-300.
13. Hartley, T. and Mehdi, Q. 2006. Towards online adaptation in action games: Case storage and retrieval. In Proceedings of the 8th International Conference on Computer Games: AI and Mobile Systems (CGAIMS 2006).
14. Havok. 2008. http://www.havok.com.
15. Henrich, A. 1996. A hybrid split strategy for k-d-tree based access structures. In Proceedings of the 4th ACM Workshop on Advances in GIS, ACM, New York, 1-8.
16. Henrich, A., Six, H., and Widmayer, P. 1989. The LSD tree: Spatial access to multidimensional point and non-point data. In Proceedings of the 15th International Conference on Very Large Data Bases, P.M.G. Apers and G. Wiederhold (eds.). 45-53.
17. Hunicke, R. and Chapman, V. 2004. AI for dynamic difficulty adjustment in games. In Proceedings of the Challenges in Game Artificial Intelligence, AAAI Workshop. AAAI Press.
18. Iida H., Uiterwijk, J. W. H. M., van den Herik, H. J., and Herschberg, I. S. 1993. Potential applications of opponent-model search. Part 1: The domain of applicability. ICCA Journal 16, 4, 201-208.
19. Kaminka, G., Veloso, M., Schaffer, S., Sollitto, C., Adobbati, R., Marshall, A., Scholer, A. and Tejada, S. 2002. GameBots: A flexible test bed for multiagent team research. Commun. ACM 45, 1 (Jan.), 43-45.
20. Kerkez, B. and Cox, M. 2001. Incremental case-based plan recognition using state indices. In Cased-based Reasoning Research and Development: Proceedings of 4th International Conference on Case-Based Reasoning (ICCBR 2001), D. W. Aha et al. (eds.), Springer Verlag, New York, 291-305.
21. Kolodner, J. 1993. Case-Based Reasoning (1st ed.). Morgan Kaufmann, San Francisco, CA.
22. Krogh, A. and Vedelsby, J. 1995. Neural network ensembles, cross validation and active learning. In Advances in Neural Information Processing Systems 7, G. Tesauro et al. (eds.), MIT Press, Cambridge MA, 231-238.
23. Laird, J. 2001. It knows what you're going to do: Adding anticipation to a quakebot. In Proceedings of the Fifth International Conference on Autonomous Agents, 385-392. Available from
24. http://ai.eecs.umich.edu/people /laird/papers/Agents01.pdf.
25. Manslow, J. 2002. Learning and adaptation. In AI Game Programming Wisdom, S. Rabin (ed.), Charles River Media, 557-566.
26. Manslow, J. 2006. Practical algorithms for in-game learning. In AI Game Programming Wisdom 3. S. Rabin (ed.), Charles River Media, 599-616.
27. Mitchell, T. 1997. Machine Learning. McGraw-Hill, New York.
28. NVIDIA. 2008. PhysX. http://www.nvidia.com/object/nvidia-physx.html.
29. Orkin, J. 2006. 3 States and a plan: The AI of F.E.A.R. Presentation at the Game Developers Conference.
30. Overmars, M. 1981. Transforming semi-dynamic data structures into dynamic structures. Tech. Rep. RUU-CS-81-10, Institute of Information and Computing Sciences, Utrecht University.
31. Overmars, M. and Leeuwen, J. 1981. Worst-case optimal insertion and deletion methods for decomposable searching problems. Inf. Process. Lett. 12, 4,168-173.
32. Ponsen, M. and Spronck, P. 2004. Improving adaptive game AI with evolutionary learning. In Computer Games: Artificial Intelligence, Design and Education (CGAIDE), 389-396.
33. Ramon, J., Jacobs, N., and Blockeel, H. 2002. Opponent modeling by analyzing play. In Third International Conference on Computers Games (CG'02). Workshop on agents in computer games.
34. Spronck P., Sprinkhuizen-Kuyper I., and Postma, E. 2003. Online adaptation of game opponent AI. In Simulation and in Practice. 4th International Conference on Intelligent Games and Simulation (GAME-ON 2003), 93-100.
35. Spronck, P. 2005. Adaptive game AI. Ph.D. dissertation, Universiteit Maastricht, Maastricht.
36. Thurau, C., Bauckhage, C., and Sagerer, G. 2004. Imitation learning at all levels of game-AI. In Proceedings of the Conference on Computer Games, Artificial Intelligence, Design and Education, 402-408.