Opponent modelling for case-based adaptive game AI

Entertainment Computing

Volumn 1, Issue 1, 2009, Pages 27-37

  Bakkes, Sander C J ^a   Spronck, Pieter H M ^a   Jaap van den Herik, H ^a  

^a TILBURG UNIVERSITY   (Netherlands)

Author keywords

Adaptive behaviour; Game AI; Opponent modelling; Rapid adaptation; Reliable adaptation; RTS games

Indexed keywords

ADAPTIVE BEHAVIOUR; DOMAIN KNOWLEDGE; RAPID ADAPTATION; VIDEO GAME;

EID: 70549105906     PISSN: 18759521     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.entcom.2009.09.001     Document Type: Article

References (70)

1. Tozour P. The perils of AI scripting. In: Rabin S. (Ed). AI Game Programming Wisdom (2002), Charles River Media, Inc., Hingham, MA., USA 541-547 ISBN 1-584-500-778
2. Millington I. Artificial Intelligence for Games, Chap. Decision Making (2006), Morgan Kaufmann Publishers Inc., San Francisco, California pp. 301-471, ISBN 0-124-977820
3. Bakkes S.C.J., Spronck P.H.M., and Van den Herik H.J. Rapid and reliable adaptation of video game AI. IEEE Transactions on Computational Intelligence and AI in Games 1 2 (2009) 93-104
4. S.C.J. Bakkes, P.H.M. Spronck, H.J. Van den Herik, Rapid adaptation of video game AI, in: P. Hingston, L. Barone (Eds.), Proceedings of the IEEE 2008 Symposium on Computational Intelligence and Games (CIG'08), iEEE XPlore, Catalog Number: CFP08CIG-CDR, 2008, pp. 79-86.
5. D. Carmel, S. Markovitch, Learning models of opponent's strategy in game playing, in: Proceedings of AAAI Fall Symposium on Games: Planning and Learning, Raleigh, NC, 1993, pp. 140-147.
6. Iida H., Uiterwijk J.W.H.M., Van den Herik H.J., and Herschberg I.S. Potential applications of opponent-model search. Part 1: the domain of applicability. ICCA Journal 16 4 (1993) 201-208
7. Donkers H.H.L.M., Uiterwijk J.W.H.M., and Van den Herik H.J. Probabilistic opponent-model search. Information Sciences 135 3-4 (2001) 123-149
8. H.H.L.M. Donkers, Nosce Hostem - Searching with Opponent Models, Ph.D. thesis, SIKS Dissertation Series No. 2003-13, IKAT, Maastricht University, Maastricht, The Netherlands, 2003.
9. J.Fürnkranz. Recent advances in machine learning and game playing. ÖGAI Journal 26 2 (2007) 19-28
10. Samuel A. Some studies in machine learning using the game of checkers, II - recent progress. IBM Journal 11 6 (1967) 601-617
11. Knuth D., and Moore R. An analysis of alpha-beta pruning. Artificial Intelligence 6 4 (1975) 293-326
12. H. Berliner, Search and knowledge, in: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI 77), 1977, pp. 975-979.
13. R. Korf, Generalized game trees, in: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI 89), Detroit, MI, 1989, pp. 328-333.
14. Abramson B. Expected outcome: a general model of static evaluation. IEEE Transactions on Pattern Analysis and Machine Intelligence 12 2 (1990) 182-193
15. Schaeffer J., Culberson J., Treloar N., Knight B., Lu P., and Szafron D. A world championship caliber Checkers program. Artificial Intelligence 53 2-3 (1992) 273-290
16. H.J. Van den Herik, H.H.L.M. Donkers, P.H.M. Spronck, Opponent modelling and commercial games, in: G. Kendall, S. Lucas (Eds.), Proceedings of the IEEE 2005 Symposium on Computational Intelligence and Games (CIG'05), 2005, pp. 15-25.
17. Rabin S. Preface. In: Rabin S. (Ed). AI Game Programming Wisdom (2008), Charles River Media, Inc., Hingham, MA., USA ix-xi ISBN ISBN 1-584-505-230
18. Billings D., Peña L., Schaeffer J., and Szafron D. The challenge of Poker. Artificial Intelligence 134 1-2 (2002) 201-240 Special Issue on Games, Computers and Artificial Intelligence
19. Slagle J.R., and Dixon J.K. Experiments with the M&N tree-searching program. Communications of the ACM 13 3 (1970) 147-154
20. Reibman A.L., and Ballard B.W. Nonminimax search strategies for use against fallible opponents. In: Tenenbaum J.M. (Ed). Proceedings of the 3rd National Conference on Artificial Intelligence (AAAI-83) (1983), Morgan Kaufmann Publ., San Mateo, CA., USA 338-342 ISBN 0-262-510-529
21. P.J. Jansen, Using knowledge about the opponent in game-tree search, Ph.D. thesis, Carnegie Mellon University, Pittsburgh, PA, USA, 1992.
22. Jansen P.J. KQKR: speculative thwarting a human opponent. ICCA Journal 16 1 (1993) 3-18
23. Uiterwijk J.W.H.M., and Van den Herik H.J. Speculative play in computer chess. In: Van den Herik H.J., Herschberg I.S., and Uiterwijk J.W.H.M. (Eds). Advances in Computer Chess 7 (1994), Maastricht University, Maastricht, The Netherlands 79-90 ISBN 9-062-161-014
24. Egnor D. Iocaine power. ICGA Journal 23 1 (2000) 33-35
25. G. Kendall, Iterated prisoner's dilemma competition, 2005 [online]. Available from: http://www.prisoners-dilemma.com/.
26. D. Billings, Algorithms and Assessment in Computer Poker, Ph.D. thesis, Department of Computing Science, University of Alberta, Edmonton, Alberta, Canada, 2006.
27. Scott B. The illusion of intelligence. In: Rabin S. (Ed). AI Game Programming Wisdom (2002), Charles River Media, Inc., Hingham, MA., USA 16-20 ISBN 1-584-500-778
28. Livingstone D., and Charles D. Intelligent interfaces for digital games. In: Fu D., Henke S., and Orkin J. (Eds). Proceedings of the AAAI-04 Workshop on Challenges in Game Artificial Intelligence (2004), AAAI Press, Menlo Park, CA., USA 6-10
29. G. Van Lankveld, P.H.M. Spronck, H.J. Van den Herik, Incongruity-based adaptive game balancing, in: Proceedings of the 12th Advances in Computer Games Conference (ACG12), 2009.
30. R. Houlette, Player modeling for adaptive games, in: AI Game Programming Wisdom 2, Charles River Media, Inc., Hingham, MA., USA, 2004. pp. 557-566 (ISBN 1-584-502-894).
31. Charles D., and Black M. Dynamic player modeling: a framework for player-centered digital games. In: Mehdi Q.H., Gough N.E., and Al-Dabass D. (Eds). Proceedings of Computer Games: Artificial Intelligence, Design and Education (CGAIDE 2004) (2004), University of Wolverhampton, Wolverhampton, UK 29-35
32. D. Charles, M. McNeill, M. McAlister, M. Black, A. Moore, K. Stringer, J. Kucklich, A. Kerr, Player-centered design: player modeling and adaptive digital games, in: Proceedings of the DiGRA Conference: Changing ViewsWorld in Play, 2005, pp. 285-298.
33. C.J. Bohil, F.A. Biocca, Cognitive Modeling of Video Game Players, Tech. Rep., Media, Interface, and Network Design Labs (MINDLab), Dept. of Telecommunication, Information and Media, Michigan State University, East Lansing, Michigan, USA, 2007.
34. Millington I. Artificial Intelligence for Games (2006), Morgan Kaufmann Publishers Inc., San Francisco, California ISBN 0-124-977820
35. Donkers H.H.L.M., and Spronck P.H.M. Preference-based player modeling. In: Rabin S. (Ed). AI Game Programming Wisdom (2006), Charles River Media, Inc., Hingham, MA., USA 647-659 ISBN 1-584-504-579
36. Laramée F.D. Using n-gram statistical models to predict player behavior. In: Rabin S. (Ed). AI Game Programming Wisdom (2002), Charles River Media, Inc., Hingham, MA., USA 596-601 ISBN 1-584-500-778
37. J. Denzinger, J. Hamdan, Improving modeling of other agents using tentative stereotypes and compactification of observations, in: Proceedings of the 2004 IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT 2004), 2004, pp. 106-112.
38. M. Rohs, Preference-based Player Modelling for Civilization IV, Bachelor's Thesis, Department of Knowledge Engineering, Maastricht University, Maastricht, The Netherlands, 2007.
39. Yannakakis G.N. How to model and augment player satisfaction: a review. Proceedings of the 1st Workshop on Child, Computer and Interaction (ICMI'08) (2008), ACM Press, Montreal, Canada
40. Sailer F., Lanctot M., and Buro M. Simulation-based planning in RTS games. In: Rabin S. (Ed). AI Game Programming Wisdom 4 (2008), Charles River Media, Inc., Hingham, MA., USA 405-418 ISBN 1-584-505-230
41. M.J.M. Van der Heijden, S.C.J. Bakkes, P.H.M. Spronck, Dynamic formations in real-time strategy games, in: P. Hingston, L. Barone (Eds.), Proceedings of the IEEE 2008 Symposium on Computational Intelligence and Games (CIG'08), iEEE XPlore, Catalog Number: CFP08CIG-CDR, 2008, pp. 47-54.
42. M. Bergsma, Opponent Modelling in Machiavelli, Bachelor's Thesis, Department of Knowledge Engineering, Maastricht University, Maastricht, The Netherlands, 2005.
43. F. Aiolli, C.E. Palazzi, New Frontiers for Entertainment Computing, vol. 279 of IFIP International Federation for Information Processing, Chap. Enhancing Artificial Intelligence in Games by Learning the Opponent's Playing Style, Springer-Verlag, Heidelberg, Germany, 2008, pp. 1-10.
44. Aiolli F., and Palazzi C.E. Enhancing artificial intelligence on a real mobile game. International Journal of Computer Games Technology (2009) article ID 45616
45. A.J. Lockett, C.L. Chen, R. Miikkulainen, Evolving explicit opponent models in game playing, in: Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation (GECCO-2007), 2007, pp. 2106-2113, .
46. Schadd F.C., Bakkes S.C.J., and Spronck P.H.M. Opponent modeling in real-time strategy games. In: Roccetti M. (Ed). Proceedings of the 8th International Conference on Intelligent Games and Simulation (GAMEON'2007), EUROSIS-ETI (2007), Ghent University, Ghent, Belgium 61-68
47. Davison B.D., and Hirsh H. Predicting sequences of user actions. Predicting the Future: AI Approaches to Time-Series Problems (1998), AAAI Press, Menlo Park, CA., USA 5-12
48. Darken C.J., and Anderegg B.G. Particle filters and simulacra for more realistic opponent tracking. In: Rabin S. (Ed). AI Game Programming Wisdom 4 (2008), Charles River Media, Inc., Hingham, MA., USA 419-428 ISBN 1-584-505-230
49. S. Hladky, V. Bulitko, An evaluation of models for predicting opponent locations in first-person shooter video games, in: P. Hingston, L. Barone (Eds.), Proceedings of the IEEE 2008 Symposium on Computational Intelligence and Games (CIG'08), iEEE XPlore, Catalog Number: CFP08CIG-CDR, 2008, pp. 39-46.
50. A.J.J. Valkenberg, Opponent Modelling in World of Warcraft, Bachelor's Thesis, Department of Knowledge Engineering, Maastricht University, Maastricht, The Netherlands, 2007.
51. Wong C., Kim J., Han E., and Jung K. Human-centered modeling for style-based adaptive games. Journal of Zhejiang University - Science A 10 4 (2009) 530-534
52. Thue D.J., Bulitko V., and Spetch M. Player modeling for interactive storytelling: a practical approach. In: Rabin S. (Ed). AI Game Programming Wisdom 4 (2008), Charles River Media, Inc., Hingham, MA., USA 633-646 ISBN 1-584-505-230
53. Demasi P., de A.J., and Cruz O. Online coevolution for action games. International Journal of Intelligent Games and Simulation 2 3 (2002) 80-88
54. Graepel T., Herbrich R., and Gold J. Learning to fight. In: Mehdi Q.H., Gough N.E., and Al-Dabass D. (Eds). Proceedings of Computer Games: Artificial Intelligence, Design and Education (CGAIDE 2004) (2004), University of Wolverhampton, Wolverhampton, UK 193-200
55. Johnson S. Adaptive AI: a practical example. In: Rabin S. (Ed). AI Game Programming Wisdom 2 (2004), Charles River Media, Inc., Hingham, MA., USA 639-647 ISBN 1-584-502-894
56. Spronck P.H.M., Ponsen M.J.V., Sprinkhuizen-Kuyper I.G., and Postma E.O. Adaptive game AI with dynamic scripting. Machine Learning 63 3 (2006) 217-248
57. M. Sharma, M. Holmes, J. Santamaria, A. Irani, C. Isbell, A. Ram, Transfer learning in real-time strategy games using hybrid CBR/RL, in: Proceedings of the Twentieth International Joint Conference on Artificial Intelligence (IJCAI-2007, 2007, pp. 1041-1046.
58. Aha D.W., Molineaux M., and Ponsen M.J.V. Learning to win case-based plan selection in a real-time strategy game. Proceedings of 6th International Conference on Case-Based Reasoning (ICCBR-05) (2005), DePaul University, Chicago, Illinois, USA 5-20
59. Ponsen M.J.V., and Spronck P.H.M. Improving adaptive game AI with evolutionary learning. In: Mehdi Q.H., Gough N.E., and Al-Dabass D. (Eds). Proceedings of Computer Games: Artificial Intelligence, Design and Education (CGAIDE 2004) (2004), University of Wolverhampton, Wolverhampton, UK 389-396
60. Ontañón S., Mishra K., Sugandh N., and Ram A. Case-based planning and execution for real-time strategy games. Proceedings of the 7th International Conference on Case-Based Reasoning (ICCBR '07) (2007), Springer-Verlag, Heidelberg, Germany 164-178 10.1007/978-3-540-74141-1_12 ISBN 978-3-540-74138-1
61. Auslander B., Lee-Urban S., Hogg C., and Muñoz-Avila H. Recognizing the enemy: combining reinforcement learning with strategy selection using case-based reasoning. Proceedings of the 9th European Conference on Case-Based Reasoning (ECCBR 2008) (2008), University of Trier, Trier, Germany 59-73
62. S. Johansson, The Spring Project, 2009 [online]. Available from: http://spring.clan-sy.com/.
63. Bakkes S.C.J., and Spronck P.H.M. Automatically generating a score function for strategy games. In: Rabin S. (Ed). AI Game Programming Wisdom 4 (2008), Charles River Media, Inc., Hingham, MA., USA 647-658 ISBN 1-584-505-230
64. R.S. Sutton, Learning to predict by the methods of temporal differences, in: Machine Learning, Kluwer Academic Publishers, Boston, Manufactured in The Netherlands, 1988, 9-44 [online]. Available from: http://www.cs.ualberta.ca/~sutton/papers/sutton-88.pdf.
65. Hartigan J.A., and Wong M.A. A K-means clustering algorithm. Applied Statistics 28 1 (1979) 100-108
66. A. Seizinger, AI:AAI, creator of the game AI 'AAI', 2006 [online]. Available: from: http://spring.clan-sy.com/wiki/AI:AAI.
67. S. Abou-Samra, C. Comair, R. Champagne, S.T. Fam, P. Ghali, S. Lee, J. Pan, X. Li, Data compression/decompression based on pattern and symbol run length encoding for use in a portable handheld video game system, USA Patent #6,416,410, 2002.
68. Angiulli F., and Folino G. Distributed nearest neighbor-based condensation of very large data sets. IEEE Transactions on Knowledge and Data Engineering 19 12 (2007) 1593-1606
69. Evans R. Varieties of learning. In: Rabin S. (Ed). AI Game Programming Wisdom (2002), Charles River Media, Inc., Hingham, MA., USA 571-575 ISBN 1-584-500-778
70. Pearson K. On lines and planes of closest fit to systems of points in space. Philosophical Magazine 2 6 (1901) 559-572