Modeling motivation for adaptive nonplayer characters in dynamic computer game worlds

Computers in Entertainment

Volumn 5, Issue 4, 2008, Pages

  Merrick, Kathryn ^a,b  

^a UNIVERSITY OF SYDNEY   (Australia)

^b UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Computer games; Motivation; Neural nets; Nonplayer characters; Persistent virtual worlds; Reinforcement learning

Indexed keywords

COMPUTER SIMULATION; MULTI AGENT SYSTEMS; REINFORCEMENT LEARNING;

COMPUTER GAMES; NONPLAYER CHARACTERS; PERSISTENT VIRTUAL WORLDS;

GAME THEORY;

EID: 41149145158     PISSN: 15443574     EISSN: 15443981     Source Type: Journal    
DOI: 10.1145/1324198.1324203     Document Type: Article

References (30)

1. BAILLIE-DE BYL, P. 2004. Programming Believable Characters for Computer Games. Charles River Media.
2. DECI, E. AND RYAN, R. 1985. Intrinsic Motivation and Self-Determination in Human Behavior. Plenum Press, New York.
3. GRAEPEL, T., HERBRICH, R. AND GOLD, J. 2004. Learning to fight. In Proceedings of the International Conference on Computer Games: Artificial Intelligence, Design and Education.
4. HUANG, X. AND WENG, J. 2002. Novelty and reinforcement learning in the value system of developmental robots. In Proceedings of the Second International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems (Edinburgh, Scotland), CG. Prince et al. (eds), 47-55.
5. rd International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems (Lund University Cognitive Studies), C.G. Prince et al. (eds.), 73-80.
6. LAIRD, J. AND VAN LENT, M. 2000. Interactive computer games: Human-level AI's killer application. In Proceedings of the National Conference on Artificial Intelligence (AAAI), 1171-1178.
7. MAHER, M.-L. AND GERO, J.S. 2002. Agent models of 3D virtual worlds. ACADIA 2002: Thresholds. California State Polytechnic University, Pamona, 127-138.
8. MAHER, M.-L. AND MERRICK, K. 2005. Agent models for dynamic 3D virtual worlds. In Proceedings of the 2005 International Conference on Cyberworlds (Singapore), 27-34.
9. MARSLAND, S., NEHMZOW, U., AND SHAPIRO, J. 2000. A real-time novelty detector for a mobile robot. In EUREL European Advanced Robotics Systems Masterclass and Conference.
10. MERCERON, A. 2001. Languages and Logic. Pearson Education, Australia.
11. MERRICK, K. AND MAHER, M.-L. 2006. Motivated reinforcement learning for non-player characters in persistent computer game worlds. In Proceedings of the International Conference on Advances in Computer Entertainment Technology (electronic proceedings).
12. MERRICK, K. AND MAHER, M.-L. 2007. Motivated reinforcement learning for adaptive characters in open-ended virtual worlds. In Proceedings of the International Conference on Advances in Computer Entertainment Technology (Salzburg, Austria), 127-134.
13. MOOK, D.G. 1987. Motivation: The Organization of Action, W. W. Norton, New York.
14. NILSSON, N.J., 1996. Introduction to machine learning, http://ai.stanford.edu/people/nilsson/mlbook.html. Accessed Jan. 2006.
15. OUDEYER, P.-Y. AND KAPLAN, F. 2004. Intelligent adaptive curiosity: A source of self-development. In Proceedings of the Fourth International Workshop on Epigenetic Robotics (Lund University), 127-130.
16. OUDEYER, P.-Y., KAPLAN, F., AND HAFNER, V. 2007. Intrinsic motivation systems for autonomous mental development. IEEE Trans. Evolutionary Computation 11,1, 265-286.
17. REYNOLDS, C. 1987. Flocks, herds and schools: A distributed behavioral model. Computer Graphics 21, 4.
18. RUSSEL, S. J. AND NORVIG, P. 1995. Artificial Intelligence: A Modern Approach. Prentice Hall, Englewood Cliffs, NJ.
19. SAUNDERS, R. 2001. Curious design agents and artificial creativity. Ph.D. dissertation, University of Sydney, Sydney.
20. SAUNDERS, R. AND GERO, J.S. 2001. Designing for interest and novelty: Motivating design agents. In CAAD Futures 2001, Kluwer, Dordrecht, 725-738.
21. SCHMIDHUBER, J. 1991. Curious model building control systems. In Proceedings of the IEEE, International Joint Conference on Artificial Neural Networks (Singapore), 1458-1463.
22. SCHMIDHUBER, J. 1997. What's interesting. Tech Rep.TR-35-97, Lugano, Switzerland.
23. SIMSEK, O. AND BARTO, A.G. 2006. An intrinsic reward mechanism for efficient exploration. In Proceedings of the 23rd International Conference on Machine Learning (University of Pittsburgh, PA).
24. SINGH, S., BARTO, A.G., AND CHENTANEX, N. 2005. Intrinsically motivated reinforcement learning. Advances in Neural Information Processing Systems 17 (NIPS), 1281-1288.
25. STANLEY, J.C. 1976. Computer simulation of a model of habituation. Nature 261, 146-148.
26. SUTTON, R.S. AND BARTO, A.G. 2000. Reinforcement Learning: An Introduction. The MIT Press, Cambridge, MA.
27. TRAVIS, M.F., BEAR, H.G., HYATT, G., REBER, P., AND TAUBER, J. 2000. Towards more humanlike computer opponents. In Proceedings of the AAAI Spring Symposium on Artificial Intelligence and Interactive Entertainment (Palo Alto, CA), 22-26.
28. WATKINS, C. AND DAYAN, P. 1992. Q-learning. Machine Learning 8,3, 279-292.
29. WOOLDRIDGE, M. AND JENNINGS, N. 1995. Intelligent agents: Theory and practice. The Knowledge Engineering Review 10, 2, 115-152.
30. ZELTZER, 1992. Autonomy, interaction and presence. Presence: Teleoperators and Virtual Environments 1, 1, 127-132.