IMPLANT: An integrated mdp and pomdp learning agent for adaptive games

Proceedings of the 5th Artificial Intelligence and Interactive Digital Entertainment Conference, AIIDE 2009

Volumn , Issue , 2009, Pages 94-99

  Tan, Chek Tien ^a   Cheng, Ho Lun ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

ABSTRACT MODELING; ACTION POLICIES; AGENT IMPLEMENTATION; GAME ENVIRONMENT; LEARNING AGENTS; OPTIMAL POLICIES; PLAYER MODELING; PROOF OF CONCEPT;

ARCHITECTURE; ARTIFICIAL INTELLIGENCE; INTERACTIVE COMPUTER GRAPHICS; VIRTUAL REALITY;

HUMAN COMPUTER INTERACTION;

EID: 77958607662     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Burago, D.; Rougemont, M. D.; and Slissenko, A. 1996. On the complexity of partially observed markov decision processes. In Theoretical Computer Science 157:161-183.
2. Charles, D.; Kerr, A.; McNeill, M.; McAlister, M.; Black, M.; Kcklich, J.; Moore, A.; and Stringer, K. 2005. Playercentred game design: Player modeling and adaptive digital games. In Proceedings of the Digital Games Research Conference 285, 298.
3. Christian J., Darken, G. H. P. 2006. Findin Cover in Dynamic Environments, AI Game Programming Wisdom 3.Hingham, Massachusetts: Charles River Media, first edition.
4. Donkers, J., and Spronck, P. 2006. Preference-Based PlayerModeling, AI Game ProgrammingWisdom 3. Hingham, Massachusetts: Charles River Media, first edition.
5. Doshi, F., and Roy, N. 2008. The permutable POMDP: fast solutions to POMDPs for preference elicitation. In In AAMAS, 493-500.
6. Geramifard, A.; Chubak, P.; and Bulitko, V. 2006. Biased cost pathfinding. In AIIDE 112, 114.
7. Hussain, T. S., and Vidaver, G. 2006. Flexible and purposeful npc behaviors using real-time genetic control. In Proceedings of The IEEE Congress on Evolutionary Computation 785, 792.
8. Kaelbling, L. P.; Littman, M. L.; and Cassandra, A. R. 1998. Planning and acting in partially observable stochastic domains. In Artificial Intelligence 101:99-134.
9. Kurniawati, H.; Hsu, D.; and Lee, W. 2008. SARSOP: Efficient point-based POMDP planning by approximating optimally reachable belief spaces. In Proc. Robotics: Science and Systems.
10. Li, L.; Walsh, T. J.; and Littman, M. L. 2006. Towards a unified theory of state abstractions for MDPs. In In Proceedings of the Ninth International Symposium on Artificial Intelligence and Mathematics, 531-539.
11. Matsuzaki, C. 2004. Tennis Fundamentals. United States: Human Kinetics Publishers, first edition.
12. Pineau, J.; Gordon, G.; and Thrun, S. 2003. Point-based value iteration: An anytime algorithm for pomdps. In In IJCAI, 1025 - 1032.
13. Remco Straatman, A. B., and van der Sterren, W. 2006. Dynamic Tactical Postion Evaluation, AI Game Programming Wisdom 3. Hingham, Massachusetts: Charles River Media, first edition.
14. Shani, G.; Brafman, R. I.; and Shimony, S. E. 2007. Forward search value iteration for POMDPs. In In IJCAI.
15. Sutton, R. S., and Barto, A. G. 1998. Reinforcement Learning: An Introduction. Cambridge, Massachusetts: The MIT Press.
16. Tan, C. T., and Cheng, H. 2008a. A Combined Tactical and Strategic Hierarchical Learning Framework in Multi-agent Games. In Proceedings of the ACM SIGGRAPH Sandbox Symposium on Videogames.
17. Tan, C. T., and Cheng, H. 2008b. TAP: An Effective Personality Representation for Inter-Agent Adaptation in Games. In AIIDE.
18. Thue, D., and Bulitko, V. 2006. Modeling goal-directed players in digital games. In AIIDE 285, 298.
19. van der Sterren, W. 2006. Being a Better Buddy: Interpreting the Player's Behavior, AI Game Programming Wisdom 3. Hingham, Massachusetts: Charles River Media, first edition.
20. White, C., and Brogan, D. 2006. The self organization of context for multi agent games. In AIIDE.
21. Yannakakis, G. N., and Maragoudakis, M. 2005. Player modeling impact on players entertainment in computer games. In Springer-Verlag: Lecture Notes in Computer Science 3538:74.