Experience-driven procedural content generation

IEEE Transactions on Affective Computing

Volumn 2, Issue 3, 2011, Pages 147-161

  Yannakakis, Georgios N ^a   Togelius, Julian ^a  

^a IT UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

adaptation; computer games.; personalization; Procedural content generation; user affect; user experience

Indexed keywords

ADAPTATION; COMPUTER GAMES.; PERSONALIZATIONS; PROCEDURAL CONTENT GENERATION; USER AFFECT; USER EXPERIENCE;

EID: 84857914027     PISSN: 19493045     EISSN: None     Source Type: Journal    
DOI: 10.1109/T-AFFC.2011.6     Document Type: Article

References (107)

1. J. Juul, A Casual Revolution: Reinventing Video Games and Their Players. MIT Press, 2009.
2. T. Taylor, Play Between Worlds: Exploring Online Game Culture. MIT Press, Mar. 2006.
3. C. Bateman and R. Boon, 21st Century Game Design. Charles River Media, 2005.
4. E. Hudlicka, "Affective Game Engines: Motivation and Requirements," Proc. Fourth Int'l Conf. Foundations of Digital Games, pp. 299-306, 2009.
5. R.W. Picard, Affective Computing. MIT Press, 1997.
6. I. Leite, A. Pereira, S. Mascarenhas, G. Castellano, C. Martinho, R. Prada, and A. Paiva, "Closing the Loop: From Affect Recognition to Empathic Interaction," Proc. Third Int'l Workshop Affect Interaction in Natural Environments, ACM Multimedia '10. 2010.
7. P. Sundström, A. Stahl, and K. Höök, "In Situ Informants Exploring an Emotional Mobile Messaging System in Their Everyday Practice," Int'l J. Human-Computer Studies, vol. 65, pp. 388-403, Apr. 2007. (Pubitemid 46216844)
8. P. Sundström, "Exploring the Affective Loop," technical report, Stockholm Univ., 2005.
9. R.W. Picard, E. Vyzas, and J. Healey, "Toward Machine Emotional Intelligence: Analysis of Affective Physiological State," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 10, pp. 1175-1191, Oct. 2001. (Pubitemid 33047955)
10. K.L. Walton, Mimesis as Make-Believe. Harvard Univ. Press, 1990.
11. C. Bateman and L.E. Nacke, "The Neurobiology of Play," Proc. Future Play '10, pp. 1-8, 2010.
12. R.A. Calvo and S.D. Mello, "Affect Detection: An Interdisciplinary Reveiw of Models, Methods and Their Applications," IEEE Trans. Affective Computing, vol. 1, no. 1, pp. 18-37, Jan.-June 2010.
13. P. Rani, C. Liu, N. Sarkar, and E. Vanman, "An Empirical Study of Machine Learning Techniques for Affect Recognition in Humanrobot Interaction," Pattern Analysis and Applications, vol. 9, no. 1, pp. 58-69, 2006. (Pubitemid 43823166)
14. P. Rani, N. Sarkar, and C. Liu, "Maintaining Optimal Challenge in Computer Games through Real-Time Physiological Feedback," Proc. 11th Int'l Conf. Human Computer Interaction, 2005.
15. G. Chanel, C. Rebetez, M. Betrancourt, and T. Pun, "Boredom, Engagement and Anxiety as Indicators for Adaptation to Difficulty in Games," Proc. 12th Int'l Conf. Entertainment and Media in the Ubiquitous Era, pp. 13-17, 2008.
16. J. Kim and E. Andre, "Emotion Recognition Using Physiological and Speech Signal in Short-Term Observation," Proc. Int'l Tutorial and Research Workshop Perception and Interactive Technologies, pp. 53-64, 2006. (Pubitemid 44072270)
17. R. Mandryk and K. Inkpen, "Physiological Indicators for the Evaluation of Co-Located Collaborative Play," Proc. ACM Conf. Computer Supported Cooperative Work, pp. 102-111, 2004. (Pubitemid 40928507)
18. S. Tognetti, M. Garbarino, A. Bonarini, and M. Matteucci, "Modeling Enjoyment Preference from Physiological Responses in a Car Racing Game," Proc. IEEE Conf. Computational Intelligence and Games, pp. 321-328, Aug. 2010.
19. G.N. Yannakakis, J. Hallam, and H.H. Lund, "Entertainment Capture through Heart Rate Activity in Physical Interactive Playgrounds," User Modeling and User-Adapted Interaction, special issue: Affective mModeling and adaptation, vol. 18, nos. 1/2, pp. 207-243, Feb. 2008. (Pubitemid 351185637)
20. G.N. Yannakakis, H.P. Martínez, and A. Jhala, "Towards Affective Camera Control in Games," User Modeling and User-Adapted Interaction, vol. 20, no. 4, pp. 313-340, 2010.
21. A. Drachen, L. Nacke, G.N. Yannakakis, and A.L. Pedersen, "Correlation between Heart Rate, Electrodermal Activity and Player Experience in First-Person Shooter Games," Proc. ACM SIGGRAPH '10, 2010.
22. S. McQuiggan, S. Lee, and J. Lester, "Predicting User Physiological Response for Interactive Environments: An Inductive Approach," Proc. Second Artificial Intelligence for Interactive Digital Entertainment Conf., pp. 60-65, 2006.
23. R. Aylett, J. Dias, and A. Paiva, "An Affectively Driven Planner for Synthetic Characters," Proc. Int'l Conf. Automated Planning and Scheduling, 2006.
24. P.F. Camara, Creativity and Artificial Intelligence: A Conceptual Blending Approach; Applications of Cognitive Linguistics. Mouton de Gruyter, 2006.
25. K. Stanley, B. Bryant, and R. Miikkulainen, "Real-Time Evolution in the NERO Video Game," Proc. IEEE Symp. Computational Intelligence and Games, pp. 182-189, Apr. 2005.
26. D. Djordjevich, P. Xavier, M. Bernard, J. Whetzel, M. Glickman, and S. Verzi, "Preparing for the Aftermath: Using Emotional Agents in Game-Based Training for Disaster Response," Proc. IEEE Symp. Computational Intelligence and Games, pp. 266-275, Apr. 2008.
27. J. Togelius, G.N. Yannakakis, K.O. Stanley, and C. Browne, "Search-Based Procedural Content Generation," Proc. European Conf. Applications of Evolutionary Computation, 2010.
28. C. Pedersen, J. Togelius, and G.N. Yannakakis, "Modeling Player Experience for Content Creation," IEEE Trans. Computational Intelligence and AI in Games, vol. 2, no. 1, pp. 54-67, Sept. 2010.
29. N. Shaker, G.N. Yannakakis, and J. Togelius, "Towards Automatic Personalized Content Generation for Platform Games," Proc. Artificial Intelligence and Interactive Digital Entertainment, pp. 63-68, Oct. 2010.
30. J. Gratch and S. Marsella, "Evaluating a Computational Model of Emotion," Autonomous Agents and Multi-Agent Systems, vol. 11, no. 1, pp. 23-43, 2005. (Pubitemid 40878560)
31. C. Conati, "Probabilistic Assessment of User's Emotions in Educational Games," J. Applied Artificial Intelligence, special issue on merging vognition and affect in HCI, vol. 16, pp. 555-575, 2002. (Pubitemid 35019458)
32. R.L. Mandryk, K.M. Inkpen, and T.W. Calvert, "Using Psychophysiological Techniques to Measure User Experience with Entertainment Technologies," Behaviour and Information Technology, special issue on user experience, vol. 25, no. 2, pp. 141-158, 2006. (Pubitemid 43065344)
33. R.J. Pagulayan, K. Keeker, D. Wixon, R.L. Romero, and T. Fuller, User-Centered Design in Games: The HCI Handbook. Lawrence Erlbaum Assoc., 2003.
34. G.N. Yannakakis and J. Hallam, "Towards Optimizing Entertainment in Computer Games," Applied Artificial Intelligence, vol. 21, pp. 933-971, 2007. (Pubitemid 350125657)
35. G.N. Yannakakis, "Preference Learning for Affective Modeling," Proc. Int'l Conf. Affective Computing and Intelligent Interaction, pp. 126-131, Sept. 2009.
36. G.N. Yannakakis and J. Hallam, "Towards Capturing and Enhancing Entertainment in Computer Games," Proc. Fourth Hellenic Conf. Artificial Intelligence, pp. 432-442, May 2006. (Pubitemid 44030003)
37. G.N. Yannakakis and J. Hallam, "Real-Time Game Adaptation for Optimizing Player Satisfaction," IEEE Trans. Computational Intelligence and AI in Games, vol. 1, no. 2, pp. 121-133, June 2009.
38. C. Pedersen, J. Togelius, and G.N. Yannakakis, "Modeling Player Experience in Super Mario Bros," Proc. IEEE Symp. Computational Intelligence and Games. pp. 132-139, Sept. 2009.
39. A. Nijholt, "BCI for Games: A State of the Art Survey," Proc. Entertainment Computing, pp. 225-228, 2009.
40. T. Partala and V. Surakka, "Pupil Size Variation as an Indication of Affective Processing," Int'l J. Human-Computer Studies, vol. 59, nos. 1/2, pp. 185-198, 2003.
41. A. Barreto, J. Zhai, and M. Adjouadi, "Non-Intrusive Physiological Monitoring for Automated Stress Detection in Human-Computer Interaction," Proc. Human Computer Interaction, pp. 29-39, 2007.
42. S. Asteriadis, K. Karpouzis, and S.D. Kollias, "A Neuro-Fuzzy Approach to User Attention Recognition," Proc. Int'l Conf. Artificial Neural Networks, pp. 927-936, 2008.
43. M. Pantic and G. Caridakis, "Image and Video Processing for Affective Applications" Emotion-Oriented Systems: The Humaine Handbook, pp. 101-117, Springer-Verlag, 2011.
44. L. Kessous, G. Castellano, and G. Caridakis, "Multimodal Emotion Recognition in Speech-Based Interaction Using Facial Expression, Body Gesture and Acoustic Analysis," J. Multimodal User Interfaces, vol. 3, pp. 33-48, 2010.
45. T. Kannetis, A. Potamianos, and G.N. Yannakakis, "Fantasy, Curiosity and Challenge as Adaptation Indicators in Multimodal Dialogue Systems for Preschoolers," Proc. Workshop Child, Computer and Interaction, ICMI '09, Nov. 2009.
46. Z. Zeng, M. Pantic, G. Roisman, and T. Huang, "A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 1, pp. 39-58, Jan. 2009.
47. N. Frijda, The Emotions. Cambridge Univ. Press, 1986.
48. L. Feldman, "Valence Focus and Arousal Focus: Individual Differences in the Structure of Affective Experience," J. Personality and Social Psychology, vol. 69, pp. 53-166, 1995.
49. J.A. Russell, "Core Affect and the Psychological Construction of Emotion," Psychological Rev., vol. 110, pp. 145-172, 2003. (Pubitemid 37170695)
50. S. Asteriadis, D. Soufleros, and K. Karpouzis, "A Natural Head Pose and Eye Gaze Dataset," Proc. Int'l Conf. Multimodal Interfaces, 2009.
51. R.L. Mandryk and M.S. Atkins, "A Fuzzy Physiological Approach for Continuously Modeling Emotion during Interaction with Play Environments," Int'l J. Human-Computer Studies, vol. 65, pp. 329-347, 2007. (Pubitemid 46216840)
52. H.P. Martinez, A. Jhala, and G.N. Yannakakis, "Analyzing the Impact of Camera Viewpoint on Player Psychophysiology," Proc. Int'l Conf. Affective Computing and Intelligent Interaction. pp. 394-399, Sept. 2009.
53. K. Isbister and N. Schaffer, Game Usability: Advancing the Player Experience. Morgan Kaufman, 2008.
54. A. Ortony, G.L. Clore, and A. Collins, The Cognitive Structure of Emotions. Cambridge Univ. Press, 1988.
55. B.F. Skinner, The Behavior of Organisms: An Experimental Analysis. B.F. Skinner Foundation, 1938.
56. K.R. Scherer, "Studying the Emotion-Antecedent Appraisal Process: An Expert System Approach," Cognition and Emotion, vol. 7, pp. 325-355, 1993.
57. T.W. Malone, "What Makes Things Fun to Learn? Heuristics for Designing Instructional Computer Games," Proc. Third ACM SIGSMALL Symp. and the First SIGPC Symp. Small Systems, pp. 162-169, 1980.
58. R. Koster, A Theory of Fun for Game Design. Paraglyph Press, 2005.
59. M. Csikszentmihalyi, Flow: The Psychology of Optimal Experience. Harper Collins, 1990.
60. E. Hastings, R. Guha, and K.O. Stanley, "Evolving Content in the Galactic Arms Race Video Game," Proc. IEEE Symp. Computational Intelligence and Games, pp. 241-248, 2009.
61. H. Iida, N. Takeshita, and J. Yoshimura, "A Metric for Entertainment of Boardgames: Its Implication for Evolution of Chess Variants," Proc. Int'l Wireless Comm. Expo, pp. 65-72, 2003.
62. J.K. Olesen, G.N. Yannakakis, and J. Hallam, "Real-Time Challenge Balance in an RTS Game Using rtNEAT," Proc. IEEE Symp. Computational Intelligence and Games, pp. 87-94, Dec. 2008.
63. G. van Lankveld, P. Spronck, and M. Rauterberg, "Difficulty Scaling through Incongruity," Proc. Fourth Int'l Artificial Intelligence and Interactive Digital Entertainment Conf., pp. 228-229, 2008.
64. P. Spronck, I. Sprinkhuizen-Kuyper, and E. Postma, "Difficulty Scaling of Game AI," Proc. Fifth Int'l Conf. Intelligent Games and Simulation, pp. 33-37, 2004.
65. G. Andrade, G. Ramalho, H. Santana, and V. Corruble, "Extending Reinforcement Learning to Provide Dynamic Game Balancing," Proc. Workshop Reasoning, Representation, and Learning in Computer Games, 19th Int'l Joint Conf. Artificial Intelligence, pp. 7-12, Aug. 2005.
66. N. Sorenson and P. Pasquier, "Towards a Generic Framework for Automated Video Game Level Creation," Proc. European Conf. Applications of Evolutionary Computation, pp. 130-139, 2010.
67. R. Houlette, "Player Modeling for Adaptive Games," AI Game Programming Wisdom II, pp. 557-566. Charles River Media Inc, 2004.
68. D. Charles and M. Black, "Dynamic Player Modelling: A Framework for Player-Centric Digital Games," Proc. Int'l Conf. Computer Games: Artificial Intelligence, Design, and Education, pp. 29-35, 2004.
69. G.N. Yannakakis and M. Maragoudakis, "Player Modeling Impact on Player's Entertainment in Computer Games," Proc. 10th Int'l Conf. User Modeling, pp. 74-78, July 2005.
70. C. Thurau, C. Bauckhage, and G. Sagerer, "Learning Human-Like Movement Behavior for Computer Games," From Animals to Animats 8: Proc. 8th Int'l Conf. Simulation of Adaptive Behavior, pp. 315-323, July 2004.
71. D. Thue, V. Bulitko, M. Spetch, and E. Wasylishen, "Interactive Storytelling: A Player Modelling Approach," Proc. Third Conf. Artificial Intelligence and Interactive Digital Entertainment, pp. 43-48, 2007.
72. R. Thawonmas, M. Kurashige, K. Iizuka, and M. Kantardzic, "Clustering of Online Game Users Based on Their Trails Using Self-Organizing Map," Proc. Entertainment Computing, pp. 366-369, 2006. (Pubitemid 44577430)
73. A. Drachen, A. Canossa, and G.N. Yannakakis, "Player Modeling Using Self-Organization in Tomb Raider: Underworld," Proc. IEEE Symp. Computational Intelligence and Games, pp. 1-8, Sept. 2009.
74. O. Missura and T. Gärtner, "Player Modeling for Intelligent Difficulty Adjustment," Proc. ECML-09 Workshop from Local Patterns to Global Models, Sept. 2009.
75. B. Weber and M. Mateas, "A Data Mining Approach to Strategy Prediction," Proc. IEEE Symp. Computational Intelligence in Games, pp. 140-147, Sept. 2009.
76. S.H. Fairclough, "Fundamentals of Physiological Computing," Interacting with Computers, vol. 21, nos. 1/2, pp. 133-145, 2009.
77. N. Ravaja, T. Saari, M. Turpeinen, J. Laarni, M. Salminen, and M. Kivikangas, "Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play?" Presence Teleoperators and Virtual Environments, vol. 15, no. 4, pp. 381-392, 2006. (Pubitemid 44387182)
78. M. Schwartz, H.P. Martinez, G.N. Yannakakis, and A. Jhala, "Investigating the Interplay between Camera Viewpoints, Game Information, and Challenge," Proc. Artificial Intelligence and Interactive Digital Entertainment, Oct. 2009.
79. A. Drachen and A. Canossa, "Towards Gameplay Analysis via Gameplay Metrics," Proc. 13th MindTrek, Sept. 2009.
80. J. Fürnkranz and E. Hüllermeier, "Preference Learning," Künstliche Intelligenz, vol. 19, no. 1, pp. 60-61, 2005.
81. J. Doyle, "Prospects for Preferences," Computational Intelligence, vol. 20, no. 2, pp. 111-136, May 2004.
82. G.N. Yannakakis, M. Maragoudakis, and J. Hallam, "Preference Learning for Cognitive Modeling: A Case Study on Entertainment Preferences," IEEE Systems, Man, and Cybernetics; Part A: Systems and Humans, vol. 39, no. 6, pp. 1165-1175, Nov. 2009.
83. J. Togelius, M. Preuss, and G.N. Yannakakis, "Towards Multiobjective Procedural Map Generation," Proc. Workshop Procedural Content Generation, Foundations of Digital Games, June 2010.
84. D. Dimovska, P. Jarnfelt, S. Selvig, and G.N. Yannakakis, "Towards Procedural Level Generation for Rehabilitation," Proc. Workshop Procedural Content Generation, Foundations of Digital Games, June 2010.
85. G.N. Yannakakis, J. Togelius, R. Khaled, A. Jhala, K. Karpouzis, A. Paiva, and A. Vasalou, "Siren: Towards Adaptive Serious Games for Teaching Conflict Resolution," Proc. Fourth European Conf. Games Based Learning, 2010.
86. Y. Cheong and M. Young, "A Computational Model of Narrative Generation for Suspense," Proc. AAAI '06 Computational Aesthetic Workshop, 2006.
87. H.P. Martínez and G.N. Yannakakis, "Genetic Search Feature Selection for Affective Modeling: A Case Study on Reported Preferences," Proc. Third Int'l Workshop Affective Interaction in Natural Environments, pp. 15-20, 2010.
88. J. Togelius, R. De Nardi, and S.M. Lucas, "Towards Automatic Personalised Content Creation in Racing Games," Proc. IEEE Symp. Computational Intelligence and Games, 2007.
89. J. Marks and V. Hom, "Automatic Design of Balanced Board Games," Proc. Artificial Intelligence and Interactive Digital Entertainment Int'l Conf., pp. 25-30, 2007.
90. C. Browne, "Automatic Generation and Evaluation of Recombination Games," PhD dissertation, Queensland Univ. of Technology, 2008.
91. J. Togelius and J. Schmidhuber, "An Experiment in Automatic Game Design," Proc. IEEE Symp. Computational Intelligence and Games, pp. 252-259, Dec. 2008.
92. A. Martin, A. Lim, S. Colton, and C. Browne, "Evolving 3D Buildings for the Prototype Video Game Subversion," Proc. EvoApplications, 2010.
93. H. Takagi, "Interactive Evolutionary Computation: Fusion of the Capacities of EC Optimization and Human Evaluation," Proc. IEEE, vol. 89, no. 9, pp. 1275-1296, 2001. (Pubitemid 33766623)
94. M.O. Riedl and N. Sugandh, "Story Planning with Vignettes: Toward Overcoming the Content Production Bottleneck," Proc. First Joint Int'l Conf. Interactive Digital Storytelling, pp. 168-179, 2008.
95. M.J. Nelson, C. Ashmore, and M. Mateas, "Authoring an Interactive Narrative with Declarative Optimization-Based Drama Management," Proc. Artificial Intelligence and Interactive Digital Entertainment Int'l Conf., 2006.
96. P.J. Bentley and S. Kumar, "The Ways to Grow Designs: A Comparison of Embryogenies for an Evolutionary Design Problem," Proc. Genetic and Evolutionary Computation Conf., pp. 35-43, 1999.
97. G.S. Hornby and J.B. Pollack, "The Advantages of Generative Grammatical Encodings for Physical Design," Proc. IEEE Congress on Evolutionary Computation, 2001.
98. K.O. Stanley, "Compositional Pattern Producing Networks: A Novel Abstraction of Development," Genetic Programming and Evolvable Machines, special issue on developmental systems, vol. 8, no. 2, pp. 131-162, 2007. (Pubitemid 46904474)
99. K.O. Stanley and R. Miikkulainen, "A Taxonomy for Artificial Embryogeny," Artificial Life, vol. 9, no. 2, pp. 93-130, 2003.
100. F. Rothlauf, Representations for Genetic and Evolutionary Algorithms. Springer, 2006.
101. J. Togelius, M. Preuss, N. Beume, S. Wessing, J. Hagelbäck, and G.N. Yannakakis, "Multiobjective Exploration of the Starcraft Map Space," Proc. IEEE Conf. Computational Intelligence and Games, pp. 265-272, Aug. 2010.
102. A. Lindenmayer, "Mathematical Models for Cellular Interaction in Development Parts I and II," J. Theoretical Biology, vol. 18, pp. 280-299 and 300-315, 1968.
103. P. Prusinkiewicz, "Graphical Applications of L-Systems," Proc. Graphics Interface/Vision Interface, pp. 247-253, 1986.
104. G.S.P. Miller, "The Definition and Rendering of Terrain Maps," Proc. ACM SIGGRAPH, vol. 20, 1986.
105. D. Ashlock, "Automatic Generation of Game Elements Via Evolution," Proc. IEEE Conf. Computational Intelligence and Games, 2010.
106. R.M. Smelik, T. Tutenel, K.J. de Kraker, and R. Bidarra, "Integrating Procedural Generation and Manual Editing of Virtual Worlds," Proc. ACM Foundations of Digital Games, June 2010.
107. A.M. Smith and M. Mateas, "Variations Forever: Flexibly Generating Rulesets from a Sculptable Design Space of Mini-Games," Proc. IEEE Conf. Computational Intelligence and Games, pp. 273-280, Aug. 2010.