Fusing visual and behavioral cues for modeling user experience in games

IEEE Transactions on Cybernetics

Volumn 43, Issue 6, 2013, Pages 1519-1531

  Shaker, Noor ^a   Asteriadis, Stylianos ^b   Yannakakis, Georgios N ^c   Karpouzis, Kostas ^d  

^a IT UNIVERSITY OF COPENHAGEN   (Denmark)

^b INFORMATION TECHNOLOGIES INSTITUTE   (Greece)

^c UNIVERSITY OF MALTA   (Malta)

^d NATIONAL TECHNICAL UNIVERSITY OF ATHENS   (Greece)

Author keywords

Content personalization; Experience driven procedural content generation; Multimodal interaction; Player experience modeling; Visual cues

Indexed keywords

CONTENT PERSONALIZATION; MULTI-MODAL INTERACTIONS; PLAYER EXPERIENCE MODELING; PROCEDURAL CONTENT GENERATIONS; VISUAL CUES;

USER INTERFACES;

ADULT; AFFECT; ARTICLE; ASSOCIATION; BIOLOGICAL MODEL; COMPETITIVE BEHAVIOR; COMPUTER SIMULATION; FEMALE; FRUSTRATION; GAME; HUMAN; LEARNING; MALE; MIDDLE AGED; PHYSIOLOGY; PSYCHOPHYSIOLOGY; RECREATION; VISION; YOUNG ADULT;

ADULT; AFFECT; BIOFEEDBACK, PSYCHOLOGY; COMPETITIVE BEHAVIOR; COMPUTER SIMULATION; CUES; FEMALE; FRUSTRATION; GAME THEORY; HUMANS; LEARNING; MALE; MIDDLE AGED; MODELS, BIOLOGICAL; VIDEO GAMES; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84890081139     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2013.2271738     Document Type: Article

References (54)

1. Reuters. (2007). Video-game sales overtaking music [Online]. Available: http://articles.moneycentral.msn.com/Investing/Extra/ VideoGameSalesOver%takingMusic.aspx
2. G. N. Yannakakis, "Game AI revisited," in Proc. ACM Comput. Frontiers Conf., May 2012, pp. 285-292.
3. G. N. Yannakakis and J. Togelius, "Experience-driven procedural content generation," IEEE Trans. Affective Comput., vol. 2, no. 3, pp. 147-161, Jul.-Sep. 2011.
4. S. Asteriadis, P. Tzouveli, K. Karpouzis, and S. Kollias, "Estimation of behavioral user state based on eye gaze and head pose - Application in an e-learning environment," Multimedia Tools Applicat., vol. 41, no. 3, pp. 469-493, 2009.
5. M. Csikszentmihalyi, Flow: The Psychology of Optimal Experience. New York, NY, USA: Harper Perennial, 1991.
6. G. Calleja, In-Game: From Immersion to Incorporation. Cambridge, MA, USA: MIT Press, 2011.
7. K. Höök, "Affective loop experiences - What are they?," in Proc. PERSUASIVE, LNCS 5033. 2008, pp. 1-12.
8. C. Jennett, A. L. Cox, P. Cairns, S. Dhoparee, A. Epps, T. Tijs, and A. Walton, "Measuring and defining the experience of immersion in games," Int. J. Human Comput. Stud., vol. 66, no. 9, pp. 641-661, Sep. 2008.
9. S. Ioannou, G. Caridakis, K. Karpouzis, and S. Kollias, "Robust feature detection for facial expression recognition," J. Image Video Process., vol. 2007, no. 2, p. 5, Jul. 2007.
10. G. Castellano, A. Pereira, I. Leite, A. Paiva, and P. W. McOwan, "Detecting user engagement with a robot companion using task and social interaction-based features," in Proc. Int. Conf. Multimodal Interfaces, 2009, pp. 119-126.
11. J. Sanghvi, G. Castellano, I. Leite, A. Pereira, P. W. McOwan, and A. Paiva, "Automatic analysis of affective postures and body motion to detect engagement with a game companion," in Proc. 6th Int. Conf. Human Robot Interaction, 2011, pp. 305-312.
12. A. J. N. van Breemen, X. Yan, and B. Meerbeek, "iCat: An animated user-interface robot with personality," in Proc. AAMAS, 2005, pp. 143-144.
13. A. Drachen, A. Canossa, and G. N. Yannakakis, "Player modeling using self-organization in tomb raider: Underworld," in Proc. IEEE Symp. Comput. Intell. Games, Sep. 2009, pp. 1-8.
14. N. Shaker, J. Togelius, G. N. Yannakakis, B. Weber, T. Shimizu, T. Hashiyama, N. Sorenson, P. Pasquier, P. Mawhorter, G. Takahashi, G. Smith, and R. Baumgarten, "The 2010 Mario AI championship: Level generation track," IEEE Trans. Comput. Intell. Games, vol. 3, no. 4, pp. 332-347, Dec. 2011.
15. G. Yannakakis, H. Martínez, and A. Jhala, "Towards affective camera control in games," User Model. User-Adapted Interaction, vol. 20, no. 4, pp. 313-340, 2010.
16. S. Tognetti, M. Garbarino, A. Bonarini, and M. Matteucci, "Modeling enjoyment preference from physiological responses in a car racing game," in Proc. IEEE Symp. Comput. Intell. Games, Aug. 2010, pp. 321-328.
17. R. Mandryk, K. Inkpen, and T. Calvert, "Using psychophysiological techniques to measure user experience with entertainment technologies," Behav. Inform. Technol., vol. 25, no. 2, pp. 141-158, 2006. (Pubitemid 43065344)
18. A. Kapoor, W. Burleson, and R. W. Picard, "Automatic prediction of frustration," Int. J. Human Comput. Stud., vol. 65, no. 8, pp. 724-736, Aug. 2007. (Pubitemid 46810294)
19. J. Sykes, "Affective gaming: Measuring emotion through the gamepad," in Proc. CHI: New Horizons, 2003, pp. 732-733.
20. F. Buttussi, L. Chittaro, R. Ranon, and A. Verona, "Adaptation of graphics and gameplay in fitness games by exploiting motion and physiological sensors," in Proc. Smart Graphics, 7th Int. Symp. (ser. Lecture Notes in Computer Science), vol. 4569. Jun. 2007, pp. 85-96.
21. H. O. Istance, A. Hyrskykari, S. Vickers, and T. Chaves, "For your eyes only: Controlling 3-D online games by eye-gaze," in Proc. INTERACT, vol. 1. 2009, pp. 314-327.
22. L. Nacke, S. Stellmach, D. Sasse, J. Niesenhaus, and R. Dachselt, "Laif: A logging and interaction framework for gaze-based interfaces in virtual entertainment environments," in Proc. Interactive Cultures Conf., Sep. 2010, pp. 19-28.
23. S. Almeida, A. Veloso, L. Roque, and O. Mealha, "The eyes and games: A survey of visual attention and eye tracking input in video games," in Proc. SBGames: X Brazilian Symp. Comput. Games Dig. Entertainment Arts Design Track, Nov. 2011.
24. M. S. El-Nasr and S. Yan, "Visual attention in 3-D video games," in Proc. Adv. Comput. Entertainment Technol., 2006, p. 22.
25. P. Isokoski, M. Joos, O. Spakov, and B. Martin, "Gaze controlled games," Universal Access Inform. Soc., vol. 8, no. 4, pp. 323-337, 2009.
26. J. D. Smith and T. C. N. Graham, "Use of eye movements for video game control," in Proc. ACM SIGCHI Int. Conf. Adv. Comput. Entertainment Technol., Jan. 2006, pp. 20-28.
27. S. Kaiser, T. Wehrle, and S. Schmidt, "Emotional episodes, facial expressions, and reported feelings in human-computer interactions," in Proc. Xth Conf. Int. Soc. Res. Emotions, 1998, pp. 82-86.
28. A. Liapis, G. N. Yannakakis, and J. Togelius, "Adapting models of visual aesthetics for personalized content creation," IEEE Trans. Comput. Intell. AI Games, Special Issue Comput. Aesthetics Games, vol. 4, no. 3, pp. 213-228, Sep. 2012.
29. J. Doran and I. Parberry, "Controlled procedural terrain generation using software agents," IEEE Trans. Comput. Intell. AI Games, vol. 2, no. 2, pp. 111-119, Jun. 2010.
30. M. Frade, F. F. de Vega, and C. Cotta, "Evolution of artificial terrains for video games based on accessibility," in Proc. Evol. Applicat., vol. 6024. 2010, pp. 90-99.
31. L. Cardamone, G. Yannakakis, J. Togelius, and P. Lanzi, "Evolving interesting maps for a first person shooter," in Proc. Int. Conf. Appl. Evol. Comput., vol. 6624. 2011, pp. 63-72.
32. J. Togelius, M. Preuss, and G. Yannakakis, "Towards multiobjective procedural map generation," in Proc. Workshop Procedural Content Generation Games, 2010, p. 3.
33. S. Kazmi and I. Palmer, "Action recognition for support of adaptive gameplay: A case study of a first person shooter," Int. J. Comput. Games Technol., p. 1, 2010.
34. J. Togelius, R. De Nardi, and S. Lucas, "Towards automatic personalised content creation for racing games," in Proc. IEEE Symp. Comput. Intell. Games, Apr. 2007, pp. 252-259. (Pubitemid 47431311)
35. G. Smith, J. Whitehead, and M. Mateas, "Tanagra: A mixed-initiative level design tool," in Proc. Int. Conf. Foundations Dig. Games, Jun. 2010, pp. 209-216.
36. N. Shaker, S. Asteriadis, G. Yannakakis, and K. Karpouzis, "A gamebased corpus for analysing the interplay between game context and player experience," in Affective Computing and Intelligent Interaction, vol. 6975. Berlin, Germany: Springer, 2011, pp. 547-556.
37. G. N. Yannakakis, M. Maragoudakis, and J. Hallam, "Preference learning for cognitive modeling: A case study on entertainment preferences," IEEE Trans. Sys., Man, Cyber. A, Syst., Humans, vol. 39, no. 6, pp. 1165-1175, Nov. 2009.
38. K. Poels and W. I. Jsselsteijn, "Development and validation of the game experience questionnaire," in Proc. FUGA Workshop Mini Symp., Apr. 2008.
39. G. N. Yannakakis, "Preference learning for affective modeling," in Proc. Int. Conf. Affective Comput. Intell. Interaction, Sep. 2009, pp. 126-131.
40. C. Pedersen, J. Togelius, and G. N. Yannakakis, "Modeling player experience for content creation," IEEE Trans. Comput. Intell. AI Games, vol. 2, no. 1, pp. 54-67, Mar. 2010.
41. N. Shaker, G. N. Yannakakis, and J. Togelius, "Towards automatic personalized content generation for platform games," in Proc. AAAI Conf. Artif. Intell. Interactive Dig. Entertainment, Oct. 2010, pp. 63-68.
42. N. Shaker, G. Yannakakis, and J. Togelius, "Digging deeper into platform game level design: Session size and sequential features," in Proc. Eur. Conf. Applicat. Evol. Comput.(EvoApplications), 2012.
43. M. Csikszentmihalyi, Finding Flow: The Psychology of Engagement with Everyday Life. New York, NY, USA: Basic Books, 1997.
44. G. Caridakis, G. Castellano, L. Kessous, A. Raouzaiou, L. Malatesta, S. Asteriadis, and K. Karpouzis, "Multimodal emotion recognition from expressive faces, body gestures and speech," in Proc. AIAI, 2007, pp. 375-388.
45. G. Caridakis, S. Asteriadis, and K. Karpouzis, "User modeling via gesture and head pose expressivity features," in Proc. 5th Int. Workshop Semantic Media Adaptation Personalization, 2010, pp. 9-10.
46. G. Yannakakis and J. Hallam, "Erratum: Ranking vs. preference: A comparative study of self-reporting," Affective Comput. Intell. Interaction, p. 1, 2011.
47. J. Fürnkranz and E. Hüllermeier, "Pairwise preference learning and ranking,"in Proc. Mach. Learn. ECML, 2003, pp. 145-156. (Pubitemid 37230973)
48. G. N. Yannakakis and J. Hallam, "Game and player feature selection for entertainment capture," in Proc. 5th Int. Conf. Comput. Intell. Games, 2007, pp. 244-251. (Pubitemid 47431310)
49. G. N. Yannakakis and J. Hallam, "Entertainment modeling through physiology in physical play," Int. J. Human Comput. Stud., vol. 66, no. 10, pp. 741-755, Oct. 2008.
50. P. Sundstrm, "Exploring the affective loop," Stockholm Univ., Stockholm, Sweden, Tech. Rep., 2005.
51. E. Hudlicka, "Affective computing for game design," in Proc. 4th Int. North Amer. Conf. Intell. Games Simulation, 2008, pp. 5-12.
52. H. Martinez and G. Yannakakis, "Genetic search feature selection for affective modeling: A case study on reported preferences," in Proc. 3rd Int. Workshop Affective Interaction Natural Environments, 2010, pp. 15-20.
53. N. Shaker, G. Yannakakis, J. Togelius, M. Nicolau, and M. O'Neill, "Evolving personalized content for super mario bros using grammatical evolution," in Proc. AAAI Conf. Artif. Intell. Interactive Dig. Entertainment, Oct. 2012, pp. 48-54.
54. E. J. Hastings, R. K. Guha, and K. O. Stanley, "Evolving content in the galactic arms race video game," in Proc. 5th Int. Conf. Comput. Intell. Games, 2009, pp. 241-248.