Towards personalised gaming via facial expression recognition

Proceedings of the 10th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, AIIDE 2014

Volumn , Issue , 2014, Pages 30-36

  Blom, Paris Mavromoustakos ^a   Bakkes, Sander ^a   Tan, Chek Tien ^b   Whiteson, Shimon ^a   Roijers, Diederik ^a   Valenti, Roberto ^a   Gevers, Theo ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER GAMES; COMPUTER VISION; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER GRAPHICS; INTERNET; SOCIAL NETWORKING (ONLINE);

AFFECTIVE STATE; FACIAL EXPRESSION ANALYSIS; FACIAL EXPRESSION RECOGNITION; FACIAL EXPRESSIONS; GAME EXPERIENCE; HUMAN PLAYERS; PERSONALISATION; PLAYER EXPERIENCE;

FACE RECOGNITION;

EID: 84916879231     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (39)

1. Bakkes, S. C. J.; Whiteson, S. A.; Li, G.; Visniuc, G.; Charitos, E.; Heijne, N.; and Swellengrebel, A. 2014. Challenge balancing for personalised game spaces.
2. Bakkes, S. C. J.; Tan, C. T.; and Pisan, Y. 2012. Personalised gaming. Journal: Creative Technologies 3.
3. Baltrusaitis, T.; McDuff, D.; Banda, N.; Mahmoud, M.; Kaliouby, R. E.; Robinson, P.; and Picard, R. 2011. Real-time inference of mental states from facial expressions and upper body gestures. Face and Gesture 2011 909-914.
4. Bartlett, M. S.; Hager, J. C.; Ekman, P.; and Sejnowski, T. J. 1999. Measuring facial expressions by computer image analysis. Psychophysiology 36(2):253-63.
5. Branco, P. 2006. Computer-based facial expression analysis for assessing user experience. Ph.D. Dissertation, Universidade do Minho.
6. Buenaposada, J. M.; Munoz, E.; and Baumela, L. 2007. Recognising facial expressions in video sequences. Pattern Analysis and Applications 11(1):101-116.
7. Charles, D.; McNeill, M.; McAlister, M.; Black, M.; Moore, A.; Stringer, K.; Kucklich, J.; and Kerr, A. 2005. Player-centered design: Player modeling and adaptive digital games. In DiGRA, 285-298.
8. Darley, W., and Lim, J. 1992. The effect of consumers? emotional reactions on behavioral intention: The moderating role of personal relevance and self-monitoring. Psychology and Marketing 9(4):329-346.
9. Drachen, A.; Nacke, L.; Yannakakis, G.; and Pedersen, A. 2010. Correlation between heart rate, electrodermal activity and player experience in First-Person Shooter games. In Proceedings of the 5th ACM SIGGRAPH Symposium on Video Games, 49-54. ACM.
10. Gagne, A.; Seif El-Nasr, M.; and Shaw, C. 2011. A Deeper Look at the use of Telemetry for Analysis of Player Behavior in RTS Games. In International Conference on Entertainment Computing ICEC.
11. Ghijsen, M. 2004. Facial Expression Analysis for Human Computer Interaction. Affective Computing, IEEE Transactions on 2(3):147-161.
12. Juul, J. 2013. The art of failure: An essay on the pain of playing video games. Mit Press.
13. Mandryk, R. L.; Atkins, M. S.; and Inkpen, K. M. 2006. A continuous and objective evaluation of emotional experience with interactive play environments. Proceedings of the SIGCHI conference on Human Factors in computing systems - CHI ?06 1027.
14. McDuff, D.; el Kaliouby, R.; Kassam, K.; and Picard, R. 2011. Acume: A new visualization tool for understanding facial expression and gesture data. In Face and Gesture 2011, 591-596. IEEE.
15. Medler, B.; John, M.; and Lane, J. 2011. Data cracker: developing a visual game analytic tool for analyzing online gameplay. In Proceedings of the 2011 annual conference on Human factors in computing systems, 2365-2374. ACM.
16. Michel, P., and El Kaliouby, R. 2003. Real time facial expression recognition in video using support vector machines. Proceedings of the 5th international conference on Multimodal interfaces - ICMI ?03 258.
17. Molyneux, P. D. 2006. The future of game AI - Lecture. Imperial College London, London, UK. October 4, 2006.
18. Moura, D.; Seif El-Nasr, M.; and Shaw, C. D. 2011. Visualizing and Understanding Players Behavior in Video Games : Discovering Patterns and Supporting Aggregation and Comparison. In SIGGRAPH, 2-7.
19. Nacke, L., and Lindley, C. 2008. Flow and immersion in firstperson shooters: measuring the player's gameplay experience. Proceedings of the 2008 Conference on Future 81-88.
20. Nacke, L. E.; Grimshaw, M. N.; and Lindley, C. a. 2010. More than a feeling: Measurement of sonic user experience and psychophysiology in a first-person shooter game. Interacting with Computers 22(5):336-343.
21. Pedersen, C.; Togelius, J.; and Yannakakis, G. N. 2009a. Modeling Player Experience for Content Creation. IEEE Transactions on Computational Intelligence and AI in Games 1(2):121-133.
22. Pedersen, C.; Togelius, J.; and Yannakakis, G. N. 2009b. Modeling player experience in super mario bros. In CIG 2009, 132-139.
23. Persson, M. 2009. Infinite mario. [Online] Available: http://www. mojang.com/notch/mario.
24. Petty, R., and Cacioppo, J. 1979. Issue involvement can increase or decrease persuasion by enhancing message-relevant cognitive responses. Journal of personality and social psychology 37(10):1915.
25. Riedl, M. 2010. Scalable personalization of interactive experiences through creative automation. Computers in Entertainment 8(4):26.
26. Russell, J. A. 1980. A circumplex model of affect. Journal of Personality and Social Psychology 39(6):1161-1178.
27. Shaker, N.; Asteriadis, S.; Yannakakis, G. N.; and Karpouzis, K. 2011. A game-based corpus for analysing the interplay between game context and player experience. In Affective Computing and Intelligent Interaction, 547-556.
28. Shaker, N.; Yannakakis, G. N.; and Togelius, J. 2012. Digging deeper into platform game level design: session size and sequential features. In Applications of Evolutionary Computation, 275- 284.
29. Shaker, N.; Yannakakis, G. N.; and Togelius, J. 2013. Crowdsourcing the aesthetics of platform games. IEEE Transactions on Computational Intelligence and AI in Games 5(3):276-290. Sightcorp. 2014. Insight SDK. [Online] Available: http:// sightcorp.com/.
30. Tan, C. T., and Pisan, Y. 2012. Towards Automated Player Experience Detection With Computer Vision Techniques. In CHI Workshop on Game User Experience.
31. Tan, C. T.; Rosser, D.; Bakkes, S.; and Pisan, Y. 2012. A feasibility study in using facial expressions analysis to evaluate player experiences. In Proceedings of The 8th Australasian Conference on Interactive Entertainment: Playing the System, 5. ACM.
32. Teng, C. 2010. Customization, immersion satisfaction, and online gamer loyalty. Computers in Human Behavior 26(6):1547-1554.
33. Togelius, J.; Yannakakis, G. N.; Stanley, K. O.; and Browne, C. 2011. Search-based procedural content generation: A taxonomy and survey. IEEE Transactions on Computational Intelligence and AI in Games 3(3):172-186.
34. Togelius, J.; Karakovskiy, S.; and Baumgarten, R. 2010. The 2009 Mario AI Competition. In CEC 2010, 1-8.
35. Yannakakis, G. N., and Hallam, J. 2009. Real-time game adaptation for optimizing player satisfaction. IEEE Transactions on Computational Intelligence and AI in Games 1(2):121-133.
36. Yannakakis, G. N., and Hallam, J. 2011. Ranking vs. preference: a comparative study of self-reporting. In Affective Computing and Intelligent Interaction, 437-446.
37. Yannakakis, G. 2011. Experience-driven procedural content generation. Affective Computing, IEEE 1-16.
38. Zaman, B., and Shrimpton-Smith, T. 2006. The FaceReader: Measuring instant fun of use. In Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles, number October in -, 457-460. ACM.
39. Zammitto, V.; Seif El-Nasr, M.; and Newton, P. 2010. Exploring Quantitative Methods for Evaluating Sports Games. Signals 8- 11.