A feasibility study in using facial expressions analysis to evaluate player experiences

ACM International Conference Proceeding Series

Volumn , Issue , 2012, Pages

  Tan, Chek Tien ^a   Rosser, Daniel ^a   Bakkes, Sander ^a   Pisan, Yusuf ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

facial expression analysis; game user experience; playtesting

Indexed keywords

AUTOMATIC EVALUATION; COMPUTER VISION TECHNIQUES; FACIAL EXPRESSION ANALYSIS; FACIAL EXPRESSIONS; FEASIBILITY STUDIES; PLAYER EXPERIENCE; PLAYTESTING; QUANTITATIVE METHOD; USER EXPERIENCE; USER STUDY;

COMPUTER APPLICATIONS;

COMPUTER VISION;

EID: 84865318985     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2336727.2336732     Document Type: Conference Paper

References (30)

1. T. Baltrusaitis, D. McDuff, N. Banda, M. Mahmoud, R. E. Kaliouby, P. Robinson, and R. Picard. Real-time inference of mental states from facial expressions and upper body gestures. Face and Gesture 2011, pages 909-914, Mar. 2011.
2. M. S. Bartlett, J. C. Hager, P. Ekman, and T. J. Sejnowski. Measuring facial expressions by computer image analysis. Psychophysiology, 36(2):253-63, Mar. 1999.
3. P. Branco. Computer-based facial expression analysis for assessing user experience. PhD thesis, 2006.
4. J. M. Buenaposada, E. Muñoz, and L. Baumela. Recognising facial expressions in video sequences. Pattern Analysis and Applications, 11(1):101-116, Oct. 2007.
5. A. Chapin. THE FUTURE IS A VIDEOGAME. Canadian Business, 84(4):46-48, 2011.
6. J. F. Cohn and M. A. Sayette. Automated Facial Coding. Behavioral Research Methods, pages 1-33, 2010.
7. M. N. Dailey, G. W. Cottrell, C. Padgett, and R. Adolphs. EMPATH: a neural network that categorizes facial expressions. Journal of cognitive neuroscience, 14(8):1158-73, Nov. 2002.
8. A. Drachen, L. Nacke, G. Yannakakis, and A. Pedersen. Correlation between heart rate, electrodermal activity and player experience in First-Person Shooter games. In Proceedings of the 5th ACM SIGGRAPH Symposium on Video Games, pages 49-54. ACM, 2010.
9. P. Ekman and W. V. Friesen. The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica, 1(1):49-98, 1969.
10. P. Ekman, W. V. Friesen, and J. C. Hager. Facial Action Coding System, volume 48. A Human Face, 2002.
11. A. Gagne, M. Seif El-Nasr, and C. Shaw. A Deeper Look at the use of Telemetry for Analysis of Player Behavior in RTS Games. In International Conference on Entertainment Computing ICEC, 2011.
12. M. Ghijsen. Facial Expression Analysis for Human Computer Interaction. Affective Computing, IEEE Transactions on, 2(3):147-161, 2004.
13. R. L. Mandryk, M. S. Atkins, and K. M. Inkpen. A continuous and objective evaluation of emotional experience with interactive play environments. Proceedings of the SIGCHI conference on Human Factors in computing systems - CHI '06, page 1027, 2006.
14. D. McDuff, R. el Kaliouby, K. Kassam, and R. Picard. Acume: A new visualization tool for understanding facial expression and gesture data. In Face and Gesture 2011, pages 591-596. IEEE, Mar. 2011.
15. D. McDuff, R. E. Kaliouby, and K. Kassam. Affect valence inference from facial action unit spectrograms. Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2010.
16. B. Medler, M. John, and J. Lane. Data cracker: developing a visual game analytic tool for analyzing online gameplay. In Proceedings of the 2011 annual conference on Human factors in computing systems, pages 2365-2374. ACM, 2011.
17. P. Michel and R. El Kaliouby. Real time facial expression recognition in video using support vector machines. Proceedings of the 5th international conference on Multimodal interfaces - ICMI '03, page 258, 2003.
18. D. Moura, M. Seif El-Nasr, and C. D. Shaw. Visualizing and Understanding Players âǍŹ Behavior in Video Games : Discovering Patterns and Supporting Aggregation and Comparison. In SIGGRAPH, pages 2-7, 2011.
19. L. Nacke and C. Lindley. Flow and immersion in first-person shooters: measuring the player's gameplay experience. Proceedings of the 2008 Conference on Future, pages 81-88, 2008.
20. L. E. Nacke. Affective Ludology: Scientific Measurement of User Experience in Interactive Entertainment. PhD thesis, 2009.
21. L. E. Nacke, M. N. Grimshaw, and C. a. Lindley. More than a feeling: Measurement of sonic user experience and psychophysiology in a first-person shooter game. Interacting with Computers, 22(5):336-343, Sept. 2010.
22. B. Reeves, J. Cummings, and J. Scarboroug. Government Uses for Games and Virtual Worlds : Optimizing Choices for Citizens and Government Workers in the Areas of Energy Efficiency , Educational Assessment , Worker Productivity , Safety and Health , and Quality. Technical report, 2010.
23. J. A. Russell. A circumplex model of affect. Journal of Personality and Social Psychology, 39(6):1161-1178, 1980.
24. J. M. Saragih, S. Lucey, and J. F. Cohn. Deformable Model Fitting by Regularized Landmark Mean-Shift. International Journal of Computer Vision, 91(2):200-215, Sept. 2010.
25. P. Sweetser and P. Wyeth. GameFlow: a model for evaluating player enjoyment in games. Computers in Entertainment (CIE), 3(3):3-3, 2005.
26. C. Tan and A. Johnston. Towards a Nondisruptive, Practical, and Objective Automated Playtesting Process. In Workshops at the Seventh Artificial Intelligence and Interactive Digital Entertainment Conference, pages 25-28, 2011.
27. C. T. Tan and Y. Pisan. Towards Automated Player Experience Detection With Computer Vision Techniques. In CHI Workshop on Game User Experience, 2012.
28. G. Tenenbaum, G. J. Fogarty, and S. A. Jackson. The flow experience: a Rasch analysis of Jackson's Flow State Scale. Journal Of Outcome Measurement, 3(3):278-294, 1999.
29. B. Zaman and T. Shrimpton-Smith. The FaceReader: Measuring instant fun of use. In Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles, number October, pages 457-460. ACM, 2006.
30. V. Zammitto, M. Seif El-Nasr, and P. Newton. Exploring Quantitative Methods for Evaluating Sports Games. Signals, pages 8-11, 2010.