Arrrgghh!!! - Blending quantitative and qualitative methods to detect player frustration

Proceedings of the 6th International Conference on the Foundations of Digital Games, FDG 2011

Volumn , Issue , 2011, Pages 61-68

  Canossa, Alessandro ^a   Drachen, Anders ^b   Sørensen, Janus Rau Møller ^c  

^a IT UNIVERSITY OF COPENHAGEN   (Denmark)

^b AALBORG UNIVERSITY   (Denmark)

^c EIDOS Square Enix   (United States)

Author keywords

Game design; Game development; Gameplay metrics; Patterns of behavior; Player frustration; Qualitative and quantitative research methods; Small sample size; User experience

Indexed keywords

GAME DESIGN; GAME DEVELOPMENT; GAMEPLAY; PATTERNS OF BEHAVIOR; PLAYER FRUSTRATION; QUANTITATIVE RESEARCH METHODS; SMALL SAMPLE SIZE; USER EXPERIENCE;

BLENDING; COMPUTER SOFTWARE; INTERACTIVE COMPUTER GRAPHICS;

SOFTWARE DESIGN;

EID: 84858983786     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2159365.2159374     Document Type: Conference Paper

References (33)

1. Amsel, A. 1990. Arousal, suppression, and persistence: Frustration theory, attention, and its disorders. In Cognition & Emotion, Psychology Press.
2. Berkowitz, L. 1969. The frustration-aggression hypothesis revisited. In: Roots of aggression, Atherton Press, New York.
3. Brave, S. B. and Nass, C. 2003. Agents that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent, Doctoral Dissertation, Stanford University Stanford, CA, USA.
4. Canossa, A. and Drachen, A. 2009. Patterns of Play: Play-Personas in User-Centered Game Development. In Proceedings of DIGRA '09 DiGRA Publishers, London, UK.
5. Csikszentmihalyi, M. 1990. Flow: The Psychology of Optimal Experience. New York: Harper and Row.
6. Davis, J. P., Steury, K. and Pagulayan, R. 2005. A survey method for assessing perceptions of a game: The consumer playtest in game design. In Game Studies, 5, 1.
7. DeRosa, P. 2007. Tracking Player Feedback to Improve Game Design. Gamasutra. Available from: http://www.gamasutra.com/view/feature/1546/tracking- player-feedback-to-.php.
8. Dollard, J. and Miller, N. E. (Eds.). 1939. Frustration and aggression, Yale University Press, New Haven, USA.
9. Drachen, A. and Canossa, A. 2011. Towards Gameplay Analysis via Gameplay Metrics. In Media in the Ubiquitous Era: Ambient, Social and Gaming Media. IGI Global Publishers.
10. Drachen, A. and Canossa, A. 2011 Evaluating Motion: Spatial User Behavior in Virtual Environments. In press for International Journal of Arts and Technology - Special issue on ACM Academic MindTrek '09: Everyday Life in the Ubiquitous Era. Inderscience Publishers.
11. Hazlett, L. R. 2006. Measuring emotional valence during interactive experiences: boys at video game play. In Proceedings of the SIGCHI conference on Human Factors in computing systems. ACM New York, NY, USA.
12. Ijsselsteijn, W et al. 2007. Characterizing and Measuring User Experiences in Digital Games. In Proceedings of ACE Conference'07, Salzburg, Austria .
13. Isbister, K. and Schaffer, N. 2008 (Eds.). Game Usability: Advancing the Player Experience. Morgan Kaufman.
14. Kiel, M., Gilleade, K. M. and Dix, A. 2004. Using frustration in the design of adaptive videogames. In Proceeding of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology, ACM New York, NY, USA .
15. Kim, J. H., Gunn, D. V., Schuh, E., Phillips, B., Pagulayan, R. J. and Wixon, D. 2008. Tracking real-time user experience (TRUE): a comprehensive instrumentation solution for complex systems. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems '08, Florence, Italy.
16. Longley, P. A., Goodchild, M. F., Maguire, D. J. 2005. Geographical information systems: principles, techniques, management, and applications. John Wiley & Sons.
17. Mellon, L. 2004. Metrics in MMP Development and Operations. Game Developer Conference presentation. Available from: http://www.maggotranch.com/ gdc2004.ppt.
18. Norman, D. A. 1988. The psychology of everyday things. Basic Books, New York, USA.
19. Pagulayan, R.J., Keeker, K., Wixon, D., Romero, R.L. and Fuller, T. 2003. User-centred design in games. In The Human-Computer Interaction Handbook, Erlbaum, Mahwah, NJ, USA.
20. Pedersen, N. 2010. G-Player. Available from: http://nikolajp.dk/kl2/ replayshow.php?matchid=1.
21. Rohrer, C. 2008. When to Use Which User Experience Research Methods. Available from: http://www.useit.com/alertbox/user-research-methods.html.
22. Rosenzweig, S. 1944. Personality and the behavior disorders. Ronald Press, New York, USA.
23. Scheirer J., Fernandez R., Klein J. and Picard R.W. 2002. Frustrating the user on purpose: A step toward building an affective computer. Interacting with Computers - the interdisciplinary journal of Human-Computer Interaction, 14, 2, 93-118. (Pubitemid 34199154)
24. Silverman, D. 2001. Interpreting Qualitative Data: Methods for Analysing Talk, Text and Interaction. Sage Publications Ltd; 2nd edition.
25. Swain, C. 2009. Improving academic-industry collaboration for game research and education. In Proceedings of the 4th International Conference on Foundations of Digital Games. ACM New York, NY, USA.
26. Thompson, C. 2007. How Microsoft Labs invented a New Science of Play. Wired Magazine 15, 9. Available from: http://www.wired.com/gaming/virtualworlds/ magazine/15-09/ff-halo?currentPage=all.
27. Tychsen, A. and Canossa, A. 2008. Defining Personas in Games Using Metrics. In Proceedings of FUTURE PLAY '08 ACM publishers, 73-80, Toronto, Canada.
28. Vorderer, P. and Jennings, B. 2006. Playing Video Games: Motives, Responses, and Consequences. Lawrence Erlbaum Associates, Oxford, UK.
29. Williams, D., Yee, N. and Caplan, S. E. 2008. Who plays, how much, and why? Debunking the stereotypical gamer profile. Journal of Computer-Mediated Communication 13, 993-1018.
30. Drachen, A., Canossa, A. and Yannakakis, G. 2009. Player Modeling using Self-Organization in Tomb Raider: Underworld. In Proceedings of IEEE Computational Intelligence in Games (CIG) '09, IEEE Publishers, pp. 1-8. Milan, Italy.
31. Mahlmann, T., Drachen, A., Togelius, J., Canossa and A. Yannakakis, G. N. 2010. Predicting Player Behavior in Tomb Raider: Underworld. In Proceedings of IEEE Computational Intelligence in Games (CIG) '10, IEEE Publishers. Copenhagen, Denmark.
32. Pagulayan R. and Keeker, K. 2007. Measuring Pleasure and Fun: Playtesting. In Handbook of Formal and Informal Interaction Design Methods. Morgan Kaufmann Publishers.
33. Nielsen, J. and Landauer, T. K. 1993. A mathematical model of the finding of usability problems. In Proceedings of ACM INTERCHI'93 Conference. Amsterdam, The Netherlands.