Absolute and relative user perception of classification accuracy in an affective video game

Interacting with Computers

Volumn 29, Issue 2, 2017, Pages 271-286

  McCrea, Sean ^a   Geršak, Gregor ^b   Novak, Domen ^a  

^a UNIVERSITY OF WYOMING   (United States)

^b UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

Affective computing; Computer games; Machine learning; Physiological computing; User experience

Indexed keywords

BRAIN; HUMAN COMPUTER INTERACTION; LEARNING SYSTEMS; SURVEYS; USER EXPERIENCE;

AFFECTIVE COMPUTING; BRAIN ACTIVITY; CLASSIFICATION ACCURACY; CLASSIFICATION ALGORITHM; GAME EXPERIENCE; PHYSIOLOGICAL COMPUTING; USER PERCEPTIONS; VIDEO GAME;

COMPUTER GAMES;

EID: 85016239075     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1093/iwc/iww026     Document Type: Article

References (42)

1. Armijo-Olivo, S., Warren, S., Fuentes, J. and Magee, D.J. (2011). Clinical relevance vs. statistical significance: Using neck outcomes in patients with temporomandibular disorders as an example. Man. Ther., 16, 563-572.
2. Bailenson, J.N., Pontikakis, E.D., Mauss, I.B., Gross, J.J., Jabon, M. E., Hutcherson, C.A.,,John, O. (2008). Real-time classification of evoked emotions using facial feature tracking and physiological responses. Int. J. Hum. Comput. Stud., 66, 303-317.
3. Booth, M. (2009). The AI Systems of Left 4 Dead. In Artificial Intelligence and Interactive Digital Entertainment Conference at Stanford.
4. Bradley, M.M. and Lang, P.J. (1994). Measuring emotion: The selfassessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry, 25, 49-59.
5. Brouwer, A.-M., van Schaik, M., Korteling, J., van Erp, J. and Toet, A. (2015). Neuroticism, extraversion, conscientiousness and stress: physiological correlates. IEEE Trans. Affect. Comput., 6, 109-117.
6. Chanel, G., Rebetez, C., Bétrancourt, M. and Pun, T. (2011). Emotion assessment from physiological signals for adaptation of game difficulty. IEEE Trans. Syst. Man Cybern. A Syst. Hum., 41, 1052-1063.
7. Chase, S.M., Schwartz, A.B. and Kass, R.E. (2009). Bias, optimal linear estimation, and the differences between open-loop simulation and closed-loop performance of spiking-based brain-computer interface algorithms. Neural Netw., 22, 1203-1213.
8. Chen, J. (2007). Flow in games (and everything else). Commun. ACM., 50, 31-34.
9. Cook, M.R. (2007). Psychophysiology of peripheral vascular changes. In Obrist, P.A., Black, A.H., Irener, J. and Dicara, L.V. (eds), Cardiovascular Psychophysiology: Current Issues in Response Mechanisms, Biofeedback and Methodology. Aldine Transaction, Piscateway, NJ, USA, pp. 60-84.
10. Csikszentmihalyi, M. (1990). Flow: The Psychology of Optimal Experience. Harper Perennial, London.
11. da Silva Cameirao, M., Bermúdez i Badia, S., Duarte, E. and Verschure, P.F.M.J. (2011). Virtual reality based rehabilitation speeds up functional recovery of the upper extremities after stroke: A randomized controlled pilot study in the acute phase of stroke using the Rehabilitation Gaming System. Restor. Neurol. Neurosci., 29, 287-298.
12. Fairclough, S.H. (2009). Fundamentals of physiological computing. Interact. Comput., 21, 133-145.
13. Fairclough, S.H., Karran, A.J. and Gilleade, K. (2015). Classification accuracy from the perspective of the user: real-time interaction with physiological computing. In Proc. 33rd Annual Conf. Human Factors in Computing Systems (CHI '15), pp. 3029-3038. ACM Press, New York, NY, USA.
14. Gilleade, K., Dix, A. and Allanson, J. (2005). Affective videogames and modes of affective gaming: assist me, challenge me, emote me. In Proceedings of DiGRA 2005, Vancouver, Canada.
15. Glowinski, D., Dael, N., Camurri, A., Volpe, G., Mortillaro, M. and Scherer, K. (2011). Toward a minimal representation of affective gestures. IEEE Trans. Affect. Comput., 2, 106-118.
16. Goffin, R.D. and Olson, J.M. (2011). Is it all relative? Comparative judgments and the possible improvement of self-ratings and ratings of others. Perspect. Psychol. Sci., 6, 48-60.
17. Goldberg, L.R., Johnson, J. a., Eber, H.W., Hogan, R., Ashton, M. C., Cloninger, C.R. and Gough, H.G. (2006). The international personality item pool and the future of public-domain personality measures. J. Res. Pers., 40, 84-96.
18. Gosling, S.D., Rentfrow, P.J. and Swann Jr., W.B. (2003). A very brief measure of the Big-Five personality domains. J. Res. Pers., 37, 504-528.
19. Guerrero, C.R., Fraile Marinero, J.C., Turiel, J.P. and Muñoz, V. (2013). Using 'human state aware' robots to enhance physicalhuman-robot interaction in a cooperative scenario. Comput. Methods Programs Biomed., 112, 250-259.
20. Guo, Y.-F. and Stein, P.K. (2003). Circadian rhythm in the cardiovascular system: chronocardiology. Am. Heart. J., 145, 779-786.
21. Kreibig, S.D. (2010). Autonomic nervous system activity in emotion: A review. Biol. Psychol., 84, 394-421.
22. Liu, C., Agrawal, P., Sarkar, N. and Chen, S. (2009). Dynamic difficulty adjustment in computer games through real-time anxietybased affective feedback. Int. J. Hum. Comput. Interact., 25, 506-529.
23. Liu, C., Conn, K., Sarkar, N. and Stone, W. (2008). Online affect detection and robot behavior adaptation for intervention of children with autism. IEEE Trans. Robotics, 24, 883-896.
24. Mandryk, R.L. and Atkins, M.S. (2007). A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. Int. J. Hum. Comput. Stud., 65, 329-347.
25. McAuley, E., Duncan, T. and Tammen, V.V. (1989). Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: A confirmatory factor analysis. Res. Q. Exerc. Sport., 60, 48-58.
26. Nagle, A., Novak, D., Wolf, P. and Riener, R. (2015). Increased enjoyment using a tablet-based serious game with regularly changing visual elements: A pilot study. Gerontechnology, 14, 32-44.
27. Negini, F., Mandryk, R.L. and Stanley, K.G. (2014). Using affective state to adapt characters, NPCs, and the environment in a first-person shooter game. In Proceedings of the 2014 IEEE Games, Entertainment, and Media Conference. Toronto, IEEE Press, pp. 1-8.
28. Novak, D., Mihelj, M. and Munih, M. (2012). A survey of methods for data fusion and system adaptation using autonomic nervous system responses in physiological computing. Interact. Comput., 24, 154-172.
29. Novak, D., Mihelj, M., Ziherl, J., Olenšek, A. and Munih, M. (2011). Psychophysiological measurements in a biocooperative feedback loop for upper extremity rehabilitation. IEEE Trans. Neural Syst. Rehabil. Eng., 19, 400-410.
30. Novak, D., Nagle, A. and Riener, R. (2014a). Linking recognition accuracy and user experience in an affective feedback loop. IEEE Trans. Affect. Comput., 5, 168-172.
31. Novak, D., Nagle, A., Keller, U. and Riener, R. (2014b). Increasing motivation in robot-aided arm rehabilitation with competitive and cooperative gameplay. J. Neuroeng. Rehabil., 11:64.
32. Picard, R.W., Vyzas, E. and Healey, J. (2001). Toward machine emotional intelligence: Analysis of affective physiological state. IEEE. Trans. Pattern. Anal. Mach. Intell., 23, 1175-1191.
33. Picot, A., Charbonnier, S. and Caplier, A. (2012). On-line detection of drowsiness using brain and visual information. IEEE Trans. Syst. Man Cybern. A Syst. Hum., 42, 764-775.
34. Piquado, T., Isaacowitz, D. and Wingfield, A. (2010). Pupillometry as a measure of cognitive effort in younger and older adults. Psychophysiology., 47, 560-569.
35. Pope, A.T., Bogart, E.H. and Bartolome, D.S. (1995). Biocybernetic system evaluates indices of operator engagement in automated task. Biol. Psychol., 40, 187-195.
36. Rahulamathavan, Y., Phan, R.C.-W., Chambers, J.A. and Parish, D. J. (2013). Facial expression recognition in the encrypted domain based on local Fisher discriminant analysis. IEEE Trans. Affect. Comput., 4, 83-92.
37. Shen, L., Wang, M. and Shen, R. (2009). Affective e-learning: using 'emotional' data to improve learning in pervasive learning environment. J. Educ. Techno. Soc., 12, 176-189.
38. Shirzad, N. and Van der Loos, H.F.M. (2016). Evaluating the user experience of exercising reaching motions with a robot that predicts desired movement difficulty. J. Mot. Behav., 48, 31-46.
39. van de Laar, B., Bos, D.P., Reuderink, B., Poel, M. and Nijholt, A. (2013). How much control is enough? Influence of unreliable input on user experience. IEEE Trans. Cybern., 43, 1584-1592.
40. Van der Zwaag, M.D., Janssen, J.H. and Westerink, J.H.D.M. (2013). Directing physiology and mood through music: validation of an affective music player. IEEE Trans. Affect. Comput., 4, 57-68.
41. Wilson, G.F. and Russell, C.A. (2003). Real-time assessment of mental workload using psychophysiological measures and artificial neural networks. Hum. Factors., 45, 635-643.
42. Zander, T.O. and Kothe, C. (2011). Towards passive brain-computer interfaces: applying brain-computer interface technology to human-machine systems in general. J. Neural. Eng., 8, 025005.