Capturing user engagement via psychophysiology: Measures and mechanisms for biocybernetic adaptation

International Journal of Autonomous and Adaptive Communications Systems

Volumn 6, Issue 1, 2013, Pages 63-79

  Fairclough, Stephen H ^a   Gilleade, Kiel ^a   Ewing, Katie C ^a   Roberts, Jenna ^a  

^a LIVERPOOL JOHN MOORES UNIVERSITY   (United Kingdom)

Author keywords

BA; Biocybernetic adaptation; Computer games; ECG; EEG; PC; Physiological computing; Task engagement

Indexed keywords

BARIUM; BIOCYBERNETICS; BIOFEEDBACK; ELECTROCARDIOGRAPHY; ELECTROENCEPHALOGRAPHY; PERSONAL COMPUTERS; PHYSIOLOGY; SOFTWARE DESIGN;

AFFECTIVE COMPUTING; BIOCYBERNETIC ADAPTATION; FINANCIAL INCENTIVES; LABORATORY EXPERIMENTS; PERFORMANCE FEEDBACK; PHYSIOLOGICAL COMPUTING; REAL TIME MONITORING; TASK ENGAGEMENT;

COMPUTER GAMES;

EID: 84870851690     PISSN: 17548632     EISSN: 17548640     Source Type: Journal    
DOI: 10.1504/IJAACS.2013.050694     Document Type: Review

References (43)

1. Allanson, J. (2002) 'Electrophysiologically interactive computer systems', IEEE Magazine, Vol. 35, March, pp.60-65.
2. Allanson, J. and Fairclough, S.H. (2004) 'A research agenda for physiological computing', Interacting with Computers, Vol. 16, pp.857-878.
3. Allen, J.J.B., Coan, J.A. and Nazarian, M. (2004) 'Issues and assumptions on the road from raw signals to metrics of frontal EEG asymmetry in emotion', Biological Psychology, Vol. 67, pp.183-218.
4. Allison, B.Z., Wolpaw, E.W. and Wolpaw, J.R. (2007) Brain-computer interface systems: progress and prospects', Expert Review of Medical Devices, Vol. 4, No. 4, pp.463-474.
5. Beatty, J. (1982) 'Task-evoked pupillary responses, processing load and the structure of processing resources', Psychological Bulletin, Vol. 91, No. 2, pp.276-292.
6. Burleson, W. and Picard, R.W. (2004) 'Affective agents: sustaining motivation to learn through failure and a state of "stuck"', Paper presented at the Workshop on Social and Emotional Intelligence in Learning Environments.
7. Chanel, G.C. and Rebetez, C. (2008) 'Boredom, engagement and anxiety as indicators for adaptation to difficulty in games', Paper presented at the 12th International Conference on Entertainment and Media in the Ubiquitous Era.
8. Chen, J. (2007) 'Flow in games (and everything else)', Communications of the ACM, Vol. 50, No. 4, pp.31-34.
9. Coan, J.A. and Allen, J.J.B. (2003) 'Frontal EEG asymmetry and the behavioural activation and inhibition systems', Psychophysiology, Vol. 40, pp.106-114.
10. Coan, J.A. and Allen, J.J.B. (2004) 'Frontal EEG asymmetry as a moderator and mediator of emotion', Biological Psychology, Vol. 67, pp.7-49.
11. Csikszentmihalyi, M. (1990) Flow: The Psychology of Optimal Experience. New York: Harper Perennial.
12. Davidson, R.J. (2004) 'What does the prefrontal cortex "do" in affect: perspectives on frontal EEG asymmetry research', Biological Psychology, Vol. 67, pp.219-233.
13. Fairclough, S.H. (2007) 'Psychophysiological inference and physiological computer games', Paper presented at the ACE Workshop -Brainplay'07: Brain-Computer Interfaces and Games.
14. Fairclough, S.H. (2008) 'BCI and physiological computing: similarities, differences and intuitive control', Paper presented at the Workshop on BCI and Computer Games: CHI'08.
15. Fairclough, S.H. (2009) 'Fundamentals of physiological computing', Interacting with Computers, Vol. 21, pp.133-145.
16. Freeman, F.G., Mikulka, P.J., Prinzel, L.J. and Scerbo, M.W. (1999) 'Evaluation of an adaptive automation system using three EEG indices with a visual tracking task', Biological Psychology, Vol. 50, pp.61-76.
17. Gaillard, A.W.K. (2001) 'Stress, workload, and fatigue as three biobehavioural states: a general overview', in P.A. Hancock and P.A. Desmond (Eds.), Stress, Workload, and Fatigue. Mahweh, NJ: Erlbaum, pp.623-639.
18. Gevins, A. and Smith, M.E. (2003) 'Neurophysiological measures of cognitive workload during human-computer interaction', Theoretical Issues in Ergonomic Science, Vol. 4, Nos. 1-2, pp.113-121.
19. Gevins, A., et al. (1998) 'Monitoring working memory load during computer-based tasks with EEG pattern recognition models', Human Factors, Vol. 40, No. 1, pp.79-91.
20. Gilleade, K.M. and Dix, A. (2004) 'Using frustration in the design of adaptive videogame', Paper presented at the Advances in Computer Entertainment Technology.
21. Gilleade, K.M., Dix, A. and Allanson, J. (2005) 'Affective videogames and modes of affective gaming: assist me, challenge me, emote me', Paper presented at the Proceedings of DiGRA 2005.
22. Harmon-Jones, E. and Allen, J.J.B. (1997) 'Behavioural activation sensitivity and resting frontal EEG asymmetry: covariation of putative indicators related to risk for mood disorders', Journal of Abnormal Psychology, Vol. 106, No. 1, pp.159-163.
23. Kapoor, A., Burleson, W. and Picard, R.W. (2007) 'Automatic prediction of frustration', Int. J. Human-Computer Studies, Vol. 65, pp.724-736.
24. Klein, J., Moon, Y. and Picard, R.W. (2002) 'This computer responds to user frustration: theory, design and results', Interacting with Computers, Vol. 14, pp.119-140.
25. Larsen, J.T., Norris, C.J. and Cacioppo, J.T. (2003) 'Effects of positive and negative affect on electromyographic activity over the zygomaticus major and corrugator supercilii', Psychophysiology, Vol. 40, pp.776-785.
26. Locke, E.A. and Latham, G.P. (1990) A Theory of Goal Setting and Task Performance. Englewood Cliffs, NJ: Prentice-Hall.
27. Marshall, S.P., Davis, C.L. and Knust, S.R. (2004) The Index of Cognitive Activity: Estimating Cognitive Effort from Pupil Dilation. San Diego, CA: EyeTracking Inc.
28. Matthews, G., et al. (2002) 'Fundamental dimensions of subjective state in performance settings: task engagement, distress and worry', Emotion, Vol. 2, No. 4, pp.315-340.
29. Miller, A. and Tomarken, A.J. (2001) 'Task-dependent changes in frontal brain asymmetry: effects of incentive cues, outcome expectancies and motor responses', Psychophysiology, Vol. 38, pp.500-511.
30. Mulder, G. (1986) 'The concept and measurement of mental effort', in G.R.J. Hockey, A.W.K. Gaillard and M.G.H. Coles (Eds.), Energetical Issues in Research on Human Information Processing. Dordrecht, The Netherlands: Martinus Nijhoff, pp.175-198.
31. Nacke, L. and Lindley, C.A. (2008) 'Flow and immersion in first-person shooters: measuring the player's gameplay experience', Paper presented at the Conference on Future Play: Research, Play, Share.
32. Pantic, M. and Rothkrantz, L.J.M. (2003) 'Towards an affect-sensitive multimodal human-computer interaction', Proceedings of the IEEE, Vol. 91, No. 9, pp.1370-1390.
33. Picard, R.W., Vyzas, E. and Healey, J. (2001) 'Towards machine emotional intelligence: analysis of affective physiological state', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 10, pp.1175-1191.
34. Pizzagalli, D., Sherwood, R.J., Henriques, J.B. and Davidson, R.J. (2005) 'Frontal brain asymmetry and reward responsiveness', Psychological Science, Vol. 16, No. 10, pp.805-813.
35. Pope, A.T., Bogart, E.H. and Bartolome, D.S. (1995) 'Biocybernetic system evaluates indices of operator engagement in automated task', Biological Psychology, Vol. 40, pp.187-195.
36. Richter, M., Friedrich, A. and Gendolla, G.H. (2008) 'Task difficulty effects on cardiac activity', Psychophysiology, Vol. 45, pp.869-875.
37. Richter, M. and Gendolla, G.H.E. (2007) 'Incentive value, unclear task difficulty, and cardiovascular reactivity in active coping', Int. J. Psychophysiology, Vol. 63, No. 3, pp.294-301.
38. Ryan, R.M., Rigby, C.S. and Przybylski, A. (2006) 'The motivational pull of video games: a selfdetermination approach', Motivation and Emotion, Vol. 30, pp.347-363.
39. Saari, T. and Ravaja, N. (2005) 'Towards emotionally adapted games based on user controlled emotion knobs', Paper presented at the DiGRA 2005: Changing Views: Worlds in Play.
40. Scerbo, M.W., Freeman, F.G. and Mikulka, P.J. (2003) 'A brain-based system for adaptive automation', Theoretical Issues in Ergonomic Science, Vol. 4, Nos. 1-2, pp.200-219.
41. Wilson, G.F. and Russell, C.A. (2007) 'Performance enhancement in an uninhabited air vehicle task using psychophysiologically determined adaptive aiding', Human Factors, Vol. 49, No. 6, pp.1005-1018.
42. Wright, R.A. (2008) 'Refining the prediction of effort: Brehm's distinction between potential motivation and motivation intensity', Social and Personality Psychology Compass, Vol. 2, No. 2, pp.682-701.
43. Wright, R.A. and Kirby, L.D. (2001) 'Effort determination of cardiovascular response: an integrative analysis with applications in social psychology', in M.P. Zanna (Ed.), Advances in Social Psychology. San Diego, CA: Academic Press. pp.255-307.