Valence, arousal and dominance in the EEG during game play

International Journal of Autonomous and Adaptive Communications Systems

Volumn 6, Issue 1, 2013, Pages 45-62

  Reuderink, Boris ^a   Mühl, Christian ^a   Poel, Mannes ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Adaptive communication systems; Affective computing; Affective signal processing; Alpha asymmetry; Arousal; BCI; Brain computer interfaces; Dominance; EEG; Electroencephalogram; Emotion recognition; Frustration; Valence

Indexed keywords

ELECTROENCEPHALOGRAPHY; INTERFACE STATES; SIGNAL PROCESSING;

ADAPTIVE COMMUNICATION SYSTEMS; AFFECTIVE COMPUTING; ALPHA ASYMMETRY; AROUSAL; DOMINANCE; EMOTION RECOGNITION; FRUSTRATION; VALENCE;

BRAIN COMPUTER INTERFACE;

EID: 84870816639     PISSN: 17548632     EISSN: 17548640     Source Type: Journal    
DOI: 10.1504/IJAACS.2013.050691     Document Type: Article

References (58)

1. Aftanas, L.I. and Golocheikine, S.A. (2001) 'Human anterior and frontal midline theta and lower alpha reflect emotionally positive state and internalized attention: high-resolution EEG investigation of meditation', Neuroscience Letters, Vol. 310, No. 1, pp.57-60.
2. Aftanas, L.I., Reva, N.V., Savotina, L. and Makhnev, V.P. (2006) 'Neurophysiological correlates of induced discrete emotions in humans: an individually oriented analysis', Neuroscience and Behavioral Physiology, Vol. 36, No. 2, pp.119-130.
3. Aftanas, L.I., Reva, N.V., Varlamov, A.A., Pavlov, S.V. and Makhnev, V.P. (2004) 'Analysis of evoked EEG synchronization and desynchronization in conditions of emotional activation in humans: temporal and topographic characteristics', Neuroscience and Behavioral Physiology, Vol. 34, No. 8, pp.859-867.
4. Aftanas, L.I., Varlamov, A.A., Pavlov, S.V., Makhnev, V.P. and Reva, N.V. (2001) 'Affective picture processing: event-related synchronization within individually defined human theta band is modulated by valence dimension', Neuroscience Letters, Vol. 303, No. 2, pp.115-118.
5. Aftanas, L.I., Varlamov, A.A., Pavlov, S.V., Makhnev, V.P. and Reva, N.V. (2002) 'Timedependent cortical asymmetries induced by emotional arousal: EEG analysis of event-related synchronization and desynchronization in individually defined frequency bands', Int. J. Psychophysiology, Vol. 44, No. 1, pp.67-82.
6. Allen, J., Coan, J.A. and Nazarian, M. (2004) 'Issues and assumptions on the road from raw signals to metrics of frontal EEG asymmetry in emotion', Biological Psychology, Vol. 67, Nos.1-2, pp.183-218.
7. Barry, R.J., Clarke, A.R., Johnstone, S.J. and Brown, C.R. (2009) 'EEG differences in children between eyes-closed and eyes-open resting conditions', Clinical Neurophysiology, Vol. 120, No. 10, pp.1806-1811.
8. Barry, R.J., Clarke, A.R., Johnstone, S.J., Magee, C.A. and Rushby, J.A. (2007) 'EEG differences between eyes-closed and eyes-open resting conditions', Clinical Neurophysiology, Vol. 118, No. 12, pp.2765-2773.
9. Benovoy, M., Cooperstock, J.R. and Deitcher, J. (2008) 'Biosignals analysis and its application in a performance setting', Proceedings of the International Conference on Bio-Inspired Systems and Signal Processing, pp.253-258.
10. Bradley, M.M. and Lang, P.J. (1994) 'Measuring emotion: The self-assessment manikin and the semantic differential', Journal of Behavior Therapy and Experimental Psychiatry, Vol. 25, No. 1, pp.49-59.
11. Cacioppo, J.T., Petty, R.E., Losch, M.E. and Kim, H.S. (1986) 'Electromyographic activity over facial muscle regions can differentiate the valence and intensity of affective reactions', Journal of Personality and Social Psychology, Vol. 50, No. 2, pp.260-268.
12. Chanel, G., Kierkels, J.J.M., Soleymani, M. and Pun, T. (2009) 'Short-term emotion assessment in a recall paradigm', Int. J. Human-Computer Studies, Vol. 67, No. 8, pp.607-627.
13. Chanel, G., Kronegg, J., Grandjean, D. and Pun, T. (2006) 'Emotion assessment: arousal evaluation using EEG's and peripheral physiological signals', Multimedia Content Representation, Classification and Security, Vol. 4105 of Lecture Notes in Computer Science, Berlin/Heidelberg: Springer, pp.530-537.
14. Chanel, G., Rebetez, C., Bétrancourt, M. and Pun, T. (2008) 'Boredom, engagement and anxiety as indicators for adaptation to difficulty in games', MindTrek: Proceedings of the 12th International Conference on Entertainment and Media in the Ubiquitous Era, ACM, New York, NY, USA, pp.13-17.
15. Codispoti, M., Bradley, M.M. and Lang, P.J. (2001) 'Affective reactions to briefly presented pictures', Psychophysiology, Vol. 38, No. 3, pp.474-478.
16. Davidson, R. J. (1992) 'Anterior cerebral asymmetry and the nature of emotion', Brain and Cognition, Vol. 20, No. 1, pp.125-151.
17. Demaree, H.A., Everhart, E.D., Youngstrom, E.A. and Harrison, D.W. (2005) 'Brain lateralization of emotional processing: historical roots and a future incorporating "dominance''', Behavioral and Cognitive Neuroscience Reviews, Vol. 4, No. 1, pp.3-20.
18. Diener, H. and Oertel, K. (2006) Experimental approach to affective interaction in games, Edutainment, Vol. 3942, pp.507-518.
19. Frazier, T.W., Strauss, M.E. and Steinhauer, S.R. (2004) 'Respiratory sinus arrhythmia as an index of emotional response in young adults', Psychophysiology, Vol. 41, No. 1, pp.75-83.
20. Heraz, A. and Frasson, C. (2007) 'Predicting the three major dimensions of the learner's emotions from brainwaves', World Academy of Science, Engineering and Technology (WASET), Vol. 31, pp.323-329.
21. Huster, R.J., Stevens, S., Gerlach, A.L. and Rist, F. (2009) 'A spectralanalytic approach to emotional responses evoked through picture presentation', Int. J. Psychophysiology, Vol. 72, No. 2, pp.212-216.
22. Keil, A., Müller, M.M., Gruber, T., Wienbruch, C., Stolarova, M. and Elbert, T. (2001) 'Effects of emotional arousal in the cerebral hemispheres: a study of oscillatory brain activity and event-related potentials', Clinical Neurophysiology, Vol. 112, No. 11, pp.2057-2068.
23. Khosrowabadi, R., Wahab, A., Ang, K.K. and Baniasad, M.H. (2009) 'Affective computation on EEG correlates of emotion from musical and vocal stimuli', IJCNN'09: Proceedings of the 2009 International Joint Conference on Neural Networks, pp.1590-1594.
24. Kim, J. and André, E. (2008) 'Emotion recognition based on physiological changes in music listening', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, No. 12, pp.2067-2083.
25. Klados, M.A., Frantzidis, C., Vivas, A.B., Papadelis, C., Lithari, C., Pappas, C. and Bamidis, P.D. (2009) 'A framework combining delta event-related oscillations (EROs) and synchronisation effects (ERD/ERS) to study emotional processing', Computational Intelligence and Neuroscience, Vol. 2009, Article ID 549419.
26. Klein, J., Moon, Y. and Picard, R.W. (2002) 'This computer responds to user frustration: theory, design, and results', Interacting with Computers, Vol. 14, pp.119-140.
27. Ko, K., Yang, H. and Sim, K. (2009) 'Emotion recognition using EEG signals with relative power values and bayesian network', Int. J. Control, Automation and Systems, Vol. 7, No. 5, pp.865-870.
28. Krause, C., Viemeröc, V., Rosenqvista, A., Sillanmäkia, L. and Aström, T. (2000) 'Relative electroencephalographic desynchronization and synchronization in humans to emotional film content: an analysis of the 4-6, 6-8, 8-10 and 10-12 Hz frequency bands', Neuroscience Letters, Vol. 286, No. 1, pp.9-12.
29. Kreibig, S.D., Wilhelm, F.H., Roth, W.T. and Gross, J.J. (2007) 'Cardiovascular, electrodermal, and respiratory response patterns to fear-and sadness-inducing films', Psychophysiology, Vol. 44, No. 5, pp.787-806.
30. Lang, P.J., Greenwald, M.K., Bradley, M.M. and Hamm, A.O. (1993) 'Looking at pictures: affective, facial, visceral, and behavioral reactions', Psychophysiology, Vol. 30, No. 3, pp.261-273.
31. Lazar, N.A., Luna, B., Sweeney, J.A. and Eddy,W.F. (2002) 'Combining brains: a survey of methods for statistical pooling of information', NeuroImage, Vol. 16, pp.538-550.
32. Lin, Y.P., Wang, C.H., Wu, T.L., Jeng, S.K. and Chen, J.H. (2009) 'EEG-based emotion recognition in music listening: a comparison of schemes for multiclass support vector machine', Proceedings of the IEEE International Conference on Acoustics Speech and Signal Processing, pp.489-492.
33. Liu, C., Agrawal, P., Sarkar, N. and Chen, S. (2009) 'Dynamic difficulty adjustment in computer games through real-time anxiety-based affective feedback', Int. J. Human-Computer Interaction, Vol. 25, No. 6, pp.506-529.
34. Loughin, T.M. (2004) 'A systematic comparison of methods for combiningp-values fromindependent tests', Computational Statistics and Data Analysis, Vol. 47, pp.467-485.
35. Magnée, M.J., Stekelenburg, J.J., Kemner, C. and de Gelder, B. (2007) 'Similar facial electromyographic responses to faces, voices, and body expressions', Neuroreport, Vol. 18, No. 4, pp.369-372.
36. Mandryk, R.L., Inkpen, K.M. and Calvert, T.W. (2006) 'Using psychophysiological techniques to measure user experience with entertainment technologies', Behaviour and Information Technology, Vol. 25, No. 2, pp.141-158.
37. Marosi, E., Bazán, O., Yañez, G., Bernal, J., Fernández, T., Rodríguez, M., Silva, J. and Reyes, A. (2002) 'Narrow-band spectral measurements of EEG during emotional tasks', Int. J. Neuroscience, Vol. 112, No. 7, pp.871-891.
38. Müller, M.M., Keil, A., Gruber, T. and Elbert, T. (1999) 'Processing of affective pictures modulates right-hemispheric gamma band EEG activity', Clinical Neurophysiology, Vol. 110, No. 11, pp.1913-1920.
39. Murugappan, M., Rizon, M., Nagarajan, R., Yaacob, S., Hazry, D. and Zunaidi, I. (2008) 'Timefrequency analysis of EEG signals for human emotion detection', 4th Kuala Lumpur International Conference on Biomedical Engineering 2008, Vol. 21, pp.262-265.
40. Pfurtscheller, G. (1999) 'Event-related EEG/MEG synchronization and desynchronization: basic principles', Clinical Neurophysiology, Vol. 110, No. 11, pp.1842-1857.
41. Picard, R.W. (1997) Affective Computing. Cambridge, Massachusetts/London, England: The MIT Press.
42. Picard, R.W., Vyzas, E. and Healey, J. (2001) 'Toward machine emotional intelligence: analysis of affective physiological state', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 10, pp.1175-1191.
43. Rainville, P., Bechara, A., Naqvi, N. and Damasio, A.R. (2006) 'Basic emotions are associated with distinct patterns of cardiorespiratory activity', Int. J. Psychophysiology, Vol. 61, No. 1, pp.5-18.
44. Reuderink, B., Nijholt, A. and Poel, M. (2009) 'Affective Pacman: a frustrating game for braincomputer interface experiments', Proceedings of the 3rd International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN 2009), Vol. 9 of Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, pp.221-227.
45. Rizon, M., Murugappan, M., Nagarajan, R. and Yaacob, S. (2008) 'Asymmetric ratio and FCM based salient channel selection for human emotion detection using EEG', WSEAS Transactions on Signal Processing, Vol. 4, No. 10, pp.596-603.
46. Russell, J.A. (1980) 'A circumplex model of affect', Journal of Personality and Social Psychology, Vol. 39, No. 6, pp.1161-1178.
47. Salminen, M. and Ravaja, N. (2007) 'Oscillatory brain responses evoked by video game events: the case of super monkey ball 2', CyberPsychology and Behavior, Vol. 10, No. 3, pp.330-338.
48. Salminen, M. and Ravaja, N. (2008) 'Increased oscillatory theta activation evoked by violent digital game events', Neuroscience Letters, Vol. 435, No. 1, pp.69-72.
49. Sammler, D., Grigutsch, M., Fritz, T. and Koelsch, S. (2007) 'Music and emotion: electrophysiological correlates of the processing of pleasant and unpleasant music', Psychophysiology, Vol. 44, No. 2, pp.293-304.
50. Sander, D., Grandjean, D. and Scherer, K.R. (2005) 'A systems approach to appraisal mechanisms in emotion', Neural Networks, Vol. 18, No. 4, pp.317-352.
51. Scheirer, J., Fernandez, R., Klein, J. and Picard, R.W. (2002) 'Frustrating the user on purpose: a step toward building an affective computer', Interacting with Computers, Vol. 14, pp.93-118.
52. Schlögl, A., Keinrath, C., Zimmermann, D., Scherer, R., Leeb, R. and Pfurtscheller, G. (2007) 'A fully automated correction method of EOG artifacts in EEG recordings', Clinical Neurophysiology, Vol. 118, pp.98-104.
53. Schmidt, L.A. and Trainor, L.J. (2001) 'Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions', Cognition and Emotion, pp.487-500.
54. Silberman, E. andWeingartner, H. (1986) 'Hemispheric lateralization of functions related to emotion', Brain and Cognition, Vol. 5, No. 3, pp.322-353.
55. Spiridon, E. and Fairclough, S.H. (2009) 'Detection of anger with and without control for affective computing systems', Proceedings of the Conference of Affective Computing and Intelligent Interaction, pp.90-95.
56. Takahashi, K. (2004) 'Remarks on SVM-based emotion recognition from multi-modal biopotential signals', Proceedings of the 13th IEEE International Workshop on Robot and Human Interactive Communication, RO-MAN 2004, pp.95-100.
57. Tucker, D.M. (1981) 'Lateral brain function, emotion, and conceptualization', Psychological bulletin, Vol. 89, No. 1, pp.19-46.
58. Zeng, Z., Pantic, M., Roisman, G.I. and Huang, T.S. (2007) 'A survey of affect recognition methods: audio, visual and spontaneous expressions', ICME'07: Proceedings of the 9th International Conference on Multimodal Interfaces, pp.126-133.