Multi-modal affect induction for affective brain-computer interfaces

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6974 LNCS, Issue PART 1, 2011, Pages 235-245

  Mühl, Christian ^a   Van Den Broek, Egon L ^a,c,d   Brouwer, Anne Marie ^b   Nijboer, Femke ^a   Van Wouwe, Nelleke ^b   Heylen, Dirk ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

^b TNO   (Netherlands)

^c Human Centered Computing Consultancy   (Austria)

^d RADBOUD UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

affective brain computer interfaces; auditory; ECG; EEG; emotion; multi modal; visual

Indexed keywords

AFFECTIVE BRAIN-COMPUTER INTERFACES; AUDITORY; EMOTION; MULTI-MODAL; VISUAL;

ELECTROCARDIOGRAPHY; ELECTROCHROMIC DEVICES; HUMAN COMPUTER INTERACTION; INTELLIGENT COMPUTING; INTERFACES (COMPUTER); PHYSIOLOGICAL MODELS;

BRAIN COMPUTER INTERFACE;

EID: 80054842643     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-24600-5_27     Document Type: Conference Paper

References (27)

1. Aftanas, L.I., Reva, N.V., Varlamov, A.A., Pavlov, S.V., Makhnev, V.P.: Analysis of evoked eeg synchronization and desynchronization in conditions of emotional activation in humans: temporal and topographic characteristics. Neuroscience and Behavioral Physiology 34(8), 859-867 (2004)
2. Baumgartner, T., Esslen, M., Jancke, L.: From emotion perception to emotion experience: Emotions evoked by pictures and classical music. International Journal of Psychophysiology 60(1), 34-43 (2006)
3. Bradley, M.M., Lang, P.J.: Affective reactions to acoustic stimuli. Psychophysiology 37(2), 204-215 (2000)
4. Bradley, M.M., Lang, P.J.: The international affective digitized sounds (IADS-2): Affective ratings of sounds and instruction manual. Technical report, University of Florida, Center for Research in Psychophysiology, Gainesville, Fl, USA (2007)
5. Brefczynski-Lewis, J., Lowitszch, S., Parsons, M., Lemieux, S., Puce, A.: Audiovisual non-verbal dynamic faces elicit converging fMRI and ERP responses. Brain Topography 21(3-4), 193-206 (2009)
6. Codispoti, M., Ferrari, V., Bradley, M.M.: Repetitive picture processing: autonomic and cortical correlates. Brain Research 1068(1), 213-220 (2006)
7. Ethofer, T., Van De Ville, D., Scherer, K., Vuilleumier, P.: Decoding of emotional information in voice-sensitive cortices. Current Biology 19(12), 1028-1033 (2009)
8. Grandjean, D., Sander, D., Pourtois, G., Schwartz, S., Seghier, M.L., Scherer, K., Vuilleumier, P.: The voices of wrath: brain responses to angry prosody in meaningless speech. Nature Neuroscience 8(2), 145-146 (2005)
9. Guntekin, B., Basar, E.: Emotional face expressions are differentiated with brain oscillations. International Journal of Psychophysiology 64(1), 91-100 (2007)
10. Hadjikhani, N., de Gelder, B.: Seeing fearful body expressions activates the fusiform cortex and amygdala. Current Biology 13(24), 2201-2205 (2003)
11. Hajcak, G., MacNamara, A., Olvet, D.M.: Event-related potentials, emotion, and emotion regulation: An integrative review. Developmental Neuropsychology 35(2), 129-155 (2010)
12. Hari, R., Salmelin, R., Makela, J.P., Salenius, S., Helle, M.: MEG cortical rhythms. International Journal of Psychophysiology 26, 51-62 (1997)
13. Jensen, O., Mazaheri, A.: Shaping functional architecture by oscillatory alpha activity: gating by inhibition. Frontiers in Human Neuroscience 4 (2010)
14. Kim, J., André, E.: Emotion recognition based on physiological changes in music listening. IEEE Transactions on Pattern Analysis and Machine Intelligence 30(12), 2067-2083 (2008)
15. Kober, H., Feldman Barrett, L., Joseph, J., Bliss-Moreau, E., Lindquist, K.,Wager, T.D.: Functional grouping and cortical-subcortical interactions in emotion: a metaanalysis of neuroimaging studies. NeuroImage 42(2), 998-1031 (2008)
16. Krause, C.M.: Cognition- and memory-related erd/ers responses in the auditory stimulus modality. Progress in brain research 159, 197-207 (2006)
17. Lang, P.J., Bradley, M.M., Cuthbert, B.N.: International affective picture system (IAPS): Technical manual and affective ratings. Technical report, University of Florida, Center for Research in Psychophysiology, Gainesville, Fl, USA (1999)
18. Näätänena, R., Paavilainen, P., Rinne, T., Alho, K.: The mismatch negativity (MMN) in basic research of central auditory processing: A review. Clinical Neurophysiology 118(12), 2544-2590 (2007)
19. Panksepp, J., Bernatzky, G.: Emotional sounds and the brain: the neuro-affective foundations of musical appreciation. Behavioral Processes 60, 133-155 (2002)
20. Pfurtscheller, G., Lopes da Silva, F.H.: Event-related EEG/MEG synchronization and desynchronization: basic principles. Clinical Neurophysiology 110(11), 1842- 1857 (1999)
21. Picard, R.W.: Affective Computing. The MIT Press, Cambridge (1997)
22. Pourtois, G., Vuilleumier, P.: Dynamics of emotional effects on spatial attention in the human visual cortex. Progress in Brain Research, vol. 156, pp. 67-91. Elsevier, Amsterdam (2006)
23. Sabatinelli, D., Lang, P.J., Keil, A., Bradley, M.M.: Emotional perception: Correlation of functional MRI and event-related potentials. Cerebral Cortex 17(5), 1085-1091 (2007)
24. Sander, D., Grandjean, D., Scherer, K.R.: A systems approach to appraisal mechanisms in emotion. Neural Networks 18(4), 317-352 (2005)
25. Vuilleumier, P.: How brains beware: neural mechanisms of emotional attention. Trends in Cognitive Sciences 9(12), 585-594 (2005)
26. Wang, J., Nicol, T., Skoe, E., Sams, M., Kraus, N.: Emotion modulates early auditory response to speech. Journal of Cognitive Neuroscience 21(11), 2121-2128 (2009)
27. Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(1), 39-58 (2009)