DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses

IEEE Transactions on Affective Computing

Volumn 6, Issue 3, 2015, Pages 209-222

  Abadi, Mojtaba Khomami ^a,b   Subramanian, Ramanathan ^c   Kia, Seyed Mostafa ^d   Avesani, Paolo ^d   Patras, Ioannis ^e   Sebe, Nicu ^a  

^a UNIVERSITY OF TRENTO   (Italy)

^b TELECOM ITALIA   (Italy)

^c UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^d FONDAZIONE BRUNO KESSLER   (Italy)

^e QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Affective computing; Emotion recognition; MEG; Single trial classification; User physiological responses

Indexed keywords

CLASSIFICATION (OF INFORMATION); DECODING; ELECTROCARDIOGRAPHY; HUMAN COMPUTER INTERACTION; MOTION PICTURES; PHYSIOLOGY;

AFFECTIVE COMPUTING; EMOTION RECOGNITION; MAGNETOENCEPHALOGRAM (MEG); MULTIMEDIA CONTENTS; MULTIMODAL DATABASE; PERFORMANCE EVALUATIONS; PHYSIOLOGICAL RESPONSE; SINGLE-TRIAL CLASSIFICATIONS;

PHYSIOLOGICAL MODELS;

EID: 84940987310     PISSN: None     EISSN: 19493045     Source Type: Journal    
DOI: 10.1109/TAFFC.2015.2392932     Document Type: Article

References (35)

1. M. K. Abadi, S. M. Kia, R. Subramanian, P. Avesani, and N. Sebe, "User-centric affective video tagging from MEG and peripheral physiological responses," in Proc. Humaine Assoc. Conf. Affective Comput. Intell. Interaction, 2013, pp. 582-587
2. E. E. Bartolini, "Eliciting emotion with film: Development of a stimulus set," Master's thesis, Wesleyan University, Connecticut, USA, 2001
3. Y. Benjamini and Y. Hochberg, "Controlling the false discovery rate:A practical and powerful approach to multiple testing," J. Roy. Stat. Soc. . Series B (Methodological), vol. 57, no. 1, pp. 289-300, 1995
4. M. Bradley, "Emotional memory: A dimensional analysis," in Emotions: Essays on Emotion Theory. Lawrence Erlbaum, Hillsdale, NJ, 1994
5. L. Chen, S. Gunduz, and M. T. Ozsu, "Mixed type audio classification with support vector machine," in Proc. IEEE Int. Conf. Multimedia Expo, 2006, pp. 781-784
6. R. Cowie, G. McKeown, and E. Douglas-Cowie, "Tracing emotion: An overview," Int. J. Synthetic Emotions, vol. 3, no. 1, pp. 1-17, 2012
7. B. Furht, Ed., Encyclopedia of Multimedia. New York, NY, USA: Springer, 2006
8. M. K. Greenwald, E. W. Cook, and P. J. Lang, "Affective judgement and psychophysiological response: Dimensional covariation in the evaluation of pictorial stimuli," J. Psychophysiology, vol. 3, pp. 51-64, 1989
9. J. J. Gross and R. W. Levenson, "Emotion elicitation using films," Cognition Emotion, vol. 9, no. 1, pp. 87-108, 1995
10. A. Hanjalic and L.-Q. Xu, "Affective video content representation and modeling," IEEE Trans. Multimedia, vol. 7, no. 1, pp. 143-154, Feb. 2005
11. U. Hasson, R. Malach, and D. J. Heeger, "Reliability of cortical activity during natural stimulation," Trends Cognitive Sci., vol. 14, no. 1, pp. 40-48, 2010
12. H. Joho, J. Staiano, N. Sebe, and J. M. Jose, "Looking at the viewer: Analysing facial activity to detect personal highlights of multimedia contents," Multimedia Tools Appl., vol. 51, no. 2, pp. 505-523, 2011
13. S. M. Kia, E. Olivetti, and P. Avesani, "Discrete cosine transform for MEG signal decoding," in Proc. Int. Workshop Pattern Recognit. Neuroimaging, 2013, pp. 132-135
14. J. Kim and E. Andre, "Emotion recognition based on physiological changes in music listening," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 12, pp. 2067-2083, Dec. 2008
15. S. Koelstra, C. Muhl, M. Soleymani, J.-S. Lee, A. Yazdani, T. Ebrahimi, T. Pun, A. Nijholt, and I. Patras, "DEAP: A database for emotion analysis using physiological signals," IEEE Trans. Affective Comput., vol. 3, no. 1, pp. 18-31, Jan.-Mar. 2012
16. S. Koelstra and I. Patras, "Fusion of facial expressions and eeg for implicit affective tagging," Image Vis. Comput., vol. 31, no. 2, pp. 164-174, 2013
17. P. Lang, M. Bradley, and B. Cuthbert, "IAPS: Affective ratings of pictures and instruction manual," Univ. of Florida, Gainesville, FL, Tech. Rep. A-8, 2008
18. N. A. Lazar, B. Luna, J. A. Sweeney, and W. F. Eddy, "Combining brains: A survey of methods for statistical pooling of information," Neuroimage, vol. 16, no. 2, pp. 538-550, 2002
19. C. Leys, C. Ley, O. Klein, P. Bernard, and L. Licata, "Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median," J. Exp. Soc. Psychol., vol. 49, no. 4, pp. 764-766, 2013
20. D. Li, I. K. Sethi, N. Dimitrova, and T. McGee, "Classification of general audio data for content-based retrieval," Pattern Recognit. Lett., vol. 22, no. 5, pp. 533-544, 2001
21. C. L. Lisetti and F. Nasoz, "Using noninvasive wearable computers to recognize human emotions from physiological signals," EURASIP J. Adv. Signal Process., vol. 2004, no. 11, pp. 1672-1687, 2004
22. B. D. Lucas, and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. Int. Joint Conf. Artif. Intell., 1981, pp. 674-679
23. P. Mitra and B. Pesaran, "Analysis of dynamic brain imaging data," Biophys. J., vol. 76, no. 2, pp. 691-708, 1999
24. E. Mower, M. J. Mataric, and S. Narayanan, "Human perception of audio-visual synthetic character emotion expression in the presence of ambiguous and conflicting information," IEEE Trans. Multimedia, vol. 11, no. 5, pp. 843-855, Aug. 2009
25. R. Oostenveld, P. Fries, E. Maris, and J.-M. Schoffelen, "Fieldtrip: Open source software for advanced analysis of meg, eeg, and invasive electrophysiological data," Comput. Intell. Neuroscience, vol. 2011, pp. 1:1-1:9, Jan. 2011
26. P.-Y. Oudeyer, "The production and recognition of emotions in speech: Features and algorithms," Int. J. Human Comput. Interaction, vol. 59, nos. 1-2, pp. 157-183, 2003
27. J. Schwarzbach, "A simple framework (asf) for behavioral and neuroimaging experiments based on the psychophysics toolbox for matlab," Behav. Res. Meth., vol. 43, no. 4, pp. 1194-1201, 2011
28. N. Sebe, M. S. Lew, I. Cohen, Y. Sun, T. Gevers, and T. S. Huang, "Authentic facial expression analysis," Image and Vis. Comput., vol. 25, no. 12, pp. 1856-1863, 2007
29. R. Sinha and O. A. Parsons, "Multivariate response patterning of fear and anger," Cognition Emotion, vol. 10, no. 2, pp. 173-198, 1996
30. D. M. Sloan, "Emotion regulation in action: Emotional reactivity in experiential avoidance," Behav. Res. Therapy, vol. 42, no. 11, pp. 1257-1270, 2004
31. M. Soleymani, J. Lichtenauer, T. Pun, and M. Pantic, "A multimodal database for affect recognition and implicit tagging," IEEE Trans. Affective Comput., vol. 3, no. 1, pp. 42-55, Jan.-Mar. 2012
32. H. L. Wang, and L.-F. Cheong, "Affective understanding in film," IEEE Trans. Circ. Syst. Video Technol., vol. 16, no. 6, pp. 689-704, Jun. 2006
33. J. Wijsman, B. Grundlehner, J. Penders, and H. Hermens, "Trapezius muscle emg as predictor of mental stress," in Proc. Wireless Health, 2010, pp. 155-163
34. Y. Yan, E. Ricci, R. Subramanian, G. Liu, and N. Sebe, "Multi-task linear discriminant analysis for view invariant action recognition," IEEE Trans. Image Process., vol. 23, no. 12, pp. 5599-5611, Dec. 2014
35. J. Zhou, J. Chen, and J. Ye, "MALSAR: Multi-tAsk Learning via StructurAl Regularization," Arizona State University, 2011.