Affective characterization of movie scenes based on content analysis and physiological changes

International Journal of Semantic Computing

Volumn 3, Issue 2, 2009, Pages 235-254

  Soleymani, Mohammad ^a   Chanel, Guillaume ^a   Kierkels, Joep J M ^a   Pun, Thierry ^a  

^a UNIVERSITY OF GENEVA   (Switzerland)

Author keywords

affective computing; affective personalization and characterization; emotion recognition and assessment; Multimedia indexing and retrieval; physiological signals analysis

Indexed keywords

FELT; INDEXING (OF INFORMATION); MOTION PICTURES; PHYSIOLOGICAL MODELS; PHYSIOLOGY;

AFFECTIVE COMPUTING; EMOTION RECOGNITION; MULTIMEDIA INDEXING AND RETRIEVAL; PERSONALIZATIONS; PHYSIOLOGICAL SIGNALS;

ANALYSIS OF VARIANCE (ANOVA);

EID: 78649311783     PISSN: 1793351X     EISSN: 17937108     Source Type: Journal    
DOI: 10.1142/S1793351X09000744     Document Type: Article

References (33)

1. A. Hanjalic and L. Q. Xu, Affective video content representation and modeling, IEEE Transactions. on Multimedia, 7(1) (2005) 143-154.
2. R. W.Picard and S. B. Daily, Evaluating affective interactions: Alternatives to asking what users feel, CHI Workshop on Evaluating Affective Interfaces: Innovative Approaches, Portland, Oregon, April 2005.
3. K. Boehner, R. DePaula, P. Dourish and P. Sengers, How emotion is made and measured, Int. Jounal of Human-Computer Studies 65(4) (2007) 275-291.
4. H. L. Wang and L. F. Cheong, Affective understanding in film, IEEE Transactions on Circuits and Systems for Video Technology 16(6) (2006) 689-704.
5. M. Xu, J. S. Jin, S. Luo and L. Duan, Hierarchical movie affective content analysis based on arousal and valence features, Proceedings of the 16th ACM International Conference on Multimedia ACM, Vancouver, Canada, October 2008, pp. 677-680.
6. S. Zhang, Q. Tian, S. Jiang, Q. Huang and W. Gao, Affective MTV analysis based on arousal and valence features, IEEE International Conference on Multimedia and Expo, Hannover, Germany, 2008, pp. 1369-1372.
7. T. L. Wu, H. K. Wang, C. C. Ho, Y. P. Lin, T. T. Hu, M. F. Weng, L. W Chan, C. H. Yang, Y. H. Yang, Y. P. Hung, Y. Y. Chuang, H. H. Chen, H. H. Chen, J. H. Chen and S. K. Jeng, Interactive content presentation based on expressed emotion and physiological feedback, Proceedings of the 16th ACM International Conference on Multimedia ACM, Vancouver, Canada, October 2008, pp. 1009-1010.
8. J. A. Russell and A. Mehrabian, Evidence for a 3-factor theory of emotions, Journal of Research in Personality 11(3) (1977) 273-294.
9. A. Benoit, L. Bonnaud, A. Caplier, P. Ngo, L. Lawson, D. Trevisan, V. Levacik, C. Mancas and G. Chanel, Multimodal focus attention and stress detection and feedback in an augmented driver simulator, 3rd IFIP Conference on Artificial Intelligence Applications & Innovations, Athens, Greece, 2006.
10. J. A. Healey, Wearable and Automotive Systems for Affect Recognition from Physiology, MIT, May 2000.
11. G. Chanel, J. Kronegg, D. Grandjean and T. Pun, Emotion assessment: Arousal evaluation using EEG's and peripheral physiological signals, LNCS 4105, September 2006, pp. 530-537.
12. G. Chanel, K. Ansari-Asl and T. Pun, Valence-arousal evaluation using physiological signals in an emotion recall paradigm, IEEE Conference on System, Man, and Cybernetics, Montreal, October 2007.
13. K. Ansari-Asl, G. Chanel and T. Pun, A channel selection method for EEG classification in emotion assessment based on synchronization likelihood, Proceedings of the European Signal Processing Conference, Poznan, Poland, Sept. 2007.
14. K. Takahashi, Remarks on emotion recognition from bio-potential signals, 2nd Conference on Autonomous Robots and Agents, New Zealand, Dec. 2004.
15. J. A. Russel, M. Lewicka and T. Niit, A cross-cultural study of a circumplex model of affect, Journal of Personality and Social Psychology 57(5) (1989).
16. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. S. Kollias, W. Fellenz and J. G. Taylor, Emotion recognition in human-computer interaction, IEEE Signal Processing Magazine 18(1) (2001) 32-80.
17. J. D. Morris, Observations: SAM: The self-assessment manikin-An efficient crosscultural measurement of emotional response, Journal of Advertising Research 35(6) (1995) 63-68.
18. R. W. Picard, Affective Computing (MIT Press, 1997).
19. D. G. Li, I. K. Sethi, N. Dimitrova and T. Mcgee, Classification of general audio data for content-based retrieval, Pattern Recognition Letters 22(5) (2001) 533-544.
20. L. Lu, H. Jiang and H. Zhang, A robust audio classification and segmentation method, Proceeding of the Ninth ACM International Conference on Multimedia, September 2001, pp. 203-211.
21. P. Boersma and D. Weenink, Praat: Doing Phonetics by Computer, Computer Program, 2008.
22. C. Lei, S. Gunduz and M. T. Ozsu, Mixed type audio classification with support vector machine, IEEE Multimedia and Expo, July 2006, pp. 781-784.
23. B. Janvier, E. Bruno, T. Pun and S. Marchand-Maillet, Information-theoretic temporal segmentation of videos and applications: Multiscale keyframe selection and transition detection, Multimedia Tools and Applications 30 (2006) 273-288.
24. N. Moenne-Loccoz, OVAL: An object-based video access library to facilitate the development of content-based video retrieval systems, Viper group, Computer Vision and Multimedia Laboratory, Univ. of Geneva, April 2004.
25. Z. Rasheed, Y. Sheikh and M. Shah, On the use of computable features for film classification, IEEE Transactions on Circuits and Systems for Video Technology 15(1) (2005) 52-64.
26. P. J. Lang, M. K. Greenwald, M. M. Bradley and A.O. Hamm, Looking at pictures-Affective, facial, visceral, and behavioral reactions, Psychophysiology 30(3) (1993) 261-273.
27. P. Rainville, A. Bechara, N. Naqvi and A. R. Damasio, Basic emotions are associated with distinct patterns of cardiorespiratory activity, International Journal of Psychophysiology 61(1) (2006) 5-18.
28. J. Kim and E. Andre, Emotion recognition based on physiological changes in music listening, IEEE Transactions on Pattern Analysis and Machine Vision 30(12) (2008) 2067-2083.
29. R. A. Mcfarland, Relationship of skin temperature-changes to the emotions accompanying music, Biofeedback and Self-Regulation 10(3) (1985) 255-267.
30. G.-B. Duchenne de Boulogne and R. Andrew Cuthbertson, The Mechanism of Human Facial Expression (Cambridge University Press, 1990).
31. F. H. Kanfer, Verbal rate, eyeblink, and content in structured psychiatric interviews, Journal of Abnormal and Social Psychology 61(3) (1960) 341-347.
32. J. Rottenberg, R. D. Ray and J. J. Gross, Emotion elicitation using films, in the handbook of emotion elicitation and assessment, A. Coan and J. J. B. Allen eds. (Oxford University Press, London, 2007).
33. M. E. Tipping, Sparse Bayesian learning and the relevance vector machine, Journal of Machine Learning Research 1(3) (2001) 211-244.