Affective characterization of movie scenes based on multimedia content analysis and user's physiological emotional responses

Proceedings - 10th IEEE International Symposium on Multimedia, ISM 2008

Volumn , Issue , 2008, Pages 228-235

  Soleymani, Mohammad ^a   Chanel, Guillaume ^a   Kierkels, Joep J M ^a   Pun, Thierry ^a  

^a UNIVERSITY OF GENEVA   (Switzerland)

Author keywords

Affective computing; Affective personalization and characterization; Emotion recognition and assessment; Multimedia indexing and retrieval; Physiological signals analysis

Indexed keywords

FACE RECOGNITION; FELT; INDEXING (OF INFORMATION); MOTION PICTURES; VISUAL COMMUNICATION;

AFFECTIVE COMPUTING; AFFECTIVE PERSONALIZATION AND CHARACTERIZATION; EMOTION RECOGNITION AND ASSESSMENT; MULTIMEDIA INDEXING AND RETRIEVAL; PHYSIOLOGICAL SIGNALS ANALYSIS;

PHYSIOLOGICAL MODELS;

EID: 62949123026     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISM.2008.14     Document Type: Conference Paper

References (28)

1. A. Hanjalic and L. Q. Xu, "Affective video content representation and modeling," IEEE Trans. on Multimedia, vol. 7, no. 1, pp. 143-154, 2005.
2. R.W.Picard and S.B.Daily, "Evaluating Affective Interactions: Alternatives to Asking What Users Feel,", CHI Workshop on Evaluating Affective Interfaces: Innovative Approaches Portland: Apr.2005.
3. K. Boehner, R. DePaula, P. Dourish, and P. Sengers, "How emotion is made and measured," Int. J. of Human Computer Studies, vol. 65, no. 4, pp. 275-291, Apr.2007.
4. H. L. Wang and L. F. Cheong, "Affective understanding in film," IEEE Transactions on Circuits and Systems for Video Technology, vol. 16, no. 6, pp. 689-704, June2006.
5. J. A. Russell and A. Mehrabian, "Evidence for A 3-Factor Theory of Emotions," J. of Research in Personality, vol. 11, no. 3, pp. 273-294, 1977.
6. A.Benoit, L.Bonnaud, A.Caplier, P.Ngo, L.Lawson, D.Trevisan, V.Levacik, C.Mancas, and G.Chanel, "Multimodal Focus Attention and Stress Detection and Feedback in an Augmented Driver Simulator,", 3rd IFIP Conf. Artif. Intell. Applicat & Innov., Athens, Greece: 2006.
7. J.A. Healey, "Wearable and Automotive Systems for Affect Recognition from Physiology.", Massachusetts Institute of Technology, May 2000.
8. G. Chanel, J. Kronegg, D. Grandjean, and T. Pun, "Emotion assessment: Arousal evaluation using EEG's and peripheral physiological signals,", Springer LNCS, vol. 4105, pp 530-537, Sept. 2006.
9. G. Chanel, K. Ansari-Asl, and T. Pun, "Valence-arousal evaluation using physiological signals in an emotion recall paradigm,", IEEE SMC Montreal, Oct. 2007.
10. K. Ansari-Asl, G. Chanel, and T. Pun, "A channel selection method for EEG classification in emotion assessment based on synchronization likelihood,", Eusipco 2007, Poznan, Poland, Sept. 2007.
11. K. Takahashi, "Remarks on Emotion Recognition from Bio-Potential Signals,", 2nd Conference on Autonomous Robots and Agents, New Zealand, Dec. 2004.
12. J. A.Russel, M. Lewicka, and T. Niit, "A Cross-Cultural Study of a Circumplex Model of Affect," J. of Personality and Social Psychology, vol. 57, no. 5, 1989.
13. J. D. Morris, "Observations: SAM: The self-assessment manikin - An efficient cross-cultural measurement of emotional response," J. of Advertising Research, vol. 35, no. 6, pp. 63-68, 1995.
14. J.Rottenberg, R.D.Ray, and J.J.Gross, "Emotion elicitation using films," in The handbook of emotion elicitation and assessment. A.Coan and J.J.B.Allen, Eds. London: Oxford University Press, 2007.
15. R. W.Picard, Affective computing The MIT press, 1997.
16. D. G. Li, I. K. Sethi, N. Dimitrova, and T. Mcgee, "Classification of general audio data for content-based retrieval," Pattern Recognition Letters, vol. 22, no. 5, pp. 533-544, 2001.
17. L. Lu, H. Jiang, and H. Zhang, "A Robust Audio Classification and Segmentation Method,", ACM int. conf. on Mult., pp. 203-211, Sept. 2001.
18. P. Boersma and D. Weenink, "Praat: doing phonetics by computer," computer program, 2008.
19. B. Janvier, E. Bruno, T. Pun, and S. Marchand-Maillet, "Information-theoretic temporal segmentation of videos and applications: multiscale keyframe selection and transition detection," Mult. Tools and Ap., vol. 30, pp. 273-288, 2006.
20. N. Moënne-Loccoz, "OVAL: an object-based video access library to facilitate the development of content-based video retrieval systems," Viper group, Computer Vision and Multimedia Laboratory, Univ. of Geneva, 03.04, 2004.
21. C. Lei, S. Gunduz, and M. T. Ozsu, "Mixed Type Audio Classification with Support Vector Machine,", IEEE Multimedia and Expo, pp. 781-784, July 2006.
22. Z. Rasheed, Y. Sheikh, and M. Shah, "On the use of computable features for film classification," IEEE Trans. on Circuits and Systems for Video Technology, vol. 15, no. 1, pp. 52-64, Jan. 2005.
23. P. J. Lang, M. K. Greenwald, M. M. Bradley, and A. O. Hamm, "Looking at Pictures - Affective, Facial, Visceral, and Behavioral Reactions," Psychophysiology, vol. 30, no. 3, pp. 261-273, 1993.
24. P. Rainville, A. Bechara, N. Naqvi, and A. R. Damasio, "Basic emotions are associated with distinct patterns of cardiorespiratory activity," Int. J. of Psychophysiology, vol. 61, no. 1, pp. 5-18, 2006.
25. J. Kim, "Emotion Recognition from Physiological Measurement,", Humaine European Network of Excellence Workshop Santorini, Greece: Sept. 2004.
26. G.-B.Duchenne de Boulogne and R.Andrew Cuthbertson, The Mechanism of Human Facial Expression Cambridge University Press, 1990.
27. F. H. Kanfer, "Verbal Rate, Eyeblink, and Content in Structured Psychiatric Interviews," J. of Abnormal and Social Psychology, vol. 61, no. 3, pp. 341-347, 1960.
28. M. E. Tipping, "Sparse Bayesian learning and the relevance vector machine," J. of Machine Learning Research, vol. 1, no. 3, pp. 211-244, 2001.