Affective ranking of movie scenes using physiological signals and content analysis

MM 2008 - Proceedings of the 2008 ACM International Conference on Multimedia, with Co-located Symposium and Workshops: MS 2008

Volumn , Issue , 2008, Pages 32-39

  Soleymani, Mohammad ^a   Chanel, Guillaume ^a   Kierkels, Joep J M ^a   Pun, Thierry ^a  

^a UNIVERSITY OF GENEVA   (Switzerland)

Author keywords

Affective computing; Affective personalization and ranking; Emotion recognition and assessment; Multimedia indexing and retrieval; Physiological signals

Indexed keywords

BLOOD PRESSURE; FELT; FELTS; INDEXING (OF INFORMATION); MOTION PICTURES; SEMANTICS; VIDEO CAMERAS;

AFFECTIVE COMPUTING; EMOTION RECOGNITION; MULTIMEDIA INDEXING AND RETRIEVAL; PERSONALIZATIONS; PHYSIOLOGICAL SIGNALS;

PHYSIOLOGICAL MODELS;

EID: 84928230430     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1460676.1460684     Document Type: Conference Paper

References (33)

1. K. Ansari-Asl, G. Chanel, and T. Pun, A channel selection method for EEG classification in emotion assessment based on synchronization likelihood, In Eusipco 2007, 15th Eur. Signal Proc. Conf., Poznan, Poland, September 2007.
2. A. Benoit, L. Bonnaud, A. Caplier, P. Ngo, L. Lawson, D. Trevisan, V. Levacik, C. Mancas, and G. Chanel, Multimodal focus attention and stress detection and feedback in an augmented driver simulator, In 3rd IFIP Conference on Artificial Intelligence Applications & Innovations (AIAI), Athens, Greece, June 2006.
3. K. Boehner, R. De Paula, P. Dourish, and P. Sengers, "How emotion is made and measured", International Journal. of Human-Computer Studies, 65(4):275-291, April 2007.
4. P. Boersma and D. Weenink, Praat: doing phonetics by computer (Version 5.0.05) [Computer program]. Retrieved January 19, 2008, from http://www.praat.org/.
5. A. Brave, C. Nass, and K. Hutchinson, Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent, International Journal of Human Computer Studies, 62(2):161-178, 2005.
6. C. H. Chan and G. J. F. Jones, Affect based indexing and retrieval of films, In Multimedia 2005, Singapore, November 2005.
7. G. Chanel G., K. Ansari-Asl, and T. Pun, Valence-arousal evaluation using physiological signals in an emotion recall paradigm, In 2007 IEEE SMC Int. Conf. on Systems, Man and Cybernetics, Smart cooperative systems and cybernetics: advancing knowledge and security for humanity, Montreal, Canada, October 2007.
8. G. Chanel, J. Kronegg, D. Grandjean, and T. Pun, Emotion assessment: Arousal evaluation using EEG's and peripheral physiological signals, Proc. Int. Workshop Multimedia Content Representation, Classification and Security (MRCS), B. Gunsel, A. K. Jain, A. M. Tekalp, B. Sankur, Eds., Lecture Notes in Computer Science, Vol. 4105, Springer, pages 530-537, Istanbul, Turkey, September 2006.
9. L. Chen, S. Gunduz, and M. T. Ozsu, Mixed type audio classification with support vector machine, In Int. Conf. on Multimedia and Expo, Toronto, Canada, July 2006.
10. R. R. Cornelius, Theoretical approaches to emotion, Proc. Int. Speech Communication Association (ISCA) Workshop on Speech and Emotion, pages 3-10, Belfast, Northern Ireland, September 2000.
11. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. G. Taylor, Emotion recognition in human computer interaction, IEEE Signal Processing Magazine, 18(1):32-80, 2001.
12. G. B. Duchenne and R. A. Cuthbertson, The mechanism of human facial expression, Cambridge University Press, Cambridge, 1990.
13. P. Ekman, et al., Universals and cultural differences in the judgments of facial expressions of emotion, Journal of Personality and Social Psychology, 53(4):712-717, 1987.
14. A. Hanjalic and L. Q. Xu, Affective video content representation and modeling, IEEE Trans. Multimedia, 7(1):143-154, February 2005.
15. J. A. Healey, Wearable and Automotive Systems for Affect Recognition from Physiology, PhD thesis, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, May 2000.
16. B. Janvier, É. Bruno, S. Marchand-Maillet, and T. Pun, Information-theoretic temporal segmentation of video and applications: multiscale keyframes selection and shot boundaries detection, Multimedia Tools and Applications, 30(3):273-288, 2006.
17. F. H. Kanfer, "Verbal Rate, Eyeblink, and Content in Structured Psychiatric Interviews", Journal of Abnormal and Social Psychology, 61(3):341-347, 1960.
18. J. Kim, Emotion recognition from physiological measurement, In Humaine European Network of Excellence Workshop, Santorini, Greece, September 2004.
19. J. Kronegg, G. Chanel, S. Voloshynovskiy, and T. Pun, EEG-based synchronized brain-computer interfaces: A model for optimizing the number of mental tasks, IEEE Transactions on Neural Systems and Rehabilitation Engineering, 15(1):50-58, March 2007.
20. P. J. Lang, M. K. Greenwald, M. M. Bradley, and A. O. Hamm, Looking at pictures: affective, facial, visceral, and behavioral reactions, Psychophysiology, 30(3):261-273, 1993.
21. D. Li, I. K. Sethi, N. Dimitrova, and T. McGee, Classification of general audio data for content-based retrieval, Pattern Recognition Letters, 22(5):533-544, 2001.
22. L. Lu, H. Jiang, H. J. Zhang, A robust audio classification and segmentation method, In Multimedia 2001, 2001.
23. N. Moenne-Loccoz, OVAL: an object-based video access library to facilitate the development of content-based video retrieval systems. Technical report, Viper group - University of Geneva, 2004.
24. J. D. Morris, SAM: the self-assessment manikin, an efficient cross-cultural measurement of emotional response, Journal of Advertising Research, 35(6):63-68, 1995.
25. R. W. Picard, Affective Computing, MIT Press, Cambridge, MA, 1997.
26. R. W. Picard and S. B. Daily, "Evaluating Affective Interactions: Alternatives to Asking What Users Feel, ", CHI Workshop on Evaluating Affective Interfaces: Innovative Approaches Portland: April 2005.
27. P. Rainville, A. Bechara, N. Naqvi, and A. R. Damasio, Basic emotions are associated with distinct patterns of cardiorespiratory activity, International Journal of Psychophysiology, 61(1):5-18, 2006.
28. Z. Rasheed, Y. Sheikh, and M. Shah, On the use of computable features for film classification, IEEE Transactions on Circuit and Systems for Video Technology, (11): 52-64, 2005.
29. J. Rottenberg, R. D. Ray, and J. J. Gross, Emotion elicitation using films. In: J. A. Coan & J. J. B. Allen (Eds.), The handbook of emotion elicitation and assessment. Oxford University Press, London, 2007.
30. J. Russell, A. Mehrabian, Evidence for a 3-factor theory of emotions, Journal of Research in Personality, 11(3):273-294, 1977.
31. K. Takahashi, Remarks on Emotion Recognition from Bio-Potential Signals, In 2nd International Conference on Autonomous Robots and Agents, Palmerston North, New Zealand, December 2004.
32. M. Tipping, Sparse bayesian learning and the relevance vector machine, Journal of Machine Learning Research, 1(3):211-244, 2001.
33. H. L. Wang, L. F. Cheong, Affective understanding in film, IEEE Transactions on Circuits and Systems for Video Technology, 16 (6),: 689-704, 2006.