LIRIS-ACCEDE: A video database for affective content analysis

IEEE Transactions on Affective Computing

Volumn 6, Issue 1, 2015, Pages 43-55

  Baveye, Yoann ^a,b   Dellandréa, Emmanuel ^a   Chamaret, Christel ^b   Chen, Liming ^b  

^a Department of Research and Innovation Technicolor ^*  (France)

^b ECOLE CENTRALE DE LYON   (France)

Author keywords

Affective computing; Computational emotion modeling; Emotion classification; Induced emotion; Video database

Indexed keywords

COMPUTATION THEORY; COMPUTATIONAL METHODS; COPYRIGHTS; DATABASE SYSTEMS; INDEXING (OF INFORMATION); VIDEO RECORDING;

AFFECTIVE COMPUTING; EMOTION CLASSIFICATION; EMOTION MODELING; INDUCED EMOTION; VIDEO DATABASE;

CLASSIFICATION (OF INFORMATION);

EID: 84924112380     PISSN: 19493045     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAFFC.2015.2396531     Document Type: Article

References (63)

1. A. Hanjalic, "Extracting moods from pictures and sounds: Towards truly personalized TV," IEEE Signal Process. Mag., vol. 23, no. 2, pp. 90-100, Mar. 2006.
2. S. Arifin and P. Y. K. Cheung, "Affective level video segmentation by utilizing the pleasure-arousal-dominance information," IEEE Trans. Multimedia, vol. 10, no. 7, pp. 1325-1341, Nov. 2008.
3. S. Zhao, H. Yao, X. Sun, P. Xu, X. Liu, and R. Ji, "Video indexing and recommendation based on affective analysis of viewers," in Proc. 19th ACM Int. Conf. Multimedia, 2011, pp. 1473-1476.
4. M. Horvat, S. Popovic, and K. Cosic, "Multimedia stimuli databases usage patterns: A survey report," in Proc. 36th Int. Convention Inf. Commun. Technol. Electron. Microelectron., 2013, pp. 993-997.
5. M. Soleymani, M. Larson, T. Pun, and A. Hanjalic, "Corpus development for affective video indexing," IEEE Trans. Multimedia, vol. 16, no. 4, pp. 1075-1089, Jun. 2014.
6. Y. Baveye, J.-N. Bettinelli, E. Dellandrea, L. Chen, and C. Chamaret, "A large video data base for computational models of induced emotion," in Proc. Humaine Assoc. Conf. Affective Comput. Intell. Interaction, 2013, pp. 13-18.
7. J. A. Russell, "A circumplex model of affect," J. Person. Soc. Psychol., vol. 39, no. 6, pp. 1161-1178, 1980.
8. P. Philippot, "Inducing and assessing differentiated emotionfeeling states in the laboratory," Cognition Emotion, vol. 7, no. 2, pp. 171-193, 1993.
9. J. J. Gross and R. W. Levenson, "Emotion elicitation using films," Cognition Emotion, vol. 9, no. 1, pp. 87-108, 1995.
10. E. Douglas-Cowie, R. Cowie, I. Sneddon, C. Cox, O. Lowry, M. McRorie, J.-C. Martin, L. Devillers, S. Abrilian, A. Batliner, N. Amir, and K. Karpouzis, "The HUMAINE database: Addressing the collection and annotation of naturalistic and induced emotional data," in Proc. 2nd Int. Conf. Affective Comput. Intell. Interaction, 2007, vol. 4738, pp. 488-500.
11. A. Schaefer, F. Nils, X. Sanchez, and P. Philippot, "Assessing the effectiveness of a large database of emotion-eliciting films: A new tool for emotion researchers," Cognition Emotion, vol. 24, no. 7, pp. 1153-1172, Nov. 2010.
12. J. Rottenberg, R. D. Ray, and J. J. Gross, "Emotion elicitation using films," in Handbook Emotion Elicitation Assessment, London, U.K.: Oxford Univ. Press, 2007, p. 9.
13. S. Koelstra, C. Muhl, M. Soleymani, J.-S. Lee, A. Yazdani, T. Ebrahimi, T. Pun, A. Nijholt, and I. Patras, "DEAP: A database for emotion analysis using physiological signals," IEEE Trans. Affective Comput., vol. 3, no. 1, pp. 18-31, Jan.-Mar. 2012.
14. M. Soleymani, J. Lichtenauer, T. Pun, and M. Pantic, "A multimodal database for affect recognition and implicit tagging," IEEE Trans. Affective Comput., vol. 3, no. 1, pp. 42-55, Jan.-Mar. 2012.
15. S. Carvalho, J. Leite, S. Galdo-Álvarez, and O. Gonc¸alves, "The emotional movie database (EMDB): A self-report and psychophysiological study," Appl. Psychophysiol. Biofeedback, vol. 37, no. 4, pp. 279-294, 2012.
16. C.-H. Demarty, C. Penet, G. Gravier, and M. Soleymani, "A benchmarking campaign for the multimodal detection of violent scenes in movies," in Proc. 12th Int. Conf. Comput. Vis., 2012, pp. 416-425.
17. B. Jou, S. Bhattacharya, and S.-F. Chang, "Predicting viewer perceived emotions in animated GIFs," in Proc. ACM Int. Conf. Multimedia, 2014, pp. 213-216.
18. A. Hanjalic and L.-Q. Xu, "Affective video content representation and modeling," IEEE Trans. Multimedia, vol. 7, no. 1, pp. 143-154, Feb. 2005.
19. N. Malandrakis, A. Potamianos, G. Evangelopoulos, and A. Zlatintsi, "A supervised approach to movie emotion tracking," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., May. 2011, pp. 2376-2379.
20. H.-B. Kang, "Affective content detection using HMMs," in Proc. 11th ACM Int. Conf. Multimedia, 2003, pp. 259-262.
21. H. L. Wang and L.-F. Cheong, "Affective understanding in film," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 6, pp. 689-704, Jun. 2006.
22. K. Sun and J. Yu, "Video affective content representation and recognition using video affective tree and hidden Markov models," in Proc. Int. Conf. Affective Comput. Intell. Interaction, 2007, vol. 4738, pp. 594-605.
23. th ACM Int. Conf. Multimedia, 2008, pp. 677-680.
24. M. Soleymani, G. Chanel, J. Kierkels, and T. Pun, "Affective characterization of movie scenes based on multimedia content analysis and user's physiological emotional responses," in Proc. IEEE Int. Symp. Multimedia, Dec. 2008, pp. 228-235.
25. M. Soleymani, J. Kierkels, G. Chanel, and T. Pun, "A Bayesian framework for video affective representation," in Proc. Int. Conf. Affective Comput. Intell. Interaction, Sep. 2009, pp. 1-7.
26. G. Irie, T. Satou, A. Kojima, T. Yamasaki, and K. Aizawa, "Affective audio-visual words and latent topic driving model for realizing movie affective scene classification," IEEE Trans. Multimedia, vol. 12, no. 6, pp. 523-535, Oct. 2010.
27. S. Zhang, Q. Huang, S. Jiang, W. Gao, and Q. Tian, "Affective visualization and retrieval for music video," IEEE Trans. Multimedia, vol. 12, no. 6, pp. 510-522, Oct. 2010.
28. A. Yazdani, E. Skodras, N. Fakotakis, and T. Ebrahimi, "Multimedia content analysis for emotional characterization of music video clips," EURASIP J. Image Video Process., vol. 2013, no. 1, p. 26, 2013.
29. K. Sun, J. Yu, Y. Huang, and X. Hu, "An improved valencearousal emotion space for video affective content representation and recognition," in Proc. IEEE Int. Conf. Multimedia Expo, 2009, pp. 566-569.
30. R. W. Lienhart, "Comparison of automatic shot boundary detection algorithms," in Proc. Int. Conf. Electron. Imaging, 1998, pp. 290-301.
31. H. Leventhal and K. Scherer, "The relationship of emotion to cognition: A functional approach to a semantic controversy," Cognition Emotion, vol. 1, no. 1, pp. 3-28, 1987.
32. A. Metallinou and S. S. Narayanan, "Annotation and processing of continuous emotional attributes: Challenges and opportunities," in Proc. 10th IEEE Int. Conf. Workshops Autom. Face Gesture Recognit., Apr. 2013, pp. 1-8.
33. C. Colombo, A. Del Bimbo, and P. Pala, "Semantics in visual information retrieval," IEEE Multimedia, vol. 6, no. 3, pp. 38-53, Sep. 1999.
34. J. Xiao, J. Hays, K. Ehinger, A. Oliva, and A. Torralba, "SUN database: Large-scale scene recognition from abbey to zoo," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3485-3492.
35. M. Soleymani and M. Larson, "Crowdsourcing for affective annotation of video: Development of a viewer-reported boredom corpus," in Proc. Workshop Crowdsourcing Search Eval., Jul. 2010, pp. 4-8.
36. S. M. Mohammad and P. D. Turney, "Crowdsourcing a word-emotion association lexicon," Comput. Intell., vol. 29, no. 3, pp. 436-465, Aug. 2013.
37. Y.-H. Yang and H. Chen, "Ranking-based emotion recognition for music organization and retrieval," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 4, pp. 762-774, May. 2011.
38. P. A. Russell and C. D. Gray, "Ranking or rating? some data and their implications for the measurement of evaluative response," Brit. J. Psychol., vol. 85, no. 1, pp. 79-92, Feb. 1994.
39. S. Ovadia, "Ratings and rankings: Reconsidering the structure of values and their measurement," Int. J. Soc. Res. Methodol., vol. 7, no. 5, pp. 403-414, 2004.
40. G. N. Yannakakis and J. Hallam, "Ranking vs. preference: A comparative study of self-reporting," in Proc. Int. Conf. Affective Comput. Intell. Interaction, 2011, vol. 6974, pp. 437-446.
41. R. Mantiuk, A. M. Tomaszewska, and R. Mantiuk, "Comparison of four subjective methods for image quality assessment." Comput. Graph. Forum, vol. 31, no. 8, pp. 2478-2491, 2012.
42. J. D. Smyth, D. A. Dillman, L. M. Christian, and M. J. Stern, "Comparing check-all and forced-choice question formats in web surveys," Public Opinion Quarterly, vol. 70, no. 1, pp. 66-77, 2006.
43. nd ed. London, U.K.: Springer, 2008.
44. M. M. Bradley and P. J. Lang, "Measuring emotion: The self-assessment manikin and the semantic differential," J. Behav. Therapy Exp. Psychiatry, vol. 25, No. 1, pp. 49-59, Mar. 1994.
45. R. B. Dietz and A. Lang, "Aefective agents: Effects of agent affect on arousal, attention, liking and learning," in Proc. Cognitive Technol. Conf., 1999.
46. J. L. Fleiss, "Measuring nominal scale agreement among many raters," Psychol. Bull., vol. 76, no. 5, pp. 378-382, 1971.
47. K. Krippendorff, "Estimating the reliability, systematic error and random error of interval data," Educ. Psychol. Meas., vol. 30, no. 1, pp. 61-70, Apr. 1970.
48. J. J. Randolph, "Free-marginal multirater kappa (multirater kfree): An alternative to Fleiss fixed-marginal multirater kappa," Paper presented at the Joensuu University Learn. Instruction Symp., Joensuu, Finland, Oct. 2005.
49. J. R. Landis and G. G. Koch, "The measurement of observer agreement for categorical data," Biometrics, vol. 33, no. 1, pp. 159-174, Mar. 1977.
50. S. Zhang, Q. Tian, Q. Huang, W. Gao, and S. Li, "Utilizing affective analysis for efficient movie browsing," in Proc. IEEE Int. Conf. Image Process., Nov. 2009, pp. 1853-1856.
51. L. Canini, S. Benini, and R. Leonardi, "Affective recommendation of movies based on selected connotative features," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 4, pp. 636-647, Apr. 2013.
52. S. Mallat and S. Zhong, "Characterization of signals from multiscale edges," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 7, pp. 710-732, Jul. 1992.
53. Y. Baveye, F. Urban, C. Chamaret, V. Demoulin, and P. Hellier, "Saliency-guided consistent color harmonization," in Proc. Comput. Color Imaging Workshop, 2013, vol. 7786, pp. 105-118.
54. D. Hasler and S. Suesstrunk, "Measuring colourfulness in natural images," in Proc. SPIE Electron. Imaging 2003: Human Vis. Electron. Imaging VIII, 2003, vol. 5007, pp. 87-95.
55. Y. Ke, X. Tang, and F. Jing, "The design of high-level features for photo quality assessment," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2006, vol. 1, pp. 419-426.
56. O. Le Meur, T. Baccino, and A. Roumy, "Prediction of the inter-observer visual congruency (IOVC) and application to image ranking," in Proc. 19th ACM Int. Conf. Multimedia, 2011, pp. 373-382.
57. Y. Luo and X. Tang, "Photo and video quality evaluation: Focusing on the subject," in Proc. 10th Int. Conf. Comput. Vis., 2008, vol. 5304, pp. 386-399.
58. Y. Baveye, F. Urban, and C. Chamaret, "Image and video saliency models improvement by blur identification," in Proc. Int. Conf. Comput. Vis. Graphics, vol. 7594, 2012, pp. 280-287.
59. Y. Baveye, C. Chamaret, E. Dellandréa, and L. Chen, "A protocol for cross-validating large crowdsourced data: The case of the LIRIS-ACCEDE affective video dataset," in Proc. Int. ACM Workshop Crowdsourcing Multimedia, 2014, pp. 3-8.
60. J. A. Sloboda, "Empirical studies of emotional response to music," in Cognitive Bases of Musical Communication. Washington, D.C., USA: Amer. Psychol. Assoc., 1992, pp. 33-46.
61. M. Zentner, D. Grandjean, and K. R. Scherer, "Emotions evoked by the sound of music: Characterization, classification, and measurement." Emotion, vol. 8, no. 4, pp. 494-521, 2008.
62. K. R. Scherer and M. R. Zentner, "Emotional effects of music: Production rules," Music Emotion: Theory Research. Oxford, U.K.: Oxford Univ. Press, 2001, pp. 361-392.
63. Y. Baveye, E. Dellandrea, C. Chamaret, and L. Chen, "From crowdsourced rankings to affective ratings," in Proc. IEEE Int. Conf. Multimedia Expo Workshops, Jul. 2014, pp. 1-6.