A connotative space for supporting movie affective recommendation

IEEE Transactions on Multimedia

Volumn 13, Issue 6, 2011, Pages 1356-1370

  Benini, Sergio ^a   Canini, Luca ^a   Leonardi, Riccardo ^a  

^a UNIVERSITY OF BRESCIA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

AFFECTIVE RESPONSE; AUDIO-VISUAL; DIRECT MAPPING; HIGH VARIABILITY; MEDIA CONTENT; MOVIE SCENES; SINGLE USERS; VIDEO FEATURES;

SPHERES;

MOTION PICTURES;

EID: 82055162907     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2163058     Document Type: Article

References (46)

1. A. Hanjalic, "Extracting moods from pictures and sounds," IEEE Signal Process. Mag., vol. 23, no. 2, pp. 90-100, Mar. 2006.
2. R. W. Picard, "Affective computing: From laughter to IEEE," IEEE Trans. Affective Comput., vol. 1, no. 1, pp. 11-17, Jan.-Jun. 2010.
3. E. S. H. Tan, "Film-induced affect as a witness emotion," Poetics, vol. 23, no. 1, pp. 7-32, 1995.
4. G. M. Smith, Film Structure and the Emotion System. Cambridge, U.K.: Cambridge Univ. Press, 2003.
5. M. Soleymani, G. Chanel, J. J. M. Kierkels, and T. Pun, "Affective ranking of movie scenes using physiological signals and content analysis," in Proc. ACM Workshop Multimedia Semantics Proceedings, Vancouver, BC, Canada, Oct. 2008, pp. 32-39.
6. A. Hanjalic and L.-Q. Xu, "Affective video content representation and modeling," IEEE Trans. Multimedia, vol. 7, no. 1, pp. 143-154, Feb. 2005. (Pubitemid 40178377)
7. A. Mehrabian, "Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament," Current Psychol.: Develop., Learn., Personal., Social, vol. 14, pp. 261-292, 1996.
8. J. Wang, E. Chng, C. Xu, H. Lu, and X. Tong, "Identify sports video shots with "happy" or "sad" emotions," in Proc. Int. Conf. Multimedia and Expo (ICME), Toronto, ON, Canada, Jul. 2006.
9. M. Xu, L.-T. Chia, and J. Jin, "Affective content analysis in comedy and horror videos by audio emotional event detection," in Proc. Int. Conf. Multimedia and Expo (ICME), Amsterdam, The Netherlands, Jul. 2005.
10. M. Xu, J. S. Jin, S. Luo, and L. Duan, "Hierarchical movie affective content analysis based on arousal and valence features," in Proc. ACM Int. Conf. Multimedia, Vancouver, BC, Canada, 2008, pp. 677-680.
11. I. de Kok, "A model for valence using a color component in affective video content analysis," in Proc. 4th Twente Student Conf. IT , Enschede, The Netherlands, Jan. 2006.
12. H.-B. Kang, "Affective content detection using HMMs," in Proc. ACM Int. Conf. Multimedia, Berkeley, CA, Nov. 2003.
13. K. Sun and J. Yu, "Video affective content representation and recognition using video affective tree and hidden Markov models," in Proc. 2nd Int. Conf. Affective Computing and Intelligent Interaction (ACII '07), Berlin, Germany, 2007, pp. 594-605.
14. H. L.Wang and L. F. Cheong, "Affective understanding in film," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 6, pp. 689-704, Jun. 2006. (Pubitemid 44109543)
15. G. Irie, T. Satou, A. Kojima, T. Yamasaki, and K. Aizawa, "Affective audio-visual words and latent topic driving model for realizing movie affective scene classification," IEEE Trans. Multimedia, vol. 12, no. 6, pp. 523-535, Oct. 2010.
16. G. Adomavicius and A. Tuzhilin, "Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions," IEEE Trans. Knowl. Data Eng., vol. 17, no. 6, pp. 734-749, Jun. 2005. (Pubitemid 40860454)
17. M. Tkalcic, U. Burnik, and A. Kosir, "Using affective parameters in a content-based recommender system for images," User Model. User- Adapt. Interact., vol. 20, no. 4, pp. 279-311, 2010.
18. C. T. Castelli, "Trini diagram: Imaging emotional identity 3D positioning tool," Internet Imag., vol. 3964, no. 1, pp. 224-233, 1999.
19. C. Osgood, G. Suci, and P. Tannenbaum, The Measurement of Meaning. Urbana, IL: Univ. Illinois Press, 1957.
20. J. A. Russell, "A circumplex model of affect," J. Personal. Social Psychol., vol. 39, pp. 1161-1178, 1980.
21. R. M. Weaver, A Rhetoric and Composition Handbook. New York: William Morrow, 1974.
22. D. Arijon, Grammar of the Film Language. Los Angeles, CA: Silman-James Press, 1991.
23. D. Heise, Expressive Order: Confirming Sentiments in Social Actions. New York: Springer, 2007.
24. J. A. Russell and A. Mehrabian, "Evidence for a three-factor theory of emotions," J. Res. Personal., vol. 11, pp. 273-294, Sep. 1977. (Pubitemid 8193195)
25. K. Scherer, "What are emotions? And how can they be measured?," Social Sci. Inf., Jan. 2005.
26. R. Plutchik, "The nature of emotions," Amer. Scientist, vol. 89, no. 4, pp. 344-350, 2001.
27. J. R. J. Fontaine, K. R. Scherer, E. B. Roesch, and P. C. Ellsworth, "The world of emotions is not two-dimensional," Psychol. Sci., vol. 18, no. 12, pp. 1050-1057, 2007.
28. J. J. Dahlgaard, S. Schütte, E. Ayas, and S. M. Dahlgaard-Park, "Kansei/affective engineering design: A methodology for profound affection and attractive quality creation," TQM J, Special Edition on Affective Engineering, vol. 20, no. 4, 2008.
29. User Test. [Online]. Available: http://www.ing.unibs.it/~luca.canini/ tests/index.php.
30. What is a "Great Film Scene" or "Great Film Moment"? An Introduction to the Topic. [Online]. Available: http://www.filmsite.org/ scenes.html.
31. Internet Movie Database. [Online]. Available: http://www.imdb.com.
32. A. Hanjalic, R. L. Lagendijk, and J. Biemond, "Automated high-level movie segmentation for advanced video retrieval systems," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 4, pp. 580-588, Jun. 1999.
33. C. Cotsaces, N. Nikolaidis, and I. Pitas, "Video shot detection and condensed representation," IEEE Signal Process. Mag., vol. 23, no. 2, pp. 28-27, Mar. 2006.
34. S. Benini, L.-Q. Xu, and R. Leonardi, "Identifying video content consistency by vector quantization," in Proc. WIAMIS'05, Montreux, Switzerland, Apr. 13-15, 2005.
35. H. Sundaram and S.-F. Chang, "Computable scenes and structures in films," IEEE Trans. Multimedia, vol. 4, no. 4, pp. 482-491, Dec. 2002.
36. J. A. Coan and J. J. B. Allen, Handbook of Emotion Elicitation and Assessment. New York: Oxford Univ. Press, 2007.
37. S. S. Stevens, "On the theory of scales of measurement," Science, vol. 103, pp. 677-680, 1983.
38. P. Shrout and J. Fleiss, "Intraclass correlations: Uses in assessing rater reliability," Psychol. Bull., vol. 86, no. 2, pp. 420-428, 1979.
39. M. K. Greenwald, E. W. Cook, and P. Lang, "Dimensional covariation in the evaluation of pictorial stimuli," J. Psychophysiol., vol. 3, pp. 51-64, 1989.
40. J. J. M. Kierkels, M. Soleymani, and T. Pun, "Queries and tags in affectbased multimedia retrieval," in Proc. 2009 IEEE Int. Conf. Multimedia and Expo (ICME'09), Piscataway, NJ, 2009, pp. 1436-1439.
41. M. J. Pazzani and D. Billsus, "Content-based recommendation systems," in The Adaptive Web: Methods and Strategies of Web Personalization. New York: Springer-Verlag, 2007, pp. 325-341. (Pubitemid 351189202)
42. Y.-H. Yang and H. H. Chen, "Music emotion ranking," in Proc. ICASSP, 2009, pp. 1657-1660.
43. Y. Rubner, C. Tomasi, and L. J. Guibas, "A metric for distributions with applications to image databases," in Proc. 1998 IEEE Int. Conf. Computer Vision, Bombay, India, Jan. 1998, pp. 59-66.
44. R. Fagin, R. Kumar, and D. Sivakumar, "Comparing top lists," in Proc. 14th Annu. ACM-SIAM Symp. Discrete Algorithms (SODA '03), Philadelphia, PA, 2003, pp. 28-36.
45. M. Kendall and J. D. Gibbons, Rank Correlation Methods. London, U.K.: Edward Arnold, 1990.
46. P. Berens, "Circstat: A matlab toolbox for circular statistics," J. Statist. Softw., vol. 31, no. 10 1-21, 2009.