Affective recommendation of movies based on selected connotative features

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 23, Issue 4, 2013, Pages 636-647

  Canini, Luca ^a   Benini, Sergio ^a   Leonardi, Riccardo ^a  

^a UNIVERSITY OF BRESCIA   (Italy)

Author keywords

Affective recommendation; video analysis

Indexed keywords

AFFECTIVE RECOMMENDATION; EMOTIONAL REACTIONS; EMOTIONAL RESPONSE; HIGH VARIABILITY; INTERMEDIATE REPRESENTATIONS; INTERSUBJECTIVITY; PHYSIOLOGICAL SIGNALS; VIDEO ANALYSIS;

REACTION INTERMEDIATES;

MOTION PICTURES;

EID: 84875993671     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2012.2211935     Document Type: Article

References (59)

1. R. W. Picard, "Affective computing: From laughter to IEEE," IEEE Trans. Affective Comput., vol. 1, no. 1, pp. 11-17, Jan. 2010.
2. E. S. H. Tan, "Film-induced affect as a witness emotion," Poetics, vol. 23, no. 1, pp. 7-32, 1995.
3. G. M. Smith, Film Structure and the Emotion System. Cambridge, U.K.: Cambridge Univ. Press, 2003.
4. S. Benini, L. Canini, and R. Leonardi, "A connotative space for supporting movie affective recommendation," IEEE Trans. Multimedia, vol. 13, no. 6, pp. 1356-1370, Dec. 2011.
5. I. Lopatovska and I. Arapakis, "Theories, methods and current research on emotions in library and information science, information retrieval and human-computer interaction," Inf. Process. Manage., vol. 47, no. 4, pp. 575-592, Jul. 2011.
6. A. Hanjalic, "Extracting moods from pictures and sounds," IEEE Signal Process. Mag., vol. 23, no. 2, pp. 90-100, Mar. 2006.
7. A. Hanjalic and L.-Q. Xu, "Affective video content representation and modeling," IEEE Trans. Multimedia, vol. 7, no. 1, pp. 143-154, Feb. 2005. (Pubitemid 40178377)
8. A. Mehrabian, "Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament," Current Psychol. Develop. Learning Personality Social, vol. 14, no. 4, pp. 261-292, Dec. 1996.
9. J. Wang, E. Chng, C. Xu, H. Lu, and X. Tong, "Identify sports video shots with 'happy' or 'sad' emotions," in Proc. Int. Conf. Multimedia Expo, Jul. 2006, pp. 877-880.
10. M. Xu, L.-T. Chia, and J. Jin, "Affective content analysis in comedy and horror videos by audio emotional event detection," in Proc. Int. Conf. Multimedia Expo, Jul. 2005, pp. 622-625. (Pubitemid 44668944)
11. M. Xu, J. S. Jin, S. Luo, and L. Duan, "Hierarchical movie affective content analysis based on arousal and valence features," in Proc. ACM Int. Conf. Multimedia, 2008, pp. 677-680.
12. H.-L. Wang and L.-F. Cheong, "Affective understanding in film," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 6, pp. 689-704, Jun. 2006. (Pubitemid 44109543)
13. H. L.Wang and L.-F. Cheong, "Taxonomy of directing semantics for film shot classification," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 10, pp. 1529-1542, Oct. 2009.
14. G. Irie, T. Satou, A. Kojima, T. Yamasaki, and K. Aizawa, "Affective audio-visual words and latent topic driving model for realizing movie affective scene classification," IEEE Trans. Multimedia, vol. 12, no. 6, pp. 523-535, Oct. 2010.
15. G. Adomavicius and A. Tuzhilin, "Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions," IEEE Trans. Knowl. Data Eng., vol. 17, no. 6, pp. 734-749, Jun. 2005. (Pubitemid 40860454)
16. M. Tkalcic, A. Kosir, and J. Tasic, "Affective recommender systems: The role of emotions in recommender systems," in Proc. RecSys Workshop Hum. Decision Making Recommender Syst., 2011, pp. 9-13.
17. M. Tkalcic, U. Burnik, and A. Kosir, "Using affective parameters in a content-based recommender system for images," User Model. User-Adapt. Interact., vol. 20, no. 4, pp. 279-311, 2010.
18. M. Pantic and A. Vinciarelli, "Implicit human-centered tagging," IEEE Signal Process. Mag., vol. 26, no. 6, pp. 173-180, Nov. 2009.
19. M. Tkalcic, A. Odic, A. Kosir, and J. F. Tasic, "Impact of implicit and explicit affective labeling on a recommender system's performance," in Proc. 19th Int. Conf. Advances User Modeling, 2012, pp. 342-354.
20. Z. Sicheng, H. Yao, S. Xiaoshuai, P. Xu, R. Ji, and X. Liu, "Video indexing and recommendation based on affective analysis of viewers," in Proc. ACM Int. Conf. Multimedia, Dec. 2011, pp. 1473-1476.
21. M. Soleymani, M. Pantic, and T. Pun, "Multi-modal emotion recognition in response to videos," IEEE Trans. Affective Comput., vol. 99, no. 2, pp. 211-223, Apr.-Jun. 2012.
22. S. Koelstra, C. Muehl, M. Soleymani, J.-S. Lee, A. Yazdani, T. Ebrahimi, T. Pun, A. Nijholt, and I. Patras, "DEAP: A database for emotion analysis using physiological signals," IEEE Trans. Affect. Comput., vol. 3, no. 1, pp. 18-31, Jan.-Mar. 2012.
23. H.-J. Kim and Y. S. Choi, "EmoSens: Affective entity scoring, a novel service recommendation framework for mobile platform," in Proc. 5th ACM Conf. Recommender Syst., Oct. 2011.
24. I. Arapakis, K. Athanasakos, and J. M. Jose, "A comparison of general versus personalized affective models for the prediction of topical relevance," in Proc. 33rd Int. ACM SIGIR Conf. Res. Develop. Inform. Retrieval, 2010, pp. 371-378.
25. C. T. Castelli, "Trini diagram: Imaging emotional identity 3-D positioning tool," Int. Soc. Opt. Eng., vol. 3964, pp. 224-233, Dec. 1999.
26. America Movie Classics Company LLC. (2012). What Is a "Great Film Scene" or "Great Film Moment"? An Introduction to the Topic [Online]. Available: http://www.filmsite.org/scenes.html
27. C. Osgood, G. Suci, and P. Tannenbaum, The Measurement of Meaning. Champaign, IL: Univ. Illinois Press, 1957.
28. Y. Rubner, C. Tomasi, and L. Guibas, "The earth mover's distance as a metric for image retrieval," Int. J. Comput. Vision, vol. 40, no. 2, pp. 99-121, 2000. (Pubitemid 32136368)
29. T. Sikora, "The MPEG-7 visual standard for content description: An overview," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 6, pp. 696-702, Jun. 2001. (Pubitemid 32616531)
30. B. S. Manjunath, J.-R. Ohm, V. V. Vasudevan, and A. Yamada, "Color and texture descriptors," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 6, pp. 703-715, Jun. 2001. (Pubitemid 32616532)
31. S. Jeannin and A. Divakaran, "MPEG-7 visual motion descriptors," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 6, pp. 720-724, Jun. 2001.
32. G. Tzanetakis and P. Cook, "Musical genre classification of audio signals," IEEE Trans. Speech Audio Process., vol. 10, no. 5, pp. 293-302, Jul. 2002. (Pubitemid 34950067)
33. G. Tzanetakis, G. Essl, and P. Cook, "Audio analysis using the discrete wavelet transform," in Proc. Conf. Acoust. Music Theory Applicat., 2001.
34. Z. Rasheed, Y. Sheikh, and M. Shah, "On the use of computable features for film classification," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 1, pp. 52-64, Jan. 2005.
35. S. Benini, A. Bianchetti, R. Leonardi, and P. Migliorati, "Extraction of significant video summaries by dendrogram analysis," in Proc. Int. Conf. Image Process., Apr. 2006, pp. 133-136.
36. P. Valdez and A. Mehrabian, "Effects of color on emotions," J. Exp. Psychol., vol. 123, no. 4, pp. 394-409, 1994.
37. T. Holman, Sound for Film and Television. Waltham, MA: Focal Press, 2002.
38. G. Tzanetakis, "Automatic musical genre classification of audio signals," in Proc. ISMIR, 2001.
39. I. Daubechies, "Orthonormal bases of compactly supported wavelets II: Variations on a theme," J. Math. Anal., vol. 24, no. 2, pp. 499-519, Mar. 1993.
40. D. Arijon, Grammar of the Film Language. Beverly Hills, CA: Silman-James Press, 1976.
41. B. Salt, Moving Into Pictures. More on Film History, Style, and Analysis. London, U.K.: Starword, 2006.
42. K. Chorós, "Video shot selection and content-based scene detection for automatic classification of TV sports news," in Internet: Technical Development and Applications (Advances in Intelligent and Soft Computing, vol. 64). Berlin/Heidelberg, Germany: Springer, 2009, pp. 73-80.
43. J. V. deWeijer, T. Gevers, and A. Gijsenij, "Edge-based color constancy," IEEE Trans. Image Process., vol. 16, no. 9, pp. 2207-2214, Sep. 2007. (Pubitemid 47321550)
44. L. Canini, S. Benini, P. Migliorati, and R. Leonardi, "Emotional identity of movies," in Proc. 16th IEEE Int. Conf. Image Process., Nov. 2009, pp. 1821-1824.
45. E. T. Hall, The Hidden Dimension. New York: Anchor, 1990.
46. S. Benini, L. Canini, and R. Leonardi, "Estimating cinematographic scene depth in movie shots," in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2010, pp. 855-860.
47. L. Canini, S. Benini, and R. Leonardi, "Affective analysis on patterns of shot types in movies," in Proc. 7th Int. Symp. Image Signal Process. Anal., Sep. 2011, pp. 253-258.
48. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection," J. Mach. Learning Res., vol. 3, pp. 1157-1182, Jan. 2003.
49. J.-B. Yang and C.-J. Ong, "Feature selection for support vector regression using probabilistic prediction," in Proc. 16th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2010, pp. 343-352.
50. W. Duch, "Studies in fuzziness and soft computing," in Filter Methods (Physica-Verlag). Berlin, Germany: Springer, 2006, pp. 89-118.
51. H. Peng, F. Long, and C. Ding, "Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and minredundancy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 8, pp. 1226-1238, Aug. 2005. (Pubitemid 41245053)
52. C. Ding and H. Peng, "Minimum redundancy feature selection from microarray gene expression data," J. Bioinform. Comput. Biol., vol. 3, no. 2, pp. 185-205, Apr. 2005. (Pubitemid 40561382)
53. Y.-H. Yang and H. H. Chen, "Music emotion ranking," in Proc. ICASSP, 2009, pp. 1657-1660.
54. A. J. Smola and B. Scḧolkopf, "A tutorial on support vector regression," Statist. Comput., vol. 14, no. 3, pp. 199-222, Aug. 2004. (Pubitemid 39063488)
55. M. J. Pazzani and D. Billsus, "Content-based recommendation systems," in The Adaptive Web: Methods and Strategies of Web Personalization. Berlin, Germany: Springer-Verlag, 2007, pp. 325-341. (Pubitemid 351189202)
56. J. A. Russell, "A circumplex model of affect," J. Personality Social Psychol., vol. 39, no. 6, pp. 1161-1178, Dec. 1980.
57. M. Kendall and J. D. Gibbons, Rank Correlation Methods. London, U.K.: Edward Arnold, 1990.
58. P. Refaeilzadeh, L. Tang, and H. Liu, "Cross validation," in Encyclopedia of Database Systems, K. L. Liu and M. T. Ö zsu, Eds. New York: Springer, 2009.
59. L. Canini, S. Benini, and R. Leonardi. (2012). A Complete List of Adopted Movie Scenes for Affective Recommendation [Online]. Available: http://www.ing.unibs.it/sbenini/misc/TCSVT-movie-scenefull-list.xlsx