Exploring principles-of-art features for image emotion recognition

MM 2014 - Proceedings of the 2014 ACM Conference on Multimedia

Volumn , Issue , 2014, Pages 47-56

  Zhao, Sicheng ^a   Gao, Yue ^b   Jiang, Xiaolei ^a   Yao, Hongxun ^a   Chua, Tat Seng ^b   Sun, Xiaoshuai ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Affective image classification; Art theory; Image emotion; Image features; Principles of art

Indexed keywords

IMAGE ENHANCEMENT; MEAN SQUARE ERROR;

ART THEORY; CLASSIFICATION ACCURACY; EMOTION RECOGNITION; IMAGE EMOTION; IMAGE FEATURES; MEAN SQUARED ERROR; PRINCIPLES OF ART; STATE-OF-THE-ART APPROACH;

IMAGE CLASSIFICATION;

EID: 84913556374     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2647868.2654930     Document Type: Conference Paper

References (45)

1. R. Arnheim. Art and visual perception: A psychology of the creative eye. University of California Press, 1954.
2. D. H. Ballard. Generalizing the hough transform to detect arbitrary shapes. Pattern Recognition, 13(2):111-122, 1981.
3. S. Benini, L. Canini, and R. Leonardi. A connotative space for supporting movie affective recommendation. IEEE Transactions on Multimedia, 13(6):1356-1370, 2011.
4. D. Borth, R. Ji, T. Chen, T. Breuel, and S.-F. Chang. Large-scale visual sentiment ontology and detectors using adjective noun pairs. In ACM MM, 2013.
5. S. Calahan. Storytelling through lighting: a computer graphics perspective. SIGGRAPH course notes, 96, 1996.
6. R. G. Collingwood. The principles of art, volume 62. Oxford University Pre USA, 1958.
7. R. Datta, J. Li, and J. Z. Wang. Algorithmic inferencing of aesthetics and emotion in natural images: An exposition. In ICIP, 2008.
8. S. Dhar, V. Ordonez, and T. Berg. High level describable attributes for predicting aesthetics and interestingness. In CVPR, 2011.
9. Y. Gao, M. Wang, Z.-J. Zha, J. Shen, X. Li, and X. Wu. Visual-textual joint relevance learning for tag-based social image search. IEEE Transactions on Image Processing, 22(1):363-376, 2013.
10. A. Hanjalic. Extracting moods from pictures and sounds: Towards truly personalized tv. IEEE Signal Processing Magazine, 23(2):90-100, 2006.
11. A. Hanjalic and L.-Q. Xu. Affective video content representation and modeling. IEEE Transactions on Multimedia, 7(1):143-154, 2005.
12. J. Hobbs, R. Salome, and K. Vieth. The visual experience. Davis Publications, 1995.
13. G. Irie, T. Satou, A. Kojima, T. Yamasaki, and K. Aizawa. Affective audio-visual words and latent topic driving model for realizing movie affective scene classification. IEEE Transactions on Multimedia, 12(6):523-535, 2010.
14. J. Itten. The art of color: the subjective experience and objective rationale of color. Wiley, 1974.
15. J. Jia, S. Wu, X. Wang, P. Hu, L. Cai, and J. Tang. Can we understand van gogh's mood? learning to infer affects from images in social networks. In ACM MM, 2012.
16. D. Joshi, R. Datta, E. Fedorovskaya, Q. Luong, J. Z. Wang, J. Li, and J. Luo. Aesthetics and emotions in images. IEEE Signal Processing Magazine, 28(5):94-115, 2011.
17. H. Kang. Affective content detection using hmms. In ACM MM, 2003.
18. M. Kass and J. Solomon. Smoothed local histogram filters. ACM Transactions on Graphics, 29(4):100, 2010.
19. P. Lang, M. Bradley, B. Cuthbert, et al. International affective picture system (IAPS): Affective ratings of pictures and instruction manual. NIMH, Center for the Study of Emotion & Attention, 2005.
20. B. Li, W. Xiong, W. Hu, and X. Ding. Context-aware affective images classification based on bilayer sparse representation. In ACM MM, 2012.
21. L. Liu, R. Chen, L. Wolf, and D. Cohen-Or. Optimizing photo composition. In Computer Graphics Forum, 2010.
22. G. Loy and J. Eklundh. Detecting symmetry and symmetric constellations of features. In ICCV, 2006.
23. G. Loy and A. Zelinsky. Fast radial symmetry for detecting points of interest. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(8):959-973, 2003.
24. X. Lu, P. Suryanarayan, R. B. Adams Jr, J. Li, M. G. Newman, and J. Z. Wang. On shape and the computability of emotions. In ACM MM, 2012.
25. Y. Luo and X. Tang. Photo and video quality evaluation: Focusing on the subject. In ECCV, 2008.
26. J. Machajdik and A. Hanbury. Affective image classification using features inspired by psychology and art theory. In ACM MM, 2010.
27. J. Mikels, B. Fredrickson, G. Larkin, C. Lindberg, S. Maglio, and P. Reuter-Lorenz. Emotional category data on images from the international affective picture system. Behavior research methods, 37(4):626-630, 2005.
28. J. Ni, M. Singh, and C. Bahlmann. Fast radial symmetry detection under affine transformations. In CVPR, 2012.
29. M. A. Nicolaou, H. Gunes, and M. Pantic. A multi-layer hybrid framework for dimensional emotion classification. In ACM MM, 2011.
30. M. Redi and B. Merialdo. Enhancing semantic features with compositional analysis for scene recognition. In ECCV Workshop, 2012.
31. J. Ruskan. Emotion and Art: Mastering the Challenges of the Artist's Path. R. Wyler & Co., 2012.
32. H. Schlosberg. Three dimensions of emotion. Psychological review, 61(2):81, 1954.
33. M. Solli and R. Lenz. Color based bags-of-emotions. In CAIP, 2009.
34. X. Sun, H. Yao, and R. Ji. What are we looking for: Towards statistical modeling of saccadic eye movements and visual saliency. In CVPR, 2012.
35. X. Sun, H. Yao, R. Ji, and S. Liu. Photo assessment based on computational visual attention model. In ACM MM, 2009.
36. J. Van De W., C. Schmid, and J. Verbeek. Learning color names from real-world images. In CVPR, 2007.
37. J. C. van Gemert. Exploiting photographic style for category-level image classification by generalizing the spatial pyramid. In ICMR, 2011.
38. W. Wang, Y. Yu, and S. Jiang. Image retrieval by emotional semantics: A study of emotional space and feature extraction. In IEEE SMC, 2006.
39. X. Xiang and M. Kankanhalli. Affect-based adaptive presentation of home videos. In ACM MM, 2011.
40. L. Xu, Q. Yan, Y. Xia, and J. Jia. Structure extraction from texture via relative total variation. ACM Transactions on Graphics, 31(6):139, 2012.
41. M. Xu, J. S. Jin, S. Luo, and L. Duan. Hierarchical movie affective content analysis based on arousal and valence features. In ACM MM, 2008.
42. V. Yanulevskaya, J. Van Gemert, K. Roth, A. Herbold, N. Sebe, and J. Geusebroek. Emotional valence categorization using holistic image features. In ICIP, 2008.
43. S. Zhao, H. Yao, X. Sun, P. Xu, X. Liu, and R. Ji. Video indexing and recommendation based on affective analysis of viewers. In ACM MM, 2011.
44. S. Zhao, H. Yao, F. Wang, X. Jiang, and W. Zhang. Emotion based image musicalization. In ICMEW, 2014.
45. S. Zhao, H. Yao, Y. Yang, and Y. Zhang. Affective image retrieval via multi-graph learning. In ACM MM, 2014.