Object-based visual sentiment concept analysis and application

MM 2014 - Proceedings of the 2014 ACM Conference on Multimedia

Volumn , Issue , 2014, Pages 367-376

  Chen, Tao ^a   Yu, Felix X ^a   Chen, Jiawei ^a   Cui, Yin ^a   Chen, Yan Ying ^a   Chang, Shih Fu ^a  

^a Howard Hughes Medical Institute   (United States)

Author keywords

Affective computing; Social multimedia; Visual sentiment

Indexed keywords

HIERARCHICAL SYSTEMS;

AFFECTIVE COMPUTING; CLASSIFICATION APPROACH; CLASSIFICATION PERFORMANCE; CONCEPT CLASSIFICATION; DISCRIMINATIVE FEATURES; OBJECT LOCALIZATION; SOCIAL MULTIMEDIA; VISUAL SENTIMENT;

CLASSIFICATION (OF INFORMATION);

EID: 84913593458     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2647868.2654935     Document Type: Conference Paper

References (35)

1. Supplemental Webpage. http://www.ee.columbia.edu/dvmm/vso/supplemental.html.
2. Subhabrata Bhattacharya, Behnaz Nojavanasghari, Tao Chen, Dong Liu, Shih-Fu Chang, and Mubarak Shah. Towards a comprehensive computational model for aesthetic assessment of videos. In Proceedings of the 21st ACM International Conference on Multimedia. ACM, 2013.
3. Damian Borth, Rongrong Ji, Tao Chen, Thomas Breuel, and Shih-Fu Chang. Large-scale visual sentiment ontology and detectors using adjective noun pairs. In Proceedings of the 21st ACM International Conference on Multimedia. ACM, 2013.
4. Yan-Ying Chen, Tao Chen, Winston H. Hsu, Hong-Yuan Mark Liao, and Shih-Fu Chang. Predicting viewer affective comments based on image content in social media. In Proceedings of the International Conference on Multimedia Retrieval. ACM, 2014.
5. Ritendra Datta, Dhiraj Joshi, Jia Li, and James Z Wang. Studying aesthetics in photographic images using a computational approach. In European Conference on Computer Vision. Springer, 2006.
6. J. Deng, W. Dong, R. Socher, L. J. Li, K. Li, and L. Fei-Fei. ImageNet: A Large-Scale Hierarchical Image Database. In Computer Vision and Pattern Recognition, 2009.
7. Jia Deng, Jonathan Krause, and Li Fei-Fei. Fine-grained crowdsourcing for fine-grained recognition. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 580-587. IEEE, 2013.
8. Kun Duan, Devi Parikh, David Crandall, and Kristen Grauman. Discovering localized attributes for fine-grained recognition. In Computer Vision and Pattern Recognition. IEEE, 2012.
9. Andrea Esuli and Fabrizio Sebastiani. SentiWordNet: A publicly available lexical resource for opinion mining. In Proceedings of the Conference on Language Resources and Evaluation, volume 6, 2006.
10. Rong-En Fan, Kai-Wei Chang, Cho-Jui Hsieh, Xiang-Rui Wang, and Chih-Jen Lin. Liblinear: A library for large linear classification. The Journal of Machine Learning Research, 9:1871-1874, 2008.
11. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan. Object detection with discriminatively trained part based models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(9):1627-1645, 2010.
12. V. Ferrari and A. Zisserman. Learning visual attributes. In Neural Information Processing Systems, 2007.
13. Yanwei Fu, Timothy M Hospedales, Tao Xiang, and Shaogang Gong. Attribute learning for understanding unstructured social activity. In European Conference on Computer Vision. Springer, 2012.
14. R. B. Girshick, P. F. Felzenszwalb, and D. McAllester. Discriminatively trained deformable part models, release 5. http://people.cs.uchicago.edu/~rbg/latent-release5/.
15. Chang Huang, Haizhou Ai, Yuan Li, and Shihong Lao. High-performance rotation invariant multiview face detection. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 29(4):671-686, 2007.
16. P. Isola, J. Xiao, A. Torralba, and A. Oliva. What makes an image memorable? In Computer Vision and Pattern Recognition, 2011.
17. Jia Jia, Sen Wu, Xiaohui Wang, Peiyun Hu, Lianhong Cai, and Jie Tang. Can we understand van Gogh's mood?: Learning to infer affects from images in social networks. In Proceedings of the 20th ACM international conference on Multimedia, pages 857-860. ACM, 2012.
18. Dhiraj Joshi, Ritendra Datta, Elena Fedorovskaya, Quang-Tuan Luong, James Z Wang, Jia Li, and Jiebo Luo. Aesthetics and emotions in images. Signal Processing Magazine, IEEE, 28(5):94-115, 2011.
19. Cyril Laurier and Perfecto Herrera. Mood Cloud: A real-time music mood visualization tool. In Proceedings of the 2008 Computers in Music Modeling and Retrieval Conference, 2008.
20. Hugo Liu and Push Singh. ConceptNet - a practical commonsense reasoning tool-kit. BT technology journal, 22(4):211-226, 2004.
21. J. Machajdik and A. Hanbury. Affective image classification using features inspired by psychology and art theory. In Proceedings of ACM Multimedia, pages 83-92, 2010.
22. L. Marchesotti, F. Perronnin, D. Larlus, and G. Csurka. Assessing the aesthetic quality of photographs using generic image descriptors. In Proceedings of the International Conference on Computer Vision, 2011.
23. M. Naphade, J. Smith, J. Tesic, S.-F. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and Curtis J. Large-scale concept ontology for multimedia. In IEEE Multimedia, 2006.
24. Bo Pang and Lillian Lee. Opinion mining and sentiment analysis. Information Retrieval, 2(1-2):1-135, 2008.
25. Genevieve Patterson and James Hays. Sun attribute database: Discovering, annotating, and recognizing scene attributes. In Computer Vision and Pattern Recognition. IEEE, 2012.
26. Mohammad Amin Sadeghi and Ali Farhadi. Recognition using visual phrases. In Computer Vision and Pattern Recognition. IEEE, 2011.
27. Pierre Sermanet, David Eigen, Xiang Zhang, Michael Mathieu, Rob Fergus, and Yann LeCun. Overfeat: Integrated recognition, localization and detection using convolutional networks. arXiv:1312.6229, 2013.
28. J. R. Smith, M. Naphade, and A. Natsev. Multimedia semantic indexing using model vectors. In International Conference on Multimedia and Expo, 2003.
29. Mike Thelwall, Kevan Buckley, Georgios Paltoglou, Di Cai, and Arvid Kappas. Sentiment strength detection in short informal text. Journal of the American Society for Information Science and Technology, 61(12):2544-2558, 2010.
30. Andranik Tumasjan, Timm O Sprenger, Philipp G Sandner, and Isabell M Welpe. Predicting elections with Twitter: What 140 characters reveal about political sentiment. In Proceedings of the 4th International AAAI Conference on Weblogs and Social Media, 2010.
31. Weining Wang and Qianhua He. A survey on emotional semantic image retrieval. In Image Processing, 2008. ICIP 2008. 15th IEEE International Conference on, pages 117-120. IEEE, 2008.
32. Theresa Wilson, Janyce Wiebe, and Paul Hoffmann. Recognizing contextual polarity in phrase-level sentiment analysis. In Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, 2005.
33. V. Yanulevskaya, J. van Gemert, K. Roth, A. Herbold, N. Sebe, and J. M. Geusebroek. Emotional valence categorization using holistic image features. In Proceedings of the IEEE International Conference on Image Processing, pages 101-104, 2008.
34. Guangnan Ye, Dong Liu, I-Hong Jhuo, and Shih-Fu Chang. Robust late fusion with rank minimization. In Computer Vision and Pattern Recognition. IEEE, 2012.
35. Felix X. Yu, Dong Liu, Sanjiv Kumar, Tony Jebara, and Shih-Fu Chang. ∞SVM for learning with label proportions. In International Conference on Machine Learning, 2013.