Beyond object recognition: Visual sentiment analysis with deep coupled adjective and noun neural networks

IJCAI International Joint Conference on Artificial Intelligence

Volumn 2016-January, Issue , 2016, Pages 3484-3490

  Jingwen, Wang ^a   Fu, Jianlong ^b   Xu, Yong ^a   Mei, Tao ^b  

^a SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

^b MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; OBJECT RECOGNITION;

DEEP NEURAL NETWORKS; FAST CONVERGENCE; FINE GRAINED; KULLBACK-LEIBLER; POSITIVE AND NEGATIVE EMOTIONS; SENTIMENT ANALYSIS; STATE OF THE ART; THREE NETWORKS;

DATA MINING;

EID: 85006134827     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Damian Borth, Rongrong Ji, Tao Chen, Thomas Breuel, and Shih-Fu Chang. Large-scale visual sentiment ontology and detectors using adjective noun pairs. In ACM Multimedia, pages 223-232, 2013.
2. Victor Campos, Amaia Salvador, Xavier Giro-i Nieto, and Brendan Jou. Diving Deep into Sentiment: Understanding Fine-tuned CNNs for Visual Sentiment Prediction. In Proceedings of the 1st International Workshop on Affect & Sentiment in Multimedia, pages 57-62, 2015.
3. Tao Chen, Damian Borth, Trevor Darrell, and Shih-Fu Chang. Deepsentibank: Visual sentiment concept classification with deep convolutional neural networks. ArXiv preprint arXiv: 1410. 8586, 2014.
4. Tao Chen, Felix X Yu, Jiawei Chen, Yin Cui, Yan-Ying Chen, and Shih-Fu Chang. Object-based visual sentiment concept analysis and application. In ACM Multimedia, pages 367-376, 2014.
5. Xinlei Chen, Hao Fang, Tsung-Yi Lin, Ramakrishna Vedantam, Saurabh Gupta, Piotr Dollar, and C Lawrence Zitnick. Microsoft COCO captions: Data collection and evaluation server. ArXiv preprint arXiv: 1504. 00325, 2015.
6. L Chen-Yu, X Saining, G Patrick, Z Zhengyou, and T Zhuowen. Deeply-supervised nets. CoRR, abs/1409. 5185, 3 (4): 93, 2014.
7. Ritendra Datta, Jia Li, and James Z Wang. Algorithmic inferencing of aesthetics and emotion in natural images: An exposition. In ICIP, pages 105-108, 2008.
8. Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. Imagenet: A large-scale hierarchical image database. In CVPR, pages 248-255, 2009.
9. Jianlong Fu, Jinqiao Wang, Yong Rui, Xin-Jing Wang, Tao Mei, and Hanqing Lu. Image tag refinement with view-dependent concept representations. TCSVT, pages 1409-1422, 2015.
10. Jianlong Fu, Yue Wu, Tao Mei, Jinqiao Wang, Hanqing Lu, and Yong Rui. Relaxing from vocabulary: Robust weakly-supervised deep learning for vocabulary-free image tagging. In ICCV, pages 1985-1993, 2015.
11. Chuang Gan, Naiyan Wang, Yi Yang, Dit-Yan Yeung, and Alexander G. Hauptmann. Devnet: A deep event network for multimedia event detection and evidence recounting. In CVPR, pages 2568-2577, 2015.
12. Brendan Jou, Tao Chen, Nikolaos Pappas, Miriam Redi, Mercan Topkara, and Shih-Fu Chang. Visual Affect Around the World: A Large-scale Multilingual Visual Sentiment Ontology. In ACM Multimedia, pages 159-168, 2015.
13. Andrej Karpathy, George Toderici, Sachin Shetty, Tommy Leung, Rahul Sukthankar, and Li Fei-Fei. Largescale video classification with convolutional neural networks. In CVPR, pages 1725-1732, 2014.
14. Eunjeong Ko and Eun Yi Kim. Recognizing the sentiments of web images using hand-designed features. In ICCI & CC, pages 156-161, 2015.
15. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, pages 1097-1105, 2012.
16. Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86 (11): 2278-2324, 1998.
17. Changsheng Li, Qingshan Liu, Jing Liu, and Hanqing Lu. Ordinal distance metric learning for image ranking. IEEE Transactions on Neural Networks and Learning Systems, pages 1551-1559, 2015.
18. Tsung-Yu Lin, Aruni RoyChowdhury, and Subhransu Maji. Bilinear CNN Models for Fine-grained Visual Recognition. ArXiv preprint arXiv: 1504. 07889, 2015.
19. Jana Machajdik and Allan Hanbury. Affective image classification using features inspired by psychology and art theory. In ACM Multimedia, pages 83-92, 2010.
20. Alexander Patrick Mathews. Captioning Images Using Different Styles. In ACM Multimedia, pages 665-668, 2015.
21. Tao Mei, Yong Wang, Xian-Sheng Hua, Shaogang Gong, and Shipeng Li. Coherent image annotation by learning semantic distance. In CVPR, pages 1-8, 2008.
22. Louis-Philippe Morency, Rada Mihalcea, and Payal Doshi. Towards multimodal sentiment analysis: Harvesting opinions from the web. In Proceedings of the 13th International Conference on Multimodal Interfaces, pages 169-176, 2011.
23. Robert Plutchik. Emotion: A psychoevolutionary synthesis. Harpercollins College Division, 1980.
24. Stefan Siersdorfer, Enrico Minack, Fan Deng, and Jonathon Hare. Analyzing and predicting sentiment of images on the social web. In ACM Multimedia, pages 715-718, 2010.
25. Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. Going deeper with convolutions. ArXiv preprint arXiv: 1409. 4842, 2014.
26. Jianxiong Xiao, James Hays, Krista Ehinger, Aude Oliva, Antonio Torralba, et al. Sun database: Large-scale scene recognition from abbey to zoo. In CVPR, pages 3485-3492, 2010.
27. Yong Xu, Hui Ji, and Cornelia Fermüller. Viewpoint invariant texture description using fractal analysis. IJCV, pages 85-100, 2009.
28. Victoria Yanulevskaya, JC Van Gemert, Katharina Roth, Ann-Katrin Herbold, Nicu Sebe, and Jan-Mark Geusebroek. Emotional valence categorization using holistic image features. In ICIP, pages 101-104, 2008.
29. Quanzeng You, Jiebo Luo, Hailin Jin, and Jianchao Yang. Joint Visual-Textual Sentiment Analysis with Deep Neural Networks. In ACM Multimedia, pages 1071-1074, 2015.
30. Quanzeng You, Jiebo Luo, Hailin Jin, and Jianchao Yang. Robust image sentiment analysis using progressively trained and domain transferred deep networks. In AAAI, 2015.
31. Jianbo Yuan, Sean Mcdonough, Quanzeng You, and Jiebo Luo. Sentribute: image sentiment analysis from a midlevel perspective. In Workshop on Issues of Sentiment Discovery and Opinion Mining, page 10, 2013.