Leveraging multimodal information for event summarization and concept-level sentiment analysis

Knowledge-Based Systems

Volumn 108, Issue , 2016, Pages 102-109

  Shah, Rajiv Ratn ^a   Yu, Yi ^b   Verma, Akshay ^c   Tang, Suhua ^d   Shaikh, Anwar Dilawar ^e   Zimmermann, Roger ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b NATIONAL INSTITUTE OF INFORMATICS   (Japan)

^c MOTILAL NEHRU NATIONAL INSTITUTE OF TECHNOLOGY   (India)

^d UNIVERSITY OF ELECTRO COMMUNICATIONS   (Japan)

^e DELHI TECHNOLOGICAL UNIVERSITY   (India)

Author keywords

Multimedia summarization; Multimedia related services; Multimodal analysis; Semantics analysis; Sentics analysis

Indexed keywords

IMAGE PROCESSING; METADATA; MODAL ANALYSIS; NATURAL LANGUAGE PROCESSING SYSTEMS; SEMANTICS; SOCIAL NETWORKING (ONLINE);

00-01; 99-00; MULTIMEDIA SUMMARIZATION; MULTIMEDIA-RELATED SERVICES; MULTIMODAL ANALYSIS; SEMANTICS ANALYSIS; SENTICS ANALYSIS;

MULTIMEDIA SERVICES;

EID: 84975497501     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2016.05.022     Document Type: Article

References (34)

1. [1] By the numbers: 170+ interesting instagram statistics, 2016, ( http://expandedramblings.com/index.php/important-instagram-stats/). Online: Last Accessed May, 2016.
2. [2] Shah, R.R., Shaikh, A.D., Yu, Y., Geng, W., Zimmermann, R., Wu, G., EventBuilder: Real-time multimedia event summarization by visualizing social media. ACM Multimedia, 2015, 185–188.
3. [3] Poria, S., Cambria, E., Gelbukh, A., Bisio, F., Hussain, A., Sentiment data flow analysis by means of dynamic linguistic patterns. IEEE Comput. Intell. Mag. 10:4 (2015), 26–36.
4. [4] Cambria, E., Olsher, D., Rajagopal, D., SenticNet 3: acommon and common-sense knowledge base for cognition-driven sentiment analysis. AAAI Conference on Artificial Intelligence, 2014, 1515–1521.
5. [5] Cambria, E., Livingstone, A., Hussain, A., The hourglass of emotions. Springer Cognitive Behavioural Systems, 2012, 144–157.
6. [6] Poria, S., Gelbukh, A., Cambria, E., Hussain, A., Huang, G.-B., EmoSenticSpace: anovel framework for affective common-sense reasoning. Knowl.-Based Syst. 69 (2014), 108–123 Elsevier.
7. [7] Mezaris, V., Scherp, A., Jain, R., Kankanhalli, M.S., Real-life events in multimedia: detection, representation, retrieval, and applications. Multim. Tools Appl. 70:1 (2014), 1–6 Springer.
8. [8] Scherp, A., Mezaris, V., Ionescu, B., De Natale, F., HuEvent ’14: workshop on human-centered event understanding from multimedia. ACM Multimedia, 2014, 1253–1254.
9. [9] Scherp, A., Mezaris, V., Survey on modeling and indexing events in multimedia. Multim. Tools Appl. 70:1 (2014), 7–23 Springer.
10. [10] Firan, C.S., Georgescu, M., Nejdl, W., Paiu, R., Bringing order to your photos: event-driven classification of flickr images based on social knowledge. ACM CIKM, 2010, 189–198.
11. [11] Rattenbury, T., Good, N., Naaman, M., Towards automatic extraction of event and place semantics from flickr tags. ACM SIGIR, 2007, 103–110.
12. [12] Zaharieva, M., Zeppelzauer, M., Breiteneder, C., Automated social event detection in large photo collections. ACM ICMR, 2013, 167–174.
13. [13] Del Fabro, M., Sobe, A., Böszörmenyi, L., Summarization of real-life events based on community-contributed content. MMEDIA, 2012, 119–126.
14. [14] Long, R., Wang, H., Chen, Y., Jin, O., Yu, Y., Towards effective event detection, tracking and summarization on microblog data. Springer Web-Age Information Management, 2011, 652–663.
15. [15] Filatova, E., Hatzivassiloglou, V., Event-based extractive summarization. ACL Workshop on Summarization, 2004, 104–111.
16. [16] Naaman, M., Social multimedia: highlighting opportunities for search and mining of multimedia data in social media applications. Multim. Tools Appl. 56:1 (2012), 9–34 Springer.
17. [17] Cambria, E., Poria, S., Bisio, F., Bajpai, R., Chaturvedi, I., The CLSA model: anovel framework for concept-level sentiment analysis. Springer Computational Linguistics and Intelligent Text Processing, 2015, 3–22.
18. [18] Agarwal, B., Poria, S., Mittal, N., Gelbukh, A., Hussain, A., Concept-level sentiment analysis with dependency-based semantic parsing: anovel approach. Springer Cognit. Comput., 2015, 1–13.
19. [19] Poria, S., Cambria, E., Winterstein, G., Huang, G.-B., Sentic patterns: dependency-based rRules for concept-level sentiment analysis. Knowl.-Based Syst. 69 (2014), 45–63 Elsevier.
20. [20] Poria, S., Agarwal, B., Gelbukh, A., Hussain, A., Howard, N., Dependency-based semantic parsing for concept-level text analysis. Springer Computational Linguistics and Intelligent Text Processing, 2014, 113–127.
21. [21] Cambria, E., Fu, J., Bisio, F., Poria, S., AffectiveSpace 2: enabling affective intuition for concept-level sentiment analysis. AAAI Conference on Artificial Intelligence, 2015, 508–514.
22. [22] Poria, S., Cambria, E., Hussain, A., Huang, G.-B., Towards an intelligent framework for multimodal affective data analysis. Neural Netw. 63 (2015), 104–116 Elsevier.
23. [23] Li, C.T., Shan, M.K., Emotion-based impressionism slideshow with automatic music accompaniment. ACM Multimedia, 2007, 839–842.
24. [24] Stupar, A., Michel, S., Picasso: automated soundtrack suggestion for multi-modal data. ACM CIKM, 2011, 2589–2592.
25. [25] Hanjalic, A., Xu, L.-Q., Affective video content representation and modeling. IEEE Trans. Multim. 7:1 (2005), 143–154.
26. [26] Soleymani, M., Kierkels, J.J.M., Chanel, G., Pun, T., A bayesian framework for video affective representation. IEEE ACII, 2009, 1–7.
27. [27] Wang, H.L., Cheong, L.F., Affective understanding in film. IEEE TCSVT 16:6 (2006), 689–704.
28. [28] Cristani, M., Pesarin, A., Drioli, C., Murino, V., Rodà, A., Grapulin, M., Sebe, N., Toward an automatically generated soundtrack from low-level cross-modal correlations for automotive scenarios. ACM Multimedia, 2010, 551–560.
29. [29] Yu, Y., Shen, Z., Zimmermann, R., Automatic music soundtrack generation for outdoor videos from contextual sensor information. ACM Multimedia, 2012, 1377–1378.
30. [30] Rahmani, H., Piccart, B., Fierens, D., Blockeel, H., Three complementary approaches to context aware movie recommendation. ACM CAMRa, 2010, 57–60.
31. [31] Shah, R.R., Yu, Y., Zimmermann, R., ADVISOR: personalized video soundtrack recommendation by late fusion with heuristic rankings. ACM Multimedia, 2014, 607–616.
32. [32] Hochbaum, D.S., Approximating covering and packing problems: set cover, vertex cover, independent set, and related problems. Approximation Algorithms for NP-hard Problems, 1996, PWS, 94–143.
33. [33] Thomee, B., Elizalde, B., Shamma, D.A., Ni, K., Friedland, G., Poland, D., Borth, D., Li, L.-J., YFCC100M: the new data in multimedia research. Commun. ACM 59:2 (2016), 64–73.
34. [34] Whissel, C., The dictionary of affect in language. Plutchik, R., Kellerman, H., (eds.) Emotion: Theory, Research and Experience, vol. 4, 1989, Academic Press, New York, 113–131 The Measurement of Emotions.