Automatic visual concept learning for social event understanding

IEEE Transactions on Multimedia

Volumn 17, Issue 3, 2015, Pages 346-358

  Yang, Xiaoshan ^a,b   Zhang, Tianzhu ^a,b   Xu, Changsheng ^a,b   Hossain, M Shamim ^c  

^a INSTITUTE OF AUTOMATION   (China)

^b China Singapore Institute of Digital Media   (Singapore)

^c KING SAUD UNIVERSITY   (Saudi Arabia)

Author keywords

Event analysis; video recognition

Indexed keywords

ALGORITHMS; ITERATIVE METHODS; WEB SERVICES; WEBSITES;

CONCEPT MINING; DISCRIMINABILITY; EVENT ANALYSIS; EXPERIMENTAL EVALUATION; MULTIPLE CLASSIFIERS; VIDEO RECOGNITION; VISUAL CONCEPT; VISUAL CONCEPT LEARNING;

LEARNING ALGORITHMS;

EID: 84923365373     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2015.2393635     Document Type: Article

References (45)

1. B.-K. Bao, W. Min, K. Lu, and C. Xu, "Social event detection with robust high-order co-clustering," in Proc. 3rd ACM Int. Conf. Multimedia Retrieval, 2013, pp. 135-142.
2. M. Zaharieva, M. Zeppelzauer, and C. Breiteneder, "Automated social event detection in large photo collections," in Proc. ACM Int. Conf. Multimedia Retrieval, 2013, pp. 167-174.
3. G. Petkos, S. Papadopoulos, and Y. Kompatsiaris, "Social event detection using multimodal clustering and integrating supervisory signals," in Proc. 2nd ACM Int. Conf. Multimedia Retrieval, New York, NY, USA, 2012, pp. 23:1-23:8.
4. M. Brenner and E. Izquierdo, "Social event detection and retrieval in collaborative photo collections," in Proc. 2nd ACM Int. Conf. Multimedia Retrieval, 2012, pp. 21:1-21:8.
5. Y. Wang, H. Sundaram, and L. Xie, "Social event detection with interaction graph modeling," in Proc. ACM Int. Conf. Multimedia, 2012, pp. 865-868.
6. T. Reuter and P. Cimiano, "Event-based classification of social media streams," in Proc. ACM Int. Conf. Multimedia Retrieval, 2012, pp. 22:1-22:8.
7. X. Liu and B. Huet, "Heterogeneous features and model selection for event-based media classification," in Proc. 3rd ACM Conf. Int. Conf. Multimedia Retrieval, 2013, pp. 151-158.
8. S. Orlando, F. Pizzolon, and G. Tolomei, "Seed: A framework for extracting social events from press news," in Proc. Int. World Wide Web Conf., 2013, pp. 1285-1294.
9. V. Ramanathan, P. Liang, and F.-F. Li, "Video event understanding using natural language descriptions," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 905-912.
10. J. Liu, Q. Yu, O. Javed, S. Ali, A. Tamrakar, A. Divakaran, H. Cheng, and H. S. Sawhney, "Video event recognition using concept attributes," in Proc. IEEE Workshop Appl. Comput. Vis., Jan. 2013, pp. 339-346.
11. Z. Ma, Y. Yang, Z. Xu, S. Yan, N. Sebe, and A. G. Hauptmann, "Complex event detection via multi-source video attributes," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2013, pp. 2627-2633.
12. Y. Yang, Z. Ma, Z. Xu, S. Yan, and A. G. Hauptmann, "How related exemplars help complex event detection in web videos?," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 2104-2111.
13. Z. Ma, Y. Yang, Z. Xu, N. Sebe, and A. G. Hauptmann, "We are not equally negative: Fine-grained labeling for multimedia event detection," in Proc. ACM Int. Conf. Multimedia, 2013, pp. 293-302.
14. Z. Ma, Y. Yang, Y. Cai, N. Sebe, and A. G. Hauptmann, "Knowledge adaptation for ad hoc multimedia event detection with few exemplars," in Proc. ACM Int. Conf. Multimedia, 2012, pp. 469-478.
15. Y. Yang, Y. Yang, Z. Huang, J. Liu, and Z. Ma, "Robust cross-media transfer for visual event detection," in Proc. ACM Int. Conf. Multimedia, 2012, pp. 1045-1048.
16. L. Jiang, A. G. Hauptmann, and G. Xiang, "Leveraging high-level and low-level features for multimedia event detection," in Proc. ACM Int. Conf. Multimedia, 2012, pp. 449-458.
17. J. Luo, J. Yu, D. Joshi, and W. Hao, "Event recognition: Viewing the world with a third eye," in Proc. 16th ACM Int. Conf. Multimedia, 2008, pp. 1071-1080.
18. N. Imran, J. Liu, J. Luo, and M. Shah, "Event recognition from photo collections via pagerank," in Proc. ACM Int. Conf. Multimedia, 2009, pp. 621-624.
19. L. Duan, D. Xu, and S.-F. Chang, "Exploiting web images for event recognition in consumer videos: A multiple source domain adaptation approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2012, pp. 1338-1345.
20. C. H. Lampert, H. Nickisch, and S. Harmeling, "Learning to detect unseen object classes by between-class attribute transfer," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2009, pp. 951-958.
21. D. Parikh and K. Grauman, "Relative attributes," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 503-510.
22. A. G. Hauptmann, "Lessons for the future from a decade of informedia video analysis research," in Proc. ACM Int. Conf. Image Video Retrieval, 2005, pp. 1-10.
23. Q. Yu, J. Liu, H. Cheng, A. Divakaran, and H. S. Sawhney, "Multimedia event recounting with concept based representation," in Proc. ACM Conf. Multimedia, 2012, pp. 1073-1076.
24. D. Ding, F. Metze, S. Rawat, P. F. Schulam, S. Burger, E. Younessian, L. Bao, M. G. Christel, and A. Hauptmann, "Beyond audio and video retrieval: Towards multimedia summarization," in Proc. 2nd ACM Int. Conf. Multimedia Retrieval, 2012, pp. 2:1-2:8.
25. M. Rohrbach, M. Stark, G. Szarvas, I. Gurevych, and B. Schiele, "What helps where-and why? Semantic relatedness for knowledge transfer," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2010, pp. 910-917.
26. B. Gong, Y. Shi, F. Sha, and K. Grauman, "Geodesic flow kernel for unsupervised domain adaptation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2012, pp. 2066-2073.
27. B. Gong, K. Grauman, and F. Sha, "Connecting the dots with landmarks: Discriminatively learning domain-invariant features for unsu-pervised domain adaptation," in Proc. Int. Conf. Mach. Learn., 2013, pp. 222-230.
28. W. Lu, J. Li, T. Li, W. Guo, H. Zhang, and J. Guo, "Web multimedia object classification using cross-domain correlation knowledge," IEEE Trans. Multimedia, vol. 15, no. 8, pp. 1920-1929, Dec. 2013.
29. S. D. Roy, T. Mei, W. Zeng, and S. Li, "Socialtransfer: Cross-domain transfer learning from social streams for media applications," in Proc. ACM Int. Conf. Multimedia, 2012, pp. 649-658.
30. C. Li, A. Sun, and A. Datta, "Twevent: Segment-based event detection from tweets," in Proc. ACM Int. Conf. Inf. Knowl. Manag., 2012, pp. 155-164.
31. A. Sun and S. S. Bhowmick, "Quantifying tag representativeness of visual content of social images," in Proc. ACM Int. Conf. Multimedia, 2010, pp. 471-480.
32. J. Revaud, M. Douze, C. Schmid, and H. Jegou, "Event retrieval in large video collections with circulant temporal encoding," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2013, pp. 2459-2466.
33. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2003, vol. 2, pp. 1470-1477.
34. G. Csurka, C. R. Dance, L. Fan, J. Willamowski, and C. Bray, "Visual categorization with bags of keypoints," in Proc. Eur. Conf. Comput. Vis., Workshop, 2004, pp. 1-22.
35. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. Comput. Vs. Pattern Recog., Jun. 2006, vol. 2, pp. 2169-2178.
36. J. Zhu, H. Zou, S. Rosset, and T. Hastie, "Multi-class adaboost," Statist. Interface, vol. 2, no. 3, pp. 349-360, 2009.
37. M. Chen, Z. E. Xu, K. Q Weinberger, and F. Sha, "Marginalized de-noising autoencoders for domain adaptation," inProc. ICML, 2012, pp. 767-774.
38. X. Glorot, A. Bordes, and Y. Bengio, "Domain adaptation for large-scale sentiment classification: A deep learning approach," in Proc. Int. Conf. Mach. Learn., 2011, pp. 513-520.
39. Y. Bengio, "Learning deep architectures for ai," Found. Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
40. X. Yang, Q. Song, and Y. Wang, "A weighted support vector machine for data classification," Int. J Pattern Recog. AI, vol. 21, no. 5, pp. 961-976, 2007.
41. L. Liu, L. Wang, and X. Liu, "In defense of soft-assignment coding," inProc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp 2486-2493.
42. H. Wang, A. Kläser, C Schmid, and C.-L. Liu, "Action recognition by dense trajectories," in Proc. IEEE Conf. Comput. Vs. Pattern Recog, Jun. 2011, pp. 3169-3176.
43. J. D. R. Farquhar, D. R. Hardoon, H. Meng, J. Shawe-Taylor, and S. Szedmák, "Two view learning: Svm-2k, theory and practice," in Advances Neural Inf. Process. Syst. 18, Vancouver, BC, Canada, Dec. 2005, pp. 355-362.
44. A. Blum and T. M. Mitchell, "Combining labeled and unlabeled sata with co-training," in Proc. 11th Annu. Conf Comput. Learn. Theory, Madison, WI, USA, Jul. 1998, pp. 92-100.
45. W. Wang and Z. Zhou, "Co-training with insufficient views," in Asian Conf. Mach. Learn, Canberra, Australia, Nov. 2013, pp. 467-482.