Concepts not alone: Exploring pairwise relationships for zero-shot video activity recognition

30th AAAI Conference on Artificial Intelligence, AAAI 2016

Volumn , Issue , 2016, Pages 3487-3493

  Gan, Chuang ^a   Lin, Ming ^c   Yang, Yi ^b   De Melo, Gerard ^a   Hauptmann, Alexander G ^d  

^a TSINGHUA UNIVERSITY   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^c UNIVERSITY OF MICHIGAN   (United States)

^d CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CONTENT BASED RETRIEVAL; FRACTURE MECHANICS; IMAGE RETRIEVAL; PATTERN RECOGNITION; SEMANTICS;

ACTIVITY RECOGNITION; DISCRIMINATIVE POWER; MATRIX APPROACH; MULTIMEDIA EVENT DETECTIONS; ROBUST APPROACHES; SEMANTIC RELATEDNESS; VIDEO ACTIVITY; VIDEO RECOGNITION;

IMAGE RECOGNITION;

EID: 84990038696     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. Chang, C.-C., and Lin, C.-J. 2011. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2:271-2727.
2. Dalton, J.; Allan, J.; and Mirajkar, P. 2013. Zero-shot video retrieval using content and concepts. In CIKM, 1857-1860.
3. Deng, J.; Dong, W.; Socher, R.; Li, L.-J.; Li, K.; and Fei-Fei, L. 2009. Imagenet: A large-scale hierarchical image database. In CVPR, 248-255.
4. Fan, M.; Zhao, D.; Zhou, Q.; Liu, Z.; Zheng, T. F.; and Chang, E. Y. 2014. Distant supervision for relation extraction with matrix completion., In ACL volume 1, 839-849.
5. Gabrilovich, E., and Markovitch, S. 2007. Computing semantic relatedness using wikipedia-based explicit semantic analysis. In IJCAI, 1606-1611.
6. Gan, C.; Lin, M.; Yang, Y.; Zhuang, Y.; and Hauptmann, A. G. 2015a. Exploring semantic inter-class relationships (SIR) for zero-shot action recognition. In AAAI.
7. Gan, C.; Wang, N.; Yang, Y.; Yeung, D.-Y.; and Hauptmann, A. G. 2015b. DevNet: A deep event network for multimedia event detection and evidence recounting. In CVPR, 2568- 2577.
8. Guadarrama, S.; Krishnamoorthy, N.; Malkarnenkar, G.; Venugopalan, S.; Mooney, R.; Darrell, T.; and Saenko, K. 2013. Youtube2text: Recognizing and describing arbitrary activities using semantic hierarchies and zero-shot recognition. In ICCV, 2712-2719.
9. Habibian, A.; Mensink, T.; and Snoek, C. G. 2014. Composite concept discovery for zero-shot video event detection. In ICMR, 17.
10. Hauptmann, A.; Yan, R.; Lin, W.-H.; Christel, M.; and Wactlar, H. 2007. Can high-level concepts fill the semantic gap in video retrieval? a case study with broadcast news. Multimedia, IEEE Transactions on 9(5):958-966.
11. Heilbron, F. C.; Escorcia, V.; Ghanem, B.; and Niebles, J. C. Activitynet: A large-scale video benchmark for human activity understanding.
12. Jia, Y. 2013. Caffe: An open source convolutional architecture for fast feature embedding. http://caffe.berkeleyvision.org.
13. Jiang, X.; Lim, L.-H.; Yao, Y.; and Ye, Y. 2011. Statistical ranking and combinatorial hodge theory. Mathematical Programming 127(1):203-244.
14. Jiang, Y.-G.; Bhattacharya, S.; Chang, S.-F.; and Shah, M. 2013. High-level event recognition in unconstrained videos. International Journal of Multimedia Information Retrieval 2(2):73-101.
15. Jiang, L.; Meng, D.; Mitamura, T.; and Hauptmann, A. G. 2014. Easy samples first: Self-paced reranking for zeroexample multimedia search. In Multimedia, 547-556. ACM.
16. Jiang, L.; Yu, S.-I.; Meng, D.; Mitamura, T.; and Hauptmann, A. G. 2015a. Bridging the ultimate semantic gap: A semantic search engine for internet videos. ICMR.
17. Jiang, Y.-G.; Wu, Z.; Wang, J.; Xue, X.; and Chang, S.-F. 2015b. Exploiting feature and class relationships in video categorization with regularized deep neural networks. arXiv preprint arXiv:1502.07209.
18. Karpathy, A.; Toderici, G.; Shetty, S.; Leung, T.; Sukthankar, R.; and Fei-Fei, L. 2014. Large-scale video classification with convolutional neural networks. In CVPR, 1725-1732.
19. Krizhevsky, A.; Sutskever, I.; and Hinton, G. E. 2012. Imagenet classification with deep convolutional neural networks. In NIPS, 1097-1105.
20. Lampert, C. H.; Nickisch, H.; and Harmeling, S. 2009. Learning to detect unseen object classes by between-class attribute transfer. In CVPR, 951-958.
21. Lin, D. 1998. An information-theoretic definition of similarity. In ICML, volume 98, 296-304.
22. Liu, J.; Yu, Q.; Javed, O.; Ali, S.; Tamrakar, A.; Divakaran, A.; Cheng, H.; and Sawhney, H. 2013. Video event recognition using concept attributes. In WACV, 339-346.
23. Mensink, T.; Gavves, E.; and Snoek, C. G. M. Costa: Cooccurrence statistics for zero-shot classification.
24. Mikolov, T.; Sutskever, I.; Chen, K.; Corrado, G. S.; and Dean, J. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems, 3111-3119.
25. Oneata, D.; Verbeek, J.; Schmid, C.; et al. 2013. Action and event recognition with fisher vectors on a compact feature set. In ICCV.
26. Rabiner, L. R., and Schafer, R. W. 2007. Introduction to digital speech processing. Foundations and trends in signal processing 1(1):1-194.
27. Simonyan, K., and Zisserman, A. 2015. Very deep convolutional networks for large-scale image recognition. ICLR.
28. Singh, B.; Han, X.; Wu, Z.; Morariu, V. I.; and Davis, L. S. 2015. Selecting relevant web trained concepts for automated event retrieval. ICCV.
29. Soomro, K.; Zamir, A. R.; and Shah, M. 2012. UCF101: A dataset of 101 human actions classes from videos in the wild. arXiv preprint arXiv:1212.0402.
30. Sun, C.; Gan, C.; and Nevatia, R. 2015. Automatic concept discovery from parallel text and visual corpora. ICCV.
31. Wang, H., and Schmid, C. 2013. Action recognition with improved trajectories. In ICCV.
32. Wu, S.; Bondugula, S.; Luisier, F.; Zhuang, X.; and Natarajan, P. 2014. Zero-shot event detection using multi-modal fusion of weakly supervised concepts. In CVPR, 2665-2672.
33. Yan, Y.; Tan, M.; Tsang, I.; Yang, Y.; Zhang, C.; and Shi, Q. 2015. Scalable maximum margin matrix factorization by active riemannian subspace search. In IJCAI.
34. Ye, G.; Li, Y.; Xu, H.; Liu, D.; and Chang, S.-F. Eventnet: A large scale structured concept library for complex event detection in video. Multimedia.
35. Ye, G.; Liu, D.; Jhuo, I.-H.; Chang, S.-F.; et al. 2012. Robust late fusion with rank minimization. In CVPR, 3021-3028.
36. Yuan, X.; Li, P.; and Zhang, T. 2014. Gradient hard thresholding pursuit for sparsity-constrained optimization. In ICML, 127-135.