DevNet: A Deep Event Network for multimedia event detection and evidence recounting

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 2568-2577

  Gan, Chuang ^a   Wang, Naiyan ^b   Yang, Yi ^c   Yeung, Dit Yan ^b   Hauptmann, Alexander G ^d  

^a TSINGHUA UNIVERSITY   (China)

^b HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^c UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^d Carnegie Mellon University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX NETWORKS; COMPUTER VISION; IMAGE CLASSIFICATION; IMAGE RETRIEVAL; IMAGE SEGMENTATION; NEURAL NETWORKS;

ACTION RECOGNITION; COMPLEX EVENT DETECTION; CONVOLUTIONAL NEURAL NETWORK; INTRINSIC PROPERTY; MULTIMEDIA EVENT DETECTIONS; SPATIAL POSITIONS; SPATIAL TEMPORALS; VIDEO EVENT DETECTIONS;

PATTERN RECOGNITION;

EID: 84959230113     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7298872     Document Type: Conference Paper

References (48)

1. Y. Y. Boykov and M.-P. Jolly. Interactive graph cuts for optimal boundary & region segmentation of objects in nd images. In ICCV, pages 105-112, 2001. 4322, 4325, 4327
2. C.-C. Chang and C.-J. Lin. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2:27:1-27:27, 2011. Software available at http://www. csie. ntu. edu. tw/cjlin/libsvm. 4322, 4326
3. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman. Return of the devil in the details: Delving deep into convolutional nets. In BMVC, 2014. 4322, 4323, 4324
4. M.-y. Chen and A. Hauptmann. Mosift: Recognizing human actions in surveillance videos. 2009. 4322, 4323
5. N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In CVPR, pages 886-893, 2005. 4323
6. N. Dalal, B. Triggs, and C. Schmid. Human detection using oriented histograms of flow and appearance. In ECCV, pages 428-441. 2006. 4323
7. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In CVPR, pages 248-255, 2009. 4322, 4323, 4324
8. D. Erhan, Y. Bengio, A. Courville, and P. Vincent. Visualizing higher-layer features of a deep network. Dept. IRO, Université de Montréal, Tech. Rep, 2009. 4323
9. C. Farabet, C. Couprie, L. Najman, and Y. LeCun. Learning hierarchical features for scene labeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(8):1915-1929, 2013. 4323
10. C. Gan, M. Lin, Y. Yang, Y. Zhuang, and A. G. Hauptmann. Exploring semantic inter-class relationships (SIR) for zeroshot action recognition. In AAAI, 2015. 4323
11. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. CVPR, pages 580-587, 2014. 4322, 4323, 4324
12. M. Gygli, H. Grabner, H. Riemenschneider, and L. Van Gool. Creating summaries from user videos. In ECCV, 2014. 4322
13. K. He, X. Zhang, S. Ren, and J. Sun. Spatial pyramid pooling in deep convolutional networks for visual recognition. In ECCV, pages 346-361. 2014. 4322, 4323
14. Y. Jia. Caffe: An open source convolutional architecture for fast feature embedding. http://caffe. berkeleyvision. org, 2013. 4323
15. Y.-G. Jiang, S. Bhattacharya, S.-F. Chang, and M. Shah. High-level event recognition in unconstrained videos. International Journal of Multimedia Information Retrieval, 2(2):73-101, 2013. 4323
16. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In CVPR, pages 1725-1732, 2014. 4322, 4323
17. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, pages 1097-1105, 2012. 4322, 4323
18. K.-T. Lai, D. Liu, M.-S. Chen, and S.-F. Chang. Recognizing complex events in videos by learning key static-dynamic evidences. In ECCV, pages 675-688, 2014. 4323
19. K.-T. Lai, D. Liu, M.-S. Chen, and S.-F. Chang. Video event detection by inferring temporal instance labels. In CVPR, pages 2251-2258, 2014. 4323
20. I. Laptev. On space-time interest points. International Journal of Computer Vision, 64(2-3):107-123, 2005. 4323
21. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld. Learning realistic human actions from movies. In CVPR, pages 1-8, 2008. 4323
22. Q. V. Le. Building high-level features using large scale unsupervised learning. In ICASSP, pages 8595-8598, 2013. 4323
23. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998. 4323
24. Y. J. Lee, J. Ghosh, and K. Grauman. Discovering important people and objects for egocentric video summarization. In CVPR, pages 3-2, 2012. 4322
25. J. Liu, Q. Yu, O. Javed, S. Ali, A. Tamrakar, A. Divakaran, H. Cheng, and H. Sawhney. Video event recognition using concept attributes. In WACV, pages 339-346, 2013. 4321, 4323
26. D. G. Lowe. Distinctive image features from scaleinvariant keypoints. International journal of computer vision, 60(2):91-110, 2004. 4322, 4323
27. Z. Lu and K. Grauman. Story-driven summarization for egocentric video. In CVPR, pages 2714-2721, 2013. 4322
28. Z. Ma, Y. Yang, N. Sebe, and A. G. Hauptmann. Knowledge adaptation with partially shared features for event detection using few exemplars. pages 1789-1802, 2014. 4323
29. D. Oneata, J. Verbeek, C. Schmid, et al. Action and event recognition with fisher vectors on a compact feature set. In ICCV, 2013. 4323, 4326
30. D. Potapov, M. Douze, Z. Harchaoui, and C. Schmid. Category-specific video summarization. In ECCV, pages 540-555. 2014. 4323
31. K. Simonyan, A. Vedaldi, and A. Zisserman. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312. 6034, 2013. 4323, 4324
32. K. Simonyan and A. Zisserman. Two-stream convolutional networks for action recognition in videos. In NIPS, 2014. 4322, 4323
33. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. ICLR, 2015. 4323
34. C. Sun, B. Burns, R. Nevatia, C. Snoek, B. Bolles, G. Myers, W. Wang, and E. Yeh. ISOMER: Informative segment observations for multimedia event recounting. In ICMR, page 241, 2014. 4321, 4323
35. C. Sun and R. Nevatia. DISCOVER: Discovering important segments for classification of video events and recounting. In CVPR, pages 2569-257, 2014. 4321, 4327, 4328
36. V. Vovk. Kernel ridge regression. In Empirical Inference, pages 105-116. 2013. 4322, 4326
37. H. Wang, A. Klaser, C. Schmid, and C.-L. Liu. Action recognition by dense trajectories. In CVPR, pages 3169-3176, 2011. 4322, 4323
38. H. Wang and C. Schmid. Action recognition with improved trajectories. In ICCV, 2013. 4322, 4323, 4326
39. X. Wang, D. F. Fouhey, and A. Gupta. Designing deep networks for surface normal estimation. CVPR, 2015. 4322
40. X. Wang, L. Zhang, L. Lin, Z. Liang, and W. Zuo. Deep joint task learning for generic object extraction. In NIPS, pages 523-531, 2014. 4322
41. Y. Wei, W. Xia, J. Huang, B. Ni, J. Dong, Y. Zhao, and S. Yan. CNN: Single-label to multi-label. arXiv preprint arXiv:1406. 5726, 2014. 4323, 4324
42. S. Wu, S. Bondugula, F. Luisier, X. Zhuang, and P. Natarajan. Zero-shot event detection using multi-modal fusion of weakly supervised concepts. In CVPR, pages 2665-2672, 2014. 4323
43. Z. Xu, Y. Yang, and A. G. Hauptmann. A discriminative CNN video representation for event detection. CVPR, 2015. 4328
44. Y. Yang, Z. Ma, Z. Xu, S. Yan, and A. G. Hauptmann. How related exemplars help complex event detection in web videos? In ICCV, pages 2104-2111, 2013. 4323
45. Q. Yu, J. Liu, H. Cheng, A. Divakaran, and H. Sawhney. Multimedia event recounting with concept based representation. In ACM Multimedia, pages 1073-1076, 2012. 4321, 4323
46. S.-I. Yu, L. Jiang, Z. Mao, X. Chang, X. Du, C. Gan, Z. Lan, Z. Xu, X. Li, Y. Cai, et al. Informedia@ TRECVID 2014 MED and MER. 4324, 4325
47. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In ECCV, pages 818-833. 2014. 4323
48. W. Zhu, S. Liang, Y. Wei, and J. Sun. Saliency optimization from robust background detection. In CVPR, pages 2814-2821, 2014. 4327, 4328