Recognize complex events from static images by fusing deep channels

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 1600-1609

  Xiong, Yuanjun ^a   Zhu, Kai ^a   Lin, Dahua ^a   Tang, Xiaoou ^a,b  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX NETWORKS; COMPUTER VISION; SEMANTICS;

EVENT RECOGNITION; INDIVIDUAL OBJECTS; NOVEL STRATEGIES; PERSONAL LIVES; SEMANTIC FUSION; SOCIAL ACTIVITIES; STATE OF THE ART; VISUAL APPEARANCE;

PATTERN RECOGNITION;

EID: 84959226544     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7298768     Document Type: Conference Paper

References (41)

1. W. Brendel, A. Fern, and S. Todorovic. Probabilistic event logic for interval-based event recognition. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 3329-3336, June 2011
2. C. Desai and D. Ramanan. Detecting actions, poses, and objects with relational phraselets. In Computer Vision-ECCV 2012, pages 158-172. Springer, 2012
3. P. Dollar, R. Appel, S. Belongie, and P. Perona. Fast feature pyramids for object detection. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 36(8):1532-1545, Aug 2014
4. P. Dollár, V. Rabaud, G. Cottrell, and S. Belongie. Behavior recognition via sparse spatio-temporal features. In Visual Surveillance and Performance Evaluation of Tracking and Surveillance, 2005. 2nd Joint IEEE International Workshop on, pages 65-72. IEEE, 2005
5. L. Duan, D. Xu, I.-H. Tsang, and J. Luo. Visual event recognition in videos by learning from web data. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 34(9):1667-1680, Sept 2012
6. C. Farabet, C. Couprie, L. Najman, and Y. LeCun. Learning hierarchical features for scene labeling. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35(8):1915-1929, 2013
7. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 580-587, June 2014
8. S. Gupta, R. Girshick, P. Arbelez, and J. Malik. Learning rich features from rgb-d images for object detection and segmentation. In Computer Vision ECCV 2014, volume 8695 of Lecture Notes in Computer Science, pages 345-360. Springer International Publishing, 2014
9. C.-L. Huang, H.-C. Shih, and C.-Y. Chao. Semantic analysis of soccer video using dynamic Bayesian network. Multimedia, IEEE Transactions on, 8(4):749-760, 2006
10. N. Ikizler, R. G. Cinbis, S. Pehlivan, and P. Duygulu. Recognizing actions from still images. In Pattern Recognition, 2008. ICPR 2008. 19th International Conference on, pages 1-4. IEEE, 2008
11. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408. 5093, 2014
12. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25, pages 1097-1105. Curran Associates, Inc., 2012
13. S. Lazebnik, C. Schmid, and J. Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, volume 2, pages 2169-2178. IEEE, 2006
14. J. Li and Y. Zhang. Learning surf cascade for fast and accurate object detection. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 3468-3475. IEEE, 2013
15. L.-J. Li and L. Fei-Fei. What, where and who? classifying events by scene and object recognition. In Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, pages 1-8, Oct 2007
16. L.-J. Li, R. Socher, and L. Fei-Fei. Towards total scene understanding: Classification, annotation and segmentation in an automatic framework. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 2036-2043, June 2009
17. L.-J. Li, H. Su, L. Fei-Fei, and E. P. Xing. Object bank: A high-level image representation for scene classification & semantic feature sparsification. In Advances in neural information processing systems, pages 1378-1386, 2010
18. M. Li, X.-B. Xue, and Z.-H. Zhou. Exploiting multi-modal interactions: A unified framework. In IJCAI, pages 1120-1125, 2009
19. W. Li, L. Niu, and D. Xu. Exploiting privileged information from web data for image categorization. In Computer Vision ECCV 2014, volume 8693 of Lecture Notes in Computer Science, pages 437-452. Springer International Publishing, 2014
20. P. Luo, X. Wang, and X. Tang. Pedestrian parsing via deep decompositional network. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 2648-2655. IEEE, 2013
21. S. Maji, L. Bourdev, and J. Malik. Action recognition from a distributed representation of pose and appearance. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 3177-3184. IEEE, 2011
22. M. Naphade, J. R. Smith, J. Tesic, S.-F. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and J. Curtis. Large-scale concept ontology for multimedia. MultiMedia, IEEE, 13(3):86-91, 2006
23. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Y. Ng. Multimodal deep learning. In Proceedings of the 28th International Conference on Machine Learning (ICML-11), pages 689-696, 2011
24. A. Oliva and A. Torralba. Modeling the shape of the scene: A holistic representation of the spatial envelope. International journal of computer vision, 42(3):145-175, 2001
25. P. Over, G. Awad, M. Michel, J. Fiscus, G. Sanders, W. Kraaij, A. F. Smeaton, and G. Quenot. Trecvid 2014-an overview of the goals, tasks, data, evaluation mechanisms and metrics. In Proceedings of TRECVID 2014. NIST, USA, 2014
26. M. Pandey and S. Lazebnik. Scene recognition and weakly supervised object localization with deformable part-based models. In Computer Vision (ICCV), 2011 IEEE International Conference on, pages 1307-1314, Nov 2011
27. M. Raptis and S. Soatto. Tracklet descriptors for action modeling and video analysis. In Computer Vision-ECCV 2010, pages 577-590. Springer, 2010
28. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. S. Bernstein, A. C. Berg, and L. Fei-Fei. Imagenet large scale visual recognition challenge. CoRR, abs/1409. 0575, 2014
29. K. Simonyan and A. Zisserman. Two-stream convolutional networks for action recognition in videos. CoRR, abs/1406. 2199, 2014
30. N. Srivastava and R. Salakhutdinov. Multimodal learning with deep boltzmann machines. In Advances in Neural Information Processing Systems 25, pages 2222-2230. Curran Associates, Inc., 2012
31. Y. Sun, X. Wang, and X. Tang. Deep learning face representation by joint identification-verification. CoRR, abs/1406. 4773, 2014
32. K. Tang, L. Fei-Fei, and D. Koller. Learning latent temporal structure for complex event detection. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 1250-1257, June 2012
33. J. R. Uijlings, K. E. van de Sande, T. Gevers, and A. W. Smeulders. Selective search for object recognition. International journal of computer vision, 104(2):154-171, 2013
34. H. Wang, M. M. Ullah, A. Klaser, I. Laptev, C. Schmid, et al. Evaluation of local spatio-temporal features for action recognition. In BMVC 2009-British Machine Vision Conference, 2009
35. S. Wu, S. Bondugula, F. Luisier, X. Zhuang, and P. Natarajan. Zero-shot event detection using multi-modal fusion of weakly supervised concepts. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 2665-2672. IEEE, 2014
36. J. Xiao, J. Hays, K. Ehinger, A. Oliva, and A. Torralba. Sun database: Large-scale scene recognition from abbey to zoo. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 3485-3492, June 2010
37. J. Yamato, J. Ohya, and K. Ishii. Recognizing human action in time-sequential images using hidden markov model. In Computer Vision and Pattern Recognition, 1992. Proceedings CVPR'92., 1992 IEEE Computer Society Conference on, pages 379-385. IEEE, 1992
38. W. Yang, Y. Wang, and G. Mori. Recognizing human actions from still images with latent poses. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 2030-2037. IEEE, 2010
39. Y. Yang and M. Shah. Complex events detection using datadriven concepts. In Computer Vision ECCV 2012, volume 7574, pages 722-735. Springer Berlin Heidelberg, 2012
40. B. Yao and L. Fei-Fei. Recognizing human-object interactions in still images by modeling the mutual context of objects and human poses. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 34(9):1691-1703, 2012
41. C. Zitnick and P. Dollr. Edge boxes: Locating object proposals from edges. In Computer Vision ECCV 2014, volume 8693, pages 391-405. Springer International Publishing, 2014.