Tube Convolutional Neural Network (T-CNN) for Action Detection in Videos

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2017-October, Issue , 2017, Pages 5823-5832

  Hou, Rui ^a   Chen, Chen ^a   Shah, Mubarak ^a  

^a UNIVERSITY OF CENTRAL FLORIDA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTER VISION; CONVOLUTION; NEURAL NETWORKS; OBJECT DETECTION;

CONVOLUTIONAL NETWORKS; CONVOLUTIONAL NEURAL NETWORK; DETECTION APPROACH; PROPOSED ARCHITECTURES; SPATIO TEMPORAL; STATE OF THE ART; TEMPORAL FEATURES; VIDEO ANALYSIS;

DEEP LEARNING;

EID: 85041907672     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2017.620     Document Type: Conference Paper

References (32)

1. P. Felzenszwalb, D. McAllester, and D. Ramanan. A discriminatively trained, multiscale, deformable part model. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1-8, 2008.
2. A. Gaidon, Z. Harchaoui, and C. Schmid. Temporal localization of actions with actoms. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35 (11): 2782-2795, 2013.
3. R. Girshick. Fast r-cnn. In IEEE International Conference on Computer Vision (ICCV), December 2015.
4. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2014.
5. G. Gkioxari and J. Malik. Finding action tubes. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 759-768, 2015.
6. M. Jain, J. Van Gemert, H. Jégou, P. Bouthemy, and C. G. Snoek. Action localization with tubelets from motion. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 740-747, 2014.
7. M. Jain, J. C. van Gemert, and C. G. Snoek. What do 15, 000 object categories tell us about classifying and localizing actions In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 46-55, 2015.
8. H. Jhuang, J. Gall, S. Zuffi, C. Schmid, and M. J. Black. Towards understanding action recognition. In IEEE International Conference on Computer Vision (ICCV), pages 3192-3199, 2013.
9. S. Ji, W. Xu, M. Yang, and K. Yu. 3d convolutional neural networks for human action recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35 (1): 221-231, 2013.
10. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. ArXiv preprint arXiv: 1408. 5093, 2014.
11. Y.-G. Jiang, J. Liu, A. Roshan Zamir, I. Laptev, M. Piccardi, M. Shah, and R. Sukthankar. THUMOS challenge: Action recognition with a large number of classes. /ICCV13-Action-Workshop/, 2013.
12. Y.-G. Jiang, J. Liu, A. Roshan Zamir, G. Toderici, I. Laptev, M. Shah, and R. Sukthankar. THUMOS challenge: Action recognition with a large number of classes. http: //crcv. ucf. edu/THUMOS14/, 2014.
13. R. Joseph and F. Ali. Yolo9000: Better, faster, stronger. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
14. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In IEEE conference on Computer Vision and Pattern Recognition (CVPR), pages 1725-1732, 2014.
15. Y. Ke, R. Sukthankar, and M. Hebert. Event detection in crowded videos. In IEEE International Conference on Computer Vision (ICCV), pages 1-8, 2007.
16. T. Lan, Y. Wang, and G. Mori. Discriminative figure-centric models for joint action localization and recognition. In IEEE International Conference on Computer Vision (ICCV), pages 2003-2010, 2011.
17. Y. LeCun, Y. Bengio, and G. Hinton. Deep learning. Nature, 521 (7553): 436-444, 2015.
18. F. Negin and F. Bremond. Human action recognition in videos: A survey. INRIA Technical Report, 2016.
19. X. Peng and C. Schmid. Multi-region two-stream r-cnn for action detection. In European Conference on Computer Vision (ECCV), pages 744-759, 2016.
20. S. Ren, K. He, R. Girshick, and J. Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. In Advances in Neural Information Processing Systems (NIPS), pages 91-99. 2015.
21. M. Rodriguez, A. Javed, and M. Shah. Action mach: A spatio-temporal maximum average correlation height filter for action recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1-8, 2008.
22. K. Simonyan and A. Zisserman. Two-stream convolutional networks for action recognition in videos. In Advances in Neural Information Processing Systems (NIPS), pages 568-576, 2014.
23. K. Soomro, H. Idrees, and M. Shah. Action localization in videos through context walk. In IEEE International Conference on Computer Vision (CVPR), pages 3280-3288, 2015.
24. W. Sultani and M. Shah. What if we do not have multiple videos of the same action-video action localization using web images. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016.
25. L. Sun, K. Jia, D.-Y. Yeung, and B. E. Shi. Human action recognition using factorized spatio-temporal convolutional networks. In IEEE International Conference on Computer Vision (ICCV), pages 4597-4605, 2015.
26. Y. Tian, R. Sukthankar, and M. Shah. Spatiotemporal deformable part models for action detection. In IEEE Conference on Computer Vision and Pattern Recognition, pages 2642-2649, 2013.
27. D. Tran, L. Bourdev, R. Fergus, L. Torresani, and M. Paluri. Learning spatiotemporal features with 3d convolutional networks. In IEEE International Conference on Computer Vision (ICCV), pages 4489-4497, 2015.
28. L. Wang, Y. Qiao, and X. Tang. Video action detection with relational dynamic-poselets. In European Conference on Computer Vision (ECCV), pages 565-580, 2014.
29. L. Wang, Y. Qiao, X. Tang, and L. V. Gool. Actionness estimation using hybrid fully convolutional networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2708-2717, June 2016.
30. P. Weinzaepfel, Z. Harchaoui, and C. Schmid. Learning to track for spatio-temporal action localization. In IEEE International Conference on Computer Vision (ICCV), pages 3164-3172, 2015.
31. J. Yue-Hei Ng, M. Hausknecht, S. Vijayanarasimhan, O. Vinyals, R. Monga, and G. Toderici. Beyond short snippets: Deep networks for video classification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 4694-4702, 2015.
32. B. Zhang, Z. Li, A. Perina, A. D. Bue, V. Murino, and J. Liu. Adaptive local movement modeling for robust object tracking. IEEE Transactions on Circuits and Systems for Video Technology, 27 (7): 1515-1526, 2017.