Deep learning for detecting multiple space-time action tubes in videos

British Machine Vision Conference 2016, BMVC 2016

Volumn 2016-September, Issue , 2016, Pages 58.1-58.13

  Saha, Suman ^a   Singh, Gurkirt ^a   Sapienza, Michael ^b   Torr, Philip H S ^b   Cuzzolin, Fabio ^a  

^a OXFORD BROOKES UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; DYNAMIC PROGRAMMING; MOTION ANALYSIS;

COLOUR IMAGE; DETECTION SPEED; LOCALISATION; MOST LIKELY; MOTION DETECTION; NETWORK DETECTIONS; SPATIAL OVERLAP; STATE OF THE ART;

DEEP LEARNING;

EID: 85041898314     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.5244/C.30.58     Document Type: Conference Paper

References (40)

1. Liangliang Cao, Zicheng Liu, and Thomas S Huang. Cross-dataset action detection. In Computer vision and pattern recognition (CVPR), 2010 IEEE conference on, pages 1998–2005. IEEE, 2010.
2. Wei Chen, Caiming Xiong, Ran Xu, and Jason Corso. Actionness ranking with lattice conditional ordinal random fields. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 748–755, 2014.
3. Sergio Escalera, Xavier Bar, Jordi Gonzalez, Miguel A Bautista, Meysam Madadi, Miguel Reyes, V ctor Ponce-L pez, Hugo J Escalante, Jamie Shotton, and Isabelle Guyon. Chalearn looking at people challenge 2014: Dataset and results. In Computer Vision-ECCV 2014 Workshops, pages 459–473. Springer, 2014.
4. G. Evangelidis, G. Singh, and R. Horaud. Continuous gesture recognition from articulated poses. In ECCV Workshops, 2014.
5. Adrien Gaidon, Zaid Harchaoui, and Cordelia Schmid. Temporal localization of actions with actoms. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35 (11):2782–2795, 2013.
6. Ross Girshick. Fast R-CNN. In Proceedings of the IEEE International Conference on Computer Vision, pages 1440–1448, 2015.
7. Ross Girshick, Jeff Donahue, Trevor Darrel, and Jitendra Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, 2014.
8. G Gkioxari and J Malik. Finding action tubes. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, 2015.
9. A Gorban, H Idrees, YG Jiang, A Roshan Zamir, I Laptev, M Shah, and R Sukthankar. Thumos challenge: Action recognition with a large number of classes, 2015.
10. Yonghao He, Hao Liu, Wei Sui, Shiming Xiang, and Chunhong Pan. Liris harl competition participant, 2012. Institute of Automation, Chinese Academy of Sciences, Beijing http://liris.cnrs.fr/harl2012/results.html.
11. Manan Jain, Jan Van Gemert, Herv J gou, Patrick Bouthemy, and Cees GM Snoek. Action localization with tubelets from motion. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 740–747. IEEE, 2014.
12. H. Jhuang, J. Gall, S. Zuffi, C. Schmid, and M. Black. Towards understanding action recognition. Proc. Int. Conf. Computer Vision, 2013.
13. Shuiwang Ji, Wei Xu, Ming Yang, and Kai Yu. 3d convolutional neural networks for human action recognition. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35(1):221–231, Jan 2013.
14. YG Jiang, J Liu, A Roshan Zamir, G Toderici, I Laptev, M Shah, and R Sukthankar. Thumos challenge: Action recognition with a large number of classes. http://crcv.ucf.edu/THUMOS14, 2014.
15. Andrej Karpathy, George Toderici, Sanketh Shetty, Thomas Leung, Rahul Sukthankar, and Li Fei-Fei. Large-scale video classification with convolutional neural networks. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, 2014.
16. A. Kl ser, M. Marszałek, C. Schmid, and A. Zisserman. Human focused action localization in video. In International Workshop on Sign, Gesture, Activity, 2010.
17. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, 2012.
18. Hildegard Kuehne, Hueihan Jhuang, Est baliz Garrote, Tomaso Poggio, and Thomas Serre. Hmdb: a large video database for human motion recognition. In Computer Vision (ICCV), 2011 IEEE International Conference on, pages 2556–2563. IEEE, 2011.
19. Ivan Laptev and Patrick P rez. Retrieving actions in movies. In Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, pages 1–8. IEEE, 2007.
20. Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. You only look once: Unified, real-time object detection. arXiv preprint arXiv:1506.02640, 2015.
21. Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. Faster R-CNN: Towards real-time object detection with region proposal networks. In Advances in Neural Information Processing Systems, pages 91–99, 2015.
22. Juan C. SanMiguel and Sergio Suja. Liris harl competition participant, 2012. Video Processing and Understanding Lab, Universidad Autonoma of Madrid, Spain, http://liris.cnrs.fr/harl2012/results.html.
23. Karen Simonyan and Andrew Zisserman. Two-stream convolutional networks for action recognition in videos. In Advances in Neural Information Processing Systems 27, pages 568–576. Curran Associates, Inc., 2014.
24. Karen Simonyan and Andrew Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
25. Khurram Soomro, Amir Roshan Zamir, and Mubarak Shah. UCF101: A dataset of 101 human action classes from videos in the wild. Technical report, CRCV-TR-12-01, 2012.
26. Khurram Soomro, Haroon Idrees, and Mubarak Shah. Action localization in videos through context walk. In Proceedings of the IEEE International Conference on Computer Vision, 2015.
27. Yicong Tian, Rahul Sukthankar, and Mubarak Shah. Spatiotemporal deformable part models for action detection. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 2642–2649. IEEE, 2013.
28. J.R.R. Uijlings, K.E.A. van de Sande, T. Gevers, and A.W.M. Smeulders. Selective search for object recognition. Int. Journal of Computer Vision, 2013. URL http://www.huppelen.nl/publications/selectiveSearchDraft.pdf.
29. Jan C van Gemert, Mihir Jain, Ella Gati, and Cees GM Snoek. Apt: Action localization proposals from dense trajectories. In BMVC, volume 2, page 4, 2015.
30. H. Wang, A. Kl ser, C. Schmid, and C. Liu. Action Recognition by Dense Trajectories. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, 2011.
31. Heng Wang and Cordelia Schmid. Action Recognition with Improved Trajectories. In Proc. Int. Conf. Computer Vision, pages 3551–3558, 2013.
32. Limin Wang, Yu Qiao, and Xiaoou Tang. Video action detection with relational dynamic-poselets. In Computer Vision–ECCV 2014, pages 565–580. Springer, 2014.
33. Limin Wang, Yu Qiao, Xiaoou Tang, and Luc Van Gool. Actionness estimation using hybrid fully convolutional networks. In CVPR, pages 2708–2717, 2016.
34. Philippe Weinzaepfel, Zaid Harchaoui, and Cordelia Schmid. Learning to track for spatio-temporal action localization. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, June 2015.
35. C. Wolf, J. Mille, E. Lombardi, O. Celiktutan, M. Jiu, E. Dogan, G. Eren, M. Baccouche, E. Dellandrea, C.-E. Bichot, C. Garcia, and B. Sankur. Evaluation of video activity localizations integrating quality and quantity measurements. In Computer Vision and Image Understanding, 127:14–30, 2014.
36. Christian Wolf, Julien Mille, Eric Lombardi, Oya Celiktutan, Mingyuan Jiu, Moez Baccouche, Emmanuel Dellandr l’a, Charles-Edmond Bichot, Christophe Garcia, and B ijlent Sankur. The LIRIS Human activities dataset and the ICPR 2012 human activities recognition and localization competition. Technical Report RR-LIRIS-2012-004, LIRIS UMR 5205 CNRS/INSA de Lyon/Universit Claude Bernard Lyon 1/Univer-sit Lumi re Lyon 2/ cole Centrale de Lyon, March 2012. URL http://liris.cnrs.fr/publis/?id=5498.
37. Zhongwen Xu, Yi Yang, and Alexander G Hauptmann. A discriminative cnn video representation for event detection. arXiv preprint arXiv:1411.4006, 2014.
38. Serena Yeung, Olga Russakovsky, Ning Jin, Mykhaylo Andriluka, Greg Mori, and Li Fei-Fei. Every moment counts: Dense detailed labeling of actions in complex videos. arXiv preprint arXiv:1507.05738, 2015.
39. Gang Yu and Junsong Yuan. Fast action proposals for human action detection and search. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1302–1311, 2015.
40. C Lawrence Zitnick and Piotr Doll r. Edge boxes: Locating object proposals from edges. In Computer Vision–ECCV 2014, pages 391–405. Springer, 2014.