Fast Temporal Activity Proposals for Efficient Detection of Human Actions in Untrimmed Videos

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 1914-1923

  Heilbron, Fabian Caba ^a   Niebles, Juan Carlos ^b,c   Ghanem, Bernard ^a  

^a KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Saudi Arabia)

^b Stanford University   (United States)

^c UNIVERSIDAD DEL NORTE   (Colombia)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; IMAGE RECOGNITION; MOTION ESTIMATION; VIDEO SIGNAL PROCESSING;

ACTION RECOGNITION; ACTIVITY DETECTION; EFFICIENT DETECTION; LARGE-SCALE VIDEO COLLECTIONS; LEARNING FRAMEWORKS; SPARSE DICTIONARIES; TEMPORAL INTERVALS; TEMPORAL SEGMENTS;

PATTERN RECOGNITION;

EID: 84986275821     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.211     Document Type: Conference Paper

References (41)

1. B. Alexe, T. Deselaers, and V. Ferrari. Measuring the objectness of image windows. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(11):2189-2202, 2012.
2. P. Arbelaez, J. Pont-Tuset, J. Barron, F. Marques, and J. Malik. Multiscale combinatorial grouping. In CVPR, 2014.
3. I. Atmosukarto, B. Ghanem, and N. Ahuja. Trajectory-based fisher kernel representation for action recognition in videos. In ICPR, 2012.
4. F. Caba Heilbron, V. Escorcia, B. Ghanem, and J. Carlos Niebles. Activitynet: A large-scale video benchmark for human activity understanding. In CVPR, 2015.
5. F. Caba Heilbron, A. Thabet, J. C. Niebles, and B. Ghanem. Camera motion and surrounding scene appearance as context for action recognition. In ACCV. 2014.
6. W. Chen, C. Xiong, R. Xu, and J. J. Corso. Actionness ranking with lattice conditional ordinal random fields. In CVPR, 2014.
7. K. Fragkiadaki, P. Arbelaez, P. Felsen, and J. Malik. Learning to segment moving objects in videos. In CVPR, 2015.
8. S. Gao, I. Tsang, L.-T. Chia, and P. Zhao. Local features are not lonely-laplacian sparse coding for image classification. In CVPR, 2010.
9. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014.
10. G. Gkioxari and J. Malik. Finding action tubes. In CVPR, 2015.
11. T. Guha and R. Ward. Learning sparse representations for human action recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(8):1576-1588, 2012.
12. J. Hosang, R. Benenson, P. Dollár, and B. Schiele. What makes for effective detection proposals? IEEE Transactions on Pattern Analysis and Machine Intelligence, 38(4):814-830, 2016.
13. M. Jain, J. v. Gemert, H. Jégou, P. Bouthemy, and C. G. Snoek. Action localization with tubelets from motion. In CVPR, 2014.
14. Y.-G. Jiang, J. Liu, A. Roshan Zamir, G. Toderici, I. Laptev, M. Shah, and R. Sukthankar. THUMOS challenge: Action recognition with a large number of classes. http: //crcv.ucf.edu/THUMOS14/, 2014.
15. M. Jiu, C. Wolf, C. Garcia, and A. Baskurt. Supervised learning and codebook optimization for bag-of-words models. Cognitive Computation, 4(4):409-419, 2012.
16. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS. 2012.
17. I. Laptev. On space-time interest points. International Journal of Computer Vision, 64(2-3):107-123, 2005.
18. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld. Learning realistic human actions from movies. In CVPR, 2008.
19. J. Mairal, J. Ponce, G. Sapiro, A. Zisserman, and F. R. Bach. Supervised dictionary learning. In NIPS. 2009.
20. P. Mettes, J. C. van Gemert, S. Cappallo, T. Mensink, and C. G. Snoek. Bag-of-fragments: Selecting and encoding video fragments for event detection and recounting. In Proceedings of the 5th ACM on International Conference on Multimedia Retrieval, pages 427-434. ACM, 2015.
21. J. Niebles, H. Wang, and L. Fei-Fei. Unsupervised learning of human action categories using spatial-temporal words. International Journal of Computer Vision, 79(3):299-318, 2008.
22. D. Oneata, J. Revaud, J. Verbeek, and C. Schmid. Spatiotemporal object detection proposals. In ECCV. 2014.
23. D. Oneata, J. Verbeek, and C. Schmid. The LEAR submission at thumos 2014. THUMOS14 Action Recognition Challenge, 2014.
24. X. Peng, L. Wang, X. Wang, and Y. Qiao. Bag of visual words and fusion methods for action recognition: Comprehensive study and good practice. arXiv preprint arXiv:1405.4506, 2014.
25. A. Quattoni, X. Carreras, M. Collins, and T. Darrell. An efficient projection for l1,? regularization. In ICML, 2009.
26. J. Sánchez, F. Perronnin, T. Mensink, and J. Verbeek. Image classification with the fisher vector: Theory and practice. International Journal of Computer Vision, 105(3):222-245, 2013.
27. C. Schuldt, I. Laptev, and B. Caputo. Recognizing human actions: a local svm approach. In ICPR, 2004.
28. A. Shabou and H. LeBorgne. Locality-constrained and spatially regularized coding for scene categorization. In CVPR, 2012.
29. C. Sun, S. Shetty, R. Sukthankar, and R. Nevatia. Temporal localization of fine-grained actions in videos by domain transfer from web images. In Proceedings of the 23rd Annual ACM Conference on Multimedia Conference, pages 371-380. ACM, 2015.
30. J. R. Uijlings, K. E. van de Sande, T. Gevers, and A. W. Smeulders. Selective search for object recognition. International journal of computer vision, 104(2):154-171, 2013.
31. J. van Gemert, M. Jain, E. Gati, and C. G. M. Snoek. APT: Action localization proposals from dense trajectories. In BMVC, 2015.
32. H. Wang and C. Schmid. Action recognition with improved trajectories. In ICCV, 2013.
33. L. Wang, Y. Qiao, and X. Tang. Action recognition and detection by combining motion and appearance features. THUMOS14 Action Recognition Challenge, 2014.
34. J. Yang, K. Yu, Y. Gong, and T. Huang. Linear spatial pyramid matching using sparse coding for image classification. In CVPR, 2009.
35. G. Yu and J. Yuan. Fast action proposals for human action detection and search. In CVPR, 2015.
36. J. Yuan, Z. Liu, and Y.Wu. Discriminative subvolume search for efficient action detection. In CVPR, 2009.
37. X. Yuan and S. Yan. Visual classification with multi-task joint sparse representation. In CVPR, 2010.
38. T. Zhang, B. Ghanem, S. Liu, and N. Ahuja. Robust visual tracking via structured multi-task sparse learning. International Journal of Computer Vision, 101(2):367-383, 2013.
39. T. Zhang, S. Liu, C. Xu, S. Yan, B. Ghanem, N. Ahuja, and M.-H. Yang. Structural Sparse Tracking. In CVPR, 2015.
40. B. Zhao and E. Xing. Quasi real-time summarization for consumer videos. In CVPR, 2014.
41. C. L. Zitnick and P. Dollár. Edge boxes: Locating object proposals from edges. In ECCV. 2014.