Unsupervised Action Discovery and Localization in Videos

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2017-October, Issue , 2017, Pages 696-705

  Soomro, Khurram ^a   Shah, Mubarak ^a  

^a UNIVERSITY OF CENTRAL FLORIDA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTERING ALGORITHMS; COMBINATORIAL OPTIMIZATION; DIRECTED GRAPHS; IMAGE SEGMENTATION; ITERATIVE METHODS;

ACTION CLASSIFIER; DISCRIMINATIVE CLUSTERING; KNAPSACK OPTIMIZATION; KNAPSACK PROBLEMS; SPECTRAL CLUSTERING; STATE OF THE ART; SUPERVISED METHODS; TEMPORAL CONSTRAINTS;

COMPUTER VISION;

EID: 85041908490     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2017.82     Document Type: Conference Paper

References (57)

1. S. Abu-El-Haija, N. Kothari, J. Lee, P. Natsev, G. Toderici, B. Varadarajan, and S. Vijayanarasimhan. Youtube-8m: A large-scale video classification benchmark. ArXiv preprint arXiv:1609.08675, 2016
2. W. Chen and J. J. Corso. Action detection by implicit intentional motion clustering. In ICCV, 2015
3. R. De Geest, E. Gavves, A. Ghodrati, Z. Li, C. Snoek, and T. Tuytelaars. Online action detection. In ECCV, 2016
4. C. Desai and D. Ramanan. Detecting actions, poses, and objects with relational phraselets. In ECCV. 2012
5. B. G. Fabian Caba Heilbron, Victor Escorcia and J. C. Niebles. Activitynet: A large-scale video benchmark for human activity understanding. In CVPR, 2015
6. G. Gkioxari and J. Malik. Finding action tubes. In CVPR, 2015
7. J. Harel, C. Koch, and P. Perona. Graph-based visual saliency. In NIPS, 2006
8. Y. Hu, L. Cao, F. Lv, S. Yan, Y. Gong, and T. S. Huang. Action detection in complex scenes with spatial and temporal ambiguities. In ICCV, 2009
9. M. Jain, J. Gemert, H. Jegou, P. Bouthemy, and C. Snoek. Action localization with tubelets from motion. In CVPR, 2014
10. M. Jain, J. C. van Gemert, and C. G. Snoek. What do 15,000 object categories tell us about classifying and localizing actions In CVPR, 2015
11. H. Jhuang, J. Gall, S. Zuffi, C. Schmid, and M. J. Black. Towards understanding action recognition. In ICCV, 2013
12. Y. Jiang, J. Liu, A. R. Zamir, G. Toderici, I. Laptev, M. Shah, and R. Sukthankar. Thumos challenge: Action recognition with a large number of classes. In ECCV Workshop, 2014
13. Y.-G. Jiang, J. Liu, A. Roshan Zamir, I. Laptev, M. Piccardi, M. Shah, and R. Sukthankar. THUMOS challenge: Action recognition with a large number of classes. http://crcv.ucf.edu/ ICCV13-Action-Workshop/, 2013
14. S. Jones and L. Shao. A multigraph representation for improved unsupervised/semi-supervised learning of human actions. In CVPR, 2014
15. S. Jones and L. Shao. Unsupervised spectral dual assignment clustering of human actions in context. In CVPR, 2014
16. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In CVPR, 2014
17. Y. Ke, R. Sukthankar, and M. Hebert. Event detection in crowded videos. In ICCV, 2007
18. T. Lan, Y. Wang, and G. Mori. Discriminative figurecentric models for joint action localization and recognition. In ICCV, 2011
19. A.-A. Liu, Y.-T. Su, W.-Z. Nie, and M. Kankanhalli. Hierarchical clustering multi-task learning for joint human action grouping and recognition. 39(1), 2017
20. J. Lu, R. Xu, and J. J. Corso. Human action segmentation with hierarchical supervoxel consistency. In CVPR, 2015
21. S. Ma, J. Zhang, N. Ikizler-Cinbis, and S. Sclaroff. Action recognition and localization by hierarchical spacetime segments. In ICCV, 2013
22. S. Ma, J. Zhang, S. Sclaroff, N. Ikizler-Cinbis, and L. Sigal. Space-time tree ensemble for action recognition and localization. IJCV, 2017
23. A. Y. Ng, M. I. Jordan, Y. Weiss, et al. On spectral clustering: Analysis and an algorithm. NIPS, 2002
24. J. C. Niebles, H. Wang, and L. Fei-Fei. Unsupervised learning of human action categories using spatialtemporal words. IJCV, 79(3), 2008
25. D. Oneata, J. Revaud, J. Verbeek, and C. Schmid. Spatiotemporal object detection proposals. In ECCV, 2014
26. D. Oneata, J. Verbeek, and C. Schmid. Efficient action localization with approximately normalized fisher vectors. In CVPR, 2014
27. M. Pavan and M. Pelillo. A new graph-theoretic approach to clustering and segmentation. In CVPR, 2003
28. M. Pavan and M. Pelillo. Dominant sets and pairwise clustering. IEEE TPAMI, 29(1), 2007
29. X. Peng and C. Schmid. Multi-region two-stream r-cnn for action detection. In ECCV, 2016
30. F. Perronnin and C. Dance. Fisher kernels on visual vocabularies for image categorization. In CVPR, 2007
31. S. Ren, K. He, R. Girshick, and J. Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. In NIPS, 2015
32. M. Rodriguez, A. Javed, and M. Shah. Action mach: A spatio-temporal maximum average correlation height filter for action recognition. In CVPR, 2008
33. S. Savarese, A. DelPozo, J. C. Niebles, and L. Fei-Fei. Spatial-temporal correlatons for unsupervised action classification. In WMVC, 2008
34. N. Shapovalova, M. Raptis, L. Sigal, and G. Mori. Action is in the eye of the beholder: Eye-gaze driven model for spatio-temporal action localization. In NIPS, 2013
35. J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE TPAMI, 22(8), 2000
36. K. Soomro, H. Idrees, and M. Shah. Action localization in videos through context walk. In ICCV, 2015
37. K. Soomro, H. Idrees, and M. Shah. Online localization and prediction of actions and interactions. ArXiv preprint arXiv:1612.01194, 2016
38. K. Soomro, H. Idrees, and M. Shah. Predicting the where and what of actors and actions through online action localization. In CVPR, 2016
39. K. Soomro and A. R. Zamir. Action recognition in realistic sports videos. In Computer Vision in Sports, pages 181-208. Springer, 2014
40. K. Soomro, A. R. Zamir, and M. Shah. Ucf101: A dataset of 101 human actions classes from videos in the wild. ArXiv preprint arXiv:1212.0402, 2012
41. Y. Tian, R. Sukthankar, and M. Shah. Spatiotemporal deformable part models for action detection. In CVPR, 2013
42. D. Tran, L. Bourdev, R. Fergus, L. Torresani, and M. Paluri. Learning spatiotemporal features with 3d convolutional networks. In ICCV, 2015
43. D. Tran and J. Yuan. Max-margin structured output regression for spatio-temporal action localization. In NIPS, 2012
44. G. Vaca-Castano, S. Das, J. P. Sousa, N. D. Lobo, and M. Shah. Improved scene identification and object detection on egocentric vision of daily activities. CVIU, 156, 2017
45. J. C. van Gemert, M. Jain, E. Gati, and C. G. Snoek. Apt: Action localization psroposals from dense trajectories. In BMVC, 2015
46. H. Wang and C. Schmid. Action recognition with improved trajectories. In ICCV, 2013
47. L. Wang, Y. Qiao, and X. Tang. Video action detection with relational dynamic-poselets. In ECCV. 2014
48. Y. Wang, H. Jiang, M. S. Drew, Z.-N. Li, and G. Mori. Unsupervised discovery of action classes. In CVPR, 2006
49. P. Weinzaepfel, Z. Harchaoui, and C. Schmid. Learning to track for spatio-temporal action localization. In ICCV, 2015
50. Y. Xie, H. Chang, Z. Li, L. Liang, X. Chen, and D. Zhao. A unified framework for locating and recognizing human actions. In CVPR, 2011
51. Y. Yang, I. Saleemi, and M. Shah. Discovering motion primitives for unsupervised grouping and one-shot learning of human actions, gestures, and expressions. IEEE TPAMI, 35(7), 2013
52. S. Yeung, O. Russakovsky, G. Mori, and L. Fei-Fei. Endto-end learning of action detection from frame glimpses in videos. ArXiv preprint arXiv:1511.06984, 2015
53. S. Yeung, O. Russakovsky, G. Mori, and L. Fei-Fei. Endto-end learning of action detection from frame glimpses in videos. In CVPR, 2016
54. G. Yu, N. A. Goussies, J. Yuan, and Z. Liu. Fast action detection via discriminative random forest voting and top-k subvolume search. IEEE Transactions on Multimedia, 13(3), 2011
55. G. Yu and J. Yuan. Fast action proposals for human action detection and search. In CVPR, 2015
56. J. Yuan, Z. Liu, and Y. Wu. Discriminative video pattern search for efficient action detection. IEEE TPAMI, 33(9), 2011
57. Z. Zhou, F. Shi, andW.Wu. Learning spatial and temporal extents of human actions for action detection. IEEE Transactions on Multimedia, 17(4), 2015.