Learning Activity Progression in LSTMs for Activity Detection and Early Detection

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 1942-1950

  Ma, Shugao ^a   Sigal, Leonid ^b   Sclaroff, Stan ^a  

^a BOSTON UNIVERSITY   (United States)

^b DISNEY RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; RECURRENT NEURAL NETWORKS;

ACTIVITY DETECTION; CLASSIFICATION ERRORS; DETECTION TASKS; LEARNING ACTIVITY; LONG SHORT TERM MEMORY;

PATTERN RECOGNITION;

EID: 84986254033     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.214     Document Type: Conference Paper

References (28)

1. W. Brendel and S. Todorovic. Learning spatiotemporal graphs of human activities. In ICCV, 2011.
2. P. F. Felzenszwalb, R. B. Girshick, D. A. McAllester, and D. Ramanan. Object detection with discriminatively trained part-based models. TPAMI, 32(9):1627-1645, 2010.
3. G. Gkioxari and J. Malik. Finding action tubes. In CVPR, 2015.
4. F. C. Heilbron, V. Escorcia, B. Ghanem, and J. C. Niebles. Activitynet: A large-scale video benchmark for human activity understanding. In CVPR, 2015.
5. M. Hoai and F. De la Torre. Max-margin early event detectors. IJCV, 107(2):191-202, 2014.
6. S. Ji, W. Xu, M. Yang, and K. Yu. 3d convolutional neural networks for human action recognition. TPAMI, 35(1):221-231, 2013.
7. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In CVPR, 2014.
8. Y. Ke, R. Sukthankar, and M. Hebert. Event detection in crowded videos. In ICCV, 2007.
9. Y. Kong and Y. Fu. Max-margin action prediction machine. TPAMI, PP(99):1-1, 2015.
10. T. Lan, Y. Wang, and G. Mori. Discriminative figure-centric models for joint action localization and recognition. In ICCV, 2011.
11. I. Laptev, M. Marsza?ek, C. Schmid, and B. Rozenfeld. Learning realistic human actions from movies. In CVPR, 2008.
12. S. Ma, L. Sigal, and S. Sclaroff. Space-time tree ensemble for action recognition. In CVPR, 2015.
13. S. Ma, J. Zhang, N. Ikizler-Cinbis, and S. Sclaroff. Action recognition and localization by hierarchical space-time segments. In ICCV, 2013.
14. J. Y. Ng, M. J. Hausknecht, S. Vijayanarasimhan, O. Vinyals, R. Monga, and G. Toderici. Beyond short snippets: Deep networks for video classification. CoRR, abs/1503.08909, 2015.
15. B. Ni, V. R. Paramathayalan, and P. Moulin. Multiple granularity analysis for fine-grained action detection. In CVPR, 2014.
16. V. Pham, C. Kermorvant, and J. Louradour. Dropout improves recurrent neural networks for handwriting recognition. CoRR, 2013.
17. M. Raptis and L. Sigal. Poselet key-framing: A model for human activity recognition. In CVPR, 2013.
18. M. Rohrbach, A. Rohrbach, M. Regneri, S. Amin, M. Andriluka, M. Pinkal, and B. Schiele. Recognizing fine-grained and composite activities using hand-centric features and script data. CoRR, abs/1502.06648, 2015.
19. M. Ryoo. Human activity prediction: Early recognition of ongoing activities from streaming videos. In ICCV, 2011.
20. K. Simonyan and A. Zisserman. Two-stream convolutional networks for action recognition in videos. In NIPS, 2014.
21. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. ICLR, 2015.
22. Y. Tian, R. Sukthankar, and M. Shah. Spatiotemporal deformable part models for action detection. In CVPR, 2013.
23. H. Wang and C. Schmid. Action recognition with improved trajectories. In ICCV, 2013.
24. L. Wang, Y. Qiao, and X. Tang. Video action detection with relational dynamic-poselets. In ECCV, 2014.
25. Y. Wang and G. Mori. Hidden part models for human action recognition: Probabilistic versus max margin. TPAMI, 33(7):1310-1323, 2011.
26. Z. Wu, X. Wang, Y. Jiang, H. Ye, and X. Xue. Modeling spatial-temporal clues in a hybrid deep learning framework for video classification. CoRR, abs/1504.01561, 2015.
27. S. Yeung, O. Russakovsky, N. Jin, M. Andriluka, G. Mori, and F. Li. Every moment counts: Dense detailed labeling of actions in complex videos. CoRR, 2015.
28. J. Yuan, Z. Liu, and Y.Wu. Discriminative subvolume search for efficient action detection. In CVPR, 2009.