Temporal Action Detection Using a Statistical Language Model

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 3131-3140

  Richard, Alexander ^a   Gall, Juergen ^a  

^a UNIVERSITY OF BONN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER VISION; DYNAMIC PROGRAMMING; MODELING LANGUAGES; NATURAL LANGUAGE PROCESSING SYSTEMS;

ACTION MODELING; ACTION RECOGNITION; ACTION SEQUENCES; JOINT PROBABILITY; MODEL COMPONENTS; STATE OF THE ART; STATISTICAL LANGUAGE MODELING; THREE COMPONENT;

PATTERN RECOGNITION;

EID: 84986270053     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.341     Document Type: Conference Paper

References (32)

1. L. R. Bahl, F. Jelinek, and R. L. Mercer. A maximum likelihood approach to continuous speech recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 5:179-190, 1983.
2. S. Bhattacharya, M. M. Kalayeh, R. Sukthankar, and M. Shah. Recognition of complex events: Exploiting temporal dynamics between underlying concepts. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, pages 2243-2250, 2014.
3. Y. Cheng, Q. Fan, S. Pankanti, and A. Choudhary. Temporal sequence modeling for video event detection. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, pages 2235-2242, 2014.
4. E. Eyjolfsdottir, S. Branson, X. P. Burgos-Artizzu, E. D. Hoopfer, J. Schor, D. J. Anderson, and P. Perona. Detecting social actions of fruit flies. In European Conf. on Computer Vision, pages 772-787, 2014.
5. M. Hoai, Z.-Z. Lan, and F. De la Torre. Joint segmentation and classification of human actions in video. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, pages 3265-3272, 2011.
6. M. Jain, J. Van Gemert, H. Jégou, P. Bouthemy, and C. G. Snoek. Action localization with tubelets from motion. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, pages 740-747, 2014.
7. M. Jain, J. C. van Gemert, and C. G. Snoek. What do 15,000 object categories tell us about classifying and localizing actions? In IEEE Int. Conf. on Computer Vision and Pattern Recognition, pages 46-55, 2015.
8. Y.-G. Jiang, J. Liu, A. Roshan Zamir, G. Toderici, I. Laptev, M. Shah, and R. Sukthankar. THUMOS challenge: Action recognition with a large number of classes. http: //crcv.ucf.edu/THUMOS14/, 2014.
9. S. Karaman, L. Seidenari, and A. Del Bimbo. Fast saliency based pooling of Fisher encoded dense trajectories. Technical report, University of Florence, 2014.
10. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, pages 1725-1732, 2014.
11. H. Kuehne, A. Arslan, and T. Serre. The language of actions: Recovering the syntax and semantics of goal-directed human activities. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, pages 780-787, 2014.
12. H. Kuehne, J. Gall, and T. Serre. An end-to-end generative framework for video segmentation and recognition. In IEEE Winter Conf. on Applications of Computer Vision, 2016.
13. T. Lan, Y. Zhu, A. R. Zamir, and S. Savarese. Action recognition by hierarchical mid-level action elements. In Int. Conf. on Computer Vision, 2015.
14. P. Mettes, J. C. van Gemert, S. Cappallo, T. Mensink, and C. G. Snoek. Bag-of-fragments: Selecting and encoding video fragments for event detection and recounting. In ACM Int. Conf. on Multimedia Retrieval, 2015.
15. H. Ney, U. Essen, and R. Kneser. On structuring probabilistic dependences in stochastic language modelling. Computer Speech & Language, 8:1-38, 1994.
16. B. Ni, V. R. Paramathayalan, and P. Moulin. Multiple granularity analysis for fine-grained action detection. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, pages 756-763, 2014.
17. D. Oneata, J. Verbeek, and C. Schmid. The LEAR submission at Thumos 2014. Technical report, Inria, 2014.
18. H. Pirsiavash and D. Ramanan. Parsing videos of actions with segmental grammars. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, pages 612-619, 2014.
19. M. Rohrbach, S. Amin, M. Andriluka, and B. Schiele. A database for fine grained activity detection of cooking activities. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, pages 1194-1201, 2012.
20. G. Sharir and T. Tuytelaars. Action in chains: A chains model for action localization and classification. In IEEE Winter Conf. on Applications of Computer Vision, pages 610-617, 2014.
21. Q. Shi, L. Wang, L. Cheng, and A. Smola. Discriminative human action segmentation and recognition using semi-Markov model. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, 2008.
22. K. Simonyan and A. Zisserman. Two-stream convolutional networks for action recognition in videos. In Advances in Neural Information Processing Systems, pages 568-576, 2014.
23. K. Soomro, A. R. Zamir, and M. Shah. Ucf101: A dataset of 101 human actions classes from videos in the wild. arXiv preprint arXiv:1212.0402, 2012.
24. S. Stein and S. J. McKenna. Combining embedded accelerometers with computer vision for recognizing food preparation activities. In ACM Int. Joint Conf. on Pervasive and Ubiquitous Computing, pages 729-738, 2013.
25. C. Sun, S. Shetty, R. Sukthankar, and R. Nevatia. Temporal localization of fine-grained actions in videos by domain transfer from web images. In ACM Conf. on Multimedia, pages 371-380, 2015.
26. J. C. van Gemert, M. Jain, E. Gati, and C. G. Snoek. APT: Action localization proposals from dense trajectories. In British Machine Vision Conference, 2015.
27. N. N. Vo and A. F. Bobick. From stochastic grammar to bayes network: Probabilistic parsing of complex activity. In IEEE Int. Conf. on Computer Vision and Pattern Recognition, pages 2641-2648, 2014.
28. H. Wang and C. Schmid. Action recognition with improved trajectories. In Int. Conf. on Computer Vision, pages 3551-3558, 2013.
29. L. Wang, Y. Qiao, and X. Tang. Action recognition and detection by combining motion and appearance features. Technical report, The Chinese University of Hong Kong and Shenzhen Institutes of Advanced Technology, 2014.
30. D. Weinland, R. Ronfard, and E. Boyer. A survey of visionbased methods for action representation, segmentation and recognition. Computer Vision and Image Understanding, 115:224-241, 2011.
31. S. Wiesler, A. Richard, P. Golik, R. Schluter, and H. Ney. RASR/NN: The RWTH neural network toolkit for speech recognition. In IEEE Int. Conf. on Acoustics, Speech and Signal Processing, pages 3281-3285, 2014.
32. J. Yuan, Z. Liu, and Y. Wu. Discriminative video pattern search for efficient action detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33:1728-1743, 2011.