VLAD3: Encoding Dynamics of Deep Features for Action Recognition

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 1951-1960

  Li, Yingwei ^a   Li, Weixin ^a   Mahadevan, Vijay ^a   Vasconcelos, Nuno ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX NETWORKS; COMPUTER VISION; DYNAMICS; LINEAR CONTROL SYSTEMS; NEURAL NETWORKS;

ACTION RECOGNITION; COMPLEX ACTIVITY; CONVOLUTIONAL NEURAL NETWORK; DYNAMIC INFORMATION; LINEAR DYNAMIC SYSTEM; PROCESS VIDEO; STATE OF THE ART; VIDEO DYNAMIC;

PATTERN RECOGNITION;

EID: 84986305500     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.215     Document Type: Conference Paper

References (35)

1. R. Arandjelovic and A. Zisserman. All about vlad. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 1578-1585. IEEE, 2013.
2. S. Bhattacharya, M. M. Kalayeh, R. Sukthankar, and M. Shah. Recognition of complex events: Exploiting temporal dynamics between underlying concepts. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 2243-2250. IEEE, 2014.
3. A. B. Chan and N. Vasconcelos. Modeling, clustering, and segmenting video with mixtures of dynamic textures. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 30(5):909-926, 2008.
4. J. Donahue, L. A. Hendricks, S. Guadarrama, M. Rohrbach, S. Venugopalan, T. Darrell, and K. Saenko. Long-term recurrent convolutional networks for visual recognition and description. In Computer Vision and Pattern Recognition (CVPR), 2015 IEEE Conference on, pages 2625-2634, June 2015.
5. G. Doretto, A. Chiuso, Y. N. Wu, and S. Soatto. Dynamic textures. International Journal of Computer Vision, 51(2):91-109, 2003.
6. J. L. Elman. Finding structure in time. Cognitive science, 14(2):179-211, 1990.
7. A. Gaidon, Z. Harchaoui, and C. Schmid. Activity representation with motion hierarchies. International journal of computer vision, 107(3):219-238, 2014.
8. A. Gorban, H. Idrees, Y.-G. Jiang, A. Roshan Zamir, I. Laptev, M. Shah, and R. Sukthankar. THUMOS challenge: Action recognition with a large number of classes.
9. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural computation, 9(8):1735-1780, 1997.
10. T. Jaakkola and D. Haussler. Exploiting generative models in discriminative classifiers. In Advances in Neural Information Processing Systems, pages 487-493, 1999.
11. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1725-1732. IEEE, 2014.
12. F.W. Ke Ning. Zjudcd submission at thumos challenge 2015. In CVPR workshop, 2015.
13. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097-1105, 2012.
14. Z. Lan, M. Lin, X. Li, A. G. Hauptmann, and B. Raj. Beyond Gaussian pyramid: Multi-skip feature stacking for action recognition. In Computer Vision and Pattern Recognition (CVPR), 2015 IEEE Conference on, pages 204-212, June 2015.
15. I. Laptev, M. Marsza?ek, C. Schmid, and B. Rozenfeld. Learning realistic human actions from movies. In Computer Vision and Pattern Recognition (CVPR), 2008 IEEE Conference on, pages 1-8. IEEE, 2008.
16. W. Li, Q. Yu, H. Sawhney, and N. Vasconcelos. Recognizing activities via bag of words for attribute dynamics. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 2587-2594. IEEE, 2013.
17. J. Liu, B. Kuipers, and S. Savarese. Recognizing human actions by attributes. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 3337-3344. IEEE, 2011.
18. R. J. Martin. A metric for arma processes. Signal Processing, IEEE Transactions on, 48(4):1164-1170, 2000.
19. J. Y.-H. Ng, M. Hausknecht, S. Vijayanarasimhan, O. Vinyals, R. Monga, and G. Toderici. Beyond short snippets: Deep networks for video classification. In Computer Vision and Pattern Recognition (CVPR), 2015 IEEE Conference on, pages 4694-4702, June 2015.
20. J. C. Niebles, C.-W. Chen, and L. Fei-Fei. Modeling temporal structure of decomposable motion segments for activity classification. In Computer Vision-ECCV 2010, pages 392-405. Springer, 2010.
21. X. Peng, L. Wang, X. Wang, and Y. Qiao. Bag of visual words and fusion methods for action recognition: Comprehensive study and good practice. arXiv preprint arXiv:1405.4506, 2014.
22. X. Peng, C. Zou, Y. Qiao, and Q. Peng. Action recognition with stacked fisher vectors. In Computer Vision-ECCV 2014, pages 581-595. Springer, 2014.
23. Z. Qiu, Q. Li, T. Yao, T. Mei, and Y. Rui. Msr asia msm at thumos challenge 2015. In CVPR workshop, 2015.
24. J. Sánchez and F. Perronnin. High-dimensional signature compression for large-scale image classification. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 1665-1672. IEEE, 2011.
25. R. H. Shumway and D. S. Stoffer. An approach to time series smoothing and forecasting using the em algorithm. Journal of time series analysis, 3(4):253-264, 1982.
26. K. Simonyan and A. Zisserman. Two-stream convolutional networks for action recognition in videos. In Advances in Neural Information Processing Systems, pages 568-576, 2014.
27. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
28. K. Soomro, A. Roshan Zamir, and M. Shah. UCF101: A dataset of 101 human actions classes from videos in the wild. In CRCV-TR-12-01, 2012.
29. C. Sun and R. Nevatia. Active: Activity concept transitions in video event classification. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 913-920. IEEE, 2013.
30. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In Computer Vision and Pattern Recognition (CVPR), 2015 IEEE Conference on, pages 1-9, June 2015.
31. D. Tran, L. Bourdev, R. Fergus, L. Torresani, and M. Paluri. C3d: generic features for video analysis. arXiv preprint arXiv:1412.0767, 2014.
32. H. Wang and C. Schmid. Action recognition with improved trajectories. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 3551-3558. IEEE, 2013.
33. L. Wang, Y. Qiao, and X. Tang. Action recognition with trajectory-pooled deep-convolutional descriptors. In Computer Vision and Pattern Recognition (CVPR), 2015 IEEE Conference on, pages 4305-4314, June 2015.
34. Z. Xu, Y. Yang, and A. G. Hauptmann. A discriminative cnn video representation for event detection. In Computer Vision and Pattern Recognition (CVPR), 2015 IEEE Conference on, pages 1798-1807, June 2015.
35. Z. Xu, L. Zhu, Y. Yang, and A. G. Hauptmann. Uts-cmu at thumos 2015. In CVPR workshop, 2015.