Going deeper into action recognition: A survey

Image and Vision Computing

Volumn 60, Issue , 2017, Pages 4-21

  Herath, Samitha ^a   Harandi, Mehrtash ^a   Porikli, Fatih ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Deep networks; Human action recognition; Motion recognition; Survey

Indexed keywords

IMAGE RECOGNITION; IMAGE SEGMENTATION; MOTION ESTIMATION; OBJECT RECOGNITION; SECURITY SYSTEMS; SEMANTICS; SURVEYING; SURVEYS;

ACTION RECOGNITION; CONTROLLED ENVIRONMENT; HUMAN ACTION ANALYSIS; HUMAN-ACTION RECOGNITION; LEARNING-BASED APPROACH; MOTION RECOGNITION; SEMANTIC SEGMENTATION; VIDEO SURVEILLANCE;

HUMAN COMPUTER INTERACTION;

EID: 85013912362     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2017.01.010     Document Type: Article

References (161)

1. [1] Aggarwal, J.K., Distributed Video Sensor Networks. 2011, Springer London, London, 27–39 Ch. Motion Analysis: Past, Present and Future.
2. [2] Ahad, M.A.R., Tan, J.K., Kim, H., Ishikawa, S., Motion history image: its variants and applications. Mach. Vis. Appl., 23, 2012.
3. [3] Arandjelovic, R., Zisserman, A., All About VLAD. Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, June 2013, 1578–1585.
4. [4] Baccouche, M., Mamalet, F., Wolf, C., Garcia, C., Baskurt, A., Sequential deep learning for human action recognition. Proceedings of the Second International Conference on Human Behavior Understanding. HBU’11, 2011, 29–39.
5. [5] Bengio, Y., Simard, P., Frasconi, P., Learning long-term dependencies with gradient descent is difficult. IEEE Trans. Neural Netw. 5:2 (1994), 157–166.
6. [6] Blank, M., Gorelick, L., Shechtman, E., Irani, M., Basri, R., Actions as space–time shapes. Proc. Int. Conference on Computer Vision (ICCV), vol. 2, 2005, 1395–1402.
7. [7] Bobick, A.F., Davis, J.W., The recognition of human movement using temporal templates. IEEE Trans. Pattern Anal. Mach. Intell. 23:3 (2001), 257–267.
8. [8] Borzeshi, E.Z., Concha, O.P., Xu, R.Y.D., Piccardi, M., Joint action segmentation and classification by an extended hidden Markov model. IEEE Signal Process Lett. 20:12 (2013), 1207–1210.
9. [9] Candès, E.J., Romberg, J., Tao, T., Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inf. Theory 52:2 (2006), 489–509.
10. [10] Carreira, J., Caseiro, R., Batista, J., Sminchisescu, C., Free-form region description with second-order pooling. IEEE Trans. Pattern Anal. Mach. Intell. 37:6 (June 2015), 1177–1189.
11. [11] Carvajal, J., McCool, C., Lovell, B.C., Sanderson, C., Joint Recognition and Segmentation of Actions via Probabilistic Integration of Spatio-Temporal Fisher Vectors. 2016 CoRR abs/1602.01601.
12. [12] Carvajal, J., Sanderson, C., McCool, C., Lovell, B.C., Multi-action recognition via stochastic modelling of optical flow and gradients. Proceedings of the MLSDA 2014 2nd Workshop on Machine Learning for Sensory Data Analysis, MLSDA’14, 2014, 19:19–19:24.
13. [13] Chaaraoui, A.A., Climent-Pérez, P., Flórez-Revuelta, F., A review on vision techniques applied to human behaviour analysis for ambient-assisted living. Expert Syst. Appl. 39:12 (2012), 10873–10888.
14. [14] Chatfield, K., Simonyan, K., Vedaldi, A., Zisserman, A., Return of the devil in the details: delving deep into convolutional nets. British Machine Vision Conference, 2014.
15. [15] Chopra, S., Hadsell, R., LeCun, Y., Learning a similarity metric discriminatively, with application to face verification. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), CVPR'05, 2005, 539–546.
16. [16] Csurka, G., Dance, C.R., Fan, L., Willamowski, J., Bray, C., Visual categorization with bags of keypoints. In Workshop on Statistical Learning in Computer Vision, ECCV, 2004, 1–22.
17. [17] Dalal, N., Triggs, B., Histograms of oriented gradients for human detection. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, 2005, 886–893 vol. 1.
18. [18] Dalal, N., Triggs, B., Schmid, C., Human detection using oriented histograms of flow and appearance. Proc. European Conference on Computer Vision (ECCV), Lecture Notes in Computer Science (LNCS), vol. 3952, 2006, 428–441.
19. [19] de Souza, C.R., Gaidon, A., Vig, E., López, A.M., Sympathy for the details: dense trajectories and hybrid classification architectures for action recognition. Proc. European Conference on Computer Vision (ECCV), 2016, 697–716.
20. [20] Dollar, P., Rabaud, V., Cottrell, G., Belongie, S., Behavior recognition via sparse spatio-temporal features. Proceedings of the 14th International Conference on Computer Communications and Networks, 2005, 65–72.
21. [21] Donahue, J., Hendricks, L.A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Saenko, K., Darrell, T., Long-term recurrent convolutional networks for visual recognition and description. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, 2625–2634.
22. [22] Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., Darrell, T., DeCAF: a deep convolutional activation feature for generic visual recognition. International Conference in Machine Learning (ICML), 2014.
23. [23] Donoho, D.L., Compressed sensing. IEEE Trans. Inf. Theory 52:4 (2006), 1289–1306.
24. [24] Doretto, G., Chiuso, A., Wu, Y.N., Soatto, S., Dynamic textures. Int. J. Comput. Vis. 51:2 (2003), 91–109.
25. [25] Du, Y., Wang, W., Wang, L., Hierarchical recurrent neural network for skeleton based action recognition. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015, 1110–1118.
26. [26] Elad, M., Sparse and Redundant Representations — From Theory to Applications in Signal and Image Processing. 2010, Springer.
27. [27] Elhamifar, E., Vidal, R., Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans. Pattern Anal. Mach. Intell. 35:11 (2013), 2765–2781.
28. [28] Fei-Fei, L., Perona, P., A Bayesian hierarchical model for learning natural scene categories. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, 2005, 524–531 vol. 2.
29. [29] Feichtenhofer, C., Pinz, A., Zisserman, A., Convolutional two-stream network fusion for video action recognition. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, 1933–1941.
30. [30] Fernando, B., Anderson, P., Hutter, M., Gould, S., Discriminative hierarchical rank pooling for activity recognition. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
31. [31] Fernando, B., Gavves, E., Oramas, M.J., Ghodrati, A., Tuytelaars, T., Modeling video evolution for action recognition. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, 5378–5387.
32. [32] Fernando, B., Gould, S., Learning end-to-end video classification with rank-pooling. ICML, 2016.
33. [33] Gaidon, A., Harchaoui, Z., Schmid, C., Actom sequence models for efficient action detection. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, 3201–3208.
34. [34] Gaidon, A., Harchaoui, Z., Schmid, C., Activity representation with motion hierarchies. Int. J. Comput. Vis. 107:3 (2014), 219–238.
35. [35] Gales, M., Young, S., The application of hidden Markov models in speech recognition. Found. Trends Signal Process. 1:3 (2007), 195–304.
36. [36] Goodale, M.A., Milner, A.D., 1 2 Separate Visual Pathways for Perception and Action. Essential Sources in the Scientific Study of Consciousness. 2003, 175.
37. [37] Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y., Generative adversarial nets. Proc. Advances in Neural Information Processing Systems (NIPS), 2014, 2672–2680.
38. [38] Goroshin, R., Bruna, J., Tompson, J., Eigen, D., LeCun, Y., Unsupervised learning of spatiotemporally coherent metrics. Proc. Int. Conference on Computer Vision (ICCV), 2015, 4086–4093.
39. [39] Guha, T., Ward, R.K., Learning sparse representations for human action recognition. IEEE Trans. Pattern Anal. Mach. Intell. 34:8 (2012), 1576–1588.
40. [40] Harandi, M., Salzmann, M., Porikli, F., Bregman divergences for infinite dimensional covariance matrices. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2014, 1003–1010.
41. [41] Harris, C., Stephens, M., A combined corner and edge detector. In Proc. of Fourth Alvey Vision Conference, 1988, 147–151.
42. [42] He, K., Zhang, X., Ren, S., Sun, J., Deep residual learning for image recognition. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
43. [43] Hoai, M., Zisserman, A., Improving human action recognition using score distribution and ranking. Proc. Asian Conference on Computer Vision (ACCV), 2015, 3–20.
44. [44] Hochreiter, S., Schmidhuber, J., Long short-term memory. Neural Comput. 9:8 (1997), 1735–1780.
45. [45] Hoffman, J., Rodner, E., Donahue, J., Kulis, B., Saenko, K., Asymmetric and category invariant feature transformations for domain adaptation. Int. J. Comput. Vis. 109:1–2 (2014), 28–41.
46. [46] Hogg, D., Model-based vision: a program to see a walking person. Image Vision Comput. 1 (1983), 5–20.
47. [47] Hongeng, S., Nevatia, R., Large-scale event detection using semi-hidden Markov models. Proc. Int. Conference on Computer Vision (ICCV), vol. 2, 2003, 1455–1462.
48. [48] Huang, W., Sun, F., Cao, L., Zhao, D., Liu, H., Harandi, M., Sparse coding and dictionary learning with linear dynamical systems. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
49. [49] Jaakkola, T., Haussler, D., Exploiting generative models in discriminative classifiers. Proc. Advances in Neural Information Processing Systems (NIPS), 1998, MIT Press, 487–493.
50. [50] Jain, M., Jgou, H., Bouthemy, P., Better exploiting motion for better action recognition. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013, 2555–2562.
51. [51] Jgou, H., Douze, M., Schmid, C., Prez, P., Aggregating local descriptors into a compact image representation. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2010, 3304–3311.
52. [52] Ji, S., Xu, W., Yang, M., Yu, K., 3D convolutional neural networks for human action recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35:1 (2013), 221–231.
53. [53] Jiang, Y.G., Dai, Q., Liu, W., Xue, X., Ngo, C.W., Human action recognition in unconstrained videos by explicit motion modeling. IEEE Trans. Image Process. 24:11 (2015), 3781–3795.
54. [54] Jiang, Y.-G., Dai, Q., Xue, X., Liu, W., Ngo, C.-W., Trajectory-based modeling of human actions with motion reference points. Proc. European Conference on Computer Vision (ECCV), 2012, 425–438.
55. [55] Kantorov, V., Laptev, I., Efficient feature extraction, encoding, and classification for action recognition. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014, 2593–2600.
56. [56] Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., Fei-Fei, L., Large-scale video classification with convolutional neural networks. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014, 1725–1732.
57. [57] Kellokumpu, V., Zhao, G., Pietikinen, M., Human activity recognition using a dynamic texture based method. British Machine Vision Conference, 2008, 885–894.
58. [58] Kläser, A., MarszaÅek, M., Schmid, C., A spatio-temporal descriptor based on 3D-gradients. In BMVC08, 2008, 275:1-10.
59. [59] Kliper-Gross, O., Gurovich, Y., Hassner, T., Wolf, L., Motion interchange patterns for action recognition in unconstrained videos. Proc. European Conference on Computer Vision (ECCV), 2012, 256–269.
60. [60] Koniusz, P., Cherian, A., Porikli, F., Tensor representations via kernel linearization for action recognition from 3D skeletons. Proc. European Conference on Computer Vision (ECCV), 2016, 37–53.
61. [61] Kovashka, A., Grauman, K., Learning a hierarchy of discriminative space–time neighborhood features for human action recognition. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, 2046–2053.
62. [62] Krizhevsky, A., Sutskever, I., Hinton, G.E., ImageNet classification with deep convolutional neural networks. Proc. Advances in Neural Information Processing Systems (NIPS), 2012, 1097–1105.
63. [63] Kuehne, H., Jhuang, H., Stiefelhagen, R., Serre, T., High Performance Computing in Science and Engineering ‘12: Transactions of the High Performance Computing Center, Stuttgart (HLRS) 2012. 2013, Springer, Berlin Heidelberg, 571–582 Ch. HMDB51: A Large Video Database for Human Motion Recognition.
64. [64] Lafferty, J.D., McCallum, A., Pereira, F.C.N., Conditional random fields: probabilistic models for segmenting and labeling sequence data. Proc. Int. Conference on Machine Learning (ICML), ICML'01, 2001, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 282–289.
65. [65] Lan, Z., Lin, M., Li, X., Hauptmann, A.G., Raj, B., Beyond Gaussian pyramid: multi-skip feature stacking for action recognition. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, 204–212.
66. [66] Laptev, I., On space–time interest points. Int. J. Comput. Vis. 64:2 (2005), 107–123.
67. [67] Laptev, I., Marszalek, M., Schmid, C., Rozenfeld, B., Learning realistic human actions from movies. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2008, 1–8.
68. [68] Lea, C., Reiter, A., Vidal, R., Hager, G.D., Segmental spatiotemporal CNNs for fine-grained action segmentation. Proc. European Conference on Computer Vision (ECCV), 2016, 36–52.
69. [69] Lecun, Y., Bottou, L., Bengio, Y., Haffner, P., Gradient-based learning applied to document recognition. Proc. IEEE 86:11 (1998), 2278–2324.
70. [70] Li, L.-J., Su, H., Fei-fei, L., Xing, E.P., Object bank: a high-level image representation for scene classification & semantic feature sparsification. Proc. Advances in Neural Information Processing Systems (NIPS), 2010, 1378–1386.
71. [71] Li, Y., Li, W., Mahadevan, V., Vasconcelos, N., VLAD3: encoding dynamics of deep features for action recognition. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
72. [72] Liu, J., Luo, J., Shah, M., Recognizing realistic actions from videos “in the wild”. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009, 1996–2003.
73. [73] Liu, J., Shahroudy, A., Xu, D., Wang, G., Spatio-temporal LSTM with trust gates for 3D human action recognition. Proc. European Conference on Computer Vision (ECCV), 2016, Springer International Publishing, 816–833.
74. [74] Lu, J., Hu, J., Tan, Y.P., Nonlinear metric learning for visual tracking. 2016 IEEE International Conference on Multimedia and Expo (ICME), 2016, 1–6.
75. [75] Mairal, J., Elad, M., Sapiro, G., Sparse representation for color image restoration. IEEE Trans. Image Process. (TIP) 17:1 (2008), 53–69.
76. [76] Marr, D., Vaina, L., Representation and recognition of the movements of shapes. Proc. R. Soc. Lond. B Biol. Sci. 214:1197 (1982), 501–524.
77. [77] Marszalek, M., Laptev, I., Schmid, C., Actions in context. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009, 2929–2936.
78. [78] Mathieu, M., Couprie, C., LeCun, Y., Deep Multi-Scale Video Prediction Beyond Mean Square Error. 2015, CoRR.
79. [79] Matikainen, P., Hebert, M., Sukthankar, R., Trajectons: action recognition through the motion analysis of tracked features. Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference on, Sept. 2009, 514–521.
80. [80] McCallum, A., Li, W., Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons. Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003 - Volume 4, CONLL'03, 2003, Association for Computational Linguistics, Stroudsburg, PA, USA, 188–191.
81. [81] Messing, R., Pal, C., Kautz, H., Activity recognition using the velocity histories of tracked keypoints. Proc. Int. Conference on Computer Vision (ICCV), 2009, 104–111.
82. [82] Metaxas, D., Zhang, S., A review of motion analysis methods for human nonverbal communication computing. Image Vision Comput. 31:6–7 (2013), 421–433.
83. [83] Mikolajczyk, K., Uemura, H., Action recognition with motion-appearance vocabulary forest. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008, 1–8.
84. [84] Misra, I., Zitnick, C.L., Hebert, M., Unsupervised Learning Using Sequential Verification for Action Recognition. 2016 arXiv preprint arXiv:1603.08561.
85. [85] Moeslund, T.B., Granum, E., A survey of advances in vision-based human motion capture and analysis. Comput. Vis. Image Underst. 104:3 (2006), 90–127.
86. [86] Ng, J.Y.-H., Hausknecht, M., Vijayanarasimhan, S., Vinyals, O., Monga, R., Toderici, G., Beyond short snippets: deep networks for video classification. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, 4694–4702.
87. [87] Ni, B., Yang, X., Gao, S., Progressively parsing interactional objects for fine grained action detection. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
88. [88] Niebles, J.C., Chen, C.-W., Fei-Fei, L., Modeling temporal structure of decomposable motion segments for activity classification. Proc. European Conference on Computer Vision (ECCV), 2010, 392–405.
89. [89] Norouznezhad, E., Harandi, M.T., Bigdeli, A., Baktash, M., Postula, A., Lovell, B.C., Directional space–time oriented gradients for 3D visual pattern analysis. Proc. European Conference on Computer Vision (ECCV), 2012, 736–749.
90. [90] Nowak, E., Jurie, F., Triggs, B., Sampling strategies for bag-of-features image classification. Proc. European Conference on Computer Vision (ECCV), 2006, Springer Berlin Heidelberg, Berlin, Heidelberg, 490–503.
91. [91] Ojala, T., Pietikainen, M., Maenpaa, T., Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24:7 (2002), 971–987.
92. [92] Olshausen, B.A., Field, D.J., Sparse coding with an overcomplete basis set: a strategy employed by V1?. Vis. Res. 37:23 (1997), 3311–3325.
93. [93] Oneata, D., Verbeek, J., Schmid, C., Action and event recognition with Fisher vectors on a compact feature set. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013, 1817–1824.
94. [94] Oreifej, O., Liu, Z., HON4D: histogram of oriented 4D normals for activity recognition from depth sequences. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2013, 716–723.
95. [95] Peng, X., Wang, L., Wang, X., Qiao, Y., Bag of Visual Words and Fusion Methods for Action Recognition: Comprehensive Study and Good Practice. 2014 CoRR abs/1405.4506.
96. [96] Peng, X., Zou, C., Qiao, Y., Peng, Q., Action recognition with stacked Fisher vectors. Proc. European Conference on Computer Vision (ECCV), 2014, 581–595.
97. [97] Perronnin, F., Dance, C., Fisher kernels on visual vocabularies for image categorization. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2007, 1–8.
98. [98] Poppe, R., A survey on vision-based human action recognition. Image Vision Comput. 28:6 (2010), 976–990.
99. [99] Quattoni, A., Wang, S., Morency, L.-P., Collins, M., Darrell, T., Hidden conditional random fields. IEEE Trans. Pattern Anal. Mach. Intell. 29:10 (2007), 1848–1852.
100. [100] Rabiner, L.R., A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77:2 (Feb. 1989), 257–286.
101. [101] Rahmani, H., Mian, A., Learning a non-linear knowledge transfer model for cross-view action recognition. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015, 2458–2466.
102. [102] Rahmani, H., Mian, A., 3D action recognition from novel viewpoints. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016, 1506–1515.
103. [103] Ranzato, M., Szlam, A., Bruna, J., Mathieu, M., Collobert, R., Chopra, S., Video (language) Modeling: A Baseline for Generative Models of Natural Videos. 2014, CoRR.
104. [104] Reddy, K.K., Shah, M., Recognizing 50 human action categories of web videos. Mach. Vis. Appl. 24:5 (2013), 971–981.
105. [105] Rissanen, J., Modeling by shortest data description. Automatica 14:5 (1978), 465–471.
106. [106] Robinson, A.J., Fallside, F., Static and dynamic error propagation networks with application to speech coding. Proc. Advances in Neural Information Processing Systems (NIPS), 1988, 632–641.
107. [107] Rodriguez, M.D., Ahmed, J., Shah, M., Action MACH a spatio-temporal maximum average correlation height filter for action recognition. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008, 1–8.
108. [108] Rohr, K., Towards model-based recognition of human movements in image sequences. CVGIP: Image Underst. 59:1 (Jan. 1994), 94–115.
109. [109] Rohrbach, M., Amin, S., Andriluka, M., Schiele, B., A database for fine grained activity detection of cooking activities. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, 1194–1201.
110. [110] Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A.C., Fei-Fei, L., ImageNet large scale visual recognition challenge. Int. J. Comput. Vis. 115:3 (2015), 211–252.
111. [111] Sadanand, S., Corso, J.J., Action bank: a high-level representation of activity in video. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, 1234–1241.
112. [112] Sanin, A., Sanderson, C., Harandi, M.T., Lovell, B.C., Spatio-temporal covariance descriptors for action and gesture recognition. IEEE Workshop on Applications of Computer Vision, 2013, 103–110.
113. [113] Schuldt, C., Laptev, I., Caputo, B., Recognizing human actions: a local SVM approach. Proc. Int. Conference on Pattern Recognition (ICPR), ICPR'04, 2004, 32–36.
114. [114] Shao, L., Zhen, X., Tao, D., Li, X., Spatio-temporal Laplacian pyramid coding for action recognition. IEEE Trans. Cybern. 44:6 (2014), 817–827.
115. [115] Simonyan, K., Zisserman, A., Two-stream convolutional networks for action recognition in videos. Proc. Advances in Neural Information Processing Systems (NIPS), 2014, 568–576.
116. [116] Singh, B., Marks, T.K., Jones, M., Tuzel, O., Shao, M., A multi-stream bi-directional recurrent neural network for fine-grained action detection. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
117. [117] Somasundaram, G., Cherian, A., Morellas, V., Papanikolopoulos, N., Action recognition using global spatio-temporal features derived from sparse representations. Comput. Vis. Image Underst. 123 (2014), 1–13.
118. [118] Song, Y., Morency, L.P., Davis, R., Action recognition by hierarchical sequence summarization. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013, 3562–3569.
119. [119] Soomro, K., Zamir, A.R., Shah, M., UCF101: A Dataset of 101 Human Actions Classes From Videos in the Wild. 2012 CoRR abs/1212.0402.
120. [120] Srivastava, N., Mansimov, E., Salakhutdinov, R., Unsupervised Learning of Video Representations Using LSTMs. 2015, CoRR.
121. [121] Srivastava, R.K., Greff, K., Schmidhuber, J., Training very deep networks. Proc. Advances in Neural Information Processing Systems (NIPS), 2015, 2377–2385.
122. [122] Su, B., Zhou, J., Ding, X., Wang, H., Wu, Y., Hierarchical dynamic parsing and encoding for action recognition. Proc. European Conference on Computer Vision (ECCV), 2016, 202–217.
123. [123] Sun, C., Nevatia, R., ACTIVE: activity concept transitions in video event classification. Proc. Int. Conference on Computer Vision (ICCV), 2013, 913–920.
124. [124] Sun, C., Nevatia, R., Large-scale web video event classification by use of Fisher Vectors. Applications of Computer Vision (WACV), 2013 IEEE Workshop on, 2013, 15–22.
125. [125] Sun, L., Jia, K., Yeung, D.Y., Shi, B.E., Human action recognition using factorized spatio-temporal convolutional networks. Proc. Int. Conference on Computer Vision (ICCV), 2015, 4597–4605.
126. [126] Sutskever, I., Vinyals, O., Le, Q.V., Sequence to sequence learning with neural networks. Proc. Advances in Neural Information Processing Systems (NIPS), 2014, 3104–3112.
127. [127] Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A., Going deeper with convolutions. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, 1–9.
128. [128] Tang, K., Fei-Fei, L., Koller, D., Learning latent temporal structure for complex event detection. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, 1250–1257.
129. [129] Tian, Y., Cao, L., Liu, Z., Zhang, Z., Hierarchical filtered motion for action recognition in crowded videos. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 42:3 (2012), 313–323.
130. [130] Tran, D., Bourdev, L., Fergus, R., Torresani, L., Paluri, M., Learning spatiotemporal features with 3D convolutional networks. Proc. Int. Conference on Computer Vision (ICCV), 2015, 4489–4497.
131. [131] Hubert Tsai, Y.-H., Yeh, Y.-R., Frank Wang, Y.-C., Learning cross-domain landmarks for heterogeneous domain adaptation. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
132. [132] Turaga, P., Chellappa, R., Subrahmanian, V.S., Udrea, O., Machine recognition of human activities: a survey. IEEE Trans. Circuits Syst. Video Technol. 18:11 (2008), 1473–1488.
133. [133] Tuzel, O., Porikli, F., Meer, P., Region covariance: a fast descriptor for detection and classification. Proc. European Conference on Computer Vision (ECCV), 2006, 589–600.
134. [134] Tuzel, O., Porikli, F., Meer, P., Pedestrian detection via classification on Riemannian manifolds. IEEE Trans. Pattern Anal. Mach. Intell. 30:10 (2008), 1713–1727.
135. [135] Varior, R.R., Shuai, B., Lu, J., Xu, D., Wang, G., A Siamese long short-term memory architecture for human re-identification. Proc. European Conference on Computer Vision (ECCV), 2016, 135–153.
136. [136] Varol, G., Laptev, I., Schmid, C., Long-term temporal convolutions for action recognition. 2016 arXiv:1604.04494.
137. [137] Vemulapalli, R., Arrate, F., Chellappa, R., Human action recognition by representing 3D skeletons as points in a lie group. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2014, 588–595.
138. [138] Vincent, P., Larochelle, H., Bengio, Y., Manzagol, P.-A., Extracting and composing robust features with denoising autoencoders. Proc. Int. Conference on Machine Learning (ICML), 2008, 1096–1103.
139. [139] Vishwakarma, S., Agrawal, A., A survey on activity recognition and behavior understanding in video surveillance. Vis. Comput. 29:10 (2013), 983–1009.
140. [140] Wang, H., Klaser, A., Schmid, C., Liu, C.-L., Action recognition by dense trajectories. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, 3169–3176.
141. [141] Wang, H., Schmid, C., Action recognition with improved trajectories. Proc. Int. Conference on Computer Vision (ICCV), 2013, 3551–3558.
142. [142] Wang, H., Ullah, M.M., Kläser, A., Laptev, I., Schmid, C., Evaluation of local spatio-temporal features for action recognition. British Machine Vision Conference, Sep. 2009, 127.
143. [143] Wang, L., Qiao, Y., Tang, X., Action recognition with trajectory-pooled deep-convolutional descriptors. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, 4305–4314.
144. [144] Wang, L., Xiong, Y., Wang, Z., Qiao, Y., Towards Good Practices for Very Deep Two-Stream ConvNets. 2015 CoRR abs/1507.02159.
145. ∼ transformations. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, 2658–2667.
146. [146] Wang, X., Gupta, A., Unsupervised learning of visual representations using videos. Proc. Int. Conference on Computer Vision (ICCV), 2015, 2794–2802.
147. [147] Wang, Y., Mori, G., Hidden part models for human action recognition: probabilistic versus max margin. IEEE Trans. Pattern Anal. Mach. Intell. 33:7 (2011), 1310–1323.
148. [148] Weinland, D., Ronfard, R., Boyer, E., Free viewpoint action recognition using motion history volumes. Comput. Vis. Image Underst. 104:23 (2006), 249–257.
149. [149] Weinland, D., Ronfard, R., Boyer, E., A survey of vision-based methods for action representation, segmentation and recognition. Comput. Vis. Image Underst. 115:2 (2011), 224–241.
150. [150] Willems, G., Tuytelaars, T., Gool, L., An efficient dense and scale-invariant spatio-temporal interest point detector. Proc. European Conference on Computer Vision (ECCV), 2008, 650–663.
151. [151] Wright, J., Yang, A.Y., Ganesh, A., Sastry, S.S., Ma, Y., Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31:2 (2009), 210–227.
152. [152] Wu, J., Zhang, Y., Lin, W., Towards good practices for action video encoding. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014, 2577–2584.
153. [153] Wu, Z., Jiang, Y., Wang, X., Ye, H., Xue, X., Wang, J., Fusing Multi-Stream Deep Networks for Video Classification. 2015, CoRR.
154. [154] Xing, D., Wang, X., Lu, H., Action recognition using hybrid feature descriptor and VLAD video encoding. Computer Vision — ACCV 2014 Workshops: Singapore, Singapore, November 1–2, 2014, Revised Selected Papers, Part I, 2015, 99–112.
155. [155] Yan, X., Chang, H., Shan, S., Chen, X., Modeling video dynamics with deep dynencoder. Proc. European Conference on Computer Vision (ECCV), 2014, 215–230.
156. [156] Yilmaz, A., Javed, O., Shah, M., Object tracking: a survey. ACM Comput. Surv., 38(4), 2006.
157. [157] Yilmaz, A., Shah, M., Actions sketch: a novel action representation. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, 2005, 984–989.
158. [158] Zeiler, M.D., Fergus, R., Visualizing and understanding convolutional networks. Proc. European Conference on Computer Vision (ECCV), 2014, 818–833.
159. [159] Zhan, B., Monekosso, D.N., Remagnino, P., Velastin, S.A., Xu, L.-Q., Crowd analysis: a survey. Mach. Vis. Appl. 19:5 (2008), 345–357.
160. [160] Zhao, G., Pietikainen, M., Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. Pattern Anal. Mach. Intell. 29:6 (2007), 915–928.
161. [161] Zhu, Y., Zhao, X., Fu, Y., Liu, Y., Sparse coding on local spatial–temporal volumes for human action recognition. Proc. Asian Conference on Computer Vision (ACCV), 2011, Springer, 660–671.