Action recognition using global spatio-temporal features derived from sparse representations

Computer Vision and Image Understanding

Volumn 123, Issue , 2014, Pages 1-13

  Somasundaram, Guruprasad ^a   Cherian, Anoop ^a   Morellas, Vassilios ^a   Papanikolopoulos, Nikolaos ^a  

^a University of Minnesota   (United States)

Author keywords

Action classification; Activity recognition; Global spatio temporal features

Indexed keywords

CLASSIFICATION (OF INFORMATION); DIGITAL STORAGE; FEATURE EXTRACTION; GESTURE RECOGNITION; IMAGE RECOGNITION; VIDEO RECORDING;

ACTION CLASSIFICATIONS; ACTIVITY RECOGNITION; COMPUTATIONALLY EFFICIENT; DICTIONARY LEARNING; REGION COVARIANCE DESCRIPTORS; SPARSE REPRESENTATION; SPATIO-TEMPORAL DESCRIPTORS; SPATIO-TEMPORAL FEATURES;

MOTION ESTIMATION;

EID: 84899639091     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2014.01.002     Document Type: Article

References (65)

1. I. Laptev On space-time interest points International Journal of Computer Vision vol. 64 2005 Springer 107 123 (Pubitemid 41314645)
2. V. Kolmogorov, and R. Zabih Computing visual correspondence with occlusions using graph cuts International Conference on Computer Vision 2001 IEEE Computer Society
3. S. Danafar, and N. Gheissari Action recognition for surveillance applications using optic flow and SVM Asian Conference on Computer Vision 2007 Springer 457 466
4. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld Learning realistic human actions from movies IEEE Conference on Computer Vision and Pattern Recognition 2008 IEEE 1 8
5. A. Fathi, A. Farhadi, and J.M. Rehg Understanding egocentric activities IEEE International Conference on Computer Vision 2011 IEEE 407 414
6. A. Fathi, J.K. Hodgins, and J.M. Rehg Social interactions: a first-person perspective IEEE Conference on Computer Vision and Pattern Recognition 2012 IEEE 1226 1233
7. J. Rehg, G. Abowd, A. Rozga, M.R.M. Clements, L. Presti, S. Sclaroff, I. Essa, Decoding children's social behavior, in: IEEE Conference on Computer Vision and Pattern Recognition, 2013.
8. F.I. Bashir, A.A. Khokhar, D. Schonfeld, S. Member, S. Member, Object trajectory-based activity classification and recognition using hidden markov models, in: IEEE Transactions on Image Processing, vol. 16, 2007.
9. L. Gorelick, M. Blank, E. Shechtman, M. Irani, R. Basri, Actions as space-time shapes, in: Transactions on Pattern Analysis and Machine Intelligence, vol. 29, 2007, pp. 2247-2253. (Pubitemid 350124072)
10. Q. Qiu, Z. Jiang, and R. Chellappa Sparse dictionary-based representation and recognition of action attributes IEEE International Conference on Computer Vision 2011 IEEE 707 714
11. J. Liu, S. Ali, and M. Shah Recognizing human actions using multiple features IEEE Conference on Computer Vision and Pattern Recognition 2008 IEEE
12. H. Wang, A. Klaser, C. Schmid, and C.-L. Liu Action recognition by dense trajectories IEEE Conference on Computer Vision and Pattern Recognition 2011 IEEE 3169 3176
13. A. Kläser, M. Marszalek, C. Schmid, A spatio-temporal descriptor based on 3D-gradients, in: Proceedings of the British Machine Vision Conference, 2008.
14. P. Scovanner, S. Ali, and M. Shah A 3-dimensional SIFT descriptor and its application to action recognition International Conference on Multimedia 2007 ACM 357 360
15. R. Messing, C. Pal, and H. Kautz Activity recognition using the velocity histories of tracked keypoints International Conference on Computer Vision 2009 IEEE 104 111
16. G.W. Taylor, R. Fergus, Y. LeCun, and C. Bregler Convolutional learning of spatio-temporal features European Conference on Computer Vision 2010 Springer 140 153
17. R. Poppe A survey on vision-based human action recognition Image and Vision Computing vol. 28 2010 Elsevier 976 990
18. H. Wang, M.M. Ullah, A. Klaser, I. Laptev, and C. Schmid et al. Evaluation of local spatio-temporal features for action recognition in: British Machine Vision Conference 16 2007
19. J. Aggarwal, and M.S. Ryoo Human activity analysis: a review ACM Computing Surveys vol. 43 2011 ACM 16
20. M. Bregonzio, S. Gong, and T. Xiang Recognising action as clouds of space-time interest points IEEE Conference on Computer Vision and Pattern Recognition 2009 IEEE 1948 1955
21. B. Chakraborty, M.B. Holte, T.B. Moeslund, and J. Gonzàlez Selective spatio-temporal interest points Computer Vision and Image Understanding vol. 116 2012 Elsevier 396 410
22. P. Dollár, V. Rabaud, G. Cottrell, and S. Belongie Behavior recognition via sparse spatio-temporal features IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance 2005 IEEE 65 72 (Pubitemid 46178025)
23. C. Schuldt, I. Laptev, and B. Caputo Recognizing human actions: a local svm approach Proceedings of the 17th International Conference on Pattern Recognition vol. 3 2004 IEEE 32 36
24. J. Liu, J. Luo, and M. Shah Recognizing realistic actions from videos in the wild IEEE Conference on Computer Vision and Pattern Recognition, 2009. CVPR 2009 2009 IEEE 1996 2003
25. K. Guo, P. Ishwar, and J. Konrad Action recognition using sparse representation on covariance manifolds of optical flow IEEE International Conference on Advanced Video and Signal Based Surveillance 2010 IEEE 188 195
26. K. Guo, P. Ishwar, and J. Konrad Action recognition in video by covariance matching of silhouette tunnels Brazilian Symposium on Computer Graphics and Image Processing 2009 IEEE
27. A. Castrodad, and G. Sapiro Sparse modeling of human actions from motion imagery International Journal of Computer Vision vol. 100 2012 Springer 1 15
28. G. Willems, T. Tuytelaars, and L. Van Gool An efficient dense and scale-invariant spatio-temporal interest point detector European Conference on Computer Vision 2008 Springer 650 663
29. J. Gall, A. Yao, N. Razavi, L. Van Gool, and V. Lempitsky Hough forests for object detection, tracking, and action recognition IEEE Transactions on Pattern Analysis and Machine Intelligence vol. 33 2011 IEEE 2188 2202
30. Q. Le, W. Zou, S. Yeung, and A. Ng Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis IEEE Conference on Computer Vision and Pattern Recognition 2011 IEEE 3361 3368
31. I. Ramirez, P. Sprechmann, and G. Sapiro Classification and clustering via dictionary learning with structured incoherence and shared features IEEE Conference on Computer Vision and Pattern Recognition 2010 IEEE 3501 3508
32. H. Wang, M.M. Ullah, A. Kläser, I. Laptev, C. Schmid, Evaluation of local spatio-temporal features for action recognition, in: BMVC 2009 British Machine Vision Conference, 2009.
33. L. Shao, and R. Mattivi Feature detector and descriptor evaluation in human action recognition Proceedings of the ACM International Conference on Image and Video Retrieval 2010 ACM 477 484
34. T. de Campos, M. Barnard, K. Mikolajczyk, J. Kittler, F. Yan, W. Christmas, and D. Windridge An evaluation of bags-of-words and spatio-temporal shapes for action recognition IEEE Workshop on Applications of Computer Vision 2011 Springer IEEE 351
35. A. Gilbert, J. Illingworth, and R. Bowden Action recognition using mined hierarchical compound features IEEE Transactions on Pattern Analysis and Machine Intelligence vol. 33 2011 IEEE 883 897
36. S. Wu, O. Oreifej, M. Shah, Action recognition in videos acquired by a moving camera using motion decomposition of Lagrangian particle trajectories, in: IEEE International Conference on Computer Vision, 2011, pp. 1419-1426.
37. M. Raptis, Discovering discriminative action parts from mid-level video representations, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, pp. 1242-1249.
38. T. Kadir, and M. Brady Saliency, scale and image description International Journal of Computer Vision vol. 45 2001 Springer 83 105 (Pubitemid 33125858)
39. Y. Li, Y. Zhou, J. Yan, Z. Niu, and J. Yang Visual saliency based on conditional entropy Asian Conference on Computer Vision 2010 Springer 246 257
40. N. Bruce, J. Tsotsos, Saliency based on information maximization, in: Advances in Neural Information Processing Systems, 2005, pp. 155-162.
41. X. Hou, L. Zhang, Dynamic visual attention: searching for coding length increments, in: Advances in Neural Information Processing Systems, 2008, pp. 681-688.
42. N. Vereshchagin, and P. Vitányi Kolmogorov's structure functions with an application to the foundations of model selection Foundations of Computer Science 2002 IEEE 751 760
43. V. Nannen, A Short Introduction to Model Selection, Kolmogorov Complexity and Minimum Description Length (MDL), arXiv preprint arXiv:1005.2364.
44. J. Rissanen Modeling by shortest data description Automatica vol. 14 1978 Elsevier 465 471
45. J. Rissanen MDL denoising IEEE Transactions on Information Theory vol. 46 2000 IEEE 2537 2543 (Pubitemid 32090030)
46. I. Ramírez, and G. Sapiro An MDL framework for sparse coding and dictionary learning IEEE Transactions on Signal Processing vol. 60 2012 IEEE 2913 2927
47. N. Saito Simultaneous noise suppression and signal compression using a library of orthonormal bases and the minimum description length criterion Wavelets in Geophysics vol. 4 1994 Academic New York 299 324
48. D.L. Donoho Compressed sensing IEEE Transactions on Information Theory vol. 52 2006 IEEE 1289 1306
49. M. Elad, and M. Aharon Image denoising via sparse and redundant representations over learned dictionaries IEEE Transactions on Image Processing vol. 15 2006 IEEE 3736 3745 (Pubitemid 44811686)
50. S. Mallat, and Z. Zhang Matching pursuits with time-frequency dictionaries IEEE Transactions on Signal Processing 41 12 1993 3397 3415 10.1109/78.258082
51. R. Rubinstein, M. Zibulevsky, M. Elad, Efficient implementation of the k-svd algorithm using batch orthogonal matching pursuit, in: CS Technion, 2008.
52. J. Mairal, F. Bach, J. Ponce, and G. Sapiro Online dictionary learning for sparse coding International Conference on Machine Learning 2009 ACM 689 696
53. I. Sipiran, and B. Bustos Harris 3D: a robust extension of the harris operator for interest point detection on 3D meshes The Visual Computer 2011 Springer 1 14
54. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2005, pp. 886-893. (Pubitemid 43897286)
55. O. Tuzel, F. Porikli, and P. Meer Region covariance: a fast descriptor for detection and classification European Conference on Computer Vision 2006 Springer 589 600 (Pubitemid 44029757)
56. V. Arsigny, P. Fillard, X. Pennec, and N. Ayache Log-euclidean metrics for fast and simple calculus on diffusion tensors Magnetic Resonance in Medicine vol. 56 2006 Wiley Online Library 411 421 (Pubitemid 44162789)
57. S. Lazebnik, C. Schmid, and J. Ponce Beyond bags of features: spatial pyramid matching for recognizing natural scene categories 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition vol. 2 2006 IEEE 2169 2178 (Pubitemid 44931582)
58. J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid Local features and kernels for classification of texture and object categories: a comprehensive study IEEE Conference on Computer Vision and Pattern Recognition Workshop 2006 IEEE 13
59. C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines, in: ACM Transactions on Intelligent Systems and Technology, vol. 2, 2011, pp. 27:1-27:27. < http://www.csie.ntu.edu.tw/cjlin/libsvm >.
60. M.D. Rodriguez, J. Ahmed, M. Shah, Action MACH: a spatio-temporal maximum average correlation height filter for action recognition, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2008.
61. I. Laptev, M. Marszałek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: IEEE Conference on Computer Vision and Pattern Recognition, 2008.
62. K.K. Reddy, and M. Shah Recognizing 50 human action categories of web videos Machine Vision and Applications 2012 Springer 1 11
63. N. Larios, H. Deng, W. Zhang, M. Sarpola, J. Yuen, R. Paasch, A. Moldenke, D. Lytle, S. Correa, and E. Mortensen et al. Automated insect identification through concatenated histograms of local appearance features: feature vector generation and region detection for deformable objects Machine Vision and Applications vol. 19 2008 Springer 105 123 (Pubitemid 351177989)
64. H. Kuehne, H. Jhuang, E. Garrote, T. Poggio, T. Serre, Hmdb: a large video database for human motion recognition, in: 2011 IEEE International Conference on Computer Vision (ICCV), 2011, pp. 2556-2563, http://dx.doi.org/10. 1109/ICCV.2011.6126543.
65. H. Wang, A. Kläser, C. Schmid, C.-L. Liu, Dense Trajectories and Motion Boundary Descriptors for Action Recognition, Research Report RR-8050, INRIA (August 2012). < http://hal.inria.fr/hal-00725627 >.