Action recognition by spatio-temporal oriented energies

Information Sciences

Volumn 281, Issue , 2014, Pages 295-309

  Zhen, Xiantong ^a,b   Shao, Ling ^a,b   Li, Xuelong ^c  

^a NANJING UNIVERSITY OF INFORMATION SCIENCE AND TECHNOLOGY   (China)

^b UNIVERSITY OF SHEFFIELD   (United Kingdom)

^c XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Action recognition; Spatio temporal Laplacian pyramid; Spatio temporal oriented energies; Steerable filters

Indexed keywords

DECOMPOSITION; LAPLACE TRANSFORMS; MOTION ESTIMATION; VIDEO RECORDING;

ACTION RECOGNITION; INVARIANT REPRESENTATION; LAPLACIAN PYRAMID; LOCAL GEOMETRIC STRUCTURES; SPATIO-TEMPORAL; SPATIOTEMPORAL PATTERNS; STATE-OF-THE-ART METHODS; STEERABLE FILTERS;

IMAGE RECOGNITION;

EID: 84904651934     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2014.05.021     Document Type: Article

References (55)

1. E.H. Adelson, and J.R. Bergen Spatiotemporal energy models for the perception of motion J. Opt. Soc. Am. 2 2 1985 284 299
2. M. Ahmad, and S.-W. Lee Human action recognition using shape and CLG-motion flow from multi-view image sequences Pattern Recogn. 41 7 2008 2237 2252
3. A. Bobick, and J. Davis The recognition of human movement using temporal templates IEEE Trans. Pattern Anal. Mach. Intell. 23 3 2002 257 267
4. Y. Boureau, J. Ponce, Y. LeCun, A theoretical analysis of feature pooling in visual recognition, in: International Conference on Machine Learning, 2010.
5. P. Burt, and E. Adelson The Laplacian pyramid as a compact image code IEEE Trans. Commun. 31 4 1983 532 540
6. K. Cannons, J. Gryn, R. Wildes, Visual tracking using a pixelwise spatiotemporal oriented energy representation, in: European Conference on Computer Vision, 2010, pp. 511-524.
7. C.-C. Chang, and C.-J. Lin LIBSVM: a library for support vector machines ACM Trans. Intell. Syst. Technol. 2 2011 27:1 27:27
8. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, 2005, pp. 886-893.
9. X. Deng, X. Liu, M. Song, J. Cheng, J. Bu, and C. Chen LF-EME: local features with elastic manifold embedding for human action recognition Neurocomputing 2012
10. K. Derpanis, J. Gryn, Three-dimensional nth derivative of gaussian separable steerable filters, in: IEEE Conference on Image Processing, vol. 3, 2005, pp. III-553.
11. K. Derpanis, M. Sizintsev, K. Cannons, R. Wildes, Efficient action spotting based on a spacetime oriented structure representation, in: IEEE Conference on Computer Vision and Pattern Recognition, 2010, pp. 1990-1997.
12. K. Derpanis, R. Wildes, Early spatiotemporal grouping with a distributed oriented energy representation, in: IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 232-239.
13. P. Dollár, V. Rabaud, G. Cottrell, S. Belongie, Behavior recognition via sparse spatio-temporal features, in: 2nd Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, 2005, pp. 65-72.
14. A.A. Efros, A.C. Berg, G. Mori, J. Malik, Recognizing action at a distance, in: IEEE International Conference on Computer Vision, vol. 2, 2003, pp. 726-733.
15. W. Freeman, E. Adelson Technology. Media Laboratory. Vision, M.I., Group, M., The design and use of steerable filters IEEE Trans. Pattern Anal. Mach. Intell. 13 9 1991 891 906
16. L. Gorelick, M. Blank, E. Shechtman, M. Irani, and R. Basri Actions as space-time shapes IEEE Trans. Pattern Anal. Mach. Intell. 29 12 2007 2247 2253
17. G. Hinton, S. Osindero, and Y. Teh A fast learning algorithm for deep belief nets Neural Comput. 18 7 2006 1527 1554
18. L. Itti, C. Koch, and E. Niebur A model of saliency-based visual attention for rapid scene analysis IEEE Trans. Pattern Anal. Mach. Intell. 20 11 1998 1254 1259
19. H. Jhuang, T. Serre, L. Wolf, T. Poggio, A biologically inspired system for action recognition, in: IEEE International Conference on Computer Vision, 2007, pp. 1-8.
20. S. Ji, W. Xu, M. Yang, K. Yu, 3d Convolutional neural networks for human action recognition, in: International Conference on Machine Learning, 2010.
21. Y.-G. Jiang, Q. Dai, X. Xue, W. Liu, and C.-W. Ngo Trajectory-based modeling of human actions with motion reference points European Conference on Computer Vision 2012 Springer 425 438
22. S. Jones, and L. Shao Content-based retrieval of human actions from realistic video databases Inform. Sci. 236 2013 56 65
23. O. Kliper-Gross, Y. Gurovich, T. Hassner, and L. Wolf Motion interchange patterns for action recognition in unconstrained videos European Conference on Computer Vision 2012 Springer 256 269
24. A. Kovashka, K. Grauman, Learning a hierarchy of discriminative space-time neighborhood features for human action recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, 2010, pp. 2046-2053.
25. H. Kuehne, H. Poggio, T. Serre, HMDB: a large video database for human action recognition, in: IEEE International Conference on Computer Vision, 2011.
26. I. Laptev, T. Lindeberg, Space-time interest points, in: IEEE International Conference on Computer Vision, 2003.
27. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
28. Z. Lu, Y. Peng, H.H. Ip, Spectral learning of latent semantics for action recognition, in: IEEE International Conference on Computer Vision, 2011, pp. 1503-1510.
29. B.D. Lucas, T. Kanade, et al., An iterative image registration technique with an application to stereo vision, in: Proceedings of the 7th International Joint Conference on Artificial Intelligence, 1981.
30. P. Matikainen, M. Hebert, R. Sukthankar, Representing pairwise spatial and temporal relations for action recognition, in: European Conference on Computer Vision, 2010, pp. 508-521.
31. R. Messing, C. Pal, H. Kautz, Activity recognition using the velocity histories of tracked keypoints, in: IEEE 12th International Conference on Computer Vision, 2009, pp. 104-111.
32. K. Mikolajczyk, and C. Schmid A performance evaluation of local descriptors IEEE Trans. Pattern Anal. Mach. Intell. 27 10 2005 1615 1630
33. M. Raptis, S. Soatto, Tracklet descriptors for action modeling and video analysis, in: Europen Conference on Computer Vision, 2010, pp. 577-590.
34. M. Riesenhuber, and T. Poggio Hierarchical models of object recognition in cortex Nature Neurosci. 2 1999 1019 1025
35. M.D. Rodriguez, J. Ahmed, M. Shah, Action MACH a spatio-temporal maximum average correlation height filter for action recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
36. S. Sadanand, J. Corso, Action bank: a high-level representation of activity in video, in: IEEE Conference on Computer Vision and Pattern Recognition, 2012, pp. 1234-1241.
37. K. Schindler, L. Van Gool, Action snippets: how many frames does human action recognition require?, in: IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
38. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local SVM approach, in: International Conference on Pattern Recognition, 2004.
39. P. Scovanner, S. Ali, M. Shah, A 3-dimensional sift descriptor and its application to action recognition, in: Proceedings of the 15th International Conference on Multimedia, 2007, pp. 357-360.
40. L. Shao, T. Kadir, and M. Brady Geometric and photometric invariant distinctive regions detection Inform. Sci. 177 4 2007 1088 1122
41. L. Shao, X. Zhen, D. Tao, and X. Li Spatio-temporal Laplacian pyramid coding for action recognition IEEE Trans. Cybern. 44 6 2014 817 827
42. C. Siagian, and L. Itti Rapid biologically-inspired scene classification using features shared with visual attention IEEE Trans. Pattern Anal. Mach. Intell. 29 2 2007 300 312
43. D. Song, and D. Tao Biologically inspired feature manifold for scene classification IEEE Trans. Image Process. 19 1 2010 174 184
44. J. Sun, X. Wu, S. Yan, L. Cheong, T. Chua, J. Li, Hierarchical spatio-temporal context modeling for action recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 2004-2011.
45. G.W. Taylor, R. Fergus, Y. Lecun, C. Bregler, Convolutional learning of spatio-temporal features, in: European Conference on Computer Vision, 2010.
46. H. Uemura, S. Ishikawa, K. Mikolajczyk, Feature tracking and motion compensation for action recognition, in: Proc. of BMVA British Machine Vision Conference (BMVC08), 2008.
47. F. Wang, Y. Jiang, C. Ngo, Video event detection using motion relativity and visual relatedness, in: Proceedings of the 16th ACM International Conference on Multimedia, ACM, 2008, pp. 239-248.
48. H. Wang, A. Klaser, C. Schmid, C.-L. Liu, Action recognition by dense trajectories, in: IEEE Conference on Computer Vision and Pattern Recognition, 2011, pp. 3169-3176.
49. R. Wildes, J. Bergen, Qualitative spatiotemporal analysis using an oriented energy representation, in: European Conference on Computer Vision, 2000, pp. 768-784.
50. A. Yao, J. Gall, L. Van Gool, A hough transform-based voting framework for action recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, 2010, pp. 2061-2068.
51. L. Yeffet, L. Wolf, Local trinary patterns for human action recognition, in: IEEE International Conference on Computer Vision, 2009, pp. 492-497.
52. A. Yilmaz, M. Shah, Actions sketch: a novel action representation, in: IEEE Conference on Computer Vision and Pattern Recognition, 2005, pp. 984-989.
53. T. Zhang, D. Tao, X. Li, and J. Yang Patch alignment for dimensionality reduction IEEE Trans. Knowl. Data Eng. 21 9 2009 1299 1313
54. X. Zhen, L. Shao, Spatio-temporal steerable pyramid for human action recognition, in: Proceedings of the 10th IEEE International Conference on Automatic Face and Gesture Recognition, 2013.
55. X. Zhen, L. Shao, D. Tao, and X. Li Embedding motion and structure features for action recognition IEEE Trans. Circ. Syst. Video Technol. 23 7 2013 1182 1190