3D SMoSIFT: Three-dimensional sparse motion scale invariant feature transform for activity recognition from RGB-D videos

Journal of Electronic Imaging

Volumn 23, Issue 2, 2014, Pages

  Wan, Jun ^a   Ruan, Qiuqi ^a   Li, Wei ^a   An, Gaoyun ^a   Zhao, Ruizhen ^a  

^a BEIJING JIAOTONG UNIVERSITY   (China)

Author keywords

bag of words model; optical flow; RGB D data; spatiotemporal feature; three dimensional sparse motion scale invariant feature transform

Indexed keywords

EDGE DETECTION; OPTICAL FLOWS;

ACTIVITY RECOGNITION; BAG-OF-WORDS MODELS; HUMAN ACTIVITY RECOGNITION; REAL-TIME APPLICATION; RGB-D DATA; SCALE INVARIANT FEATURE TRANSFORMS; SPATIO TEMPORAL FEATURES; STATE-OF-THE-ART APPROACH;

THREE DIMENSIONAL;

EID: 84898634879     PISSN: 10179909     EISSN: 1560229X     Source Type: Journal    
DOI: 10.1117/1.JEI.23.2.023017     Document Type: Article

References (36)

1. J. Aggarwal and M. Ryoo, "Human activity analysis: a review," ACM Comput. Surv. 43(3), 161-1643 (2011).
2. N. Zhang et al., "A generic approach for systematic analysis of sports videos," ACM Trans. Intell. Syst. Technol. 3(3), 461-4619 (2012).
3. L. Shao et al., "Spatio-temporal Laplacian pyramid coding for action recognition," IEEE Trans. Cybern. (2013).
4. L. Shao, S. Jones, and X. Li, "Efficient search and localisation of human actions in video databases," IEEE Trans. Circuits Syst. Video Technol. 24(3), 504-512 (2014).
5. J. Wan et al., "Gesture recognition based on hidden Markov model from sparse representative observations," in IEEE Int. Conf. on Signal Processing, Vol. 2, pp. 1180-1183, IEEE (2012).
6. J. Han et al., "Enhanced computer vision with Microsoft Kinect sensor: a review," IEEE Trans. Cybern. 43(5), 1318-1334 (2013).
7. H. J. Escalante et al., "Principal motion components for gesture recognition using a single-example," arXiv:1310.4822 (2013).
8. B. Ni, G. Wang, and P. Moulin, "RGBD-HuDaAct: a color-depth video database for human daily activity recognition," in IEEE Conf. on Computer Vision Workshops, pp. 1147-1153, IEEE (2011).
9. J. Wang et al., "Mining actionlet ensemble for action recognition with depth cameras," in IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1290-1297, IEEE (2012).
10. J. Sung et al., "Unstructured human activity detection from RGBD images," in IEEE Conf. on Robotics and Automation, pp. 842-849, IEEE (2012).
11. A. Hernández-Vela et al., "BoVDW: bag-of-visual-and-depth- words for gesture recognition," in 21st Int. Conf. on Pattern Recognition, pp. 449-452, IEEE (2012).
12. M. R. Malgireddy, I. Inwogu, and V. Govindaraju, "A temporal Bayesian model for classifying, detecting and localizing activities in video sequences," in IEEE Conf. on Computer Vision and Pattern Recognition Workshops, pp. 43-48, IEEE (2012).
13. Y. Ming, Q. Ruan, and A. G. Hauptmann, "Activity recognition from RGB-D camera with 3D local spatio-temporal features," in IEEE Conf. on Multimedia and Expo, pp. 344-349, IEEE (2012).
14. J. Wan et al., "One-shot learning gesture recognition from RGB-D data using bag of features," J. Mach. Learn. Res. 14(9), 2549-2582 (2013).
15. J. Shotton et al., "Real-time human pose recognition in parts from single depth images," Commun. ACM 56(1), 116-124 (2013).
16. P. Dollár et al., "Behavior recognition via sparse spatio-temporal features," in 2nd Joint IEEE Int. Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, pp. 65-72, IEEE (2005). (Pubitemid 46178025)
17. I. Laptev, "On space-time interest points," Int. J. Comput. Vis. 64(2-3), 107-123 (2005). (Pubitemid 41314645)
18. L. Fei-Fei and P. Perona, "A Bayesian hierarchical model for learning natural scene categories," in IEEE Conf. on Computer Vision and Pattern Recognition, Vol. 2, pp. 524-531, IEEE (2005).
19. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis. 60(2), 91-110 (2004).
20. J. Shi and C. Tomasi, "Good features to track," in IEEE Conf. on Computer Vision and Pattern Recognition, pp. 593-600, IEEE (1994).
21. B. D. Lucas et al., "An iterative image registration technique with an application to stereo vision," in Int. Joint Conf. on Artificial Intelligence, Vol. 81, pp. 674-679, AAAI Press (1981).
22. M. Camplani and L. Salgado, "Efficient spatio-temporal hole filling strategy for kinect depth maps," Proc. SPIE 8290, 82900E (2012).
23. C. Harris and M. Stephens, "A combined corner and edge detector," in Alvey Vision Conf., pp. 147-151 (1988).
24. M.-y. Chen and A. Hauptmann, "MoSIFT: recognizing human actions in surveillance videos," (2009).
25. J. C. Niebles, H. Wang, and L. Fei-Fei, "Unsupervised learning of human action categories using spatial-temporal words," Int. J. Comput. Vis. 79(3), 299-318 (2008).
26. C.-C. Chang and C.-J. Lin, "Libsvm: a library for support vector machines," ACM Trans. Intell. Syst. Technol. 2(3), 27:1-2727 (2011).
27. G. Bradski, "The OpenCV library," Dr. Dobb's J. Softw. Tools (2000).
28. J.-Y. Bouguet, "Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm," 2001, http://robots .stanford.edu/cs223b04/algo-tracking.pdf (20 March 2014).
29. I. Guyon et al., "ChaLearn gesture challenge: design and first results," in IEEE Conf. on Computer Vision and Pattern Recognition Workshops, pp. 1-6, IEEE (2012).
30. I. Guyon et al., "Results and analysis of the ChaLearn gesture challenge 2012," in Advances in Depth Image Analysis and Applications, pp. 186-204, Springer, Berlin, Heidelberg (2013).
31. B. Ni, P. Moulin, and S. Yan, "Order-preserving sparse coding for sequence classification," Lec. Notes Comput. Sci. 7573, 173-187 (2012).
32. X. Yang and Y. Tian, "Effective 3D action recognition using eigenjoints," J. Vis. Commun. Image Represent. 25(1), 2-11 (2014).
33. J. Wang, Z. Liu, and Y. Wu, "Learning actionlet ensemble for 3D human action recognition," IEEE Trans. Pattern Anal. Mach. Intell. (2013).
34. O. Oreifej and Z. Liu, "HON4D: histogram of oriented 4D normals for activity recognition from depth sequences," in IEEE Conf. Computer Vision and Pattern Recognition, pp. 716-723, IEEE (2013).
35. L. Liu and L. Shao, "Learning discriminative representations from RGB-D video data," in Proc. Int. Joint Conf. on Artificial Intelligence, pp. 1493-1500, AAAI Press (2013).
36. M. Müller and T. Röder, "Motion templates for automatic classification and retrieval of motion capture data," inACMSIGGRAPH/ Eurographics Symp. on Computer Animation, pp. 137-146, ACM (2006).