Histogram of Oriented Principal Components for Cross-View Action Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 38, Issue 12, 2016, Pages 2430-2443

  Rahmani, Hossein ^a   Mahmood, Arif ^a   Huynh, Du ^a   Mian, Ajmal ^a  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

pointcloud; Spatio temporal keypoint; view invariance

Indexed keywords

FACE RECOGNITION; GRAPHIC METHODS; MOTION ESTIMATION;

ACTION RECOGNITION; HUMAN-ACTION RECOGNITION; KEYPOINT; POINTCLOUD; PRINCIPAL COMPONENTS; SPATIOTEMPORAL DISTRIBUTIONS; STATE-OF-THE-ART METHODS; VIEW INVARIANCE;

GESTURE RECOGNITION;

EID: 84995584051     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2016.2533389     Document Type: Review

References (60)

1. J. K. Aggarwal and M. S. Ryoo, "Human activity analysis: A review, " ACM Comput. Survey, vol. 43, p. 16, 2011.
2. D. Weinland, R. Ronfard, E. Boyer, "A survey of vision-based methods for action representation, segmentation and recognition, " in Comput. Vision Image Understanding, vol. 115, pp. 224-241, 2011.
3. Z. Cheng, L. Qin, Y. Ye, Q. Huang, Q. Tian, "Human daily action analysis with multi-view and color-depth data, " in Proc. Eur. Conf. Comput. Vision, 2012, pp. 52-61.
4. C. Lu, J. Jia, C. K. Tang, "Range-sample depth feature for action recognition, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2014, pp. 772-779.
5. H. Rahmani, A. Mahmood, D. Huynh, A. Mian, "Action classification with locality-constrained linear coding, " in Proc. 22nd Int. Conf. Pattern Recog., 2014, pp. 3511-3516.
6. H. Rahmani, A. Mahmood, D. Q. Huynh, A. Mian, "Real time action recognition using histograms of depth gradients and random decision forests, " in Proc. IEEE Winter Conf. Appl. Comput. Vision, 2014, pp. 626-633.
7. X. Yang, C. Zhang, Y. Tian, "Recognizing actions using depth motion maps-based histograms of oriented gradients, " in Proc. ACM Int. Conf. Multimedia, 2012, pp. 1057-1060.
8. L. Xia and J. Aggarwal, "Spatio-temporal depth cuboid similarity feature for activity recongition using depth camera, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2013, pp. 2834-2841.
9. O. Oreifej and Z. Liu, "HON4D: Histogram of oriented 4D normals for activity recognition from depth sequences, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2013, pp. 716-723.
10. X. Yang and Y. Tian, "Super normal vector for activity recognition using depth sequences, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2014, pp. 804-811.
11. H. Zhang, W. Zhou, C. Reardon, L. E. Parker, "Simplex-based 3D spatio-temporal feature description for action recognition, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2014, pp. 2067-2074.
12. Y. Tian, R. Sukthankar, M. Shah, "Spatiotemporal deformable part models for action detection, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2013, pp. 2642-2649.
13. M. Zanfir, M. Leordeanu, C. Sminchisescu, "The moving pose: An efficient 3D kinematics descriptor for low-latency action recognition and detection, " in Proc. IEEE Int. Conf. Comput. Vision, 2013, pp. 2752-2759.
14. X. Yang and Y. Tian, "EigenJoints-based action recognition using naive Bayes nearest neighbor, " in Proc. IEEE Conf. Comput. Vision Pattern Recog. Workshops, 2012, pp. 14-19.
15. A. Yilmaz and M. Shah, "Action sketch: A novel action representation, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2005, pp. 984-989.
16. D. Weinland, E. Boyer, R. Ronfard, "Action recognition from arbitrary views using 3D exemplars, " in Proc. IEEE Int. Conf. Comput. Vision, 2007, pp. 1-7.
17. F. Lv and R. Nevatia, "Single view human action recognition using key pose matching and Viterbi path searching, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2007, pp. 1-8.
18. D. Gavrila and L. Davis, "3D model-based tracking of humans in action: A multi-view approach, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 1996, pp. 73-80.
19. T. Darrell, I. Essa, A. Pentland, "Task-specific gesture analysis in real-time using interpolated views, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 12, pp. 1236-1242, Dec. 1996.
20. B. Li, O. Camps, M. Sznaier, "Cross-view activity recognition using hankelets, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2012, pp. 1362-1369.
21. V. Parameswaran and R. Chellappa, "View invariance for human action recognition, " Int. J. Comput. Vision, vol. 66, pp. 83-101, 2006.
22. C. Rao, A. Yilmaz, M. Shah, "View-invariant representation and recognition of actions, " Int. J. Comput. Vision, vol. 50, pp. 203-226, 2002.
23. T. Syeda-Mahmood, A. Vasilescu, S. Sethi, "Recognizing action events from multiple viewpoints, " in Proc. IEEE Workshop Detection Recog. Events Video, 2001, pp. 64-72.
24. S. Seitz and C. Dyer, "View-invariant analysis of cyclic motion, " Int. J. Comput. Vision, vol. 25, pp. 231-251, 1997.
25. M. Blank, L. Gorelick, E. Shechtman, M. Irani, R. Basri, "Actions as space-time shapes, " in Proc. IEEE Int. Conf. Comput. Vision, 2005, pp. 1395-1402.
26. D. Weinland, R. Ronfard, E. Boyer, "Free viewpoint action recognition using motion history volumes, " Comput. Vision Image Understanding, vol. 104, pp. 249-257, 2006.
27. L. Xia, C. C. Chen, J. K. Aggarwal, "View invariant human action recognition using histograms of 3D joints, " in Proc. IEEE Conf. Comput. Vision Pattern Recog. Workshops, 2012, pp. 20-27.
28. J. Wang, Z. Liu, Y. Wu, J. Yuan, "Learning actionlet ensemble for 3D human action recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 5, pp. 914-927, May 2014.
29. J. Wang, X. Nie, Y. Xia, Y. Wu, S. Zhu, "Cross-view action modeling, learning and recognition, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2014, pp. 2649-2656.
30. A. Gupta, J. Martinez, J. J. Little, R. J. Woodham, "3D pose from motion for cross-view action recognition via non-linear circulant temporal encoding, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2014, pp. 2601-2608.
31. J. Zheng and Z. Jiang, "Learning view-invariant sparse representations for cross-view action recognition, " in Proc. IEEE Int. Conf. Comput. Vision, 2013, pp. 3176-3183.
32. Z. Zhang, C. Wang, B. Xiao, W. Zhou, S. Liu, C. Shi, "Crossview action recognition via a continuous virtual path, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2013, pp. 2690-2697.
33. A. Farhadi and M. K. Tabrizi, "Learning to recognize activities from the wrong view point, " in Proc. Eur. Conf. Comput. Vision, 2008, pp. 154-166.
34. A. Farhadi, M. K. Tabrizi, I. Endres, D. A. Forsyth, "A latent model of discriminative aspect, " in Proc. IEEE Int. Conf. Comput. Vision, 2009, pp. 1-8.
35. J. Liu, M. Shah, B. Kuipersy, S. Savarese, "Cross-view action recognition via view knowledge transfer, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2011, pp. 3209-3216.
36. R. Li and T. Zickler, "Discriminative virtual views for cross-view action recognition, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2012, pp. 2855-2862.
37. H. Rahmani, A. Mahmood, D. Q. Huynh, A. Mian, "HOPC: Histogram of oriented principal components of 3D pointclouds for action recognition, " in Proc. Eur. Conf. Comput. Vision, 2014, pp. 742-757.
38. W. Li, Z. Zhang, Z. Liu, "Action recognition based on a bag of 3D points, " in Proc. IEEE Conf. Comput. Vision Pattern Recog. Workshops, 2010, pp. 9-14.
39. J. Wang, Z. Liu, Y. Wu, J. Yuan, "Mining actionlet ensemble for action recognition with depth cameras, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2012, pp. 1290-1297.
40. J. Wang, Z. Liu, J. Chorowski, Z. Chen, Y. Wu, "Robust 3D action recognition with random occupancy patterns, " in Proc. Eur. Conf. Comput. Vision, 2012, pp. 872-885.
41. R. Vemulapalli, F. Arrate, R. Chellappa, "Human action recognition by representing 3D skeletons as points in a Lie group, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2014, pp. 588-595.
42. R. Gopalan, R. Li, R. Chellapa, "Domain adaption for object recognition: An unsupervised approach, " in Proc. IEEE Int. Conf. Comput. Vision, 2011, pp. 999-1006.
43. L. Campbell and A. Bobick, "Recognition of human body motion using phase space constraints, " in Proc. IEEE Int. Conf. Comput. Vision, 1995, pp. 624-630.
44. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, A. Blake, "Real-time human pose recognition in parts from single depth images, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2011, pp. 1297-1304.
45. A. W. Vieira, E. Nascimento, G. Oliveira, Z. Liu, M. Campos, "STOP: Space-time occupancy patterns for 3D action recognition from depth map sequences, " in Proc. 17th Iberoamerican Congr. Prog. Pattern Recog., Image Anal., Comput. Vision, Appl., 2012, pp. 252-259.
46. S. Tang, X. Wang, X. Lv, T. Han, J. Keller, Z. He, M. Skubic, S. Lao, "Histogram of oriented normal vectors for object recognition with a depth sensor, " in Proc. 11th Asian Conf. Comput. Vision, 2012, pp. 525-538.
47. I. Laptev, "On space-time interest point, " Int. J. Comput. Vision, vol. 64, pp. 107-123, 2005.
48. P. Doll-ar, V. Rabaud, G. Cottrell, S. Belongie, "Behavior recognition via sparse spatio-temporal features, " in Proc. 14th Int. Conf. Comput. Commun. Netw., 2005, pp. 65-72.
49. G. Willems, T. Tuytelaars, L. Gool, "An efficient dense and scale-invariant spatio-temporal interest point detector, " in Proc. Eur. Conf. Comput. Vision, 2008, pp. 650-663.
50. H. Wang and C. Schmid, "Action recognition with improved trajectories, " in Proc. IEEE Int. Conf. Comput. Vision, 2013, pp. 3551-3558.
51. H. Wang, A. Klaser, C. Schmid, C.-L. Liu, "Action recognition by dense trajectories, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2011, pp. 3169-3176.
52. S. Wu, O. Oreifej, M. Shah, "Action recognition in videos acquired by a moving camera using motion decomposition of Lagrangian particle trajectories, " in Proc. IEEE Int. Conf. Comput. Vision, 2011, pp. 1419-1426.
53. N. J. Mitra and A. Nguyen, "Estimating surface normals in noisy point clouds data, " in Proc. 19th Annu. Symp. Comput. Geometry, 2003, pp. 322-328.
54. S. Maji, A. C. Berg, J. Malik, "Classification using intersection kernel support vector machines is efficient, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2008, pp. 1-8.
55. Y. W. Chen and C. J. Lin, "Combining SVMs with various feature selection strategies, " in Feature Extraction (ser. Studies in Fuzziness and Soft Computing). Berlin, Germany: Springer, 2006.
56. J. Xie and C. Wang, "Using support vector machines with a novel hybrid feature selection method for diagnosis of erythematosquamous diseases, " Exp. Syst. Appl., vol. 38, pp. 5809-5815, 2011.
57. H. S. M. Coxeter, Regular Polytopes. New York, NY, USA: Dover, 1973.
58. F. Timbari and L. D. Stefano, "Performance evaluation of 3D keypoint detectors, " Int. J. Comput. Vision, vol. 102, pp. 198-220, 2013.
59. A. Mian, M. Bennamoun, R. Owens, "On the repeatability and quality of keypoints for local feature-based 3D object retrieval from cluttered scenes, " Int. J. Comput. Vision, vol. 89, pp. 348-361, 2010.
60. Z. Liu. (2016, Jan. 18). Description of the experimental setup for the MSR Action 3D dataset. [Online]. Available: http://research. microsoft. com/en-us/um/people/zliu/actionrecorsrc/MSRAc tion3DExpSetup. pdf.