3D action recognition from novel viewpoints

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 1506-1515

  Rahmani, Hossein ^a   Mian, Ajmal ^a  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; MOTION ESTIMATION; NEURAL NETWORKS; THREE DIMENSIONAL COMPUTER GRAPHICS;

3D HUMAN MODELS; ACTION RECOGNITION; BENCHMARK DATASETS; CONVOLUTIONAL NEURAL NETWORK; REPRESENTATION MODEL; SPATIO TEMPORAL; STATE OF THE ART; VIEW INVARIANTS;

PATTERN RECOGNITION;

EID: 84986313453     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.167     Document Type: Conference Paper

References (74)

1. Blender: A 3D modelling and rendering package. http: //www. blender. org/.
2. CMU motion capture database. http: //mocap. cs. cmu. edu/.
3. MakeHuman: An open source 3D computer graphics software. http: //www. makehuman. org/.
4. D. Anguelov, P. Srinivasan, D. Koller, S. Thrun, J. Rodgers, and J. Davis. SCAPE: shape completion and animation of people. ACM SIGGRAPH, 2005.
5. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri. Actions as space-time shapes. In ICCV, 2005.
6. F. Bogo, J. Romero, M. Loper, and M. J. Black. FAUST: Dataset and evaluation for 3D mesh registration. In CVPR, 2014.
7. Z. Cheng, L. Qin, Y. Ye, Q. Huang, and Q. Tian. Human daily action analysis with multi-view and color-depth data. In ECCVW, 2012.
8. J. R. D'Errico. Surface fitting using gridfit. In MATLAB Central File Exchange, 2008.
9. J. Donahue, L. A. Hendricks, S. Guadarrama, M. Rohrbach, S. Venugopalan, K. Saenko, and T. Darrell. Long-term recurrent convolutional networks for visual recognition and description. In CVPR, 2015.
10. Y. Du, W. Wang, and L. Wang. Hierarchical recurrent neural network for skeleton based action recognition. In CVPR, 2015.
11. A. Farhadi and M. K. Tabrizi. Learning to recognize activities from the wrong view point. In ECCV, 2008.
12. A. Farhadi, M. K. Tabrizi, I. Endres, and D. A. Forsyth. A latent model of discriminative aspect. In ICCV, 2009.
13. D. Gavrila and L. Davis. 3D model-based tracking of humans in action: A multi-view approach. In CVPR, 1996.
14. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014.
15. G. Gkioxari and J. Malik. Finding action tubes. In CVPR, 2015.
16. A. Graves and N. Jaitly. Towards end-to-end speech recognition with recurrent neural networks. In ICML, 2014.
17. A. Gupta, J. Martinez, J. J. Little, and R. J. Woodham. 3D pose from motion for cross-view action recognition via nonlinear circulant temporal encoding. In CVPR, 2014.
18. S. Gupta, R. Girshick, P. Arbelez, and J. Malik. Learning rich features from RGB-D images for object detection and segmentation. In ECCV, 2014.
19. S. Ji, W. Xu, M. Yang, and K. Yu. 3D convolutional neural networks for human action recognition. PAMI, 2013.
20. I. N. Junejo, E. Dexter, I. Laptev, and P. Perez. View-independent action recognition from temporal selfsimilarities. PAMI, 2011.
21. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In CVPR, 2014.
22. S. Katz, A. Tal, and R. Basri. Direct visibility of point sets. ACM Transactions on Graphics, 2007.
23. Y. Kong and Y. Fu. Bilinear heterogeneous information machine for RGB-D action recognition. In CVPR, 2015.
24. B. Krishnapuram, L. Carin, M. Figueiredo, and A. Hartemink. Sparse multinomial logistic regression: fast algorithms and generalization bounds. PAMI, 2005.
25. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, 2012.
26. A. Kurakin, Z. Zhang, and Z. Liu. A real time system for dynamic hand gesture recognition with a depth sensor. In EUSIPCO, 2012.
27. R. Li and T. Zickler. Discriminative virtual views for crossview action recognition. In CVPR, 2012.
28. J. Liu, M. Shah, B. Kuipers, and S. Savarese. Cross-view action recognition via view knowledge transfer. In CVPR, 2011.
29. J. Liu, M. Shah, B. Kuipersy, and S. Savarese. Cross-view action recognition via view knowledge transfer. In CVPR, 2011.
30. M. Loper, N. Mahmood, and M. J. Black. MoSh: motion and shape capture from sparse markers. ACM Transactions on Graphics, 2014.
31. S. Maji, L. Bourdev, and J. Malik. Action recognition from a distributed representation of pose and appearance. In CVPR, 2011.
32. A. Maurer and M. Pontil. Structured sparsity and generalization. Journal of Machine Learning Research, 2012.
33. A. V. Oppenheim, R. W. Schafer, and J. R. Buck. Discrete time signal processing. Prentice Hall Signal Processing Series, 1999.
34. O. Oreifej and Z. Liu. HON4D: histogram of oriented 4D normals for activity recognition from depth sequences. In CVPR, 2013.
35. V. Parameswaran and R. Chellappa. View invariance for human action recognition. IJCV, 2006.
36. H. Rahmani, D. Q. Huynh, A. Mahmood, and A. Mian. Discriminative human action classification using localityconstrained linear coding. Pattern Recognition Letters, 2015.
37. H. Rahmani, A. Mahmood, D. Huynh, and A. Mian. Action classification with locality-constrained linear coding. In ICPR, 2014.
38. H. Rahmani, A. Mahmood, A. Mian, and D. Huynh. Real time action recognition using histograms of depth gradients and random decision forests. In WACV, 2014.
39. H. Rahmani, A. Mahmood, D. Q Huynh, and A. Mian. HOPC: Histogram of oriented principal components of 3D pointclouds for action recognition. In ECCV, 2014.
40. H. Rahmani, A. Mahmood, D. Q Huynh, and A. Mian. Histogram of oriented principal components for cross-view action recognition. PAMI, 2016.
41. H. Rahmani and A. Mian. Learning a non-linear knowledge transfer model for cross-view action recognition. In CVPR, 2015.
42. H. Rahmani, A. Mian, and M. Shah. Learning a deep model for human action recognition from novel viewpoints. In arXiv: 1602. 00828, 2016.
43. C. Rao, A. Yilmaz, and M. Shah. View-invariant representation and recognition of actions. IJCV, 2002.
44. S. Sadanand and J. Corso. Action bank: A high-level representation of activity in video. In CVPR, 2012.
45. A. Shahroudy, J. Liu, T.-T. Ng, and G. Wang. NTU RGB+D: A large scale dataset for 3D human activity analysis. In CVPR, 2016.
46. A. Shahroudy, T.-T. Ng, Y. Gong, and G. Wang. Deep multimodal feature analysis for action recognition in RGB+D videos. In arXiv, 2016.
47. A. Shahroudy, T.-T. Ng, Q. Yang, and G. Wang. Multimodal multipart learning for action recognition in depth videos. PAMI, 2016.
48. A. Shahroudy, G. Wang, T.-T. Ng, and Q. Yang. Multi-modal feature fusion for action recognition in RGB-D sequences. In International Symposium on Communications, Control and Signal Processing (ISCCSP14), 2014.
49. G. Shakhnarovich. Learning Task-Specific Similarity. PhD thesis, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, 2005.
50. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake. Real-time human pose recognition in parts from single depth images. In CVPR, 2011.
51. K. Simonyan and A. Zisserman. Two-stream convolutional networks for action recognition in videos. In NIPS, 2014.
52. T. Syeda-Mahmood, A. Vasilescu, and S. Sethi. Action recognition from arbitrary views using 3D exemplars. In ICCV, 2007.
53. A. Vedaldi and K. Lenc. MatConvNet-Convolutional Neural Networks for MATLAB. In ACM International Conference on Multimedia, 2015.
54. R. Vemulapalli, F. Arrate, and R. Chellappa. Human action recognition by representing 3D skeletons as points in a Lie group. In CVPR, 2014.
55. H. Wang, A. Klaser, C. Schmid, and C.-L. Liu. Action recognition by dense trajectories. In CVPR, 2011.
56. H. Wang and C. Schmid. Action recognition with improved trajectories. In ICCV, 2013.
57. J. Wang, Z. Liu, J. Chorowski, Z. Chen, and Y. Wu. Robust 3D action recognition with random occupancy patterns. In ECCV, 2012.
58. J. Wang, Z. Liu, Y. Wu, and J. Yuan. Mining actionlet ensemble for action recognition with depth cameras. In CVPR, 2012.
59. J. Wang, Z. Liu, Y. Wu, and J. Yuan. Learning actionlet ensemble for 3D human action recognition. PAMI, 2013.
60. J. Wang, X. Nie, Y. Xia, Y. Wu, and S. Zhu. Cross-view action modeling, learning and recognition. In CVPR, 2014.
61. D. Weinland, M. Özuysal, and P. Fua. Making action recognition robust to occlusions and viewpoint changes. In ECCV, 2010.
62. D. Weinland, R. Ronfard, and E. Boyer. Free viewpoint action recognition using motion history volumes. CVIU, 2006.
63. S. Wu, O. Oreifej, and M. Shah. Action recognition in videos acquired by a moving camera using motion decomposition of Lagrangian particle trajectories. In ICCV, 2011.
64. L. Xia and J. Aggarwal. Spatio-temporal depth cuboid similarity feature for activity recongition using depth camera. In CVPR, 2013.
65. L. Xia, C. C. Chen, and J. K. Aggarwal. View invariant human action recognition using histograms of 3D joints. In CVPRW, 2012.
66. P. Yan, S. M. Khan, and M. Shah. Learning 4D action feature models for arbitrary view action recognition. In CVPR, 2008.
67. X. Yang and Y. Tian. Super normal vector for activity recognition using depth sequences. In CVPR, 2014.
68. X. Yang, C. Zhang, and Y. Tian. Recognizing actions using depth motion maps-based histograms of oriented gradients. In ACM ICM, 2012.
69. A. Yilmaz and M. Shah. Action sketch: A novel action representation. In CVPR, 2005.
70. M. Yuan and Y. Lin. Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society, 2006.
71. W. Zaremba and I. Sutskever. Learning to execute. ArXiv: 1410. 4615, 2014.
72. Z. Zhang, C. Wang, B. Xiao, W. Zhou, S. Liu, and C. Shi. Cross-view action recognition via a continuous virtual path. In CVPR, 2013.
73. J. Zheng, Z. Jiang, J. Phillips, and R. Chellappa. Crossview action recognition via a transferable dictionary pair. In BMVC, 2012.
74. Y. Zhou, B. Ni, R. Hong, M. Wang, and Q. Tian. Interaction part mining: A mid-level approach for fine-grained action recognition. In CVPR, 2015.