Combining unsupervised learning and discrimination for 3D action recognition

Signal Processing

Volumn 110, Issue , 2015, Pages 67-81

  Chen, Guang ^a   Clarke, Daniel ^a   Giuliani, Manuel ^a   Gaschler, Andre ^a   Knoll, Alois ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Depth camera; Ensemble learning; Human action recognition; Multi kernel learning; Unsupervised learning

Indexed keywords

UNSUPERVISED LEARNING;

ACTION RECOGNITION SYSTEMS; DEPTH CAMERA; ENSEMBLE LEARNING; HUMAN-ACTION RECOGNITION; MULTI-KERNEL LEARNING; SPATIO TEMPORAL FEATURES; STATE-OF-THE-ART METHODS; UNSUPERVISED FEATURE LEARNING;

LEARNING ALGORITHMS;

EID: 84922808304     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2014.08.024     Document Type: Article

References (59)

1. W. Li, Z. Zhang, Z. Liu, Action recognition based on a bag of 3d points, in: IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2010, pp. 9-14.
2. O. Oreifej, Z. Liu, Hon4d: histogram of oriented 4d normals for activity recognition from depth sequences, in: IEEE Conference on Computer Vision and Pattern Recognition, 2013.
3. G. Chen, D. Clarke, A. Knoll, Learning weighted joint-based features for action recognition using depth camera, in: International Conference on Computer Vision Theory and Applications, 2014.
4. S. Hadfield, R. Bowden, Hollywood 3d: recognizing actions in 3d natural scenes, in: IEEE Conference on Computer Vision and Pattern Recognition, 2013, pp. 3398-3405.
5. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, A. Blake, Real-time human pose recognition in parts from single depth images, in: IEEE Conference on Computer Vision and Pattern Recognition, 2011,pp. 1297-1304.
6. I. Laptev On space-time interest points Int. J. Comput. Vis. 64 2005 107 123
7. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
8. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: IEEE Conference on Computer Vision and Pattern Recognition, 2005, pp. 886-893.
9. A. Hyvarinen, J. Hurri, and P. Hoyer Natural Image Statistics: A probabilistic approach to early computational verion 2009 Spring-Verlag
10. Q. Le, W. Zou, S. Yeung, A. Ng, Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis, in: IEEE Conference on Computer Vision and Pattern Recognition, 2011, pp. 3361-3368.
11. G. Chen, F. Zhang, M. Giuliani, C. Buckl, A. Knoll, Unsupervised learning spatio-temporal features for human activity recognition from rgb-d video data, in: International Conference on Social Robotics, 2013.
12. Z.-H. Zhou, Ensemble learning, in: Encyclopedia of Biometrics, 2009, pp. 270-273.
13. G. Chen, M. Giuliani, D. Clarke, A. Gaschler, A. Knoll, Action recognition using ensemble weighted multi-instance learning, in: IEEE International Conference on Robotics and Automation, 2014.
14. A. Hernandez-Vela, M. Bautista, X. Perez-Sala, V. Ponce, X. Baro, O. Pujol, C. Angulo, S. Escalera, Bovdw: bag-of-visual-and-depth-words for gesture recognition, in: International Conference on Pattern Recognition, 2012, pp. 449-452.
15. Y. Zhao, Z. Liu, L. Yang, H. Cheng, Combing rgb and depth map features for human activity recognition, in: Signal Information Processing Association Annual Summit and Conference, 2012, pp. 1-4.
16. B. Ni, G. Wang, P. Moulin, Rgbd-hudaact: a color-depth video database for human daily activity recognition, in: IEEE International Conference on Computer Vision Workshops, 2011, pp. 1147-1153.
17. O. Oshin, A. Gilbert, R. Bowden, Capturing the relative distribution of features for action recognition, in: IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, 2011, pp. 111-116.
18. Z. Cheng, L. Qin, Y. Ye, Q. Huang, Q. Tian, Human daily action analysis with multi-view and color-depth data, in: ECCV Workshops and Demonstrations, Lecture Notes in Computer Science, vol. 7584, pp. 52-61.
19. T. Ahonen, A. Hadid, and M. Pietikainen Face description with local binary patterns: application to face recognition IEEE Trans. Pattern Anal. Mach. Intell. 28 2006 2037 2041
20. J. Wang, Z. Liu, J. Chorowski, Z. Chen, Y. Wu, Robust 3d action recognition with random occupancy patterns, in: European Conference on Computer Vision, 2012, pp. 872-885.
21. J. Yu, M. Wang, and D. Tao Semisupervised multiview distance metric learning for cartoon synthesis IEEE Trans. Image Process. 21 2012 4636 4648
22. J. Yu, D. Liu, D. Tao, and H.S. Seah On combining multiple features for cartoon character retrieval and clip synthesis IEEE Trans. Syst. Man Cybern. Part B: Cybern. 42 2012 1413 1427
23. X. Yang, Y. Tian, Eigenjoints-based action recognition using Naïve-Bayes-nearest-neighbor, in: IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2012, pp. 14-19.
24. V. Bloom, D. Makris, V. Argyriou, G3d: a gaming action dataset and real time action recognition evaluation framework, in: IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2012, pp. 7-12.
25. L. Xia, C.-C. Chen, J. Aggarwal, View invariant human action recognition using histograms of 3d joints, in: IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2012, pp. 20-27.
26. C. Wang, Y. Wang, A. Yuille, An approach to pose-based action recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, 2013, pp. 915-922.
27. G. Dong, J. Li, Efficient mining of emerging patterns: discovering trends and differences, in: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1999, pp. 43-52.
28. D. Tao, X. Tang, X. Li, and X. Wu Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval IEEE Trans. Pattern Anal. Mach. Intell. 28 2006 1088 1099
29. D. Tao, X. Li, X. Wu, and S. Maybank General tensor discriminant analysis and Gabor features for gait recognition IEEE Trans. Pattern Anal. Mach. Intell. 29 2007 1700 1715
30. D. Tao, X. Li, X. Wu, and S. Maybank Geometric mean for subspace selection IEEE Trans. Pattern Anal. Mach. Intell. 31 2009 260 274
31. G. Chen, F. Zhang, D. Clarke, A. Knoll, Learning to track multi-target online by boosting and scene layout, in: 12th International Conference on Machine Learning and Applications (ICMLA), vol. 1, 2013, pp. 197-202.
32. J. Wang, Z. Liu, Y. Wu, J. Yuan, Mining actionlet ensemble for action recognition with depth cameras, in: IEEE Conference on Computer Vision and Pattern Recognition, 2012, pp. 1290-1297.
33. L. Zhu, Y. Chen, Y. Lu, C. Lin, A. Yuille, Max margin and/or graph learning for parsing the human body, in: IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
34. B. Yao, L. Fei-Fei, Grouplet: a structured image representation for recognizing human and object interactions, in: IEEE Conference on Computer Vision and Pattern Recognition, 2010, pp. 9-16.
35. G. Chen, D. Clarke, D. Weikersdorfer, M. Giuliani, A. Gaschler, D. Wu, A. Knoll, Multi-modality gesture detection and recognition with un-supervision, randomization and discrimination, in: ChaLearn Looking at People Workshop, European Conference on Computer Vision (ECCV2014), 2014.
36. L. Xia, J. Aggarwal, Spatio-temporal depth cuboid similarity feature for activity recognition using depth camera, in: IEEE Conference on Computer Vision and Pattern Recognition, 2013.
37. F. Ofli, R. Chaudhry, G. Kurillo, R. Vidal, R. Bajcsy, Berkeley mhad: a comprehensive multimodal human action database, in: IEEE Workshop on Applications of Computer Vision, 2013, pp. 53-60.
38. H. Rehmani, A. Mahmood, A. Mian, D. Huynh, Real time action recognition using histograms of depth gradients and random decision forests, in: IEEE Winter Applications of Computer Vision Conference, 2014.
39. M. Reyes, G. Dominguez, S. Escalera, Feature weighting in dynamic time warping for gesture recognition in depth data, in: IEEE International Conference on Computer Vision Workshops, 2011, pp. 1182-1188.
40. J. Wang, Y. Wu, Learning maximum margin temporal warping for action recognition, in: The IEEE International Conference on Computer Vision, 2013.
41. A. Gaschler, S. Jentzsch, M. Giuliani, K. Huth, J. de Ruiter, A. Knoll, Social behavior recognition using body posture and head pose for human-robot interaction, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2012.
42. A. Gaschler, K. Huth, M. Giuliani, I. Kessler, J. de Ruiter, A. Knoll, Modelling state of interaction from head poses for social Human-Robot Interaction, in: ACM/IEEE HCI Conference on Gaze in Human-Robot Interaction Workshop, 2012.
43. W. Li, Z. Zhang, and Z. Liu Expandable data-driven graphical modeling of human actions based on salient postures IEEE Trans. Circuits Syst. Video Technol. 18 2008 1499 1510
44. A. Vieira, E. Nascimento, G. Oliveira, Z. Liu, M. Campos, Stop: space-time occupancy patterns for 3d action recognition from depth map sequences, in: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, Lecture Notes in Computer Science, vol. 7441, 2012, pp. 252-259.
45. A. Kurakin, Z. Zhang, Z. Liu, A real time system for dynamic hand gesture recognition with a depth sensor, in: European Signal Processing Conference, 2012, pp. 1975-1979.
46. B. Geng, D. Tao, C. Xu, Y. Yang, and X.-S. Hua Ensemble manifold regularization IEEE Trans. Pattern Anal. Mach. Intell. 34 2012 1227 1233
47. J. Yu, D. Tao, and M. Wang Adaptive hypergraph learning and its application in image classification IEEE Trans. Image Process. 21 2012 3262 3272
48. J. Yu, Y. Rui, and D. Tao Click prediction for web image reranking using multimodal sparse coding IEEE Trans. Image Process. 23 2014 2019 2032
49. X.-S. Xu, Y. Jiang, X. Xue, Z.-H. Zhou, Semi-supervised multi-instance multi-label learning for video annotation task, in: Proceedings of the 20th ACM International Conference on Multimedia, 2012, pp. 737-740.
50. G.E. Hinton, S. Osindero, and Y.W. Teh A fast learning algorithm for deep belief nets Neural Comput. 18 2006 1527 1554
51. J.-K. Kamarainen, V. Kyrki, and H. Kälviäinen Invariance properties of Gabor filter based features - overview and applications IEEE Trans. Image Process. 15 2006 1088 1099
52. J. Read, G. Phillipson, I. Serrano-Pedraza, A. Milner, and A. Parker Stereoscopic vision in the absence of the lateral occipital cortex PLoS One 5 2010
53. S. Lazebnik, C. Schmid, J. Ponce, Beyond bags of features: spatial pyramid matching for recognizing natural scene categories, in: IEEE Conference on Computer Vision and Pattern Recognition, 2006, pp. 2169-2178.
54. X.-Y. Liu, J. Wu, and Z.-H. Zhou Exploratory undersampling for class-imbalance learning IEEE Trans. Syst. Man Cybern. Part B: Cybern. 39 2009 539 550
55. Y. Freund, and R.E. Schapire A decision-theoretic generalization of on-line learning and an application to boosting J. Comput. Syst. Sci. 55 1997 119 139
56. S.V.N. Vishwanathan, Z. Sun, N. Theera-Ampornpunt, M. Varma, Multiple kernel learning and the SMO algorithm, in: Advances in Neural Information Processing Systems, vol. 23, 2010.
57. J.C. Platt, Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods, in: Advances in Large Margin Classifiers, 1999, pp. 61-74.
58. H. Wang, M.M. Ullah, A. Kläser, I. Laptev, C. Schmid, Evaluation of local spatio-temporal features for action recognition, in: British Machine Vision Conference, 2009.
59. M.A. Gowayyed, M. Torki, M.E. Hussein, M. El-Saban, Histogram of oriented displacements (HOD): describing trajectories of human joints for action recognition, in: International Joint Conference on Artificial Intelligence, 2013, pp. 1351-1357.