Human activity recognition using multi-features and multiple kernel learning

Pattern Recognition

Volumn 47, Issue 5, 2014, Pages 1800-1812

  Althloothi, Salah ^a   Mahoor, Mohammad H ^a   Zhang, Xiao ^a   Voyles, Richard M ^b  

^a University of Denver   (United States)

^b PURDUE UNIVERSITY   (United States)

Author keywords

Distal limb segments; Human activity recognition; Multiple kernel learning; Spherical harmonics coefficients; Support vector machines

Indexed keywords

DEPTH INFORMATION; DISTAL LIMB SEGMENTS; FREQUENCY DOMAINS; HUMAN ACTIVITY RECOGNITION; KINEMATIC STRUCTURES; MULTIPLE KERNEL LEARNING; SHAPE REPRESENTATION; SPHERICAL HARMONICS;

HARMONIC ANALYSIS; SUPPORT VECTOR MACHINES;

PATTERN RECOGNITION;

EID: 84893703288     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2013.11.032     Document Type: Article

References (47)

1. J. Wang, Z. Liu, Y. Wu, J. Yuan, Mining actionlet ensemble for action recognition with depth cameras, in: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2012, pp. 1290-1297.
2. W. Li, Z. Zhang, Z. Liu, Action recognition based on a bag of 3d points, in: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), IEEE, 2010, pp. 9-14.
3. L. Xia, C.-C. Chen, J. Aggarwal, View invariant human action recognition using histograms of 3d joints, in: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), June 2012, pp. 20-27.
4. X. Yang, C. Zhang, Y. Tian, Recognizing actions using depth motion maps-based histograms of oriented gradients, in: Proceedings of the 20th ACM international conference on Multimedia, MM '12, New York, NY, USA, ACM, 2012, pp. 1057-1060.
5. X. Yang, Y. Tian, Eigenjoints-based action recognition using Naive-Bayes-nearest-neighbor, in: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), June 2012, pp. 14-19.
6. M. Corporation, Kinect for windows. http://www.microsoft.com/en-us/ kinectforwindows/ , cited April 2013.
7. J. Liu, S. Ali, M. Shah, Recognizing human actions using multiple features, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, 2008, pp. 1-8.
8. L. Wang, H. Zhou, S.-C. Low, C. Leckie, Action recognition via multi-feature fusion and gaussian process classification, in: 2009 Workshop on Applications of Computer Vision (WACV), IEEE, 2009, pp. 1-6.
9. J. Liu, J. Yang, Y. Zhang, X. He, Action recognition by multiple features and hyper-sphere multi-class SVM, in:20th International Conference on Pattern Recognition (ICPR) 2010, IEEE, 2010, pp. 3744-3747.
10. R. Benmokhtar Robust human action recognition scheme based on high-level feature fusion Multimed. Tools Appl. 2012 1 23
11. K. Tran, I.A. Kakadiaris, S.K. Shah, Fusion of human posture features for continuous action recognition, in: Proceedings of the European Conference on Computer Vision Workshop on Sign, Gesture, and Activity, Crete, Greece, 2010.
12. M. Gönen, and E. AlpaydIn Multiple kernel learning algorithms J. Mach. Learn. Res. 12 2011 2211 2268
13. A. Noguchi, K. Yanai, A surf-based spatio-temporal feature for feature-fusion-based action recognition, in: Proceedings of ECCV Workshop on Human Motion: Understanding Modeling Capture and Animation, 2010.
14. N. Ikizler-Cinbis, and S. Sclaroff Object, scene and actions combining multiple features for human action recognition Comput. Vis.-ECCV 2010 2010 494 507
15. M. Bregonzio, T. Xiang, and S. Gong Fusing appearance and distribution information of interest points for action recognition Pattern Recognit. 45 3 2012 1220 1234
16. A. Rakotomamonjy, F. Bach, S. Canu, and Y. Grandvalet Simplemkl J. Mach. Learn. Res. 9 2008 2491 2521
17. M. Blank, L. Gorelick, E. Shechtman, M. Irani, R. Basri, Actions as space-time shapes, in:Tenth IEEE International Conference on Computer Vision, 2005. ICCV 2005., vol. 2, IEEE, 2005, pp. 1395-1402.
18. I. Cohen, H. Li, Inference of human postures by classification of 3d human body shape, in: IEEE International Workshop on Analysis and Modeling of Faces and Gestures, 2003, AMFG 2003, IEEE, 2003, pp. 74-81.
19. A. Yilmaz, and M. Shah A differential geometric approach to representing the human actions Comput. Vis. Image Underst. 109 3 2008 335 351
20. H.-S. Chen, H.-T. Chen, Y.-W. Chen, S.-Y. Lee, Human action recognition using star skeleton, in: Proceedings of the 4th ACM International Workshop on Video Surveillance and Sensor Networks, VSSN '06, New York, NY, USA, ACM, 2006, pp. 171-178.
21. H. Fujiyoshi, A.J. Lipton, Real-time human motion analysis by image skeletonization, in: In Proceedings of IEEE WACV98, 1998, pp. 15-21.
22. S. Chun, K. Hong, K. Jung, 3d star skeleton for fast human posture representation, in: World Academy of Science and Engineering, vol. 34, 2008, pp. 273-282.
23. S.R. Althloothi, M.H. Mahoor, and R.M. Voyles Fitting distal limb segments for accurate skeletonization in human action recognition J. Ambient Intell. Smart Environ. 4 2 2012 107 121
24. S. Althloothi, R. Voyles, M. Mahoor, G. Wu, 2d human skeleton model from monocular video for human activity recognition, in: The 2010 International Conference on Image Processing, Computer Vision and Pattern Recognition, 2010.
25. J. Sun, X. Wu, S. Yan, L.-F. Cheong, T.-S. Chua, J. Li, Hierarchical spatio-temporal context modeling for action recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, June 2009, pp. 2004-2011.
26. Y. Tian, L. Cao, Z. Liu, and Z. Zhang Hierarchical filtered motion for action recognition in crowded videos IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 42 3 2012 313 323
27. J. Sung, C. Ponce, B. Selman, A. Saxena, Unstructured human activity detection from RGBD images, in: 2012 IEEE International Conference on Robotics and Automation (ICRA), May 2012, pp. 842-849.
28. H. Zhang, L. Parker, 4-dimensional local spatio-temporal features for human activity recognition, in: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), September 2011, pp. 2044-2049.
29. Y. Zhao, Z. Liu, L. Yang, H. Cheng, Combing RGB and depth map features for human activity recognition, in: 2012 Asia-Pacific Signal Information Processing Association Annual Summit and Conference (APSIPA ASC), December 2012, pp. 1-4.
30. C.-C. Chang, and C.-J. Lin Libsvm a library for support vector machines ACM Trans. Intell. Syst. Technol. 2 3 2011 27
31. O. Oreifej, Z. Liu, W. Redmond, Hon4d: Histogram of oriented 4d normals for activity recognition from depth sequences, in: Computer Vision and Pattern Recognition (CVPR), 2013.
32. M.B. Holte, T.B. Moeslund, and P. Fihl View-invariant gesture recognition using 3d optical flow and harmonic motion context Comput. Vis. Image Underst. 114 12 2010 1353 1361
33. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, A. Blake, Real-time human pose recognition in parts from single depth images, in: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2011, pp. 1297-1304.
34. L. Shen, H. Farid, and M.A. McPeek Modeling three-dimensional morphological structures using spherical harmonics Evolution 63 4 2009 1003 1016
35. D.V. Vranic, An improvement of rotation invariant 3d-shape based on functions on concentric spheres, in: Proceedings of 2003 International Conference on Image Processing, ICIP 2003, vol. 3, IEEE, 2003, pp. III-757.
36. D. Saupe, D.V. Vranić, 3d model retrieval with spherical harmonics and moments, in: Pattern Recognition, Springer, 2001, pp. 392-397.
37. S. Althloothi, M. Mahoor, and R. Voyles A robust method for rotation estimation using spherical harmonics representation IEEE Trans. Image Process. 22 6 2013 2306 2316
38. L. Shen, S. Kim, and A.J. Saykin Fourier method for large-scale surface modeling and registration Comput. Graph. 33 3 2009 299 311
39. C. Brechbühler, G. Gerig, and O. Kübler Parametrization of closed surfaces for 3-d shape description Comput. Vis. Image Underst. 61 2 1995 154 170
40. L. Shen, and F. Makedon Spherical mapping for processing of 3d closed surfaces Image Vis. Comput. 24 7 2006 743 761
41. O. Chapelle, A. Rakotomamonjy, Second order optimization of kernel parameters, in: Proceedings of the NIPS Workshop on Kernel Learning: Automatic Selection of Optimal Kernels, 2008.
42. D.G. Luenberger, and Y. Ye Linear and Nonlinear Programming 2008 Springer vol. 116
43. J. Nocedal, and S.J. Wright Numerical Optimization 1999 Springer Verlag
44. C.-W. Hsu, and C.-J. Lin A comparison of methods for multiclass support vector machines IEEE Trans. Neural Netw. 13 2 2002 415 425
45. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local SVM approach, in: Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004, vol. 3, IEEE, 2004, pp. 32-36.
46. L. Liu, L. Shao, Learning discriminative representations from RGB-D video data, in: Proceedings of International Joint Conference on Artificial Intelligence (IJCAI), 2013.
47. Xiao Zhang, Mahoor, M.H., Voyles, R.M. Automatic Face and Gesture Recognition (FG), 2013 10th IEEE International Conference and Workshops on Facial expression recognition using HessianMKL based multiclass-SVM, 2013, pp. 1-6