A Human Activity Recognition System Using Skeleton Data from RGBD Sensors

Computational Intelligence and Neuroscience

Volumn 2016, Issue , 2016, Pages

  Cippitelli, Enea ^a   Gasparrini, Samuele ^a   Gambi, Ennio ^a   Spinsante, Susanna ^a  

^a UNIVERSITÀ POLITECNICA DELLE MARCHE   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COST EFFECTIVENESS; IMAGE RETRIEVAL; MUSCULOSKELETAL SYSTEM; PATTERN RECOGNITION;

ACTIVITY RECOGNITION; ASSISTED LIVING; FEATURE VECTORS; FUTURE IMPROVEMENTS; HOME ENVIRONMENT; HUMAN ACTIVITY RECOGNITION; HUMAN ACTIVITY RECOGNITION SYSTEMS; MULTI-CLASS SUPPORT VECTOR MACHINES;

CLUSTERING ALGORITHMS;

ACCELEROMETRY; AGED; ALGORITHM; AUTOMATED PATTERN RECOGNITION; FEMALE; HUMAN; HUMAN ACTIVITIES; JOINT; MACHINE LEARNING; MALE; PHYSIOLOGY; PROCEDURES; SKELETON; SUPPORT VECTOR MACHINE;

ACCELEROMETRY; AGED; ALGORITHMS; FEMALE; HUMAN ACTIVITIES; HUMANS; JOINTS; MACHINE LEARNING; MALE; PATTERN RECOGNITION, AUTOMATED; SKELETON; SUPPORT VECTOR MACHINE;

EID: 84962757352     PISSN: 16875265     EISSN: 16875273     Source Type: Journal    
DOI: 10.1155/2016/4351435     Document Type: Article

References (54)

1. P. Rashidi and A. Mihailidis, "A survey on ambient-assisted living tools for older adults, " IEEE Journal of Biomedical and Health Informatics, vol. 17, no. 3, pp. 579-590, 2013.
2. O. C. Ann and L. B. Theng, "Human activity recognition: a review, " in Proceedings of the IEEE International Conference on Control System, Computing and Engineering (ICCSCE '14), pp. 389-393, IEEE, Batu Ferringhi, Malaysia, November 2014.
3. S. Wang and G. Zhou, "A review on radio based activity recognition, " Digital Communications and Networks, vol. 1, no. 1, pp. 20-29, 2015.
4. L. Atallah, B. Lo, R. Ali, R. King, G.-Z. Yang, "Real-time activity classification using ambient andwearable sensors, " IEEE Transactions on Information Technology in Biomedicine, vol. 13, no. 6, pp. 1031-1039, 2009.
5. D. De, P. Bharti, S. K. Das, S. Chellappan, "Multimodal wearable sensing for fine-grained activity recognition in healthcare, " IEEE Internet Computing, vol. 19, no. 5, pp. 26-35, 2015.
6. J. K. Aggarwal and L. Xia, "Human activity recognition from3D data: a review, " Pattern Recognition Letters, vol. 48, pp. 70-80, 2014.
7. S. Gasparrini, E. Cippitelli, E. Gambi, S. Spinsante, F. Flórez-Revuelta, "Performance analysis of self-organising neural networks tracking algorithms for intake monitoring using kinect, " in Proceedings of the 1st IET International Conference on Technologies for Active and Assisted Living (TechAAL '15), Kingston, UK, November 2015.
8. J. Shotton, A. Fitzgibbon, M. Cook et al., "Real-time human pose recognition in parts from single depth images, " in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '11), pp. 1297-1304, IEEE, Providence, Rd, USA, June 2011.
9. J. R. Padilla-López, A. A. Chaaraoui, F. Gu, F. Flórez-Revuelta, "Visual privacy by context: proposal and evaluation of a level-based visualisation scheme, " Sensors, vol. 15, no. 6, pp. 12959-12982, 2015.
10. X. Yang and Y. Tian, "Super normal vector for activity recognition using depth sequences, " in Proceedings of the 27th IEEE Conference on Computer Vision and Pattern Recognition (CVPR '14), pp. 804-811, IEEE, Columbus, Ohio, USA, June 2014.
11. R. Slama, H. Wannous, M. Daoudi, "Grassmannian representation of motion depth for 3D human gesture and action recognition, " in Proceedings of the 22nd International Conference on Pattern Recognition (ICPR '14), pp. 3499-3504, IEEE, Stockholm, Sweden, August 2014.
12. O. Oreifej and Z. Liu, "HON4D: histogram of oriented 4D normals for activity recognition from depth sequences, " in Proceedings of the 26th IEEE Conference on ComputerVision and Pattern Recognition (CVPR '13), pp. 716-723, IEEE, June 2013.
13. H. Rahmani, A. Mahmood, D. Q. Huynh, A. Mian, "HOPC: histogram of oriented principal components of 3D pointclouds for action recognition, " in Computer Vision-ECCV of Lecture Notes in Computer Science 2014, D. Fleet, T. Pajdla, B. Schiele, T. Tuytelaars, Eds., vol. 8690, pp. 742-757, Springer, 2014.
14. G. Chen, D. Clarke, M. Giuliani, A. Gaschler, A. Knoll, "Combining unsupervised learning and discrimination for 3D action recognition, " Signal Processing, vol. 110, pp. 67-81, 2015.
15. A. A. Chaaraoui, J. R. Padilla-López, F. Flórez-Revuelta, "Fusion of skeletal and silhouette-based features for human action recognition with RGB-D devices, " in Proceedings of the 14th IEEE International Conference on Computer Vision Workshops (ICCVW '13), pp. 91-97, IEEE, Sydney, Australia, December 2013.
16. S. Althloothi, M. H. Mahoor, X. Zhang, R. M. Voyles, "Human activity recognition using multi-features and multiple kernel learning, " Pattern Recognition, vol. 47, no. 5, pp. 1800-1812, 2014.
17. Y. Zhu, W. Chen, G. Guo, "Fusing spatiotemporal features and joints for 3D action recognition, " in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW '13), pp. 486-491, IEEE, June 2013.
18. G. Willems, T. Tuytelaars, L. Van Gool, "An efficient dense and scale-invariant spatio-temporal interest point detector, " in Computer Vision-ECCV 2008 of Lecture Notes in Computer Science, D. Forsyth, P. Torr, A. Zisserman, Eds., vol. 5303, pp. 650-663, Springer, Berlin, Germany, 2008.
19. A. Kläser, M. Marszaek, C. Schmid, "A spatio-temporal descriptor based on 3D-gradients, " in Proceedings of the 19th British Machine Vision Conference (BMVC '08), pp. 995-1004, September 2008.
20. J. Luo, W. Wang, H. Qi, "Spatio-temporal feature extraction and representation for RGB-D human action recognition, " Pattern Recognition Letters, vol. 50, pp. 139-148, 2014.
21. Y. Zhu, W. Chen, G. Guo, "Evaluating spatiotemporal interest point features for depth-based action recognition, " Image and Vision Computing, vol. 32, no. 8, pp. 453-464, 2014.
22. A.-A. Liu, W.-Z. Nie, Y.-T. Su, L. Ma, T. Hao, Z.-X. Yang, "Coupled hidden conditional random fields for RGB-D human action recognition, " Signal Processing, vol. 112, pp. 74-82, 2015.
23. M. Devanne, H. Wannous, S. Berretti, P. Pala, M. Daoudi, A. Del Bimbo, "Space-time pose representation for 3D human action recognition, " inNewTrends in ImageAnalysis and Processing-ICIAP of Lecture Notes in Computer Science 2013, vol. 8158, pp. 456-464, Springer, Berlin, Germany, 2013.
24. L. Gan and F. Chen, "Human action recognition using APJ3D and random forests, " Journal of Software, vol. 8, no. 9, pp. 2238-2245, 2013.
25. J. Wang, Z. Liu, Y. Wu, J. Yuan, "Mining actionlet ensemble for action recognition with depth cameras, " in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '12), pp. 1290-1297, Providence, RI, USA, June 2012.
26. L. Xia, C.-C. Chen, J. K. Aggarwal, "View invariant human action recognition using histograms of 3D joints, " in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW '12), pp. 20-27, Providence, RI, June 2012.
27. X. Yang and Y. Tian, "Effective 3D action recognition using Eigen Joints, " Journal of Visual Communication and Image Representation, vol. 25, no. 1, pp. 2-11, 2014.
28. A. Taha, H. H. Zayed, M. E. Khalifa, E.-S. M. El-Horbaty, "Human activity recognition for surveillance applications, " in Proceedings of the 7th International Conference on Information Technology, pp. 577-586, 2015.
29. S. Gaglio, G. Lo Re, M. Morana, "Human activity recognition process using 3-D posture data, " IEEE Transactions on Human-Machine Systems, vol. 45, no. 5, pp. 586-597, 2015.
30. I. Theodorakopoulos, D. Kastaniotis, G. Economou, S. Fotopoulos, "Pose-based human action recognition via sparse representation in dissimilarity space, " Journal of Visual Communication and Image Representation, vol. 25, no. 1, pp. 12-23, 2014.
31. W. Ding, K. Liu, F. Cheng, J. Zhang, "STFC: spatio-temporal feature chain for skeleton-based human action recognition, " Journal of Visual Communication and Image Representation, vol. 26, pp. 329-337, 2015.
32. R. Slama, H. Wannous, M. Daoudi, A. Srivastava, "Accurate 3D action recognition using learning on the Grassmann manifold, " Pattern Recognition, vol. 48, no. 2, pp. 556-567, 2015.
33. R. Vemulapalli, F. Arrate, R. Chellappa, "Human action recognition by representing 3D skeletons as points in a lie group, " in Proceedings of the 27th IEEE Conference on Computer Vision and Pattern Recognition (CVPR '14), pp. 588-595, Columbus, Ohio, USA, June 2014.
34. R. Anirudh, P. Turaga, J. Su, A. Srivastava, "Elastic functional coding of human actions: From vector-fields to latent variables, " in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '15), pp. 3147-3155, Boston, Mass, USA, June 2015.
35. M. Jiang, J. Kong, G. Bebis, H. Huo, "Informative joints based human action recognition using skeleton contexts, " Signal Processing: Image Communication, vol. 33, pp. 29-40, 2015.
36. A. A. Chaaraoui, J. R. Padilla-López, P. Climent-Pérez, F. Flórez-Revuelta, "Evolutionary joint selection to improve human action recognition with RGB-D devices, " Expert Systems with Applications, vol. 41, no. 3, pp. 786-794, 2014.
37. S. Baysal, M. C. Kurt, P. Duygulu, "Recognizing human actions using key poses, " in Proceedings of the 20th International Conference on Pattern Recognition (ICPR '10), pp. 1727-1730, Istanbul, Turkey, August 2010.
38. A. A. Chaaraoui, P. Climent-Pérez, F. Flórez-Revuelta, "Silhouette-based human action recognition using sequences of key poses, " Pattern Recognition Letters, vol. 34, no. 15, pp. 1799-1807, 2013.
39. C. Cortes and V. Vapnik, "Support-vector networks, " Machine Learning, vol. 20, no. 3, pp. 273-297, 1995.
40. C.-W. Hsu and C.-J. Lin, "A comparison of methods for multiclass support vector machines, " IEEE Transactions on Neural Networks, vol. 13, no. 2, pp. 415-425, 2002.
41. C.-C. Chang and C.-J. Lin, "LIBSVM: a library for support vector machines, " ACMTransactions on Intelligent Systems and Technology, vol. 2, no. 3, article 27, 2011.
42. OpenNI, 2015, http://structure. io/openni.
43. J. Sung, C. Ponce, B. Selman, A. Saxena, "Unstructured human activity detection from RGBD images, " in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA '12), pp. 842-849, Saint Paul, Minn, USA, May 2012.
44. L. Seidenari, V. Varano, S. Berretti, A. Del Bimbo, P. Pala, "Recognizing actions from depth cameras as weakly aligned multi-part Bag-of-Poses, " in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW'13), pp. 479-485, Portland, Ore, USA, June 2013.
45. W. Li, Z. Zhang, Z. Liu, "Action recognition based on a bag of 3D points, " in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW '10), pp. 9-14, San Francisco, Calif, USA, June 2010.
46. J. Shan and S. Akella, "3D human action segmentation and recognition using pose kinetic energy, " in Proceedings of the IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO '14), pp. 69-75, Evanston, Ill, USA, September 2014.
47. D. R. Faria, C. Premebida, U. Nunes, "A probabilistic approach for human everyday activities recognition using body motion from RGB-D images, " in Proceedings of the 23rd IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN '14), pp. 732-737, Edinburgh, UK, August 2014.
48. G. I. Parisi, C. Weber, S. Wermter, "Self-organizing neural integration of pose-motion features for human action recognition, " Frontiers in Neurorobotics, vol. 9, no. 3, 2015.
49. J. R. Padilla-López, A. A. Chaaraoui, F. Flórez-Revuelta, "A discussion on the validation tests employed to compare human action recognition methods using the MSR Action3D dataset, " http://arxiv. org/abs/1407. 7390.
50. S. Azary and A. Savakis, "3D Action classification using sparse spatio-temporal feature representations, " in Advances in Visual Computing of LectureNotes in Computer Science, G. Bebis, R. Boyle, B. Parvin et al., Eds., vol. 7432, pp. 166-175, Springer, Berlin, Germany, 2012.
51. O. Ç eliktutan, C. Wolf, B. Sankur, E. Lombardi, "Fast exact hyper-graph matching with dynamic programming for spatiotemporal data, " Journal ofMathematical Imaging andVision, vol. 51, no. 1, pp. 1-21, 2015.
52. S. Azary and A. Savakis, "Grassmannian sparse representations and motion depth surfaces for 3D action recognition, " in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW '13), pp. 492-499, Portland, Ore, USA, June 2013.
53. J. C. Platt, "Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods, " in Advances in Large Margin Classifiers, pp. 61-74, MIT Press, Cambridge, Mass, USA, 1999.
54. H.-T. Lin, C.-J. Lin, R. C. Weng, "A note on Platt's probabilistic outputs for support vector machines, " Machine Learning, vol. 68, no. 3, pp. 267-276, 2007.