Weighted joint-based human behavior recognition algorithm using only depth information for low-cost intelligent video-surveillance system

Expert Systems with Applications

Volumn 45, Issue , 2016, Pages 131-141

  Kim, Hanguen ^a   Lee, Sangwon ^a   Kim, Youngjae ^a   Lee, Serin ^b   Lee, Dongsung ^c   Ju, Jinsun ^c   Myung, Hyun ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^c Samsung Advanced Institute of Technology (SAIT)   (South Korea)

Author keywords

Behavior recognition; Human joint estimation; Human computer interaction (HCI); Video surveillance system

Indexed keywords

ALGORITHMS; COST BENEFIT ANALYSIS; COSTS; GEODESY; HUMAN COMPUTER INTERACTION; INFORMATION USE; MONITORING; SCALES (WEIGHING INSTRUMENTS); SECURITY SYSTEMS; SUPPORT VECTOR MACHINES; TEMPLATE MATCHING;

BEHAVIOR RECOGNITION; ENVIRONMENTAL CHANGE; HUMAN BEHAVIOR RECOGNITION; HUMAN COMPUTER INTERACTION (HCI); HUMAN JOINTS; INTELLIGENT VIDEO SURVEILLANCE SYSTEMS; REGISTRATION PROCESS; VIDEO SURVEILLANCE SYSTEMS;

BEHAVIORAL RESEARCH;

EID: 84944707108     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2015.09.035     Document Type: Article

References (57)

1. Aggarwal J., and Xia L. Human activity recognition from 3D data: A review Pattern Recognition Letters 48 2014 70 80
2. Aizerman A., Braverman E.M., and Rozoner L. Theoretical foundations of the potential function method in pattern recognition learning Automation and Remote Control 25 1964 821 837
3. Alpaydin E. Introduction to machine learning 2004 MIT Press
4. Amari S.-I., and Wu S. Improving support vector machine classifiers by modifying kernel functions Neural Networks 12 6 1999 783 789
5. Biswas K., and Basu S.K. Gesture recognition using Microsoft Kinect® Proceedings of international conference on automation, robotics and applications (ICARA) 2011 100 103
6. Boykov Y., and Funka-Lea G. Graph cuts and efficient ND image segmentation International Journal of Computer Vision 70 2 2006 109 131
7. Boykov Y., and Veksler O. Graph cuts in vision and graphics: Theories and applications 2006 Springer
8. Boykov Y.Y., and Jolly M.-P. Interactive graph cuts for optimal boundary & region segmentation of objects in ND images Proceedings of IEEE international conference on computer vision (ICCV) 2001 105 112
9. Breiman L. Random forests Machine Learning 45 1 2001 5 32
10. Burges C.J. A tutorial on support vector machines for pattern recognition Data Mining and Knowledge Discovery 2 2 1998 121 167
11. Buys K., Cagniart C., Baksheev A., De Laet T., De Schutter J., and Pantofaru C. An adaptable system for RGB-D based human body detection and pose estimation Journal of Visual Communication and Image Representation 25 1 2014 39 52
12. Castro J., Delgado M., Medina J., and Ruiz-Lozano M. Intelligent surveillance system with integration of heterogeneous information for intrusion detection Expert Systems with Applications 38 9 2011 11182 11192
13. Celebi S., Aydin A.S., Temiz T.T., and Arici T. Gesture recognition using skeleton data with weighted dynamic time warping Proceedings of international conference on computer vision theory and applications (VISAPP) 2013 620 625
14. Cortes C., and Vapnik V. Support-vector networks Machine Learning 20 3 1995 273 297
15. Dubey R., Ni B., and Moulin P. A depth camera based fall recognition system for the elderly Proceedings of international conference on image analysis and recognition 2012 106 113
16. Escalera S. Human behavior analysis from depth maps International conference on articulated motion and deformable objects 2012 282 292
17. Fan C., Tian L., Wang G., Ming Y., Shi J., and Jin Y. 3D human behavior recognition based on spatiotemporal texture features Proceedings of international conference on human system interactions (HSI) 2015 350 356
18. Freedman, B., Shpunt, A., Machline, M., & Arieli, Y. (2008). Depth mapping using projected patterns. WO Patent 2,008,120,217.
19. Han J., Shao L., Xu D., and Shotton J. Enhanced computer vision with microsoft kinect sensor: a review IEEE Transactions on Cybernetics 43 5 2013 1318 1334
20. Hernández-Vela A., Zlateva N., Marinov A., Reyes M., Radeva P., Dimov D., and et al. Graph cuts optimization for multi-limb human segmentation in depth maps Proceedings of IEEE conference on computer vision and pattern recognition (CVPR) 2012 726 732
21. Hsu C.-W., and Lin C.-J. A comparison of methods for multiclass support vector machines IEEE Transactions on Neural Networks 13 2 2002 415 425
22. Jain A., Tompson J., LeCun Y., and Bregler C. Modeep: a deep learning framework using motion features for human pose estimation Proceedings of the 12th asian conference on computer vision 2014 302 315
23. Jain H.P., Subramanian A., Das S., and Mittal A. Real-time upper-body human pose estimation using a depth camera Proceedings of the international conference on computer vision/computer graphics collaboration techniques 2011 227 238
24. Lai K., Konrad J., and Ishwar P. A gesture-driven computer interface using Kinect Proceedings of the IEEE southwest symposium on image analysis and interpretation (SSIAI) 2012 185 188
25. Liu L., and Shao L. Learning discriminative representations from RGB-D video data Proceedings of the twenty-third international joint conference on artificial intelligence 2013 1493 1500
26. Megavannan V., Agarwal B., and Babu R.V. Human action recognition using depth maps Proceedings of the international conference on signal processing and communications (SPCOM) 2012 1 5
27. Microsoft. Kinect for windows. https://dev.windows.com/en-us/kinect/ Accessed 09.10.15.
28. Mitra S., and Acharya T. Gesture recognition: a survey IEEE Transactions on Systems, Man, and Cybernetics Part C: Applications & Reviews 37 3 2007 311 324
29. Moeslund T.B., Hilton A., and Krüger V. A survey of advances in vision-based human motion capture and analysis Computer Vision and Image Understanding 104 2 2006 90 126
30. OpenNI. Openni nite. http://www.openni.ru/files/nite/ Accessed 09.10.15.
31. Plagemann C., Ganapathi V., Koller D., and Thrun S. Real-time identification and localization of body parts from depth images IEEE international conference on robotics and automation (ICRA) 2010 3108 3113
32. Poppe R. Vision-based human motion analysis: an overview Computer Vision and Image Understanding 108 1 2007 4 18
33. Poppe R. A survey on vision-based human action recognition Image and Vision Computing 28 6 2010 976 990
34. Reale M.J., Canavan S., Yin L., Hu K., and Hung T. A multi-gesture interaction system using a 3-D iris disk model for gaze estimation and an active appearance model for 3-D hand pointing IEEE Transactions on Multimedia 13 3 2011 474 486
35. Ren Z., Yuan J., Meng J., and Zhang Z. Robust part-based hand gesture recognition using Kinect sensor IEEE Transactions on Multimedia 15 5 2013 1110 1120
36. del Rincón J.M., Makris D., Uruñuela C.O., and Nebel J.-C. Tracking human position and lower body parts using Kalman and particle filters constrained by human biomechanics IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 41 1 2011 26 37
37. Rogez G., Rihan J., Orrite-Uruñuela C., and Torr P.H. Fast human pose detection using randomized hierarchical cascades of rejectors International Journal of Computer Vision 99 1 2012 25 52
38. Schwarz L.A., Mkhitaryan A., Mateus D., and Navab N. Human skeleton tracking from depth data using geodesic distances and optical flow Image and Vision Computing 30 3 2012 217 226
39. Sheasby G., Warrell J., Zhang Y., Crook N., and Torr P.H. Simultaneous human segmentation, depth and pose estimation via dual decomposition Proceedings of British machine vision conference, student workshop (BMVW) 2012 1 12
40. Shotton J., Fitzgibbon A., Cook M., Sharp T., Finocchio M., Moore R., and et al. Real-time human pose recognition in parts from single depth images Proceedings of IEEE conference on computer vision and pattern recognition (CVPR) 2011 1 8
41. Shotton J., Sharp T., Kipman A., Fitzgibbon A., Finocchio M., Blake A., and et al. Real-time human pose recognition in parts from single depth images Communications of the ACM Magazine 56 1 2013 116 124
42. Sigalas M., Baltzakis H., and Trahanias P. Gesture recognition based on arm tracking for human-robot interaction Proceedings of IEEE/rsj international conference on intelligent robots and systems (IROS) 2010 5424 5429
43. iPi Soft LLC (2011). Motion capture for the masses.
44. Song S., Chandra A., and Torresen J. An ant learning algorithm for gesture recognition with one-instance training Proceedings of IEEE congress on evolutionary computation (CEC) 2013 2956 2963
45. Song Y., Demirdjian D., and Davis R. Continuous body and hand gesture recognition for natural human-computer interaction ACM Transactions on Interactive Intelligent Systems (TiiS) 2 1 2012 1 28
46. Straka M., Hauswiesner S., Rüther M., and Bischof H. Skeletal graph based human pose estimation in real-time Proceedings of British machine vision conference (BMVC) 2011 1 12
47. Toshev A., and Szegedy C. DeepPose: human pose estimation via deep neural networks Proceedings of IEEE conference on computer vision and pattern recognition (CVPR) 2014 1653 1660
48. Tran C., and Trivedi M.M. 3-D posture and gesture recognition for interactivity in smart spaces IEEE Transactions on Industrial Informatics 8 1 2012 178 187
49. Visutsak P., and Prachumrak K. Geodesic-based skeleton smoothing International Journal of Mathematical Models and Methods in Applied Sciences 5 4 2011 713 721
50. Wang J., Liu Z., Wu Y., and Yuan J. Mining actionlet ensemble for action recognition with depth cameras Proceedings of IEEE conference on computer vision and pattern recognition (CVPR) 2012 1290 1297
51. Wu D., and Shao L. Leveraging hierarchical parametric networks for skeletal joints based action segmentation and recognition Proceedings of IEEE conference on computer vision and pattern recognition (CVPR) 2014 724 731
52. Wu J., Konrad J., and Ishwar P. Dynamic time warping for gesture-based user identification and authentication with Kinect Proceedings of IEEE international conference on acoustics, speech and signal processing (ICASSP) 2013 2371 2375
53. Xu W., and Lee E.J. Gesture recognition based on 2D and 3D feature by using Kinect device Proceedings of international conference on information security and assurance (ISA) 2012 77 79
54. Yang C., Jang Y., Beh J., Han D., and Ko H. Gesture recognition using depth-based hand tracking for contactless controller application Proceedings of IEEE international conference on consumer electronics (ICCE) 2012 297 298
55. Yang Z., Zicheng L., and Hong C. RGB-depth feature for 3D human activity recognition China Communications 10 7 2013 93 103
56. Zhang Z. Microsoft Kinect sensor and its effect IEEE Multimedia 19 2 2012 4 10
57. Zhang Z., Soon Seah H., Kwang Quah C., and Sun J. GPU-accelerated real-time tracking of full-body motion with multi-layer search IEEE Transactions on Multimedia 15 1 2013 106 119