Anatomical-plane-based representation for human-human interactions analysis

Pattern Recognition

Volumn 48, Issue 8, 2015, Pages 2346-2363

  Alazrai, Rami ^a   Mowafi, Yaser ^a   George Lee, C S ^b  

^a GERMAN JORDANIAN UNIVERSITY   (Jordan)

^b PURDUE UNIVERSITY   (United States)

Author keywords

Bag of words; Human human interaction classification; Human human interaction prediction; Motion pose geometric descriptor

Indexed keywords

FORECASTING; GRAPHIC METHODS; SEMANTICS; SUPPORT VECTOR MACHINES;

APPEARANCE BASED REPRESENTATIONS; BAG OF WORDS; CLASSIFICATION FRAMEWORK; GEOMETRIC DESCRIPTOR; HIERARCHICAL CLASSIFICATION; HUMAN-HUMAN INTERACTIONS; MICROSOFT KINECT SENSORS; SUPPORT VECTOR MACHINE CLASSIFIERS;

CLASSIFICATION (OF INFORMATION);

EID: 84928271319     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2015.03.002     Document Type: Article

References (59)

1. I. Laptev, T. Lindeberg, Space-time interest points, in: Proceedings of IEEE International Conference on Computer Vision (ICCV), 2003, pp. 432-439.
2. P. Dollar, V. Rabaud, G. Cottrell, S. Belongie, Behavior recognition via sparse spatio-temporal features, in: Proceedings of IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, 2005, pp. 65-72.
3. M. Blank, L. Gorelick, E. Shechtman, M. Irani, R. Basri, Actions as space-time shapes, in: Proceedings of IEEE International Conference on Computer Vision (ICCV), 2005, pp. 1395-1402.
4. J. Niebles, H. Wang, and L. Fei-Fei Unsupervised learning of human action categories using spatial-temporal words Int. J. Comput. Vis. 79 2008 299 318
5. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008, pp. 1-8.
6. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local SVM approach, in: Proceedings of IEEE International Conference on Pattern Recognition (ICPR), 2004, pp. 32-36.
7. J. Aggarwal, and M. Ryoo Human activity analysis a review ACM Comput. Surv. 43 2011 16:1 16:43
8. P. Turaga, R. Chellappa, V. Subrahmanian, and O. Udrea Machine recognition of human activities a survey IEEE Trans. Circuits Syst. Video Technol. 18 11 2008 1473 1488
9. R.S. Snell Clinical Anatomy by Regions 9th ed. 2011 Lippincott Williams & Wilkins, Walters Kluwer United States
10. M. Ryoo, Human activity prediction: early recognition of ongoing activities from streaming videos, in: Proceedings of IEEE International Conference on Computer Vision (ICCV), 2011, pp. 1036-1043.
11. T.-F. Wu, C.-J. Lin, and R.C. Weng Probability estimates for multi-class classification by pairwise coupling J. Mach. Learn. Res. 5 2004 975 1005
12. E. Shechtman, M. Irani, Space-time behavior based correlation, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2005, pp. 405-412, ISSN 1063-6919.
13. H.-S. Chen, H.-T. Chen, Y.-W. Chen, S.-Y. Lee, Human action recognition using star skeleton, in: Proceedings of the Fourth ACM International Workshop on Video Surveillance and Sensor Networks (VSSN), 2006, pp. 171-178.
14. R. Vezzani, M. Piccardi, R. Cucchiara, An efficient Bayesian framework for on-line action recognition, in: Proceedings of IEEE International Conference on Image Processing (ICIP), 2009, pp. 3553-3556.
15. A. Yao, J. Gall, L. Van Gool, A Hough transform-based voting framework for action recognition, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, pp. 2061-2068.
16. S. Ali, and M. Shah Human action recognition in videos using kinematic features and multiple instance learning IEEE Trans. Pattern Anal. Mach. Intell. 32 2 2010 288 303
17. Z. Jiang, Z. Lin, and L. Davis Recognizing human actions by learning and matching shape-motion prototype trees IEEE Trans. Pattern Anal. Mach. Intell. 34 3 2012 533 547
18. L. Shao, L. Ji, Y. Liu, and J. Zhang Human action segmentation and recognition via motion and shape analysis Pattern Recognit. Lett. 33 4 2012 438 445
19. N. Ikizler, and P. Duygulu Histogram of oriented rectangles a new pose descriptor for human action recognition Image Vis. Comput. 27 10 2009 1515 1526
20. M. Bregonzio, T. Xiang, and S. Gong Fusing appearance and distribution information of interest points for action recognition Pattern Recognit. 45 3 2012 1220 1234
21. T. Zhang, S. Liu, C. Xu, and H. Lu Boosted multi-class semi-supervised learning for human action recognition Pattern Recognit. 44 2011 2334 2342
22. K. Tran, I. Kakadiaris, and S. Shah Part-based motion descriptor image for human action recognition Pattern Recognit. 45 7 2012 2562 2572
23. S. Pehlivan, and P. Duygulu A new pose-based representation for recognizing actions from multiple cameras Comput. Vis. Image Underst. 115 2 2011 140 151
24. L. Liu, L. Shao, and P. Rockett Boosted key-frame selection and correlated pyramidal motion-feature representation for human action recognition Pattern Recognit. 46 7 2013 1810 1818
25. L. Shao, S. Jones, and X. Li Efficient search and localization of human actions in video databases IEEE Trans. Circuits Syst. Video Technol. 24 3 2014 504 512
26. K.K. Roudposhti, and J. Dias Probabilistic human interaction understanding exploring relationship between human body motion and the environmental context Pattern Recognit. Lett. 34 7 2013 820 830
27. L. Liu, L. Shao, F. Zheng, and X. Li Realistic action recognition via sparsely-constructed Gaussian processes Pattern Recognit. 47 12 2014 3819 3827
28. A. Chan-Hon-Tong, C. Achard, and L. Lucat Simultaneous segmentation and classification of human actions in video streams using deeply optimized Hough transform Pattern Recognit. 47 12 2014 3807 3818
29. G. Goudelis, K. Karpouzis, and S. Kollias Exploring trace transform for robust human action recognition Pattern Recognit. 46 12 2013 3238 3248
30. L. Shao, X. Zhen, D. Tao, and X. Li Spatio-temporal Laplacian pyramid coding for action recognition IEEE Trans. Cybern. 44 6 2014 817 827
31. M. Lopes, F. Melo, L. Montesano, Affordance-based imitation learning in robots, in: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2007, pp. 1015-1021.
32. T. Theodoridis, A. Agapitos, H. Hu, S. Lucas, Ubiquitous robotics in physical human action recognition: a comparison between dynamic ANNs and GP, in: Proceedings of IEEE International Conference on Robotics and Automation (ICRA), 2008, pp. 3064-3069.
33. W. Takano, Y. Nakamura, Bigram-based natural language model and statistical motion symbol model for scalable language of humanoid robots, in: Proceedings of IEEE International Conference on Robotics and Automation (ICRA), 2012, pp. 1232-1237.
34. N. Oliver, B. Rosario, and A. Pentland A Bayesian computer vision system for modeling human interactions IEEE Trans. Pattern Anal. Mach. Intell. 22 8 2000 831 843
35. A. Patron, M. Marszalek, A. Zisserman, I. Reid, High Five: Recognising human interactions in TV shows, in: Proceedings of the British Machine Vision Conference (BMVC), BMVA Press, United Kingdom, 2010.
36. M.S. Ryoo, and J.K. Aggarwal Semantic representation and recognition of continued and recursive human activities Int. J. Comput. Vis. 82 2009 1 24
37. M. Ryoo, J. Aggarwal, Spatio-temporal relationship match: video structure comparison for recognition of complex human activities, in: Proceedings of IEEE International Conference on Computer Vision (ICCV), 2009, pp. 1593-1600.
38. M.S. Ryoo, J.K. Aggarwal, UT-Interaction Dataset, ICPR Contest on Semantic Description of Human Activities (SDHA), 2010, < http://cvrc.ece.utexas.edu/SDHA2010/Human-Interaction.html>
39. T.-H. Yu, T.-K. Kim, R. Cipolla, Real-time action recognition by spatiotemporal semantic and structural forest, in: Proceedings of the British Machine Vision Conference (BMVC), BMVA Press, United Kingdom, 2010, pp. 52.1-52.12.
40. D. Waltisberg, A. Yao, J. Gall, L. Van Gool, Variations of a Hough-voting action recognition system, in: Proceedings of the International Conference on Recognizing Patterns in Signals, Speech, Images, and Videos (ICPR), Springer-Verlag, Germany, 2010, pp. 306-312.
41. F. Yuan, G.-S. Xia, H. Sahbi, and V. Prinet Mid-level features and spatio-temporal context for activity recognition Pattern Recognit. 45 12 2012 4182 4191
42. U. Gaur, Y. Zhu, B. Song, A. Roy-Chowdhury, A "string of feature graphs" model for recognition of complex activities in natural videos, in: Proceedings of IEEE International Conference on Computer Vision (ICCV), 2011, pp. 2595-2602.
43. A. Vahdat, B. Gao, M. Ranjbar, G. Mori, A discriminative key pose sequence model for recognizing human interactions, in: Proceedings of IEEE International Conference on Computer Vision Workshops (ICCV Workshops), 2011, pp. 1729-1736.
44. X. Zhang, J. Cui, L. Tian, H. Zha, Local spatio-temporal feature based voting framework for complex human activity detection and localization, in: Proceedings of IEEE Asian Conference on Pattern Recognition (ACPR), 2011, pp. 12-16.
45. M. Hoai, F. De la Torre, Max-margin early event detectors, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, pp. 2863-2870.
46. I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun Large margin methods for structured and interdependent output variables J. Mach. Learn. Res. 6 2005 1453 1484
47. L. Xia, C.-C. Chen, J.K. Aggarwal, View invariant human action recognition using histograms of 3D joints, in: The Second International Workshop on Human Activity Understanding from 3D Data at Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
48. W. Li, Z. Zhang, Z. Liu, Action recognition based on a bag of 3D points, in: IEEE International Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2010, pp. 9-14.
49. J. Wang, Z. Liu, Y. Wu, J. Yuan, Mining actionlet ensemble for action recognition with depth cameras, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, pp. 1290-1297.
50. J. Sung, C. Ponce, B. Selman, A. Saxena, Unstructured human activity detection from RGBD Images, in: Proceedings of IEEE International Conference on Robotics and Automation (ICRA), 2012, pp. 842-849.
51. K. Yun, J. Honorio, D. Chattopadhyay, T.L. Berg, D. Samaras, Two-person interaction detection using body-pose features and multiple instance learning, in: The Second International Workshop on Human Activity Understanding from 3D Data at Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
52. M. Müller, T. Röder, and M. Clausen Efficient content-based retrieval of motion capture data ACM Trans. Graph. 24 3 2005 677 685
53. J. Perš, V. Sulić, M. Kristan, M. Perše, K. Polanec, and S. Kovačič Histograms of optical flow for efficient representation of body motion Pattern Recognit. Lett. 31 11 2010 1369 1376
54. A. Yao, J. Gall, G. Fanelli, L.V. Gool, Does Human Action Recognition Benefit from Pose Estimation?, in: Proceedings of the British Machine Vision Conference (BMVC), 2011, pp. 67.1-67.11.
55. The Biological Basis of Bone & Anatomical Directional Terms, 2011, URL < http://thesebonesofmine.wordpress.com/2011>
56. A. Bosch, A. Zisserman, X. Munoz, Representing shape with a spatial pyramid kernel, in: Proceedings of the Sixth ACM International Conference on Image and Video Retrieval, 2007, pp. 401-408.
57. B.K.P. Horn, and B.G. Schunck Determining optical flow Artif. Intell. 17 1981 185 203
58. C.-C. Chang, and C.-J. Lin LIBSVM a library for support vector machines ACM Trans. Intell. Syst. Technol. 2 3 2011 1 27
59. H. Sakoe, and S. Chiba Dynamic programming algorithm optimization for spoken word recognition IEEE Trans. Acoust. Speech Signal Process. 1 1978 43 49