Advances in view-invariant human motion analysis: A review

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 40, Issue 1, 2010, Pages 13-24

  Ji, Xiaofei ^a,b,c   Liu, Honghai ^a  

^a UNIVERSITY OF PORTSMOUTH   (United Kingdom)

^b NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

^c SHENYANG AEROSPACE UNIVERSITY   (China)

Author keywords

Behavior understanding; Human motion analysis; Pose representation and estimation; View invariant

Indexed keywords

BEHAVIOR UNDERSTANDING; DATA SETS; FUTURE DIRECTIONS; HUMAN BEHAVIORS; HUMAN DETECTION; HUMAN MOTION ANALYSIS; HUMAN MOTIONS; INTEGRATED PROCESS; INVARIANT REPRESENTATION; RESEARCH CHALLENGES; VISUAL ANALYSIS;

BEHAVIORAL RESEARCH;

ESTIMATION;

EID: 73049089691     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2009.2027608     Document Type: Review

References (102)

1. R. Gross and J. Shi, "The CMU motion of mody (MoBo) database," Robot. Inst. Carnegie Mellon Univ., Pittsburgh, PA, Tech. Rep. CMU-RI-TR-01-18, Jun. 2001.
2. A. Bobick and J. Davis, "The recognition of human movement using temporal templates," IEEE Trans. Pattern Anal. Mach. Intell., vol.23, no.3, pp. 257-267, Mar. 2001.
3. J. Rittscher, A. Blake, and S. Roberts, "Towards the automatic analysis of complex human body motions," Image Vis. Comput., vol.20, no.12, pp. 905-916, 2002.
4. H. Yu, G. Sun, W. Song, and X. Li, "Human motion recognition based on neural network," in Proc. IEEE Conf. Commun., Circuits Syst., 2005, vol.2, pp. 977-982.
5. H. Chen, H. Chen, Y. Chen, and S. Lee, "Human action recognition using star skeleton," in Proc. 4th ACMInt.Workshop Video Surveill. Sens. Netw., 2006, pp. 171-178.
6. H. Li, S. Lin, Y. Zhang, and K. Tao, "Automatic video-based analysis of athlete action," in Proc. IEEE Conf. Image Anal. Process., 2007, pp. 205-210.
7. O. Masoud and N. Papanikolopoulos, "A method for human action recognition," Image Vis. Comput., vol.21, no.8, pp. 729-743, 2003.
8. S. Yu, D. Tan, and T. Tan, "Modelling the effect of view angle variation on appearance-based gait recognition," in Proc. Asian Conf. Comput. Vis., 2006, vol.1, pp. 807-816.
9. A. Ogale, A. Karapurkar, and Y. Aloimonos, "View-invariant modeling and recognition of human actions using grammars," in Proc. IEEE Conf. Comput. Vis., 2005, vol.5, pp. 115-126.
10. E. Ong, A. Micilotta, R. Bowden, and A. Hilton, "Viewpoint invariant exemplar-based 3D human tracking," Comput. Vis. Image Understanding, vol. 104, no. 2/3, pp. 178-189, 2006.
11. G. Rogez, J. Guerrero, J.Martinez, and C. Orrite, "Viewpoint independent human motion analysis in man-made environments," in Proc. Brit. Mach. Vis. Conf., 2006, pp. 659-668.
12. L. Sigal, S. Bhatia, S. Roth, M. Black, and M. Isard, "Tracking looselimbed people," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2004, vol.1, pp. 421-428.
13. F. Caillette, A. Galata, and T. Howard, "Real-time 3-D human body tracking using variable lengthMarkov models," in Proc. Brit. Mach. Vis. Conf., 2005, pp. 469-478.
14. C. Menier, E. Boyer, and B. Raffin, "3D skeleton-based body pose recovery," in Proc. Int. Symp. 3-D Data Process., Vis. Transmiss., 2006, pp. 389-396.
15. A. Fossati, M. Dimitrijevic, V. Lepetit, and P. Fua, "Bridging the gap between detection and tracking for 3D monocular video-based motion capture," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
16. D. Weinland, R. Ronfard, and E. Boyer, "Free viewpoint action recognition using motion history volumes," Comput. Vis. Image Understanding, vol.104, pp. 249-257, 2006.
17. A. Yilmaz and M. Shah, "Actions sketch: A novel action representation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2005, vol.1, pp. 984-989.
18. F. Lv and R. Nevatia, "Single view human action recognition using key pose matching and viterbi path searching," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
19. D. Weinland, F. Grenoble, E. Boyer, R. Ronfard, and A. Inc, "Action recognition from arbitrary views using 3D exemplars," in Proc. IEEE Conf. Comput. Vis., 2007, pp. 1-7.
20. F. Bremond, M. Thonnat, and M. Zuniga, "Video understanding framework for automatic behavior recognition," Behav. Res. Methods, vol.3, no.38, pp. 416-426, 2006.
21. Y. Luo, T. Wu, and J. Hwang, "Object-based analysis and interpretation of human motion in sports video sequences by dynamic Bayesian networks," Comput. Vis. Image Understanding, vol. 92, no. 2/3, pp. 196-216, 2003.
22. H. Li, S.Wu, S. Lin, and Y. Zhang, "Automatic detection and recognition of athlete actions in diving video," Proc. MMM2007, Singapore, pp. 73-83.
23. J. Aggarwal and Q. Cai, "Human motion analysis: A review," Comput. Vis. Image Understanding, vol.73, no.3, pp. 428-440, 1999.
24. T. Moeslund and E. Granum, "A survey of computer vision-based human motion capture," Comput. Vis. Image Understanding, vol.81, no.3, pp. 231-268, 2001.
25. L. Wang, W. Hu, and T. Tan, "Recent developments in human motion analysis," Pattern Recognit., vol.36, no.3, pp. 585-601, 2003.
26. W. Hu, T. Tan, L.Wang, and S.Maybank, "A survey on visual surveillance of object motion and behaviors," IEEE Trans. Syst.,Man, Cybern.C: Appl. Rev., vol.34, no.3, pp. 334-352, Aug. 2004.
27. T. Moeslund, A. Hilton, and V. Krüger, "A survey of advances in visionbased human motion capture and analysis," Comput. Vis. Image Understanding, vol. 104, no. 2/3, pp. 90-126, 2006.
28. D. Forsyth, O. Arikan, and L. Ikemoto, Computational Studies of Human Motion: Tracking and Motion Synthesis. Boston, MA: Now Publishers, 2006.
29. P. Viola and M. Jones, "Robust real-time object detection," Int. J. Comput. Vis., vol.2, pp. 882-888, Feb. 2001.
30. M. Piccardi, "Background subtraction techniques: A review," in Proc. IEEE Conf. Syst., Man Cybern., 2004, vol.4, pp. 3099-3104.
31. B. Lo and S. Velastin, "Automatic congestion detection system for underground platforms," in Proc. Int. Symp. Intell. Multimedia, Video Speech Process., 2001, pp. 158-161.
32. C. Stauffer and W. Grimson, "Adaptive background mixture models for real-time tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 1999, vol.2, pp. 246-252.
33. A. Elgammal, D. Harwood, and L. Davis, "Non-parametric model for background subtraction," in Proc. Eur. Conf. Comput. Vis.-Part II, 2000, pp. 751-767.
34. A. Elgammal, R. Duraiswami, and L. Davis, "Efficient kernel density estimation using the fast Gauss transform with applications to color modeling and tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol.25, no.11, pp. 1499-1504, Nov. 2003.
35. B. Han, D. Comaniciu, and L. Davis, "Sequential kernel density approximation through mode propagation: Applications to background modeling," in Proc. Asian Conf. Comput. Vis., 2004, pp. 1-7.
36. I. Haritaoglu, D. Harwood, and L. Davis, "W (4): Real-time surveillance of people and their activities," IEEE Trans. Pattern Anal. Mach. Intell., vol.22, no.8, pp. 809-830, Aug. 2000.
37. G. Bradski and J. Davis, "Motion segmentation and pose recognition with motion history gradients," Mach. Vis. Appl., vol.13, pp. 174-184, 2002.
38. J. Gonzalez, I. Lim, P. Fua, and D. Thalmann, "Robust tracking and segmentation of human motion in an image sequence," in Proc. IEEE Conf. Acoust., Speech, Signal Process., 2003, vol.3, pp. 29-32.
39. A. Efros, A. Berg, G. Mori, and J. Malik, "Recognizing action at a distance," in Proc. IEEE Conf. Comput. Vis., 2003, pp. 726-733.
40. N. Robertson and I. Reid, "Behaviour understanding in video:Acombined method," in Proc. IEEE Conf. Comput. Vis., 2005, vol.1, pp. 808-815.
41. A. Fathi and G. Mori, "Action recognition by learning mid-level motion features," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
42. A. Lipton, H. Fujiyoshi, and R. Patil, "Moving target classification and tracking from real-time video," in Proc. IEEE Workshop Appl. Comput. Vis., 1998, pp. 8-14.
43. A. Mohan, C. Papageorgiou, and T. Poggio, "Example-based object detection in images by components," IEEE Trans. Pattern Anal. Mach. Intell., vol.23, no.4, pp. 349-361, Apr. 2001.
44. Q. Zhou and J. Aggarwal, "Tracking and classifying moving objects from video," in Proc. IEEE Workshop Perform. Eval. Tracking Surveill., 2001, pp. 1-8.
45. O. Javed and M. Shah, "Tracking and object classification for automated surveillance," in Proc. Eur. Conf. Comput. Vis.-Part IV, 2002, pp. 343-357.
46. E. Rivlin, M. Rudzsky, R. Goldenberg, U. Bogomolov, and S. Lepchev, "A real-time system for classification of moving objects," in Proc. IEEE Conf. Pattern Recognit., 2002, vol.3, pp. 688-691.
47. M. Rodriguez and M. Shah, "Detecting and segmenting humans in crowded scenes," in Proc. Int. Conf. Multimedia, 2007, pp. 353-356.
48. R. Cutler and L. Davis, "Robust real-time periodic motion detection, analysis, and applications," IEEE Trans. Pattern Anal. Mach. Intell., vol.22, no.8, pp. 781-796, Aug. 2000. (Pubitemid 30941147)
49. Y. Bogomolov, G. Dror, S. Lapchev, E. Rivlin, M. Rudzsky, and I. Tel-Aviv, "Classification of moving targets based on motion and appearance," in Proc. Brit. Mach. Vis. Conf., 2003, vol.2, pp. 429-438.
50. P. Viola, M. Jones, and D. Snow, "Detecting pedestrians using patterns of motion and appearance," Int. J. Comput. Vis., vol.63, no.2, pp. 153-161, 2005.
51. N. Howe, M. Leventon, andW. Freeman, "Bayesian reconstruction of 3D human motion from single-camera video," Adv. Neural Inf. Process. Syst., vol.12, pp. 1-8, 1999.
52. H. Sidenbladh, M. Black, and D. Fleet, "Stochastic tracking of 3D human figures using 2D image motion," in Proc. Eur. Conf. Comput. Vis.-Part II, 2000, pp. 702-718.
53. M. Isard and A. Blake, "Condensation conditional density propagation for visual tracking," Int. J. Comput. Vis., vol.29, no.1, pp. 5-28, 1998.
54. F. Daum, "Nonlinear filters: Beyond the Kalman filter," IEEE Trans. Aerosp. Electron. Syst. Mag., vol.20, no.8, pp. 57-69, Aug. 2005.
55. J. Deutscher, A. Blake, and I. Reid, "Articulated body motion capture by annealed particle filtering," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2000, vol.2, pp. 126-133.
56. R. Kehl,M. Bray, and L. V. Gool, "Full body tracking from multiple views using stochastic sampling," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2005, pp. 129-136.
57. A. Balan, L. Sigal, andM.Black, "Aquantitative evaluation of video-based 3D person tracking," in Proc. IEEEWorkshop Vis. Surveill. Perform. Eval. Tracking Surveill., 2005, pp. 349-356.
58. C. Sminchisescu, "3D human motion analysis in monocular video techniques and challenges," in Proc. IEEE Conf. Video Signal Based Surveill., 2006, pp. 76-100.
59. C. Sminchisescu, "3D human motion analysis in monocular video techniques and challenges," in Proc. IEEE Conf. Video Signal Based Surveill., 2006, pp. 76-100. [59] C. Sminchisescu, B. Triggs, I. Gravir, and F. Montbonnot, "Covariance scaled sampling for monocular 3D body tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2001, vol.1, pp. 447-454.
60. C. Sminchisescu and B. Triggs, "Kinematic jump processes for monocular 3D human tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2003, vol.1, pp. 69-76.
61. G. Loy, M. Eriksson, J. Sullivan, and S. Carlsson, "Monocular 3D reconstruction of human motion in long action sequences," in Proc. Eur. Conf. Comput. Vis., 2004, pp. 442-455.
62. M. Lee and I. Cohen, "Proposal maps driven MCMC for estimating human body pose in static images," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2004, vol.2, pp. 334-341.
63. P. Patrick, W. Svetha, and V. Geoff, "Tracking as recognition for articulated full body human motion anlysis," in Proc. IEEE Conf.Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
64. I. Mikic, M. Trivedi, E. Hunter, and P. Cosman, "Human body model acquisition and motion capture using voxel data," in Proc. 2nd Int.Workshop Articulated Motion Deformable Objects, 2002, pp. 104-118.
65. I. Mikic, M. Trivedi, E. Hunter, and P. Cosman, "Human body model acquisition and tracking using voxel data," Int. J. Comput. Vis., vol.53, no.3, pp. 199-223, 2003.
66. K. Cheung, S. Baker, and T.Kanade, "Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2003, vol.1, pp. 77-84.
67. I. Cohen and H. Li, "Inference of human postures by classification of 3D human body shape," in Proc. IEEE Int. Workshop. Anal. Model. Faces Gestures, 2003, pp. 74-81.
68. G. Shakhnarovich, P. Viola, and T. Darrell, "Fast pose estimation with parameter-sensitive hashing," in Proc. IEEE Conf. Comput. Vis., 2003, pp. 750-757.
69. A. Agarwal and B. Triggs, "3D human pose from silhouettes by relevance vector regression," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2004, vol.2, pp. 882-888.
70. A. Agarwal and B. Triggs, "Recovering 3D human pose from monocular images," IEEE Trans. Pattern Anal. Mach. Intell., vol.28, no.1, pp. 44-58, Jan. 2006.
71. N. Howe, "Silhouette lookup for automatic pose tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2004, pp. 15-22.
72. G. Mori and J. Malik, "Recovering 3D human body configurations using shape contexts," IEEE Trans. Pattern Anal. Mach. Intell., vol.28, no.7, pp. 1052-1062, Jul. 2006.
73. A. Elgammal and C. Lee, "Inferring 3D body pose from silhouettes using activity manifold learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2004, pp. 681-688.
74. C. Lee and A. Elgammal, "Simultaneous inference of view and body pose using torus manifolds," in Proc. Int. Conf. Pattern Recognit., 2006, vol.3, pp. 489-494.
75. A. Bissacco, M. Yang, and S. Soatto, "Fast human pose estimation using appearance and motion via multi-dimensional boosting regression," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
76. A. Kale, A. Chowdhury, and R. Chellappa, "Towards a view invariant gait recognition algorithm," in Proc. IEEE Conf. Adv. Video Signal Based Surveill., 2003, pp. 143-150.
77. P. Ribeiro, J. Santos-Victor, and P. Lisboa, "Human activity recognition from video: Modeling, feature selection and classification architecture," in Proc. Int. Workshop Human Activity Recognit. Model., 2005, pp. 1-10.
78. V. Parameswaran, "View-invariant in visual human motion analysis," Ph.D. dissertation, Univ. Maryland, College Park, 2004.
79. E. Shechtman and M. Irani, "Space-time behavior based correlation," in Proc. IEEE. Conf. Comput. Vis. Pattern Recognit., 2005, vol.1, pp. 405-412.
80. J. Niebles and L. Fei-Fei, "A hierarchical model of shape and appearance for human action classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
81. C. Rao, A. Yilmaz, and M. Shah, "View Invariant representation and recognition of actions," Int. J. Comput. Vis., vol.50, no.2, pp. 203-226, 2002.
82. V. Parameswaran and R. Chellappa, "View invariants for human action recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2003, vol.2, pp. 83-101.
83. V. Parameswaran and R. Chellappa, "View independent human body pose estimation from a single perspective image," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2004, vol.2, pp. 16-22.
84. A. Yilmaz and M. Shah, "Actions as objects: A novel action representation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2005, pp. 984-989.
85. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, "Actions as space-time shapes," in Proc. IEEE Conf. Comput. Vis., 2005, vol.2, pp. 1395-1402.
86. D. Weinland, R. Ronfard, and E. Boyer, "Automatic discovery of action taxonomies from multiple views," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, vol.2, pp. 1639-1645.
87. A. Elgammal, V. Shet, Y. Yacoob, and L. Davis, "Learning dynamics for exemplar-based gesture recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2003, vol.1, pp. 571-578.
88. T. Mori, Y. Segawa, M. Shimosaka, and T. Sato, "Hierarchical recognition of daily human actions based on continuous hidden Markov Models," in Proc. IEEE Conf. Automat. Face Gesture Recognit., 2004, pp. 779-784.
89. Y. Shi, A. Bobick, and I. Essa, "Learning temporal sequence model from partially labeled data," in Proc. 2006 IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2006, pp. 1631-1638.
90. F. Lv and R. Nevatia, "Recognition and segmentation of 3-D human action using HMMand multi-class AdaBoost," in Proc. Eur. Conf. Comput. Vis., 2006, vol.4, pp. 359-372.
91. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in Proc. IEEE Conf. Mach. Learn. Table Contents, 2001, pp. 282-289.
92. C. Sminchisescu, A. Kanaujia, and D. Metaxas, "Conditional models for contextual human motion recognition," Comput. Vis. Image Understanding, vol. 104, no. 2/3, pp. 210-220, 2006.
93. S.Wang, A. Quattoni, L.Morency,D.Demirdjian, and T. Darrell, "Hidden conditional random fields for gesture recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, vol.2, pp. 1521-1527.
94. C. Sutton, A. McCallum, and K. Rohanimanesh, "Dynamic conditional random fields: Factorized probabilistic models for labeling and segmenting sequence Data," J. Mach. Learn. Res., vol.8, pp. 693-723, 2007.
95. L. Wang and D. Suter, "Recognizing human activities from silhouettes: Motion subspace and factorial discriminative graphical model," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
96. H. Ning, W. Xu, Y. Gong, and T. Huang, "Latent pose estimator for continuous action recognition," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 1-7.
97. R. Natarajan and P. Nevatia, "View and scale invariant action recognition using multiview shape-flow models," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
98. M. Yamamoto, H. Mitomi, F. Fujiwara, and T. Sato, "Bayesian classification of task-oriented actions based on stochastic context-free grammar," in Proc. IEEE Conf. Automat. Face Gesture Recognit., 2006, pp. 317-323.
99. S. Park and J. Aggarwal, "Semantic-level understanding of human actions and interactions using event hierarchy," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2004, pp. 12-20.
100. S. Park and J. Aggarwal, "A hierarchical Bayesian network for event recognition of human actions and interactions," Multimedia Syst., vol.10, no.2, pp. 164-179, 2004.
101. L. Sigal and M. Black, "HumanEva: Synchronized video and motion capture dataset for evaluation of articulated human motion," Brown University, Providence, RI, Tech. Rep. CS-06-08, 2006.
102. C. Curio and M. Giese, "Combining view-based and model-based tracking of articulated human movements," in Proc. IEEE Workshop Motion Video Comput., 2005, vol.2, pp. 261-268.