Multi-view 3D human pose estimation in complex environment

International Journal of Computer Vision

Volumn 96, Issue 1, 2012, Pages 103-124

  Hofmann, M ^a   Gavrila, D M ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Articulated pose recovery; Human computer interaction; Human motion capture; Surveillance

Indexed keywords

3D HUMAN POSE ESTIMATION; CAMERA VIEW; COMPLEX ENVIRONMENTS; HUMAN MOTION CAPTURE; HUMAN UPPER BODY; HYPOTHESIS GENERATION; HYPOTHESIS VERIFICATIONS; MAXIMUM-LIKELIHOOD APPROACH; MOTION MODELS; MULTI-VIEWS; MULTIPLE CAMERAS; POSE RECOVERY; REAL WORLD DATA; SHAPE MATCHING; TEMPORAL INTEGRATION; TEXTURE MODELS; THREE COMPONENT; TIME STEP;

CAMERAS; HUMAN COMPUTER INTERACTION; INTEGRATION; MAXIMUM LIKELIHOOD ESTIMATION; MOTION ESTIMATION; RECOVERY; SECURITY SYSTEMS; SPACE SURVEILLANCE; TEXTURES; TRAJECTORIES;

THREE DIMENSIONAL;

EID: 84855341625     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-011-0451-1     Document Type: Article

References (66)

1. A. Agarwal B. Triggs 2006 Recovering 3D human pose from monocular images IEEE Transactions on Pattern Analysis and Machine Intelligence 28 1 44 58 10.1109/TPAMI.2006.21 (Pubitemid 46395303)
2. Andriluka, M., Roth, S., & Schiele, B. (2009). Pictorial structures revisited: people detection and articulated pose estimation. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
3. Balan, A., & Black, M. (2006). An adaptive appearance model approach for model-based articulated object tracking. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
4. Balan, A. O., Sigal, L., Black, M. J., Davis, J. E., & Haussecker, H. W. (2007). Detailed human shape and pose from images. In: CVPR (pp. 1-8).
5. M. Bergtholdt J. Kappes S. Schmidt C. Schnörr 2010 A study of parts-based object class detection using complete graphs International Journal of Computer Vision 87 1-2 93 117 10.1007/s11263-009-0209-1 2718743
6. Bissacco, A., Yang, M. H., & Soatto, S. (2007). Fast human pose estimation using appearance and motion via multi-dimensional boosting regression. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
7. L. Bo C. Sminchisescu 2010 Twin Gaussian processes for structured prediction International Journal of Computer Vision 87 1-2 28 52 10.1007/s11263-008-0204-y
8. Bouguet, J. Y. (2003). Camera calibration toolbox for Matlab.
9. M. Bray E. K. Meier N. N. Schraudolph L. J. V. Gool 2007 Fast stochastic optimization for articulated structure tracking Image and Vision Computing 25 3 352 364 10.1016/j.imavis.2005.10.009 (Pubitemid 44880509)
10. M. Brubaker D. Fleet A. Hertzmann 2010 Physics-based person tracking using the anthropomorphic walker International Journal of Computer Vision 87 1-2 140 155 10.1007/s11263-009-0274-5
11. K. M. Cheung S. Baker T. Kanade 2005 Shape-from-silhouette across time-part I International Journal of Computer Vision 62 221 247 10.1007/s11263-005-4881-5 (Pubitemid 40356776)
12. K. M. Cheung S. Baker T. Kanade 2005 Shape-from-silhouette across time-part II International Journal of Computer Vision 63 3 225 245 10.1007/s11263-005-6879-4 (Pubitemid 41217748)
13. S. Corazza L. Mündermann E. Gambaretto G. Ferrigno T. Andriacchi 2010 3D human motion tracking with a coordinated mixture of factor analyzers International Journal of Computer Vision 87 1-2 156 169 10.1007/s11263-009-0284- 3
14. J. Deutscher I. Reid 2005 Articulated body motion capture by stochastic search International Journal of Computer Vision 61 2 185 205 10.1023/B:VISI.0000043757.18370.9c
15. Drummond, T., & Cipolla, R. (2001). Real-time tracking of highly articulated structures in the presence of noisy measurements. In Proc. of the IEEE international conference on computer vision (ICCV) (pp. 315-320). (Pubitemid 32795076)
16. Ferrari, V., Marin-Jimenez, M., & Zisserman, A. (2009). Pose search: retrieving people using their pose. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
17. F. Fleuret J. Berclaz R. Lengagne P. Fua 2008 Multicamera people tracking with a probabilistic occupancy map IEEE Transactions on Pattern Analysis and Machine Intelligence 30 2 267 282 10.1109/TPAMI.2007.1174
18. D. A. Forsyth O. Arikan L. Ikemoto J. O'Brien D. Ramanan 2005 Computational studies of human motion Foundations and Trends in Computer Graphics and Vision 1 2-3 77 254 10.1561/0600000005
19. Fossati, A., Dimitrijevic, M., Lepetit, V., & Fua, P. (2007). Bridging the gap between detection and tracking for 3D monocular video-based motion capture. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
20. Fossati, A., Salzmann, M., & Fua, P. (2009). Observable subspaces for 3D human motion recovery. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
21. Gall, J., Stoll, C., de Aguiar, E., Theobalt, C., Rosenhahn, B., & Seidel, H. P. (2009). Motion capture using joint skeleton tracking and surface estimation. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
22. J. Gall B. Rosenhahn T. Brox H. P. Seidel 2010 Optimization and filtering for human motion capture International Journal of Computer Vision 87 1-2 75 92 10.1007/s11263-008-0173-1
23. D. M. Gavrila 1999 The visual analysis of human movement: a survey Computer Vision and Image Understanding 73 1 82 98 10.1006/cviu.1998.0716 0924.68174
24. D. M. Gavrila 2007 A Bayesian, exemplar-based approach to hierarchical shape matching IEEE Transactions on Pattern Analysis and Machine Intelligence 29 8 1408 1421 10.1109/TPAMI.2007.1062 (Pubitemid 47040439)
25. Gavrila, D. M., & Davis, L. (1996). 3-D model-based tracking of humans in action: a multi-view approach. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
26. D. M. Gavrila S. Munder 2007 Multi-cue pedestrian detection and tracking from a moving vehicle International Journal of Computer Vision 73 1 41 59 10.1007/s11263-006-9038-7 (Pubitemid 46181616)
27. Hasler, N., Rosenhahn, B., Thormählen, T., Wand, M., Gall, J., & Seidel, H. P. (2009). Markerless motion capture with unsynchronized moving cameras. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
28. Hofmann, M., & Gavrila, D. M. (2009a). Multi-view 3D human pose estimation combining single-frame recovery, temporal integration and model adaptation. In: Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
29. Hofmann, M., & Gavrila, D. M. (2009b). Single-frame 3D human pose recovery from multiple views. In Proc. of the DAGM symposium on pattern recognition.
30. I. Kakadiaris D. Metaxas 2000 Model-based estimation of 3-D human motion IEEE Transactions on Pattern Analysis and Machine Intelligence 22 12 1453 1459 10.1109/34.895978 (Pubitemid 32088471)
31. Kanaujia, A., Sminchisescu, C., & Metaxas, D. (2007). Semi-supervised hierarchical models for 3D human pose reconstruction. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
32. R. Kehl L. V. Gool 2006 Markerless tracking of complex human motions from multiple views Computer Vision and Image Understanding 103 2-3 190 209 10.1016/j.cviu.2006.07.010 (Pubitemid 44573868)
33. D. Knossow R. Ronfard R. Horaud 2008 Human motion tracking with a kinematic parametrization of extremal contours International Journal of Computer Vision 79 247 269 10.1007/s11263-007-0116-2
34. P. Kohli J. Rihan M. Bray P. H. S. Torr 2008 Simultaneous segmentation and pose estimation of humans using dynamic graph cuts International Journal of Computer Vision 79 285 298 10.1007/s11263-007-0120-6
35. A. Laurentini 1994 The visual hull concept for silhouette-based image understanding IEEE Transactions on Pattern Analysis and Machine Intelligence 16 2 150 162 10.1109/34.273735
36. C. S. Lee A. Elgammal 2010 Coupled visual and kinematic manifold models for tracking International Journal of Computer Vision 87 1-2 118 139 10.1007/s11263-009-0266-5
37. M. W. Lee I. Cohen 2006 A model-based approach for estimating human 3D poses in static images IEEE Transactions on Pattern Analysis and Machine Intelligence 28 6 905 916 10.1109/TPAMI.2006.110
38. M. W. Lee R. Nevatia 2009 Human pose tracking in monocular sequence using multilevel structured models IEEE Transactions on Pattern Analysis and Machine Intelligence 31 1 27 38 10.1109/TPAMI.2008.35
39. R. Li T. P. Tian S. Sclaroff M. H. Yang 2010 3d human motion tracking with a coordinated mixture of factor analyzers International Journal of Computer Vision 87 1-2 170 190 10.1007/s11263-009-0283-4
40. Liem, M., & Gavrila, D. M. (2009). Multi-person tracking with overlapping cameras in complex, dynamic environments. In Proc. of the British machine vision conference (BMVC).
41. Lv, F., & Nevatia, R. (2007). Single view human action recognition using key pose matching and Viterbi path searching. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
42. D. Marquardt 1963 An algorithm for least-squares estimation of nonlinear parameters SIAM Journal on Applied Mathematics 11 431 441 10.1137/0111030 153071
43. I. Mikic M. Trivedi E. Hunter P. Cosman 2003 Human body model acquisition and tracking using voxel data International Journal of Computer Vision 53 3 199 223 10.1023/A:1023012723347
44. T. B. Moeslund A. Hilton V. Kruger 2006 A survey of advances in vision-based human motion capture and analysis Computer Vision and Image Understanding 103 2-3 90 126 10.1016/j.cviu.2006.08.002 (Pubitemid 44573873)
45. G. Mori J. Malik 2006 Recovering 3D human body configurations using shape contexts IEEE Transactions on Pattern Analysis and Machine Intelligence 28 7 1052 1062 10.1109/TPAMI.2006.149
46. Navaratnam, R., Thayananthan, A., Torr, P. H. S., & Cipolla, R. (2005). Hierarchical part-based human body pose estimation. In Proc. of the British machine vision conference (BMVC).
47. E. J. Ong A. Hilton A. S. Micilotta 2006 Viewpoint invariant exemplar-based 3D human tracking Computer Vision and Image Understanding 104 178 189 10.1016/j.cviu.2006.08.004 (Pubitemid 44573875)
48. Peursum, P., Venkatesh, S., & West, G. (2007). Tracking-as- recognition for articulated full-body human motion analysis. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
49. P. Peursum S. Venkatesh G. West 2010 A study on smoothing for particle-filtered 3d human body tracking International Journal of Computer Vision 87 1-2 53 74 10.1007/s11263-009-0205-5
50. Pilu, M., & Fisher, R. B. (1995). Equal-distance sampling of superellipse models. In Proc. of the British machine vision conference (BMVC).
51. L. Rabiner 1989 A tutorial on HMMs and selected applications in speech recognition Proceedings of the IEEE 77 2 257 286 10.1109/5.18626
52. D. Ramanan D. A. Forsyth A. Zisserman 2007 Tracking people by learning their appearance IEEE Transactions on Pattern Analysis and Machine Intelligence 29 1 65 81 10.1109/TPAMI.2007.250600 (Pubitemid 46415946)
53. T. J. Roberts S. J. McKenna I. W. Ricketts 2006 Human tracking using 3D surface colour distributions Image and Vision Computing 24 12 1332 1342 10.1016/j.imavis.2006.04.011 (Pubitemid 44537533)
54. Rogez, G., Rihan, J., Ramalingam, S., Orrite, C., & Torr, P. H. (2008). Randomized trees for human pose detection. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
55. Rosenhahn, B., & Brox, T. (2007). Scaled motion dynamics for markerless motion capture. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
56. N. Seshadri C. Sundberg 1994 List Viterbi decoding algorithms with applications IEEE Transactions on Communications 42 313 323 10.1109/TCOMM.1994. 577040
57. Shakhnarovich, G., Viola, P., & Darrell, T. (2003). Fast pose estimation with parameter-sensitive hashing. In Proc. of the IEEE international conference on computer vision (ICCV) (pp. 750-757).
58. L. Sigal M. Black 2010 Guest editorial: state of the art in image- and video-based human pose and motion estimation International Journal of Computer Vision 87 1-2 1 3 10.1007/s11263-009-0293-2
59. Sigal, L., Bhatia, S., Roth, S., Black, M. J., & Isard, M. (2004). Tracking loose-limbed people. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
60. L. Sigal A. Balan M. Black 2010 Humaneva: synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion International Journal of Computer Vision 87 1-2 4 27 10.1007/s11263-009- 0273-6
61. Starck, J., & Hilton, A. (2003). Model-based multiple view reconstruction of people. In Proc. of the IEEE international conference on computer vision (ICCV) (pp. 915-922).
62. B. Stenger A. Thayananthan P. H. S. Torr R. Cipolla 2006 Model-based hand tracking using a hierarchical Bayesian filter IEEE Transactions on Pattern Analysis and Machine Intelligence 28 9 1372 1384 10.1109/TPAMI.2006.189 (Pubitemid 44132645)
63. A. Sundaresan R. Chellappa 2009 Multicamera tracking of articulated human motion using shape and motion cues IEEE Transactions on Image Processing 18 9 2114 2126 10.1109/TIP.2009.2022290 2750937
64. Vondrak, M., Sigal, L., & Jenkins, O. C. (2008). Physical simulation for probabilistic motion tracking. In Proc. of the IEEE conf. on computer vision and pattern recognition (CVPR).
65. Xu, X., & Li, B. (2007). Learning motion correlation for tracking articulated human body with a Rao-Blackwellised particle filter. In Proc. of the IEEE international conference on computer vision (ICCV).
66. Zivkovic, Z. (2004). Improved adaptive Gaussian mixture model for background subtraction. In Proc. of the international conference on pattern recognition (2) (pp. 28-31).