Markerless motion capture through visual hull, articulated ICP and subject specific model generation

International Journal of Computer Vision

Volumn 87, Issue 1-2, 2010, Pages 156-169

  Corazza, Stefano ^a   Mündermann, Lars ^a   Gambaretto, Emiliano ^b   Ferrigno, Giancarlo ^b   Andriacchi, Thomas P ^a,c  

^a STANFORD UNIVERSITY   (United States)

^b POLITECNICO DI MILANO   (Italy)

^c VETERANS AFFAIRS MEDICAL CENTER   (United States)

Author keywords

3D reconstruction; Human body model; Markerless motion capture; Shape from silhouette; Tracking

Indexed keywords

3D RECONSTRUCTION; AUTOMATIC MODEL GENERATION; BODY SEGMENT; CAMERA CONFIGURATION; COLOR CAMERAS; DATA SETS; HUMAN BODY MODELS; HUMAN MOTIONS; ITERATIVE CLOSEST POINT ALGORITHM; KINEMATIC MODEL; LEVENBERG-MARQUARDT MINIMIZATION; MARKERLESS MOTION CAPTURE; MODEL GENERATION; RANGE OF MOTIONS; SHAPE MATCHING; SHAPE-FROM-SILHOUETTE; SIX DEGREES OF FREEDOM; SUBJECT-SPECIFIC; TRACKING ALGORITHM; TRANSLATIONAL JOINTS; VARIABLE NUMBER; VISUAL HULLS;

ALGORITHMS; CAMERAS; ELECTRIC ARC WELDING; IMAGE RECONSTRUCTION; INTERACTIVE COMPUTER GRAPHICS; KINEMATICS; METALLIC MATRIX COMPOSITES; MOTION ESTIMATION;

THREE DIMENSIONAL;

EID: 75149114054     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-009-0284-3     Document Type: Article

References (49)

1. J. Aggarwal Q. Cai 1999 Human motion analysis: a review Computer Vision and Image Understanding 73 3 295 304 10.1006/cviu.1998.0744
2. T. P. Andriacchi E. J. Alexander M. K. Toney C. O. Dyrby J. A. Sum 1998 A point cluster method for in vivo motion analysis: applied to a study of knee kinematics Journal of Biomechanical Engineering 120 743 749 10.1115/1.2834888
3. Anguelov, D., Koller, D., Pang, H., Srinivasan, P., & Thrun, S. (2004). Recovering articulated object models from 3D range data. In Proceedings UAI.
4. Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005). SCAPE: shape completion and animation of people. In Proceedings SIGGRAPH.
5. Balan, A. O., Sigal, L., Black, M. J., Davis, J. E., & Haussecker, H. W. (2007). Detailed human shape and pose from images. In Proceedings CVPR.
6. Baran, I., & Popovic, J. (2007). Automatic rigging and animation of 3D characters. In Proceedings of SIGGRAPH.
7. P. Besl N. McKay 1992 A method for registration of 3D shapes Transactions on Pattern Analysis and Machine Intelligence 14 2 239 256 10.1109/34.121791
8. Bharatkumar, A. G., Daigle, K. E., Pandy, M. G., Cai, Q., & Aggarwal, J. K. (1994). Lower limb kinematics of human walking with the medial axis transformation. In IEEE Workshop on Non-Rigid Motion, Austin, USA (pp. 70-76).
9. A. Bottino A. Laurentini 2001 A silhouette based technique for the reconstruction of human movement Computer Vision and Image Understanding 83 79 0972.68558 10.1006/cviu.2001.0918
10. Bregler, C., & Malik, J. (1997). Tracking people with twists and exponential maps. In Proceedings CVPR.
11. C. Cedras M. Shah 1995 Motion-based recognition: a survey Image and Vision Computing 13 2 129 155 10.1016/0262-8856(95)93154-K
12. K. Cheung S. Baker T. Kanade 2005 Shape-from-silhouette across time part I: Theory and algorithm International Journal of Computer Vision 62 221 247 10.1007/s11263-005-4881-5 (Pubitemid 40356776)
13. S. Corazza L. Mündermann A. M. Chaudhari T. Demattio C. Cobelli T. P. Andriacchi 2006 A markerless motion capture system to study musculoskeletal biomechanics: visual hull and simulated annealing approach Annals Biomedical Engineering 34 6 1019 1029 10.1007/s10439-006-9122-8 (Pubitemid 43954334)
14. Corazza, S., Gambaretto, E., Mündermann, L., & Andriacchi, T. (2009). Automatic generation of a subject specific model for accurate markerless motion capture and biomechanical applications. IEEE Transactions on Biomedical Engineering, in press.
15. Delamarre, Q., & Faugeras, O. (1999). 3D articulated models and multiview tracking with silhouettes. In Proceedings ICCV.
16. Demirdjian, D. (2004). Combining geometric- and view-based approaches for articulated pose. In Proceedings ECCV04 (Vol. III, pp. 183-194).
17. Deutscher, J., Blake, A., & Reid, I. (2000). Articulated body motion capture by annealed particle filtering. In Proceedings CVPR (pp. 2126-2133).
18. D. Gavrila 1999 The visual analysis of human movement: a survey Computer Vision and Image Understanding 73 3 82 98 0924.68174 10.1006/cviu.1998.0716
19. Gavrila, D., & Davis, L. (1996). 3-D model based tracking of humans in action:a multiview approach. In Proceedings CVPR (pp. 73-80).
20. D. Hogg 1983 Model-based vision: a program to see a walking person Image and Vision Computing 1 5 10.1016/0262-8856(83)90003-3 (Pubitemid 13572232)
21. Isard, M., & Blake, A. (1996). Estimating 3D hand pose using hierarchical multi-label classification. In Proceedings of 4th European Conference on Computer Vision, Cambridge, UK.
22. I. A. Kakadiaris D. Metaxas 1998 Three-dimensional human body model acquisition from multiple views International Journal of Computer Vision 30 191 10.1023/A:1008071332753
23. Kanade, T., Saito, H., & Vedula, S. (1998). The 3D Room: Digitizing time-varying 3D events by synchronized multiple video streams (Tech. report CMU-RI-TR-98-34). Robotics Institute, Carnegie Mellon University.
24. D. Knossow R. Ronfard R. P. Horaud 2008 Human motion tracking with a kinematic parameterization of extremal contours International Journal of Computer Vision 79 2 247 269 10.1007/s11263-007-0116-2
25. P. Kohli J. Rihan M. Bray P. H. S. Torr 2008 Simultaneous segmentation and pose estimation of humans using dynamic graph cuts International Journal of Computer Vision 79 3 285 298 10.1007/s11263-007-0120-6
26. A. Laurentini 1994 The Visual Hull concept for silhouette base image understanding IEEE Transactions on Pattern Analysis and Machine Intelligence 16 150 162 10.1109/34.273735
27. A. Leardini L. Chiari U. Della Croce A. Cappozzo 2005 Human movement analysis using stereophotogrammetry. Part 3: Soft tissue artifact assessment and compensation Gait and Posture 21 221 225 10.1016/j.gaitpost.2004.05.002 (Pubitemid 41556840)
28. H. J. Lee Z. Chen 1985 Determination of 3D human body posture from a single view Computer Vision, Graphics, and Image Processing 30 148 168 10.1016/0734-189X(85)90094-5 813920
29. Lee, W., Gu, J., & Magnenat-Thalmann, N. (2000). Generating animatable 3D virtual humans from photographs. In Proceedings Computer Graphics Forum-Eurographics (pp. 1-10).
30. L. Legrand F. Marzani L. Dusserre 1998 A marker-free system for the analysis of. movement disabilities Medinfo 9 1066 1070
31. Liu, Q., & Prakash, E. C. (2003). The parametrization of joint rotation with the unit quaternion. In Proceedings of 7° Digital Image Computing.
32. F. Marzani E. Calais L. Legrand 2001 A 3-D marker-free system for the analysis of movement disabilities-an application to the legs IEEE Transactions on Information Technology in Biomedicine 5 1 18 26 10.1109/4233.908371 (Pubitemid 32302929)
33. I. Mikic M. Trivedi E. Hunter P. Cosman 2003 Human body model acquisition and tracking using voxel data International Journal of Computer Vision 53 199 223 10.1023/A:1023012723347
34. T. B. Moeslund A. Hilton V. Krüger 2006 A survey of advances in vision-based human motion capture and analysis Computer Vision and Image Understanding 104 2 90 126 10.1016/j.cviu.2006.08.002 (Pubitemid 44573873)
35. Moon, H., Chellappa, R., & Rosenfeld, A. (2001). 3D object tracking using shape-encoded particle propagation. In Proceedings ICCV.
36. L. Mündermann S. Corazza A. M. Chaudhari E. J. Alexander T. P. Andriacchi 2005 Most favorable camera configuration for a shape-from-silhouette markerless motion capture system for biomechanical analysis Proceedings of SPIE-IS&T Electronic Imaging 5665 278 287 10.1117/12.587970 (Pubitemid 40949083)
37. Mündermann, L., Corazza, S., & Andriacchi, T.P. (2006). The evolution of methods for the capture of human movement leading to markerless motion capture for biomechanical applications. Journal of Neuroengineering and Rehabilitation, 3(1).
38. Mündermann, L., Corazza, S., & Andriacchi, T. (2007). Accurately measuring human movement using articulated ICP with soft-joint constraints and a repository of articulated models. In Proceedings of CVPR.
39. Narayanan, P. J., Rander, P., & Kanade, T. (1995). Synchronous capture of image sequences from multiple cameras (Technical Report CMU-RI-TR-95-25). Robotics Institute, Carnegie Mellon University.
40. Nielsen, H. B. (1999). Damping parameter in Marquardt's method (Technical Report IMM-REP-1999-05). Technical University of Denmark.
41. Niskanen, M., Boyer, E., & Horaud, R. (2005). Articulated motion capture from 3-D points and normals. In Proceedings of BMVC'05.
42. J. O'Rourke N. I. Badler 1980 Model-based image analysis of human motion using constraint propagation IEEE Transactions on Pattern Analysis and Machine Intelligence 2 522 536
43. R. Plankers P. Fua 2003 Articulated soft objects for multiview shape and motion capture IEEE Transactions on Pattern Analysis and Machine Intelligence 25 1182 1187 10.1109/TPAMI.2003.1227995
44. Rosenhahn, B., & Klette, R. (2005). Automatic human model generation. Computer Analysis of Images and Patterns, 230-237.
45. B. Rosenhahn T. Brox U. G. Kersting A. W. Smith J. K. Gurney R. Klette 2006 A system for marker-less motion capture Künstliche Intelligenz (KI) 1 45 51
46. Sigal, L., & Black, M. J. (2006). HumanEva: synchronized video and motion capture dataset for evaluation of articulated human motion (Technical Report CS-06-08). Brown University.
47. D. K. Wagg M. S. Nixon 2004 Automated markerless extraction of walking people using deformable contour models Computer Animation and Virtual Worlds 15 399 406 10.1002/cav.43 (Pubitemid 41108018)
48. C. R. Wren A. Azarbayejani T. Darrell A. P. Pentland 1997 Pfinder-real-time tracking of the human body Transactions on Pattern Analysis and Machine Intelligence 19 780 785 10.1109/34.598236
49. Yamamoto, M., & Koshikawa, K. (1991). Human motion analysis based on a robot arm model. In Proceedings Computer Vision and Pattern Recognition.