Combining 2D Feature Tracking and Volume Reconstruction for Online Video-Based Human Motion Capture

International Journal of Image and Graphics

Volumn 4, Issue 4, 2004, Pages 563-583

  Theobalt, Christian ^a   Magnor, Marcus A ^a   Schüler, Pascal ^a   Seidel, Hans Peter ^a  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

Author keywords

feature tracking; kinematic body model; Marker less human motion capture; shape from silhouette; volume reconstruction

Indexed keywords

ANIMATION; COMPUTER HARDWARE; IMAGE RECONSTRUCTION; KINEMATICS; MOTION CAPTURE; MUSCULOSKELETAL SYSTEM; USER INTERFACES; VOLUME MEASUREMENT;

BODY MODELING; FEATURE-TRACKING; HUMAN MOTION CAPTURE; SHAPE-FROM-SILHOUETTE; VOLUME RECONSTRUCTION;

MOTION TRACKING;

EID: 27944448963     PISSN: 02194678     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219467804001543     Document Type: Article

References (47)

1. E. Muybridge, Animal Locomotion (1887).
2. G. Johannson, "Visual perception ofb iological motion and a model for its analysis, " Perception and Psychophysics 14(2), 201-211 (1973).
3. A. Menache, Understanding Motion Capture for Computer Animation and Video Games (Morgan Kaufmann, 1995).
4. T. Calvert and M. Chapman, Analysis and Synthesis of Human Movement, pp. 432-474 (Academic Press, 1994).
5. D. M. Gavrila, "The visual analysis ofh uman movement, " Computer Vision and Image Understanding 73(1), 82-98 (January 1999).
6. V. I. Pavlovic, R. Sharma, T. S. Huang, "Visual interpretation ofh and gestures for human-computer interaction: A review, " Pattern Analysis and Machine Intelligence 19(7), 677-695 (July 1997).
7. T. Starner, J. Weaver, A. P. Pentland, "Real-time american sign language recognition using desk and wearable computer based video, " Pattern Analysis and Machine Intelligence 20(12), 1371-1375 (December 1998).
8. S. Malassiotis, N. Aifanti, M. G. Strintzis, "A gesture recognition system using 3D data, " in Proc. 1st International Symposium on 3D Data Processing Visualization and Transmission (3DPVT-02), pp. 190-193. IEEE Computer Society, 2002.
9. P. Eisert, Very Low Bit-Rate Video Coding Using 3-D Models, Volume 20 of Berichte Aus der Kommunikations-Und Informationstechnik (Shaker-Verlag, 2001).
10. N. Grammalidis, G. Goussis, G. Troufakos, M. G. Strintzis, "Estimating body animation parameters from depth images using analysis by synthesis, " in Proc. Second International Workshop on Digital and Computational Video (DCV'01), p. 93ff (2001).
11. S. Weik and C.-E. Liedtke, "Three-dimensional motion estimation for articulated human templates using a sequence ofstereoscop ic image pairs, " in VCIP99 (1999).
12. T. K. Capin and D. Thalmann, "Controlling and efficient coding ofmp eg-4 compliant avatars, " in Proc. IWSNHC3DI'99, Santorini, Greece (1999).
13. ISO/IEC. Overview oft he MPEG-4 standard. ISO/IEC JTC1/SC29/WG11 N2323, http://www.cselt.it/mpeg/standards/mpeg-4/mpeg-4.htm (July 1998).
14. C. Theobalt, M. Magnor, P. Schueler, H.-P. Seidel, "Combining 2D feature tracking and volume reconstruction for online video-based human motion capture, " in Proc. Pacific Graphics 2002, pp. 96-103 (2002).
15. C. Theobalt, M. Magnor, P. Schueler, H.-P. Seidel, "Multi-layer skeleton fitting for online human motion capture, " in Proc. 7th International Fall Workshop on Vision, Modeling and Visualization, pp. 471-478 (2002).
16. M. Gleicher, "Animation from observation: Motion capture and motion editing, " Computer Graphics 4(33), 51-55 (November 1999).
17. L. Herda, P. Fua, R. Plaenkers, R. Boulic, D. Thalmann, "Skeleton-based motion capture for robust reconstruction of human motion, " in Proc. Computer Animation 2000, pp. 77-85 (IEEE CS Press, 2000).
18. J. K. Aggarwal and Q. Cai, "Human motion analysis: A review, " CVIU 73(3), 428-440 (March 1999).
19. D. Hogg, "Model-based vision: A program to see a walking person, " Image and Vision Computing 1(1), 5-20 (1983).
20. D. M. Gavrila and L. S. Davis, "3D model-based tracking ofh umans in action: A multiview approach, " in Computer Society Conference on Computer Vision and Pattern Recognition 96, pp. 73-80 (1996).
21. K. Rohr, "Incremental recognition ofp edestrians from image sequences, " in Computer Society Conference on Computer Vision and Pattern Recognition 93, pp. 8-13 (1993).
22. Y. Kameda, M. Minoh, K. Ikeda, "Three dimensional motion estimation ofa human body using a difference image sequence, " in Proc. Asian Conference on Computer Vision '95, pp. 181-185 (1995).
23. Y. Guo, G. Xu, S. Tsuji, "Tracking human body motion based on a stick-figure model, " J. Visual Communication and Image Representation 5(1), 1-9 (1994).
24. J. Y. Zheng and S. Suezaki, "A model based approach in extracting and generating human motion, " in Proc. International Conference on Pattern Recognition, pp. 1201-1205 (1998).
25. R. Plankers and P. Fua, "Tracking and modeling people in video sequences, " Computer Vision and Image Understanding 81(3), 285-302 (March 2001).
26. C. Bregler and J. Malik, "Tracking people with twists and exponential maps, " in Computer Society Conference on Computer Vision and Pattern Recognition 98, pp. 8-15 (1998).
27. C. R. Wren, A. Azarbayejani, T. Darrell, A. Pentland, "Pfinder: Real-time tracking ofthe human body, " IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 780-785 (1997).
28. I. Haritaoglu, D. Harwood, L. S. Davis, "W4: Who?When?Where? What? A real time system for detecting and tracking people, " in Conference on Automatic Face and Gesture Recognition 98 (Tracking and Segmentation of Moving Figures), pp. 222-227 (1998).
29. A. Laurentini, "The visual hull concept for silhouette-based image understanding, " Pattern Analysis and Machine Intelligence 16(2), 150-162 (February 1994).
30. R. Szeliski, "Rapid octree construction from image sequences, " Computer Vision, Graphics, Image Processing. Image Understanding 58(1), 23-32 (1993).
31. M. Potmesil, "Generating octree models of3d objects from their silhouettes in a sequence ofim ages, " Computer Vision, Graphics and Image Processing 40, 1-20 (1987).
32. P. Eisert, E. Steinbach, B. Girod, "Automatic reconstruction ofst ationary 3-D objects from multiple uncalibrated camera views, " IEEE Transactions on Circuits and Systems for Video Technology: Special Issue on 3D Video Technology 10(2), 261-277 (March 2000).
33. W. Matusik, C. Buehler, L. McMillan, "Polyhedral visual hulls for real-time rendering, " in Proc. 12th Eurographics Workshop on Rendering, pp. 116-126 (2001).
34. W. Matusik, C. Buehler, R. Raskar, S. J. Gortler, L. McMillan, "Image-based visual hulls, " in Siggraph 2000, Computer Graphics Proceedings, pp. 369-374 (2000).
35. B. Lok, "Online model reconstruction for interactive virtual environments, " Symposium on Interactive 3D Graphics, pp. 69-72 (2001).
36. K. Kutulakos and S. Seitz, "A theory ofsh ape by space carving, " in Proc. 7th IEEE International Conference on Computer Vision (ICCV-99), I, pp. 307-314, Los Alamitos, CA, September, 20-27, 1999. IEEE.
37. K. M. Cheung, T. Kanade, J.-Y. Bouguet, M. Holler, "A real time system for robust 3D voxel reconstruction ofh uman motions, " in Proc. CVPR, 2, pp. 714-720 (June 2000).
38. J. Luck, D. Small, C. Q. Little, "Hierarchical 3d pose estimation for articulated human body models from a sequence of volume data, " in Proc. International Workshop on Robot Vision (RoboVis), pp. 27-34 (2001).
39. I. Mikíc, M. Triverdi, E. Hunter, P. Cosman, "Articulated body posture estimation from multicamera voxel data, " in Proc. CVPR, pp. 455-462 (2001).
40. A. Bottino and A. Laurentini, "A silhouette based technique for the reconstruction ofh uman movement, " CVIU 83, 79-95 (2001).
41. S. Weik and C.-E. Liedtke, "Hierarchical 3d pose estimation for articulated human body models from a sequence of volume data, " in Robot Vision, pp. 27-34 (2001).
42. R. Y. Tsai, "An efficient and accurate camera calibration technique for 3d machine vision, " in Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR'86), pp. 364-374 (June 1986).
43. P. F. Rowat, Representing the Spatial Experience and Solving Spatial Problems in a Simulated Robot Environment, PhD thesis, University ofBrit ish Columbia (1979).
44. S. Thrun, "Learning maps for indoor mobile robots, " Artificial Intelligence 99(1), 21-71 (1998).
45. J. C. Latombe, Robot Motion Planning ( Kluwer Academic Publishers, 1991).
46. G. Bradski, "Computer vision face tracking as a component of a perceptual user interface, " in IEEE Workshop of Applications of Computer Vision, pp. 214-218 (1998).
47. K. Fukunaga, Introduction to Statistical Pattern Recognition (Academic Press, Boston, 1990).