Combining 3D flow fields with silhouette-based human motion capture for immersive video

Graphical Models

Volumn 66, Issue 6, 2004, Pages 333-351

  Theobalt, Christian ^a   Carranza, Joel ^a   Magnor, Marcus A ^a   Seidel, Hans Peter ^a  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

Author keywords

3D motion field; 3D Video; Human motion capture; Optical flow; Scene flow

Indexed keywords

IMAGE PROCESSING; MATHEMATICAL MODELS; MOTION ESTIMATION; OPTIMIZATION; PARAMETER ESTIMATION; VIDEO SIGNAL PROCESSING;

3D MOTION FIELD; 3D VIDEO; HUMAN MOTION CAPTURE; OPTICAL FLOW; SCENE FLOW;

HUMAN COMPUTER INTERACTION;

VIDEOGRAPHY;

EID: 9944253834     PISSN: 15240703     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.gmod.2004.06.009     Document Type: Conference Paper

References (38)

1. E.H, Adelson, J.R. Bergen, The plenoptic function and the elements of early vision, in: M. Landy, J.A. Movshon, Computational Models of Visual Processing. 1991.
2. J. Barron, D. Fleet, S. Beauchemin, Performance of optical flow techniques, IJCV 12(1) (1994) 43-77.
3. V. Bhaskaran, K. Konstantinidis, Image and Video Compression Standards, Kluwer, Dordrecht, 1999.
4. C. Bregler, J. Malik, Tracking people with twists and exponential maps, in: Proceedings of CVPR 98, 1998, pp. 8-15.
5. J. Carranza, C. Theobalt, M. Magnor, H.-P. Seidel, Free-viewpoint video of human actors, in: Proceedings of ACM SIGGRAPH2003, San Diego, USA, 2003, pp. 569-577.
6. K. Cheung, T. Kanade, J.-Y. Bouguet, M. Holler, A real time system for robust 3D voxel reconstruction of human motions, in: Proceedings of CVPR, vol. 2, 2000, pp. 714-720.
7. Q. Delamarre, O. Faugeras, 3D articulated models and multi-view tracking with silhouettes, in: Proceedings of ICCV 99, 1999, pp. 716-721.
8. P. Eisert, W.T. and, B. Girod, Model-aided coding: a new approach to incorporate facial animation into motion-compensated video coding, Trans. Circ. Syst. Video Technol. 10 (3) (2000) 244-258.
9. D. Gavrila, The visual analysis of human movement, CVIU 73 (1) (1999) 82-98.
10. D. Gavrila, L. Davis, 3D model-based tracking of humans in action: a multi-view approach, in: CVPR 96, 1996, pp. 73-80.
11. S. Gortler, R. Grzeszczuk, R. Szeliski, M. Cohen, The lumigraph, in: Proceedings of ACM SIGGRAPH, 1996, pp. 43-54.
12. Y. Guo, G. Xu, S. Tsuji, Tracking human body motion based on a stick-figure model, J. Vis. Commun. Image Rep. 5 (1) (1994) 1-9.
13. D. Hogg, Model-based vision: a program to see a walking person. Image Vis. Comput. 1 (1) (1983) 5-20.
14. B. Horn, Robot Vision. MIT Press, Cambridge, 1986.
15. B. Horn, Closed-form solution of absolute orientation using unit quaternions, J. Opt. Soc. Am. 4 (4) (1987) 629-642.
16. Y. Kameda, M. Minoh, K. Ikeda, Three dimensional motion estimation of a human body using a difference image sequence, in: Proceedings of the Asian Conference On Computer Vision '95, 1995, pp. 181-185.
17. R. Koch, Dynamic 3D scene analysis through synthesis feedback control, PAMI 15 (6) (1993) 556-568.
18. M. Levoy, P. Hanrahan, Light field rendering, in: Proceedings of ACM SIGGRAPH, ACM, 1996, pp. 31-42.
19. B. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, in: Proceedings of the DARPA IU Workshop, 1981, pp. 121-130.
20. J. Luck, D. Small, Real-time markerless motion tracking using linked kinematic chains, in: Proceedings of CVPRIP02, 2002.
21. W. Matusik, C. Buehler, L. McMillan, Polyhedral visual hulls for real-time rendering, in: Proceedings of 12th Eurographics Workshop on Rendering, 2001, pp. 116-126.
22. T.B. Moeslund, E. Granum, A survey of computer vision-based human motion capture, Comput. Vision Image Und.: CVIU 81 (3) (2001) 231-268.
23. P. Narayanan, P. Rander, T. Kanade, Constructing virtual worlds using dense stereo, in: Proceedings of ICCV 98, 1998, pp. 3-10.
24. R. Plaenkers, P. Fua, Tracking and modeling people in video sequences, CVIU 81 (3) (2001) 285-302.
25. W. Press, S. Teukolsky, W. Vetterling, B. Flannery, Numerical Recipes, Cambridge University Press, Cambridge, 1992.
26. K. Rohr, Incremental recognition of pedestrians from image sequences, in: Proceedings of CVPR 93, 1993, pp. 8-13.
27. P. Sand, L. McMillan, J. Popović, Continuous capture of skin deformation, in: Proceedings of ACM SIGGRPAH03, 2003, pp. 578-586.
28. J. Starck, A. Hilton, Towards a 3D virtual studio for human appearance capture, in: Proceedings of Vision, Video and Graphics, 2003, pp. 17-24.
29. C. Theobalt, J. Carranza, M. Magnor, H. Seidel, A parallel framework for silhouette-based human motion capture, in: Proceedings of Vision, Modeling and Visualization 2003, Munich, Germany, 2003, pp. 207-214.
30. C. Theobalt, J. Carranza, M.A. Magnor, H.-P. Seidel, Enhancing silhouette-based human motion capture with 3D motion fields, in: Proceedings of Pacific Graphics 2003, IEEE Computer Society Press, Canmore, Canada, 2003, pp. 185-193.
31. C. Theobalt, M. Li, M. Magnor, H.-P. Seidel, A flexible and versatile studio for synchronized multi-view video recording, in: Proceedings of Vision, Video and Graphics, 2003, pp. 9-16.
32. C. Theobalt, M. Magnor, P. Schueler, H.-P. Seidel, Combining 2D feature tracking and volume reconstruction for online video-based human motion capture, in: Proceedings of Pacific Graphics 2002, 2002, pp. 96-103.
33. R. Tsai, An efficient and accurate camera calibration technique for 3D machine vision, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'86), 1986, pp. 364-374.
34. S. Vedula, S. Baker, T. Kanade, Spatio-temporal view interpolation, in: Proceedings of the 13th ACM Eurographics Workshop on Rendering, 2002, pp. 65-75.
35. S. Vedula, S. Baker, P. Rander, R. Collins, T. Kanade, Three-dimensional scene flow, in: Proceedings of the 7th IEEE International Conference on Computer Vision (ICCV-99) [7], pp. 722-729.
36. S. Vedula, S. Baker, S. Seitz, T. Kanade, Shape and motion carving in 6D, in: Proceedings of CVPR, 2000, pp. 592-598.
37. B. Wilburn, M. Smulski, H.-H.K. Lee, M. Horowitz, The light field video camera, in: Proceedings of Media Processors 2002, SPIE Electronic Imaging 2002, 2002.
38. S. Wuermlin, E. Lamboray, O. Staadt, M. Gross, 3D video recorder, in: Proceedings of Pacific Graphics 2002, IEEE Computer Society Press, 2002, pp. 325-334.