Performance capture from sparse multi-view video

SIGGRAPH'08: International Conference on Computer Graphics and Interactive Techniques, ACM SIGGRAPH 2008 Papers 2008

Volumn , Issue , 2008, Pages

  De Aguiar, Edilson ^a   Stoll, Carsten ^a   Theobaldt, Christian ^b   Ahmed, Naveed ^a   Seidel, Hans Peter ^a   Thrun, Sebastian ^b  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^b STANFORD UNIVERSITY   (United States)

Author keywords

Marker less scene reconstruction; Multi view video analysis; Performance capture

Indexed keywords

COMPUTER GRAPHICS; INTERACTIVE COMPUTER GRAPHICS; RESTORATION;

HUMAN PERFORMANCE; LEVEL OF DETAILS; MARKER-LESS SCENE RECONSTRUCTION; MODEL SURFACES; MOTION CONSTRAINTS; MULTI-VIEW STEREOS; MULTI-VIEW VIDEO ANALYSIS; MULTI-VIEW VIDEOS; PERFORMANCE CAPTURE; PERFORMANCE DATUM; SHAPE DEFORMATIONS; SURFACE APPEARANCES; TIME-VARYING;

VIDEO SIGNAL PROCESSING;

EID: 57649088550     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (41)

1. ALLEN, B., CURLESS, B., AND POPOVIĆ, Z. 2002. Articulated body deformation from range scan data. ACM Trans. Graph. 21, 3,612-619.
2. BALAN, A. O., SIGAL, L., BLACK, M. J., DAVIS, J. E., AND HAUSSECKER, H. W. 2007. Detailed human shape and pose from images. In Proc. CVPR.
3. BICKEL, B., BOTSCH, M., ANGST, R., MATUSIK, W., OTADUY, M., PFISTER, H., AND GROSS, M. 2007. Multi-scale capture of facial geometry and motion. In Proc. of SIGGRAPH, 33.
4. BOTSCH, M., AND SORKINE, O. 2008. On linear variational surface deformation methods. IEEE TVCG 14, 1, 213-230.
5. BOTSCH, M., PAULY, M., WICKE, M., AND GROSS, M. 2007. Adaptive space deformations based on rigid cells. Computer Graphics Forum 26, 3, 339-347.
6. BYRD, R., LU, P., NOCEDAL, J., AND ZHU, C. 1995. A limited memory algorithm for bound constrained optimization. SIAM J. Sci. Comp. 16, 5, 1190-1208.
7. CARRANZA, J., THEOBALT, C., MAGNOR, M., AND SEIDEL, H.-P. 2003. Free-viewpoint video of human actors. In Proc. SIGGRAPH, 569-577.
8. DE AGUIAR, E., THEOBALT, C., STOLL, C., AND SEIDEL, H.-P. 2007. Marker-less deformable mesh tracking for human shape and motion capture. In Proc. CVPR, IEEE, 1-8.
9. DE AGUIAR, E., THEOBALT, C., STOLL, C., AND SEIDEL, H. 2007. Marker-less 3d feature tracking for mesh-based human motion capture. In Proc. ICCV HUMO07, 1-15.
10. DE AGUIAR, E., THEOBALT, C., THRUN, S., AND SEIDEL, H.-P. 2008. Automatic conversion of mesh animations into skeleton-based animations. Computer Graphics Forum (Proc. Eurographics EG'08) 27, 2 (4), 389-397.
11. EINARSSON, P., CHABERT, C.-F., JONES, A., MA, W.-C., LAMOND, B., IM HAWKINS, BOLAS, M., SYLWAN, S., AND DE-BEVEC, P. 2006. Relighting human locomotion with flowed reflectance fields. In Proc. EGSR, 183-194.
12. GOESELE, M., CURLESS, B., AND SEITZ, S. M. 2006. Multi-view stereo revisited. In Proc. CVPR, 2402-2409.
13. GROSS, M., WÜRMLIN, S., NÄF, M., LAMBORAY, E., SPAGNO, C., KUNZ, A., KOLLER-MEIER, E., SVOBODA, T., GOOL, L. V., LANG, S., STREHLKE, K., MOERE, A. V., AND STAADT, O. 2003. blue-c: a spatially immersive display and 3d video portal for telepresence. ACM TOG 22, 3, 819-827.
14. KANADE, T., RANDER, P., AND NARAYANAN, P. J. 1997. Virtualized reality: Constructing virtual worlds from real scenes. IEEE MultiMedia 4, 1, 34-47.
15. KAZHDAN, M., BOLITHO, M., AND HOPPE, H. 2006. Poisson surface reconstruction. In Proc. SGP, 61-70.
16. LEORDEANU, M., AND HEBERT, M. 2005. A spectral technique for correspondence problems using pairwise constraints. In Proc. ICCV.
17. LOWE, D. G. 1999. Object recognition from local scale-invariant features. In Proc. ICCV, vol. 2, 1150ff.
18. MATUSIK, W., BUEHLER, C., RASKAR, R., GORTLER, S., AND MCMILLAN, L. 2000. Image-based visual hulls. In Proc. SIGGRAPH, 369-374.
19. MENACHE, A., AND MANACHE, A. 1999. Understanding Motion Capture for Computer Animation and Video Games. Morgan Kaufmann.
20. MITRA, N. J., FLORY, S., OVSJANIKOV, M., GELFAND, N., AS, L. G., AND POTTMANN, H. 2007. Dynamic geometry registration. In Proc. SGP, 173-182.
21. MOESLUND, T. B., HILTON, A., AND KRÜGER, V. 2006. A survey of advances in vision-based human motion capture and analysis. Comput. Vis. Image Underst. 104, 2, 90-126.
22. MÜLLER, M., DORSEY, J., MCMILLAN, L., JAGNOW, R., AND CUTLER, B. 2002. Stable real-time deformations. In Proc. of SCA, ACM, 49-54.
23. PARAMOUNT, 2007. Beowulf movie page. http://www.beowulfmovie. com/.
24. PARK, S. I., AND HODGINS, J. K. 2006. Capturing and animating skin deformation in human motion. ACM TOG (SIGGRAPH 2006) 25, 3 (Aug.).
25. POPPE, R. 2007. Vision-based human motion analysis: An overview. CVIU 108, 1.
26. ROSENHAHN, B., KERSTING, U., POWEL, K., AND SEIDEL, H.-P. 2006. Cloth x-ray: Mocap of people wearing textiles. In LNCS 4174: Proc. DAGM, 495-504.
27. SAND, P., MCMILLAN, L., AND POPOVIĆ, J. 2003. Continuous capture of skin deformation. ACM TOG 22, 3.
28. SCHOLZ, V., STICH, T., KECKEISEN, M., WACKER, M., AND MAGNOR, M. 2005. Garment motion capture using color-coded patterns. Computer Graphics Forum (Proc. Eurographics EG'05) 24, 3 (Aug.), 439-448.
29. SHINYA, M. 2004. Unifying measured point sequences of deforming objects. In Proc. of 3DPVT, 904-911.
30. SORKINE, O., AND ALEXA, M. 2007. As-rigid-as-possible surface modeling. In Proc. SGP, 109-116.
31. STARCK, J., AND HILTON, A. 2007. Surface capture for performance based animation. IEEE CGAA 27(3), 21-31.
32. STOLL, C., KARNI, Z., RÖSSL, C., YAMAUCHI, H., AND SEIDEL, H.-P. 2006. Template deformation for point cloud fitting. In Proc. SGP, 27-35.
33. SUMNER, R. W., AND POPOVIĆ, J. 2004. Deformation transfer for triangle meshes. In SIGGRAPH '04, 399-405.
34. VEDULA, S., BAKER, S., AND KANADE, T. 2005. Image-based spatio-temporal modeling and view interpolation of dynamic events. ACM Trans. Graph. 24, 2, 240-261.
35. WAND, M., JENKE, P., HUANG, Q., BOKELOH, M., GUIBAS, L., AND SCHILLING, A. 2007. Reconstruction of deforming geometry from time-varying point clouds. In Proc. SGP, 49-58.
36. WASCHBÜSCH, M., WÜRMLIN, S., COTTING, D., SADLO, F., AND GROSS, M. 2005. Scalable 3D video of dynamic scenes. In Proc. Pacific Graphics, 629-638.
37. WHITE, R., CRANE, K., AND FORSYTH, D. 2007. Capturing and animating occluded cloth. In ACM TOG (Proc. SIGGRAPH).
38. WLLBURN, B., JOSHI, N., VAISH, V., TALVALA, E., ANTUNEZ, E., BARTH, A., ADAMS, A., HOROWITZ, M., AND LEVOY, M. 2005. High performance imaging using large camera arrays. ACM TOG 24, 3, 765-776.
39. XU, W., ZHOU, K., YU, Y., TAN, Q., PENG, Q., AND GUO, B. 2007. Gradient domain editing of deforming mesh sequences. In Proc. SIGGRAPH, ACM, 84ff.
40. YAMAUCHI, H., GUMHOLD, S., ZAYER, R., AND SEIDEL, H.-P. 2005. Mesh segmentation driven by gaussian curvature. Visual Computer 21, 8-10, 649-658.
41. ZITNICK, C. L., KANG, S. B., UYTTENDAELE, M., WINDER, S., AND SZELISKI, R. 2004. High-quality video view interpolation using a layered representation. ACM TOG 23, 3, 600-608.