Video-based reconstruction of animatable human characters

ACM Transactions on Graphics

Volumn 29, Issue 6, 2010, Pages

  Stoll, Carsten ^a   Gall, Juergen ^b   De Aguiar, Edilson ^c   Thrun, Sebastian ^d   Theobalt, Christian ^a  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^b ETH ZURICH   (Switzerland)

^c DISNEY RESEARCH   (United States)

^d STANFORD UNIVERSITY   (United States)

Author keywords

game characters; markerless motion capture; multi view reconstruction; performance capture

Indexed keywords

BODY PARTS; CHARACTER MODELS; CLOTH SIMULATION; GAME CHARACTERS; MANUAL INTERACTION; MARKERLESS MOTION CAPTURE; MULTI-VIEW RECONSTRUCTION; MULTIVIEW VIDEO; OPTICAL MARKERS; PERFORMANCE CAPTURE; PERFORMANCE DATA; PHYSICALLY-BASED SIMULATION; REAL-TIME ANIMATIONS; SKELETON MOTION; SURFACE GEOMETRIES; TIME VARYING; VIDEO SEQUENCES;

ALGORITHMS; ANIMATION; COMPUTATIONAL GEOMETRY; INTERACTIVE COMPUTER GRAPHICS; MOTION ESTIMATION; VIDEO RECORDING;

COMPUTER SIMULATION;

EID: 78650871131     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1866158.1866161     Document Type: Conference Paper

References (35)

1. ALLEN, B., CURLESS, B., POPOVIĆ, Z., AND HERTZMANN, A. 2006. Learning a correlated model of identity and pose-dependent body shape variation for real-time synthesis. In Proc. of SCA, 147-156.
2. ANGUELOV, D., SRINIVASAN, P., KOLLER, D., THRUN, S., RODGERS, J., AND DAVIS, J. 2005. SCAPE: Shape completion and animation of people. In ACM TOG (Proc. SIGGRAPH '05).
3. BALAN, A. O., AND BLACK, M. J. 2008. The naked truth: Estimating body shape under clothing. In ECCV (2), 15-29.
4. BARAN, I., AND POPOVIĆ, J. 2007. Automatic rigging and animation of 3d characters. ACM TOG (Proc. SIGGRAPH '07).
5. BHAT, K. S., TWIGG, C. D., HODGINS, J. K., KHOSLA, P. K., POPOVIĆ, Z. Z., AND SEITZ, S. M. 2003. Estimating cloth simulation parameters from video. In Proc. of SCA.
6. BRADLEY, D., POPA, T., SHEFFER, A., HEIDRICH, W., AND BOUBEKEUR, T. 2008. Markerless garment capture. ACM TOG (Proc. SIGGRAPH '08).
7. CARRANZA, J., THEOBALT, C., MAGNOR, M., AND SEIDEL, H.-P. 2003. Free-viewpoint video of human actors. In ACM TOG (Proc. SIGGRAPH '03).
8. CHOI, K.-J., AND KO, H.-S. 2005. Research problems in clothing simulation. Computer-Aided Design 37, 6, 585-592.
9. DE AGUIAR, E., THEOBALT, C., THRUN, S., AND SEIDEL, H.-P. 2008. Automatic conversion of mesh animations into skeleton-based animations. Proc. Eurographics EG'08.
10. DE AGUIAR, E., STOLL, C., THEOBALT, C., AHMED, N., SEIDEL, H.-P., AND THRUN, S. 2008. Performance capture from sparse multi-view video. In ACM TOG (Proc. SIGGRAPH'08).
11. GALL, J., STOLL, C., DE AGUIAR, E., THEOBALT, C., ROSENHAHN, B., AND SEIDEL, H.-P. 2009. Motion capture using simultaneous skeleton tracking and surface estimation. In Proc. IEEE CVPR.
12. HANSEN, N., NIEDERBERGER, A. S. P., GUZZELLA, L., AND KOUMOUTSAKOS, P. 2009. A method for handling uncertainty in evolutionary optimization with an application to feedback control of combustion. IEEE TEC 13, 1.
13. HASLER, N., STOLL, C., SUNKEL, M., ROSENHAHN, B., AND SEIDEL, H.-P. 2009. A statistical model of human pose and body shape. CGF (Proc. Eurographics 2009) 28, 2.
14. HASLER, N., STOLL, C., ROSENHAHN, B., THORMÄHLEN, T., AND SEIDEL, H.-P. 2009. Estimating body shape of dressed humans. Comput. Graph. 33, 3, 211-216.
15. JAMES, D. L., AND TWIGG, C. D. 2005. Skinning mesh animations. ACM TOG (Proc. SIGGRAPH'05).
16. KAVAN, L., COLLINS, S., ŽÁRA, J., AND O'SULLIVAN, C. 2007. Skinning with dual quaternions. In Symposium on Interactive 3D graphics and games, 39-46.
17. KAWABATA, S. 1980. The standardization and analysis of hand evaluation. Textile Machinery Society of Japan.
18. KIRCHER, S., AND GARLAND, M. 2006. Editing arbitrarily deforming surface animations. In ACM TOG (Proc. SIGGRAPH'06).
19. LOWE, D. G. 1999. Object recognition from local scale-invariant features. In Proc. ICCV, vol. 2, 1150ff.
20. MATUSIK, W., BUEHLER, C., RASKAR, R., GORTLER, S., AND MCMILLAN, L. 2000. Image-based visual hulls. In ACM TOG (Proc. SIGGRAPH'00).
21. MÜLLER, M., HEIDELBERGER, B., HENNIX, M., AND RATCLIFF, J. 2007. Position based dynamics. Journal Vis. Com..
22. PARK, S. I., AND HODGINS, J. K. 2008. Data-driven modeling of skin and muscle deformation. ACM TOG (Proc. SIGGRAPH'08).
23. POPA, T., ZHOU, Q., BRADLEY, D., KRAEVOY, V., FU, H., SHEFFER, A., AND HEIDRICH, W. 2009. Wrinkling captured garments using space-time data-driven deformation. Computer Graphics Forum (Proc. Eurographics) 28, 2.
24. POPPE, R. 2007. Vision-based human motion analysis: An overview. CVIU 108, 1-2, 4-18. (Pubitemid 47333391)
25. PRITCHARD, D., AND HEIDRICH, W. 2003. Cloth motion capture. In Proc. Eurographics EG'03.
26. SAND, P., MCMILLAN, L., AND POPOVIĆ, J. 2003. Continuous capture of skin deformation. ACM TOG (Proc. SIGGRAPH'03).
27. SCHOLZ, V., STICH, T., KECKEISEN, M., WACKER, M., AND MAGNOR, M. 2005. Garment motion capture using color-coded patterns. In Proc. Eurographics EG'05.
28. SHI, X., ZHOU, K., TONG, Y., DESBRUN, M., BAO, H., AND GUO, B. 2008. Example-based dynamic skinning in real time. ACM TOG (Proc. SIGGRAPH '08).
29. STARCK, J., AND HILTON, A. 2007. Surface capture for performance based animation. IEEE CGAA 27(3), 21-31. (Pubitemid 46767722)
30. VLASIC, D., BARAN, I., MATUSIK, W., AND POPOVIĆ, J. 2008. Articulated mesh animation from multi-view silhouettes. ACM TOG (Proc. SIGGRAPH '08).
31. VLASIC, D., PEERS, P., BARAN, I., DEBEVEC, P., POPOVÍC, J., RUSINKIEWICZ, S., AND MATUSIK, W. 2009. Dynamic shape capture using multi-view photometric stereo. In ACM TOG (Proc. SIGGRAPH Asia '09).
32. WASCHBÜSCH, M., WÜRMLIN, S., COTTING, D., SADLO, F., AND GROSS, M. 2005. Scalable 3D video of dynamic scenes. In Proc. Pacific Graphics, 629-638.
33. WHITE, R., CRANE, K., AND FORSYTH, D. 2007. Capturing and animating occluded cloth. In ACM TOG (Proc. SIGGRAPH'07).
34. XU, W., ZHOU, K., YU, Y., TAN, Q., PENG, Q., AND GUO, B. 2007. Gradient domain editing of deforming mesh sequences. In ACM TOG (Proc. SIGGRAPH '07).
35. ZITNICK, C. L., KANG, S. B., UYTTENDAELE, M., WINDER, S., AND SZELISKI, R. 2004. High-quality video view interpolation using a layered representation. ACM TOG (Proc. SIGGRAPH '04).