Video-based characters - Creating new human performances from a multi-view video database

ACM Transactions on Graphics

Volumn 30, Issue 4, 2011, Pages

  Xu, Feng ^a   Liu, Yebin ^c   Stoll, Carsten ^c   Tompkin, James ^b   Bharaj, Gaurav ^c   Dai, Qionghai ^a   Seidel, Hans Peter ^c   Kautz, Jan ^b   Theobalt, Christian ^c  

^a TSINGHUA UNIVERSITY   (China)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BODY MOTIONS; CAMERA VIEW; DATABASE CONTENTS; HUMAN PERFORMANCE; HUMAN SKELETON; KEY COMPONENT; MULTIVIEW VIDEO; PERFORMANCE CAPTURE; RETRIEVAL STRATEGIES; SHOW THROUGH; SYNTHESIS ALGORITHMS; TARGET MOTIONS; TEXTURE SYNTHESIS; USER STUDY; VIDEO FRAME; VIDEO SEQUENCES;

INTERACTIVE COMPUTER GRAPHICS; VIDEO RECORDING;

DATABASE SYSTEMS;

EID: 80051867136     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1964921.1964927     Document Type: Article

References (41)

1. BALLAN, L., AND CORTELAZZO, G. M. 2008. Marker-less motion capture of skinned models in a four camera set-up using optical flow and silhouettes. In 3DPVT.
2. BALLAN, L., BROSTOW, G. J., PUWEIN, J., AND POLLEFEYS, M. 2010. Unstructured video-based rendering: Interactive exploration of casually captured videos. ACM TOG (Proc. SIGGRAPH), 1-11.
3. BARAN, I., AND POPOVIC, J. 2007. Automatic rigging and animation of 3d characters. ACM TOG (SIGGRAPH) 26, 3, 72.
4. BRADLEY, D., POPA, T., SHEFFER, A., HEIDRICH, W., AND BOUBEKEUR, T. 2008. Markerless garment capture. ACM TOG (Proc. SIGGRAPH) 27, 3, 99.
5. BUEHLER, C., BOSSE, M., MCMILLAN, L., GORTLER, S., AND COHEN, M. 2001. Unstructured lumigraph rendering. In SIGGRAPH, 425-432. (Pubitemid 33047329)
6. CAGNIART, C., BOYER, E., AND ILIC, S. 2010. Free-form mesh tracking: a patch-based approach. In Proc. IEEE CVPR, 1-8.
7. CARRANZA, J., THEOBALT, C., MAGNOR, M., AND SEIDEL, H.- P. 2003. Free-viewpoint video of human actors. In ACM TOG (Proc. SIGGRAPH).
8. CELLY, B., AND ZORDAN, V. 2004. Animated people textures. In Proc. of CASA, 331-338.
9. CHEUNG, G. 2003. Visual Hull Construction, Alignment and Refinement for Human Kinematic Modeling, Motion Capture and Rendering. PhD thesis, Carnegie Mellon University.
10. COBZAS, D., YEREX, K., AND JAGERSAND, M. 2002. Dynamic textures for image-based rendering of fine-scale 3d structure and animation of non-rigid motion. In In Eurographics, 1067-7055.
11. DE AGUIAR, E., STOLL, C., THEOBALT, C., AHMED, N., SEIDEL, H.-P., AND THRUN, S. 2008. Performance capture from sparse multi-view video. ACM TOG (SIGGRAPH) 27, 1-10.
12. DEBEVEC, P. E., TAYLOR, C. J., AND MALIK, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In SIGGRAPH, 11-20.
13. EINARSSON, P., CHABERT, C.-F., JONES, A., MA, W.-C., LAMOND, B., IM HAWKINS, BOLAS, M., SYLWAN, S., AND DEBEVEC, P. 2006. Relighting human locomotion with flowed reflectance fields. In Proc. EGSR, 183-194.
14. FLAGG, M., NAKAZAWA, A., ZHANG, Q., KANG, S. B., RYU, Y. K., ESSA, I., AND REHG, J. M. 2009. Human video textures. In Proc. of I3D, 199-206.
15. GALL, J., STOLL, C., AGUIAR, E., THEOBALT, C., ROSENHAHN, B., AND SEIDEL, H.-P. 2009. Motion capture using joint skeleton tracking and surface estimation. In Proc. IEEE CVPR, 1746-1753.
16. GLEICHER, M. 1998. Retargetting motion to new characters. In SIGGRAPH'98, 33-42.
17. HORNUNG, A., AND KOBBELT, L. 2009. Interactive pixelaccurate free viewpoint rendering from images with silhouette aware sampling. Comput. Graph. Forum 28, 8, 2090-2103.
18. HORNUNG, A., DEKKERS, E., AND KOBBELT, L. 2007. Character animation from 2d pictures and 3d motion data. ACM TOG 26, 1, 1:1-1:9.
19. HUANG, P., HILTON, A., AND STARCK, J. 2009. Human motion synthesis from 3d video. In Proc. CVPR, 1478-1485.
20. JAIN, A., THORMÄHLEN, T., SEIDEL, H.-P., AND THEOBALT, C. 2010. Moviereshape: tracking and reshaping of humans in videos. ACM TOG (Proc. SIGGRAPH Asia) 29, 148:1-148:10.
21. JIMENEZ, J., SCULLY, T., BARBOSA, N., DONNER, C., ALVAREZ, X., VIEIRA, T., MATTS, P., ORVALHO, V., GUTIERREZ, D., AND WEYRICH, T. 2010. A practical appearance model for dynamic facial color. ACM TOG (Proc. SIGGRAPH Asia) 29, 141:1-141:10.
22. KEMELMACHER-SHLIZERMAN, I., SANKAR, A., SHECHTMAN, E., AND SEITZ, S. M. 2010. Being john malkovich. In Proc. Of ECCV, 341-353.
23. LEYVAND, T., COHEN-OR, D., DROR, G., AND LISCHINSKI, D. 2008. Data-driven enhancement of facial attractiveness. ACM TOG (Proc. SIGGRAPH) 27, 3, 38:1-38:9.
24. MATUSIK, W., BUEHLER, C., RASKAR, R., GORTLER, S. J., AND MCMILLAN, L. 2000. Image-based visual hulls. SIGGRAPH '00, 369-374. (Pubitemid 32394001)
25. MORI, G., BERG, A., EFROS, A., EDEN, A., AND MALIK, J. 2004. Video based motion synthesis by splicing and morphing. UC Berkeley Technical Reports, No. UCB/CSD-4-1337.
26. NARAYANAN, P. J., RANDER, P., AND KANADE, T. 1998. Constructing virtual worlds using dense stereo. In Proc. of ICCV, 3-10.
27. SCHAEFER, S., MCPHAIL, T., AND WARREN, J. D. 2006. Image deformation using moving least squares. ACM TOG (Proc. SIGGRAPH) 25, 3, 533-540. (Pubitemid 44481012)
28. SCHÖDL, A., AND ESSA, I. 2002. Controlled animation of video sprites. In Proc. of SCA, 121-127.
29. SCHÖDL, A., SZELISKI, R., SALESIN, D. H., AND ESSA, I. 2000. Video textures. In SIGGRAPH, 489-498. (Pubitemid 32394013)
30. STARCK, J., MILLER, G., AND HILTON, A. 2005. Video-based character animation. In Proc. of SCA, 49-58.
31. STICH, T., LINZ, C., ALBUQUERQUE, G., AND MAGNOR, M. 2008. View and Time Interpolation in Image Space. Computer Graphics Forum (Proc. Pacific Graphics) 27, 7.
32. STOLL, C., GALL, J., DE AGUIAR, E., THRUN, S., AND THEOBALT, C. 2010. Video-based reconstruction of animatable human characters. ACM TOG (Proc. SIGGRAPH Asia) 29, 139:1-139:10.
33. THEOBALT, C., WUERMLIN, S., DE AGUIAR, E., AND NIEDERBERGER, C. 2007. New trends in 3d video. In Eurographics Courses.
34. TUNG, T., NOBUHARA, S., AND MATSUYAMA, T. 2009. Complete multi-view reconstruction of dynamic scenes from probabilistic fusion of narrow and wide baseline stereo. In Proc. IEEE ICCV, 1709-1716.
35. VLASIC, D., BARAN, I., MATUSIK, W., AND POPOVIć , J. 2008. Articulated mesh animation from multi-view silhouettes. ACM TOG (Proc. SIGGRAPH '08).
36. VLASIC, D., PEERS, P., BARAN, I., DEBEVEC, P., POPOVIĆ , J., RUSINKIEWICZ, S., AND MATUSIK, W. 2009. Dynamic shape capture using multi-view photometric stereo. In ACM TOG (Proc. SIGGRAPH Asia '09).
37. WASCHBÜSCH, M., WÜRMLIN, S., AND GROSS, M. 2006. Interactive 3d video editing. Vis. Comput. 22, 631-641. (Pubitemid 44371171)
38. WEYRICH, T., PFISTER, H., AND GROSS, M. 2005. Rendering deformable surface reflectance fields. IEEE TVCG 11, 48-58. (Pubitemid 40168681)
39. WILBURN, B., JOSHI, N., VAISH, V., TALVALA, E.-V., ANTUNEZ, E., BARTH, A., ADAMS, A., HOROWITZ, M., AND LEVOY, M. 2005. High performance imaging using large camera arrays. ACM TOG (Proc. SIGGRAPH) 24, 765-776.
40. ZHOU, S., FU, H., LIU, L., COHEN-OR, D., AND HAN, X. 2010. Parametric reshaping of human bodies in images. ACM TOG (Proc. SIGGRAPH) 29, 4, 126:1-126:10.
41. ZITNICK, C. L., KANG, S. B., UYTTENDAELE, M., WINDER, S. A. J., AND SZELISKI, R. 2004. High-quality video view interpolation using a layered representation. ACM TOG (Proc. SIGGRAPH) 23, 3, 600-608.