Capturing relightable human performances under general uncontrolled illumination

Computer Graphics Forum

Volumn 32, Issue 2 PART3, 2013, Pages 275-284

  Li, Guannan ^a   Wu, Chenglei ^b,c   Stoll, Carsten ^b   Liu, Yebin ^a   Varanasi, Kiran ^b   Dai, Qionghai ^a   Theobalt, Christian ^b  

^a TSINGHUA UNIVERSITY   (China)

^b MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^c INTEL CORPORATION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FREQUENCY DOMAIN ANALYSIS; GEOMETRY; REFLECTION;

FREE-VIEWPOINT VIDEO; ILLUMINATION CONDITIONS; LAMBERTIAN REFLECTANCE; LOW-FREQUENCY COMPONENTS; PERFORMANCE CAPTURE; SPHERICAL HARMONICS; TRACKING APPROACHES; UNCONTROLLED ILLUMINATION;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84877246231     PISSN: 01677055     EISSN: 14678659     Source Type: Journal    
DOI: 10.1111/cgf.12047     Document Type: Article

References (39)

1. Boivin S., Gagalowicz A.,: Image-based rendering of diffuse, specular and glossy surfaces from a single image. In Proc. SIGGRAPH (2001), ACM, pp. 107-116. 2.
2. Basri R., Jacobs D., Kemelmacher I.,: Photometric stereo with general unknown lighting. IJCV 72, 3 (2006), 239-257. 2.
3. Bradley D., Popa T., Sheffer A., Heidrich W., Boubekeur T.,: Markerless garment capture. ACM Trans. Graphics (Proc. SIGGRAPH) 27, 3 (2008), 99. 2.
4. Cagniart C., Boyer E., Ilic S.,: Free-form mesh tracking: a patch-based approach. In Proc. IEEE CVPR (2010). 2.
5. Carceroni R. L., Kutulakos K. N.,: Multi-view scene capture by surfel sampling: From video streams to non-rigid 3d motion, shape and reflectance. Int. J. Comput. Vision 49 (September 2002), 175-214. 2.
6. De Aguiar E., Stoll C., Theobalt C., Ahmed N., Seidel H.-P., Thrun S.,: Performance capture from sparse multi-view video. ACM TOG (Proc. of SIGGRAPH) 27 (2008), 1-10. 1,2,7.
7. Debevec P.,: A median cut algorithm for light probe sampling. ACM SIGGRAPH 2006 Courses (2006). 7.
8. Debevec P. E., Hawkins T., Tchou C., Duiker H.-P., Sarokin W., Sagar M.,: Acquiring the reflectance field of a human face. In SIGGRAPH (2000), pp. 145-156. 3.
9. Einarsson P., Chabert C.-F., Jones A., Ma W.-C., Lamond B., Im Hawkins, Bolas M., Sylwan S., Debevec P.,: Relighting human locomotion with flowed reflectance fields. In Proc. EGSR (2006), pp. 183-194. 2, 3.
10. Felzenszwalb P. F., Huttenlocher D. P.,: Efficient graph-based image segmentation. IJCV 59 (2004). 4.
11. Goldman D., Curless B., Hertzmann A., Seitz S.,: Shape and spatially-varying brdfs from photometric stereo. In ICCV (oct 2005), vol. 1, pp. 341-348. 2.
12. Georghiades A. S.,: Recovering 3-d shape and reflectance from a small number of photographs. In Proc. EGSR (2003), EGRW '03, Eurographics Association, pp. 230-240. 2.
13. Gall J., Stoll C., Aguiar E., Theobalt C., Rosenhahn B., Seidel H.-P.,: Motion capture using joint skeleton tracking and surface estimation. In Proc. IEEE CVPR (2009), pp. 1746-1753. 1, 2, 3, 9.
14. Haber T., Fuchs C., Bekaert P., Seidel H.-P., Goesele M., Lensch H. P. A.,: Relighting objects from image collections. In Proc. IEEE CVPR (2009), pp. 627-634. 3, 4.
15. Hernandez C., Vogiatzis G., Brostow G. J., Stenger B., Cipolla R.,: Non-rigid photometric stereo with colored lights. In Proc. ICCV (2007), pp. 1-8. 2.
16. Kajiya J. T.,: The rendering equation. In Proc. SIGGRAPH (1986), ACM, pp. 143-150. 4.
17. Li C.,: An Efficient Algorithm for Total Variation Regularization with Applications to the Single Pixel Camera and Compressive Sensing. BiblioBazaar, 2011. 5.
18. Lensch H. P. A., Kautz J., Goesele M., Heidrich W., Seidel H.-P.,: Image-based reconstruction of spatial appearance and geometric detail. ACM TOG 22, 2 (2003), 234-257. 2, 6.
19. Matusik W., Buehler C., Raskar R., Gortler S. J., McMillan L.,: Image-based visual hulls. In SIGGRAPH (2000), pp. 369-374. 1, 2.
20. Matusik W., Pfister H., Brand M., McMillan L.,: A data-driven reflectance model. ACM TOG 22, 3 (2003), 759-769. 2.
21. Matusik W., Pfister H., Ngan A., Beardsley P. A., Ziegler R., McMillan L.,: Image-based 3d photography using opacity hulls. ACM TOG 21, 3 (2002), 427-437. 2.
22. Ng R., Ramamoorthi R., Hanrahan P.,: Triple product wavelet integrals for all-frequency relighting. ACM TOG 23, 3 (2004), 477-487. 3, 5.
23. Ramamoorthi R., Hanrahan P.,: An efficient representation for irradiance environment maps. In SIGGRAPH (2001), pp. 497-500. 3.
24. Ramamoorthi R., Hanrahan P.,: A signal-processing framework for inverse rendering. In SIGGRAPH (2001), ACM, pp. 117-128. 2, 3, 5.
25. Stoll C., Gall J., De Aguiar E., Thrun S., Theobalt C.,: Video-based reconstruction of animatable human characters. ACM TOG (Proc. SIGGRAPH Asia) 29 (2010), 139:1-139:10. 1.
26. Starck J., Hilton A.,: Surface capture for performance based animation. IEEE Computer Graphics and Applications 27(3) (2007), 21-31. 1, 2.
27. Sato Y., Wheeler M. D., Ikeuchi K.,: Object shape and reflectance modeling from observation. In SIGGRAPH (1997), pp. 379-387. 2.
28. Szeliski R., Zabih R., Scharstein D., Veksler O., Kolmogorov V., Agarwala A., Tappen M., Rother C.,: A comparative study of energy minimization methods for markov random fields with smoothness-based priors. IEEE PAMI 30 (June 2008), 1068-1080. 4.
29. Theobalt C., Ahmed N., Lensch H. P. A., Magnor M. A., Seidel H.-P.,: Seeing people in different light-joint shape, motion, and reflectance capture. IEEE TVCG 13, 4 (2007), 663-674. 2, 4.
30. Vlasic D., Baran I., Matusik W., Popovic̈ J.,: Articulated mesh animation from multi-view silhouettes. ACM TOG (Proc. SIGGRAPH '08) (2008). 1, 2.
31. Vlasic D., Peers P., Baran I., Debevec P., Popovic J., Rusinkiewicz S., Matusik W.,: Dynamic shape capture using multi-view photometric stereo. ACM TOG 28, 5 (2009), 174. 2.
32. Wenger A., Gardner A., Tchou C., Unger J., Hawkins T., Debevec P.,: Performance relighting and reflectance transformation with time-multiplexed illumination. ACM TOG 24, 3 (July 2005), 756-764. 3.
33. Wu C., Varanasi K., Liu Y., Seidel H.-P., Theobalt C.,: Shading-based dynamic shape refinement from multi-view video under general illumination. In Proc. IEEE ICCV (2011). 2, 3, 4, 8.
34. Wu C., Varanasi K., Theobalt C.,: Full body performance capture under uncontrolled and varying illumination: A shading-based approach. In ECCV (4)'12 (2012), pp. 757-770. 2.
35. Waschbüsch M., Würmlin S., Cotting D., Sadlo F., Gross M.,: Scalable 3D video of dynamic scenes. In Proc. Pacific Graphics (2005), pp. 629-638. 2.
36. Wu C., Wilburn B., Matsushita Y., Theobalt C.,: High-quality shape from multi-view stereo and shading under general illumination. In Proc. IEEE CVPR (2011), pp. 969-976. 2.
37. Yu Y., Debevec P., Malik J., Hawkins T.,: Inverse global illumination: recovering reflectance models of real scenes from photographs. In SIGGRAPH (1999), pp. 215-224. 2, 6.
38. Yu Y., Malik J.,: Recovering photometric properties of architectural scenes from photographs. In Proc. SIGGRAPH (1998), SIGGRAPH '98, ACM, pp. 207-217. 2.
39. Yoon K.-J., Prados E., Sturm P.,: Joint estimation of shape and reflectance using multiple images with known illumination conditions. IJCV 86, 2-3 (2010), 192-210. 2.