Full body performance capture under uncontrolled and varying illumination: A shading-based approach

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7575 LNCS, Issue PART 4, 2012, Pages 757-770

  Wu, Chenglei ^a,b   Varanasi, Kiran ^a   Theobalt, Christian ^a  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^b Intel Visual Computing Institute   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICULATED MOTION; BACKGROUND SEGMENTATION; FULL BODY; HUMAN PERFORMANCE; INCIDENT ILLUMINATION; LAMBERTIAN MODEL; LIGHTING CONDITIONS; MULTI-VIEW IMAGE; PERFORMANCE CAPTURE; SURFACE DETAILS; TIME STEP; TRAINING DATA; VISIBLE IMAGE;

LIGHTING;

COMPUTER VISION;

EID: 84867885706     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-33765-9_54     Document Type: Conference Paper

References (28)

1. Bregler, C., Malik, J., Pullen, K.: Twist based acquisition and tracking of animal and human kinematics. IJCV 56(3), 179-194 (2004)
2. Sidenbladh, H., Black, M.J., Fleet, D.J.: Stochastic Tracking of 3D Human Figures Using 2D Image Motion. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1843, pp. 702-718. Springer, Heidelberg (2000)
3. Deutscher, J., Blake, A., Reid, I.: Articulated body motion capture by annealed particle filtering. In: CVPR, pp. 1144-1149 (2000)
4. Balan, A., Sigal, L., Black, M., Davis, J., Haussecker, H.: Detailed human shape and pose from images. In: CVPR (2007)
5. Sigal, L., Balan, A., Black, M.: Humaneva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion. IJCV 87, 4-27 (2010)
6. Stoll, C., Hasler, N., Gall, J., Seidel, H.P., Theobalt, C.: Fast articulated motion tracking using a sums of gaussians body model. In: ICCV (2011)
7. Poppe, R.: Vision-based human motion analysis: An overview. CVIU 108(1-2) (2007)
8. Raskar, R., Nii, H., de Decker, B., Hashimoto, Y., Summet, J., Moore, D., Zhao, Y., Westhues, J., Dietz, P., Barnwell, J., Nayar, S., Inami, M., Bekaert, P., Noland, M., Branzoi, V., Bruns, E.: Prakash: lighting aware motion capture using photosensing markers and multiplexed illuminators. ACM Trans. Graph. 26 (July 2007)
9. Vlasic, D., Baran, I., Matusik, W., Popovic, J.: Articulated mesh animation from multi-view silhouettes. ACM TOG (Proc. SIGGRAPH), 97:1-97:9 (2008)
10. de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.P., Thrun, S.: Performance capture from sparse multi-view video. In: Proc. SIGGRAPH (2008)
11. Cagniart, C., Boyer, E., Ilic, S.: Free-form mesh tracking: a patch-based approach. In: CVPR (2010)
12. Starck, J., Hilton, A.: Surface capture for performance based animation. IEEE Computer Graphics and Applications 27(3), 21-31 (2007)
13. Gall, J., Stoll, C., de Aguiar, E., Theobalt, C., Rosenhahn, B., Seidel, H.P.: Motion capture using joint skeleton and surface estimation. In: CVPR (2009)
14. Moeslund, T., Hilton, A., Krüger, V.: A survey of advances in vision-based human motion capture and analysis. CVIU 104(2), 90-126 (2006)
15. Li, R., Tian, T.P., Sclaroff, S., Yang, M.H.: 3D human motion tracking with a coordinated mixture of factor analyzers. IJCV 87, 170-190 (2010)
16. Lee, C.S., Elgammal, A.: Coupled visual and kinematic manifold models for tracking. IJCV 87, 118-139 (2010)
17. Bo, L., Sminchisescu, C.: Twin gaussian processes for structured prediction. IJCV 87, 28-52 (2010)
18. Hasler, N., Rosenhahn, B., Thormählen, T., Wand,M., Gall, J., Seidel,H.P.: Markerless motion capture with unsynchronized moving cameras. In: CVPR (2009)
19. Liu, Y., Stoll, C., Gall, J., Seidel, H.P., Theobalt, C.: Markerless motion capture of interacting characters using multi-view image segmentation. In: CVPR (2011)
20. Hernandez, C., Vogiatzis, G., Cipolla, R.: Multiview photometric stereo. IEEE TPAMI 30(3), 548-554 (2008)
21. Wenger, A., Gardner, A., Tchou, C., Unger, J., Hawkins, T., Debevec, P.: Performance relighting and reflectance transformation with time-multiplexed illumination. ACM TOG (Proc. SIGGRAPH) 24(3), 756-764 (2005)
22. Vlasic, D., Peers, P., Baran, I., Debevec, P., Popovic, J., Rusinkiewicz, S., Matusik, W.: Dynamic shape capture using multi-view photometric stereo. ACM TOG (Proc. SIGGRAPH) 28(5), 174 (2009)
23. Popa, T., South-Dickinson, I., Bradley, D., Sheffer, A., Heidrich, W.: Globally consistent space-time reconstruction. In: SGP (2010)
24. Wilson, C., Ghosh, A., Peers, P., Chiang, J.Y., Busch, J., Debevec, P.: Temporal upsampling of performance geometry using photometric alignment. ACM TOG (Proc. SIGGRAPH) 29(2) (March 2010)
25. Wu, C., Varanasi, K., Liu, Y., Seidel, H.P., Theobalt, C.: Shading-based dynamic shape refinement from multi-view video under general illumination. In: ICCV (2011)
26. Zhang, L., Curless, B., Hertzmann, A., Seitz, S.: Shape and motion under varying illumination: unifying structure from motion, photometric stereo, and multiview stereo. In: ICCV, vol. 1, pp. 618-625 (October 2003)
27. Kajiya, J.T.: The rendering equation. In: Proc. ACM SIGGRAPH 20(4) (1986)
28. Kavan, L., Collins, S., Žára, J., O'Sullivan, C.: Skinning with dual quaternions. In: Symposium on Interactive 3D Graphics and Games, pp. 39-46 (2007)