Efficient multi-view performance capture of fine-scale surface detail

Proceedings - 2014 International Conference on 3D Vision, 3DV 2014

Volumn , Issue , 2015, Pages 5-12

  Robertini, Nadia ^a,b   De Aguiar, Edilson ^a,c   Helten, Thomas ^a,d   Theobalt, Christian ^a  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^b Intel VCI   (Germany)

^c FEDERAL UNIVERSITY OF ESPÍRITO SANTO   (Brazil)

^d GoalControl   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

DEFORMATION; MESH GENERATION; REPAIR;

GAUSSIAN FUNCTIONS; IMPLICIT REPRESENTATION; OCCLUSION HANDLING; PERFORMANCE CAPTURE; PHOTO-CONSISTENCY; PROBLEM FORMULATION; SURFACE DISPLACEMENT; TEMPLATE BASED METHODS;

STEREO IMAGE PROCESSING;

EID: 84925329402     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/3DV.2014.46     Document Type: Conference Paper

References (23)

1. L. Ballan and G. M. Cortelazzo. Marker-less motion capture of skinned models in a four camera set-up using optical flow and silhouettes. In 3DPVT, June 2008.
2. D. Bradley, T. Popa, A. Sheffer, W. Heidrich, and T. Boubekeur. Markerless garment capture. ACM Trans. Graph., 27(3):19, 2008.
3. C. Cagniart, E. Boyer, and S. Ilic. Free-form mesh tracking: a patch-based approach. In Proc. IEEE CVPR, 2010.
4. J. Carranza, C. Theobalt, M. Magnor, and H.-P. Seidel. Freeviewpoint video of human actors. In ACM TOG (Proc. SIGGRAPH '03), page 22, 2003.
5. E. de Aguiar, C. Stoll, C. Theobalt, N. Ahmed, H.-P. Seidel, and S. Thrun. Performance capture from sparse multi-view video. ACM Trans. Graph., 27(3), 2008.
6. J. Gall, C. Stoll, E. Aguiar, C. Theobalt, B. Rosenhahn, and H.-P. Seidel. Motion capture using joint skeleton tracking and surface estimation. In Proc. IEEE CVPR, pages 1746-1753, 2009.
7. J. Gall, C. Stoll, E. de Aguiar, C. Theobalt, B. Rosenhahn, and H. Seidel. Motion capture using joint skeleton tracking and surface estimation. In IEEE Conference on Computer Vision and Pattern Recognition, 2009.
8. C. Hernandez, G. Vogiatzis, G. J. Brostow, B. Stenger, and R. Cipolla. Non-rigid photometric stereo with colored lights. In Proc. ICCV, pages 1-8, 2007.
9. K. Kolev, M. Klodt, T. Brox, and D. Cremers. Continuous global optimization in multiview 3d reconstruction. International Journal of Computer Vision, 84(1):80-96, 2009.
10. Y. Liu, J. Gall, C. Stoll, Q. Dai, H.-P. Seidel, and C. Theobalt. Markerless motion capture of multiple characters using multiview image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(11):2720-2735, 2013.
11. W. Matusik, C. Buehler, R. Raskar, S. J. Gortler, and L. McMillan. Image-based visual hulls. In SIGGRAPH, pages 369-374, 2000.
12. P. Sand, L. McMillan, and J. Popović. Continuous capture of skin deformation. ACM TOG, 22(3):578-586, July 2003.
13. Y. Savoye. Iterative cage-based registration from multi-view silhouettes. In Proceedings of the 10th European Conference on Visual Media Production, CVMP '13, pages 8:1- 8:10. ACM, 2013.
14. J. Starck and A. Hilton. Surface capture for performancebased animation. IEEE Computer Graphics and Applications, 27(3):2131, 2007.
15. C. Stoll, N. Hasler, J. Gall, H.-P. Seidel, and C. Theobalt. Fast articulated motion tracking using a sums of gaussians body model. In D. N. Metaxas, L. Quan, A. Sanfeliu, and L. J. V. Gool, editors, ICCV, pages 951-958. IEEE, 2011.
16. C. Theobalt, E. de Aguiar, C. Stoll, H.-P. Seidel, and S. Thrun. Performance capture from multi-view video. In R. Ronfard and G. Taubin, editors, Image and Geometry Procesing for 3D-Cinematography, page 127ff. Springer, 2010.
17. T. Tung, S. Nobuhara, and T. Matsuyama. Complete multiview reconstruction of dynamic scenes from probabilistic fusion of narrow and wide baseline stereo. In Proc. IEEE ICCV, pages 1709 -1716, 2009.
18. D. Vlasic, I. Baran, W. Matusik, and J. Popović. Articulated mesh animation from multi-view silhouettes. ACM TOG (Proc. SIGGRAPH), 2008.
19. D. Vlasic, P. Peers, I. Baran, P. Debevec, J. Popović, S. Rusinkiewicz, and W. Matusik. Dynamic shape capture using multi-view photometric stereo. In ACM TOG (Proc. SIGGRAPH Asia '09), 2009.
20. M. Waschbüsch, S. Würmlin, D. Cotting, F. Sadlo, and M. Gross. Scalable 3D video of dynamic scenes. In Proc. Pacific Graphics, pages 629-638, 2005.
21. C.Wu, Y. Liu, Q. Dai, and B.Wilburn. Fusing multiview and photometric stereo for 3d reconstruction under uncalibrated illumination. IEEE TVCG, 17(8):1082-1095, 2011.
22. C. Wu, K. Varanasi, Y. Liu, H.-P. Seidel, and C. Theobalt. Shading-based dynamic shape refinement from multi-view video under general illumination. In Proc. iCCV, ICCV '11, pages 1108-1115. IEEE, 2011.
23. C. L. Zitnick, S. B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski. High-quality video view interpolation using a layered representation. ACM Trans. Graph., 23(3):600-608, Aug. 2004.