Dynamic shape capture using multi-view photometric stereo

ACM Transactions on Graphics

Volumn 28, Issue 5, 2009, Pages

  Vlasic, Daniel ^a   Peers, Pieter ^b   Baran, Ilya ^a   Debevec, Paul ^b   Popović, Jovan ^a,c,d   Rusinkiewicz, Szymon ^c,e   Matusik, Wojciech ^c  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b Institute for Creative Technologies ^*  (United States)

^c ADOBE RESEARCH   (United States)

^d UNIVERSITY OF WASHINGTON   (United States)

^e PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

3D GEOMETRY; ACTIVE SHAPE; HIGH RESOLUTION; HUMAN-SIZE; LIGHTING CONFIGURATIONS; LOW-FREQUENCY DEFORMATION; MULTI-VIEWS; MULTIPLE VIEWS; NORMAL MAPS; PHOTOMETRIC STEREO; TEMPORAL RESOLUTION; THIN PLATE SPLINE; VOLUMETRIC METHODS; WORKING VOLUME;

DEFORMATION; LIGHTING; PHOTOMETRY;

INTERACTIVE COMPUTER GRAPHICS;

EID: 77749295420     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1661412.1618520     Document Type: Conference Paper

References (51)

1. AHMED, N., THEOBALT, C., DOBRE, P., SEIDEL, H.-P., AND THRUN, S. 2008. Robust fusion of dynamic shape and normal capture for high-quality reconstruction of time-varying geometry. In Computer Vision and Pattern Recognition, 1-8.
2. ANGUELOV, D., SRINIVASAN, P., KOLLER, D., THRUN, S., RODGERS, J., AND DAVIS, J. 2005. Scape: Shape Completion and Animation of People. ACM Transactions on Graphics 24, 3 (Aug.), 408-416.
3. BALAN, A. O., SIGAL, L., BLACK, M. J., DAVIS, J. E., AND HAUSSECKER, H. W. 2007. Detailed human shape and pose from images. In Computer Vision and Pattern Recognition.
4. BERNARDINI, F., RUSHMEIER, H., MARTIN, I. M., MITTLEMAN, J., AND TAUBIN, G. 2002. Building a digital model of michelangelo's florentine pietà. IEEE Computer Graphics & Applications 22, 1 (Jan./Feb.), 59-67.
5. BRADLEY, D., POPA, T., SHEFFER, A., HEIDRICH, W., AND BOUBEKEUR, T. 2008. Markerless garment capture. ACM Transactions on Graphics 27, 3 (Aug.), 99.
6. BROX, T., BRUHN, A., PAPENBERG, N., AND WEICKERT, J. 2004. High accuracy optical flow estimation based on a theory for warping. In Proceedings of the 8th European Conference on Computer Vision, 25-36.
7. CAMPBELL, N., VOGIATZIS, G., HERNANDEZ, C., AND CIPOLLA, R. 2007. Automatic 3d object segmentation in multiple views using volumetric graph-cuts. In British Machine Vision Conference.
8. CARRANZA, J., THEOBALT, C., MAGNOR, M. A., AND SEIDEL, H.-P. 2003. Free-viewpoint video of human actors. ACM Transactions on Graphics 22, 3 (July), 569-577.
9. CHANG, W., AND ZWICKER, M. 2008. Automatic registration for articulated shapes. Computer Graphics Forum (Proceedings of SGP 2008) 27, 5, 1459-1468.
10. CORAZZA, S., MÜNDERMANN, L., CHAUDHARI, A., DEMATTIO, T., COBELLI, C., AND ANDRIACCHI, T. P. 2006. A markerless motion capture system to study musculoskeletal biomechanics: Visual hull and simulated annealing approach. Annals of Biomedical Engineering 34, 6 (July), 1019-1029.
11. CRIMINISI, A., BLAKE, A., ROTHER, C., SHOTTON, J., AND TORR, P. H. 2007. Efficient dense stereo with occlusions for new view-synthesis by four-state dynamic programming. Int. Journal of Computer Vision 71, 1, 89-110.
12. CURLESS, B., AND LEVOY, M. 1996. A volumetric method for building complex models from range images. In Proceedings of SIGGRAPH 96, Computer Graphics Proceedings, Annual Conference Series, 303-312.
13. DAVIS, J., MARSCHNER, S. R., GARR, M., AND LEVOY, M. 2002. Filling holes in complex surfaces using volumetric diffusion. In Symposium on 3D Data Processing, Visualization, and Transmission, 428-438.
14. DAVIS, J., RAMAMOORTHI, R., AND RUSINKIEWICZ, S. 2005. Spacetime stereo: A unifying framework for depth from triangulation. In IEEE Transactions on Pattern Analysis and Machine Intelligence, 196-302.
15. DE AGUIAR, E., THEOBALT, C., STOLL, C., AND SEIDEL, H.-P. 2007. Marker-less deformable mesh tracking for human shape and motion capture. In Computer Vision and Pattern Recognition.
16. DE AGUIAR, E., STOLL, C., THEOBALT, C., AHMED, N., SEIDEL, H.-P., AND THRUN, S. 2008. Performance capture from sparse multi-view video. ACM Transactions on Graphics 27, 3 (Aug.), 98.
17. EINARSSON, P., CHABERT, C.-F., JONES, A., MA, W.-C., LAMOND, B., HAWKINS, T., BOLAS, M., SYLWAN, S., AND DEBEVEC, P. 2006. Relighting human locomotion with flowed reflectance fields. In Proc. of Eurographics Symposium on Rendering, 183-194.
18. FURUKAWA, Y., AND PONCE, J. 2006. Carved visual hulls for image-based modeling. In European Conference on Computer Vision, 564-577.
19. HERNANDEZ, C., AND SCHMITT, F. 2004. Silhouette and stereo fusion for 3D object modeling. Computer Vision and Image Understanding 96, 3 (Dec.), 367-392.
20. HERNANDEZ, C., VOGIATZIS, G., AND CIPOLLA, R. 2008. Multiview photometric stereo. IEEE Trans. Pattern Anal. Mach. Intell. 30, 3, 548-554.
21. HERTZMANN, A., AND SEITZ, S. M. 2005. Example-based photometric stereo: Shape reconstruction with general, varying brdfs. IEEE Trans. Pattern Anal. Mach. Intell. 27, 8, 1254-1264.
22. HORNUNG, A., AND KOBBELT, L. 2006. Hierarchical volumetric multi-view stereo reconstruction of manifold surfaces based on dual graph embedding. In Computer Vision and Pattern Recognition, 503-510.
23. HUANG, Q.-X., ADAMS, B., WICKE, M., AND GUIBAS, L. J. 2008. Non-rigid registration under isometric deformations. Computer Graphics Forum (Proc. SGP'08) 27, 5, 1449-1457.
24. JOSHI, N., AND KRIEGMAN, D. 2007. Shape from varying illumination and viewpoint. In International Conference on Computer Vision.
25. KAZHDAN, M., BOLITHO, M., AND HOPPE, H. 2006. Poisson surface reconstruction. In Symposium on Geometry Processing.
26. LI, H., SUMNER, R. W., AND PAULY, M. 2008. Global correspondence optimization for non-rigid registration of depth scans. Computer Graphics Forum 27, 5, 1421-1430.
27. LIM, J., HO, J., YANG, M.-J., AND KRIEGMAN, D. 2005. Passive photometric stereo from motion. In International Conference on Computer Vision.
28. MA, W.-C., HAWKINS, T., PEERS, P., CHABERT, C.-F., WEISS, M., AND DEBEVEC, P. 2007. Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination. In Rendering Techniques, 183-194.
29. MITRA, N. J., FLORY, S., OVSJANIKOV, M., GELFAND, N., GUIBAS, L., AND POTTMANN, H. 2007. Dynamic geometry registration. In Proc. Symposium on Geometry Processing, 173-182.
30. NEHAB, D., RUSINKIEWICZ, S., DAVIS, J., AND RAMAMOORTHI, R. 2005. Efficiently combining positions and normals for precise 3d geometry. ACM Transactions on Graphics 24, 3 (Aug.), 536-543.
31. OKUTOMI, M., AND KANADE, T. 1993. A multiple-baseline stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence 15, 4, 353-363.
32. PEKELNY, Y., AND GOTSMAN, C. 2008. Articulated object reconstruction and markerless motion capture from depth video. Computer Graphics Forum 27, 2 (Apr.), 399-408.
33. RANDER, P. W., NARAYANAN, P., AND KANADE, T. 1997. Virtualized reality: Constructing time-varying virtual worlds from real world events. In IEEE Visualization, 277-284.
34. RUSINKIEWICZ, S., HALL-HOLT, O., AND LEVOY, M. 2002. Real-time 3D model acquisition. ACM Transactions on Graphics 21, 3 (July), 438-446.
35. SAGAWA, R., OSAWA, N., AND YAGI, Y. 2007. Deformable registration of textured range images by using texture and shape features. In 3DIM '07: Proceedings of the Sixth International Conference on 3-D Digital Imaging and Modeling, 65-72.
36. SEITZ, S. M., AND DYER, C. R. 1999. Photorealistic scene reconstruction by voxel coloring. International Journal of Computer Vision 35, 2, 151-173.
37. SEITZ, S. M., CURLESS, B., DIEBEL, J., SCHARSTEIN, D., AND SZELISKI, R. 2006. A comparison and evaluation of multiview stereo reconstruction algorithms. In Computer Vision and Pattern Recognition, 519-528.
38. SHARF, A., ALCANTARA, D. A., LEWINER, T., GREIF, C., SHEFFER, A., AMENTA, N., AND COHEN-OR, D. 2008. Space-time surface reconstruction using incompressible flow. ACM Trans. Graph. 27, 5, 1-10.
39. STARCK, J., AND HILTON, A. 2003. Model-based multiple view reconstruction of people. In International Conference on Computer Vision, 915-922.
40. STARCK, J., AND HILTON, A. 2007. Surface capture for performance based animation. IEEE Computer Graphics and Applications 27(3), 21-31.
41. SVOBODA, T., MARTINEC, D., AND PAJDLA, T. 2005. A convenient multi-camera self-calibration for virtual environments. PRESENCE: Teleoperators and Virtual Environments 14, 4 (August), 407-422.
42. THEOBALT, C., AHMED, N., LENSCH, H., MAGNOR, M., AND SEIDEL, H.-P. 2007. Seeing people in different light-joint shape, motion, and reflectance capture. IEEE Transactions on Visualization and Computer Graphics 13, 4 (July/Aug.), 663-674.
43. VLASIC, D., BARAN, I., MATUSIK, W., AND POPOVIĆ, J. 2008. Articulated mesh animation from multi-view silhouettes. ACM Transactions on Graphics 27, 3 (Aug.), 97.
44. VOGIATZIS, G., TORR, P. H. S., AND CIPOLLA, R. 2005. Multiview stereo via volumetric graph-cuts. In Computer Vision and Pattern Recognition, 391-398.
45. VOGIATZIS, G., HERNANDEZ, C., AND CIPOLLA, R. 2006. Reconstruction in the round using photometric normals and silhouettes. In 2006 Conference on Computer Vision and Pattern Recognition (CVPR 2006), 1847-1854.
46. WAND, M., JENKE, P., HUANG, Q., BOKELOH, M., GUIBAS, L., AND SCHILLING, A. 2007. Reconstruction of deforming geometry from time-varying point clouds. In Proc. Symposium on Geometry Processing, 49-58.
47. WAND, M., ADAMS, B., OVSJANIKOV, M., BERNER, A., BOKELOH, M., JENKE, P., GUIBAS, L., SEIDEL, H.-P., AND SCHILLING, A. 2009. Efficient reconstruction of nonrigid shape and motion from real-time 3d scanner data. ACM Transactions on Graphics 28, 2 (Apr.), 15.
48. WOODHAM, R. J. 1978. Photometric stereo: A reflectance map technique for determining surface orientation from image intensity. In Proc. SPIE's 22nd Annual Technical Symposium, vol. 155.
49. ZHANG, S., AND HUANG, P. 2006. High-resolution real-time three-dimensional shape measurement. Optical Engineering 45, 12.
50. ZHANG, L., SNAVELY, N., CURLESS, B., AND SEITZ, S. M. 2004. Spacetime faces: high resolution capture for modeling and animation. ACM Transactions on Graphics 23, 3 (Aug.), 548-558.
51. ZHANG, H., SHEFFER, A., COHEN-OR, D., ZHOU, Q., VAN KAICK, O., AND TAGLIASACCHI, A. 2008. Deformation-driven shape correspondence. Proc. Symposium on Geometry Processing 27, 5 (July), 1431-1439.