Dynamic Shape Capture using Multi-View Photometric Stereo

ACM Transactions on Graphics

Volumn 28, Issue 5, 2009, Pages 1-11

  Vlasic, Daniel ^a   Baran, Ilya ^a   Peers, Pieter ^b   Matusik, Wojciech ^c   Popović, Jovan ^d   Rusinkiewicz, Szymon ^e  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b Institute for Creative Technologies ^*  (United States)

^c ADOBE RESEARCH   (United States)

^d UNIVERSITY OF WASHINGTON   (United States)

^e PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 78650892938     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1618452.1618520     Document Type: Article

References (51)

1. Ahmed, N., Theobalt, C., Dobre, P., Seidel, H.-P., Thrun, S., 2008. Robust fusion of dynamic shape and normal capture for high-quality reconstruction of time-varying geometry. In Computer Vision and Pattern Recognition, 1-8.
2. Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J., 2005. Scape: Shape Completion and Animation of People. ACM Transactions on Graphics 24, 3 (Aug.), 408-416.
3. Balan, A. O., Sigal, L., Black, M. J., Davis, J. E., Haussecker, H. W., 2007. Detailed human shape and pose from images. In Computer Vision and Pattern Recognition.Balan, A. O., Sigal, L., Black, M. J., Davis, J. E., Haussecker, H. W., 2007. Detailed human shape and pose from images. In Computer Vision and Pattern Recognition.
4. Bernardini, F., Rushmeier, H., Martin, I. M., Mittle-Man, J., Taubin, G., 2002. Building a digital model of michelangelo's florentine pietà. IEEE Computer Graphics & Applications 22, 1 (Jan./Feb.), 59-67.
5. Bradley, D., Popa, T., Sheffer, A., Heidrich, W., Boubekeur, T., 2008. Markerless garment capture. ACM Transactions on Graphics 27, 3 (Aug.), 99.
6. Brox, T., Bruhn, A., Papenberg, N., Weickert, J., 2004. High accuracy optical flow estimation based on a theory for warping. In Proceedings of the 8th European Conference on Computer Vision, 25-36.
7. Campbell, N., Vogiatzis, G., Hernandez, C., Cipolla, R., 2007. Automatic 3d object segmentation in multiple views using volumetric graph-cuts. In British Machine Vision Conference.
8. Carranza, J., Theobalt, C., Magnor, M. A., Seidel, H.-P., 2003. Free-viewpoint video of human actors. ACM Transactions on Graphics 22, 3 (July), 569-577.
9. Chang, W., Zwicker, M., 2008. Automatic registration for articulated shapes. Computer Graphics Forum (Proceedings of SGP 2008) 27, 5, 1459-1468.
10. Corazza, S., Mundermann, L., Chaudhari, A., Demat-Tio, T., Cobelli, C., and Riacchi, T. P., 2006. A markerless motion capture system to study musculoskeletal biomechanics: Visual hull and simulated annealing approach. Annals of Biomedical Engineering 34, 6 (July), 1019-1029.
11. Criminisi, A., Blake, A., Rother, C., Shotton, J., Torr, P. H., 2007. Efficient dense stereo with occlusions for new view-synthesis by four-state dynamic programming. Int. Journal of Computer Vision 71, 1, 89-110.
12. Curless, B., Levoy, M., 1996. A volumetric method for building complex models from range images. In Proceedings of SIGGRAPH 96, Computer Graphics Proceedings, Annual Conference Series, 303-312.
13. Davis, J., Marschner, S. R., Garr, M., Levoy, M., 2002. Filling holes in complex surfaces using volumetric diffusion. in Symposium on 3D Data Processing, Visualization, and Transmission, 428-438.
14. Davis, J., Ramamoorthi, R., Rusinkiewicz, S., 2005. Spacetime stereo: A unifying framework for depth from triangulation. In IEEE Transactions on Pattern Analysis and Machine Intelligence, 196-302.
15. Aguiar De, E., Theobalt, C., Stoll, C., And Seidel, H.-P. 2007. Marker-less deformable mesh tracking for human shape and motion capture. IN Computer Vision and Pattern Recognition.
16. Aguiar De, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., and Thrun, S. 2008. Performance capture from sparse multi-view video. ACM Transactions on Graphics 27, 3 (Aug.), 98.
17. Einarsson, P., Chabert, C.-F., Jones, A., Ma, W.-C., La-Mond, B., Hawkins, T., Bolas, M., Sylwan, S., Debevec, P., 2006. Relighting human locomotion with flowed reflectance fields. In Proc. of Eurographics Symposium on Rendering, 183-194.
18. Furukawa, Y., Ponce, J., 2006. Carved visual hulls for image-based modeling. In European Conference on Computer Vision, 564-577.
19. Hernandez, C., Schmitt, F., 2004. Silhouette and stereo fusion for 3D object modeling. Computer Vision and Image Understanding 96, 3 (Dec.), 367-392.
20. Hernandez, C., Vogiatzis, G., Cipolla, R., 2008. Multiview photometric stereo. IEEE Trans. Pattern Anal. Mach. Intell. 30, 3, 548-554.
21. Hertzmann, A., Seitz, S. M., 2005. Example-based photometric stereo: Shape reconstruction with general, varying brdfs. IEEE Trans. Pattern Anal. Mach. Intell. 27, 8, 1254-1264.
22. Hornung, A., Kobbelt, L., 2006. Hierarchical volumetric multi-view stereo reconstruction of manifold surfaces based on dual graph embedding. In Computer Vision and Pattern Recognition, 503-510.
23. Huang, Q.-X., Adams, B., Wicke, M., Guibas, L. J., 2008. Non-rigid registration under isometric deformations. Computer Graphics Forum (Proc. SGP'08) 27, 5, 1449-1457.
24. Joshi, N., Kriegman, D., 2007. Shape from varying illumination and viewpoint. In International Conference on Computer Vision.Joshi, N., Kriegman, D., 2007. Shape from varying illumination and viewpoint. In International Conference on Computer Vision.
25. Kazhdan, M., Bolitho, M., Hoppe, H., 2006. Poisson surface reconstruction. In Symposium on Geometry Processing.
26. Li, H., Sumner, R. W., Pauly, M., 2008. Global correspondence optimization for non-rigid registration of depth scans. Computer Graphics Forum 27, 5, 1421-1430.
27. Lim, J., Ho, J., Yang, M.-H., Kriegman, D., 2005. Passive photometric stereo from motion. In International Conference on Computer Vision.
28. Ma, W.-C., Hawkins, T., Peers, P., Chabert, C.-F., Weiss, M., Debevec, P., 2007. Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination. In Rendering Techniques, 183-194.
29. Mitra, N. J., Flory, S., Ovsjanikov, M., Gelfand, N., Guibas, L., Pottmann, H., 2007. Dynamic geometry registration. In Proc. Symposium on Geometry Processing, 173-182.
30. Nehab, D., Rusinkiewicz, S., Davis, J., Ramamoor-Thi, R., 2005. Efficiently combining positions and normals for precise 3d geometry. ACM Transactions on Graphics 24, 3 (Aug.), 536-543.
31. Okutomi, M., Kanade, T., 1993. A multiple-baseline stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence 15, 4, 353-363.
32. Pekelny, Y., Gotsman, C., 2008. Articulated object reconstruction and markerless motion capture from depth video. Computer Graphics Forum 27, 2 (Apr.), 399-408.
33. Rander, P. W., Narayanan, P., Kanade, T., 1997. Vir-tualized reality: Constructing time-varying virtual worlds from real world events. In IEEE Visualization, 277-284.
34. Rusinkiewicz, S., Hall-Holt, O., Levoy, M., 2002. Real-time 3D model acquisition. ACM Transactions on Graphics 21, 3 (July), 438-446.
35. Sagawa, R., Osawa, N., Yagi, Y., 2007. Deformable registration of textured range images by using texture and shape features. In 3DIM '07: Proceedings of the Sixth International Conference on 3-D Digital Imaging and Modeling, 65-72.
36. Seitz, S. M., Dyer, C. R., 1999. Photorealistic scene reconstruction by voxel coloring. International Journal of Computer Vision 35, 2, 151-173.
37. Seitz, S. M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R., 2006. A comparison and evaluation of multiview stereo reconstruction algorithms. In Computer Vision and Pattern Recognition, 519-528.
38. Sharf, A., Alcantara, D. A., Lewiner, T., Greif, C., Sheffer, A., Amenta, N., Cohen-Or, D., 2008. Space-time surface reconstruction using incompressible flow. ACM Trans. Graph. 27, 5, 1-10.
39. Starck, J., Hilton, A., 2003. Model-based multiple view reconstruction of people. In International Conference on Computer Vision, 915-922.
40. Starck, J., Hilton, A., 2007. Surface capture for performance based animation. IEEE Computer Graphics and Applications 27(3), 21-31.
41. Svoboda, T., Martinec, D., Pajdla, T., 2005. A convenient multi-camera self-calibration for virtual environments. PRESENCE: Teleoperators and Virtual Environments 14, 4 (August), 407-422.
42. Theobalt, C., Ahmed, N., Lensch, H., Magnor, M., Seidel, H.-P., 2007. Seeing people in different light-joint shape, motion, and reflectance capture. IEEE Transactions on Visualization and Computer Graphics 13, 4 (July/Aug.), 663-674.
43. Vlasic, D., Baran, I., Matusik, W., Popovicc, J., 2008. Articulated mesh animation from multi-view silhouettes. ACM Transactions on Graphics 27, 3 (Aug.), 97.
44. Vogiatzis, G., Torr, P. H. S., Cipolla, R., 2005. Multiview stereo via volumetric graph-cuts. In Computer Vision and Pattern Recognition, 391-398.
45. Vogiatzis, G., Hernandez, C., Cipolla, R., 2006. Reconstruction in the round using photometric normals and silhouettes. In 2006 Conference on Computer Vision and Pattern Recognition (CVPR 2006), 1847-1854.
46. Wand, M., Jenke, P., Huang, Q., Bokeloh, M., Guibas, L., Schilling, A., 2007. Reconstruction of deforming geometry from time-varying point clouds. In Proc. Symposium on Geometry Processing, 49-58.
47. Wand, M., Adams, B., Ovsjanikov, M., Berner, A., Bokeloh, M., Jenke, P., Guibas, L., Seidel, H.-P., Schilling, A., 2009. Efficient reconstruction of nonrigid shape and motion from real-time 3d scanner data. ACM Transactions on Graphics 28, 2 (Apr.), 15.
48. Woodham, R. J., 1978. Photometric stereo: A reflectance map technique for determining surface orientation from image intensity. In Proc. SPIE's 22nd Annual Technical Symposium, vol. 155.
49. Zhang, S., Huang, P., 2006. High-resolution real-time three-dimensional shape measurement. Optical Engineering 45, 12.
50. Zhang, L., Snavely, N., Curless, B., Seitz, S. M., 2004. Spacetime faces: high resolution capture for modeling and animation. ACM Transactions on Graphics 23, 3 (Aug.), 548-558.
51. Zhang, H., Sheffer, A., Cohen-Or, D., Zhou, Q., Vankaick, O., Tagliasacchi, A., 2008. Deformation-driven shape correspondence. Proc. Symposium on Geometry Processing 27, 5 (July), 1431-1439.