Temporal upsampling of performance geometry using photometric alignment

ACM Transactions on Graphics

Volumn 29, Issue 2, 2010, Pages

  Wilson, Cyrus A ^a   Ghosh, Abhijeet ^a   Peers, Pieter ^a   Chiang, Jen Yuan ^a   Busch, Jay ^a   Debevec, Paul ^a  

^a University of Southern California ^*  (United States)

Author keywords

3D face scanning; Capture; Motion estimation; Optical flow; Photorealism

Indexed keywords

3D FACE SCANNING; 3D FACES; CAPTURE; CAPTURED FRAME; DYNAMIC PERFORMANCE; FACIAL GEOMETRY; ILLUMINATION CONDITIONS; LIGHTING CONDITIONS; NOVEL TECHNIQUES; PHOTOMETRIC ALIGNMENT; PHOTOREALISM; STEREO CORRESPONDENCES; TWO-STEP ALGORITHMS; UPSAMPLING; VIDEO RATES;

COMPUTATIONAL GEOMETRY; JOINTS (ANATOMY); MOTION ESTIMATION; OPTICAL FLOWS; PHOTOGRAPHY; PHOTOMETRY;

THREE DIMENSIONAL;

EID: 77951260364     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1731047.1731055     Document Type: Article

References (21)

1. AHMED, N., THEOBALT, C., DOBREV, P., SEIDEL, H.-P., AND THRUN, S. 2008. Robust fusion of dynamic shape and normal capture for high-quality reconstruction of time-varying geometry. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'08). 1-8.
2. BICKEL, B., BOTSCH, M., ANGST, R., MATUSIK, W., OTADUY, M., PFISTER, H., AND GROSS, M. 2007. Multi-Scale capture of facial geometry and motion. ACM Trans. Graph. 26, 3, 33: 1-10. (Pubitemid 47224771)
3. BROX, T., BRUHN, A., PAPENBERG, N., AND WEICKERT, J. 2004. High accuracy optical flow estimation based on a theory for warping. In Proceedings of the European Conference on Computer Vision. 25-36. (Pubitemid 38717171)
4. DAVIS, J., NEHAB, D., RAMAMOORTHI, R., AND RUSINKIEWICZ, S. 2005. Spacetime stereo: A unifying framework for depth from triangulation. IEEE Trans. Patt. Anal. Mach. Intell. 27, 2, 296-302. (Pubitemid 40384127)
5. HERNANDEZ, C., VOGIATZIS, G., BROSTOW, G. J., STENGER, B., AND CIPOLLA, R. 2007. Non-Rigid photometric stereo with colored lights. InProceedings of the IEEE International Conference on Computer Vision. 1-8.
6. KANG, S., UYTTENDAELE, M., WINDER, S.,AND SZELISKI, R. 2003. High dynamic range video. ACM Trans. Graph. 22, 3, 319-325.
7. LIM, J., HO, J., YANG, M.-H., AND KRIEGMAN, D. 2005. Passive photometric stereo from motion. In Proceedings of the IEEE International Conference on Computer Vision. 1635-1642. (Pubitemid 44042373)
8. MA, W.-C., HAWKINS, T., PEERS, P., CHABERT, C.-F., WEISS, M., AND DEBEVEC, P. 2007. Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination. In Proceedings of the Eurographics Symposium on Rendering. 183-194.
9. MA, W.-C., JONES, A., CHIANG, J.-Y., HAWKINS, T., FREDERIKSEN, S., PEERS, P., VUKOVIC, M., OUHYOUNG, M., AND DEBEVEC, P. 2008. Facial performance synthesis using deformation-driven polynomial displacement maps. ACM Trans. Graph. 27, 5, 121: 1-10.
10. MALZBENDER, T., WILBURN, B., GELB, D., AND AMBRISCO, B. 2006. Surface enhancement using real-time photometric stereo and reflectance transformation. In Proceedings of the Eurographics Symposium on Rendering. 245-250.
11. NEHAB, D., RUSINKIEWICZ, S., DAVIS, J., AND RAMAMOORTHI, R. 2005. Efficiently combining positions and normals for precise 3D geometry. ACM Trans. Graph. 24, 3, 536-543.
12. RUSINKIEWICZ, S., HALL-HOLT, O., AND LEVOY, M. 2002. Real-time 3d model acquisition. ACM Trans. Graph. 21, 3, 438-446.
13. SCHARSTEIN, D. AND SZELISKI, R. 2002. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vision 47, 1-3, 7-42. (Pubitemid 34428419)
14. VEDULA, S., BAKER, S., AND KANADE, T. 2005. Image based spatio-temporal modeling and view interpolationof dynamic events. ACM Trans. Graph. 24, 2, 240-261.
15. VLASIC, D., PEERS, P., BARAN, I., DEBEVEC, P., POPOVIĆ, J., RUSINKIEWICZ, S., AND MATUSIK, W. 2009. Dynamic shape capture using multi-view photometric stereo. ACM Trans. Graph. 28, 5, 174: 1-11.
16. WAND, M., ADAMS, B., OVSJANIKOV, M., BERNER, A., BOKELOH, M., JENKE, P., GUIBAS, L., SEIDEL, H.-P., AND SCHILLING, A. 2009. Efficient reconstruction of nonrigid shape and motion from real-time 3D scanner data. ACM Trans. Graph. 28, 2, 15: 1-15.
17. WENGER, A., GARDNER, A., TCHOU, C., UNGER, J., HAWKINS, T., AND DEBEVEC, P. 2005. Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Trans. Graph. 24, 3, 756-764
18. XYZRGB. 3D laser scanning\XYZ RGB Inc. http://www.xyzrgb.com/.
19. ZHANG, S., AND HUANG, P. 2006. High-Resolution, real-time three-dimensional shape measurement. Optical Engin. 45, 12, 123601: 1-8. (Pubitemid 44377195)
20. ZHANG, L., CURLESS, B., HERTZMANN, A., AND SEITZ, S. M. 2003. Shape and motion under varying illumination: Unifying structure from motion, photometric stereo, and multi-view stereo. In Proceedings of the IEEE International Conference on Computer Vision. 618-625.
21. ZHANG, L., SNAVELY, N., CURLESS, B., AND SEITZ, S. M. 2004. Space-time faces: High resolution capture for modeling and animation. ACM Trans. Graph. 23, 3, 548-558 (Pubitemid 40163750)