Post-production facial performance relighting using reflectance transfer

ACM Transactions on Graphics

Volumn 26, Issue 3, 2007, Pages

  Peers, Pieter ^a   Tamura, Naoki ^b,c   Matusik, Wojciech ^c   Debevec, Paul ^a  

^a Institute for Creative Technologies ^*  (United States)

^b UNIVERSITY OF TOKYO   (Japan)

^c MERL ^*

Author keywords

Image based relighting; Interactive lighting design; Reflectance transfer

Indexed keywords

IMAGE BASED RELIGHTING; INTERACTIVE LIGHTING DESIGN; REFLECTANCE FIELDS; REFLECTANCE TRANSFER;

IMAGE RECONSTRUCTION; LIGHTING; PHOTOGRAPHY; REFLECTION;

DATA STRUCTURES;

EID: 34547673010     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1276377.1276442     Document Type: Article

References (27)

1. BLANZ, V., AND VETTER, T. 1999. A morphable model for the synthesis of 3D faces. In Proceedings of SIGGRAPH 99, Computer Graphics Proceedings, Annual Conference Series, 187-194.
2. BLANZ, V., BASSO, C., POGGIO, T., AND VETTER, T. 2003. Reanimating faces in images and video. Computer Graphics Forum 22, 3 (Sept.), 641-650.
3. BROX, T., BRUHN, A., PAPENBERG, N., AND WEICKERT, J. 2004. High accuracy optical flow estimation based on a theory for warping. In Proceedings of the 8th European Conference on Computer Vision, 25-36.
4. DEBEVEC, P., HAWKINS, T., TCHOU, C., DUIKER, H.-P., SAROKIN, W., AND SAGAR, M. 2000. Acquiring the reflectance field of a human face. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 145-156.
5. DEBEVEC, P. 1998. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 189-198.
6. EINARSSON, P., CHABERT, C.-F., JONES, A., MA, W.-C., LAMOND, B., HAWKINS, T., BOLAS, M., SYLWAN, S., AND DEBEVEC, P. 2006. Relighting human locomotion with flowed reflectance fields. In Rendering Techniques 2006: 17th Euro-graphics Workshop on Rendering, 183-194.
7. EISEMANN, E., AND DURAND, F. 2004. Flash photography enhancement via intrinsic relighting. ACM Transactions on Graphics 23,3, 673-678.
8. FUCHS, M., BLANZ, V., LENSCH, H., AND SEIDEL, H.-P. 2005. Reflectance from images: a model-based approach for human faces. IEEE Transactions on Visualization and Computer Graphics 11, 3 (May-June), 296-305.
9. GEORGHIADES, A. S. 2003. Recovering 3-D shape and reflectance from a small number of photographs. In Eurographics Symposium on Rendering: 14th Eurographics Workshop on Rendering, 230-240.
10. HAWKINS, T., WENGER, A., TCHOU, C., GARDNER, A., GÖRANSSON, F., AND DEBEVEC, P. 2004. Animatable facial, reflectance fields. In Rendering Techniques 2004: 15th Eurographics Workshop on Rendering, 309-320.
11. JONES, M., AND VIOLA, P. 2003. Fast multi-view face detection. Tech. rep., MERL. TR2003-096.
12. LIU, Z., SHAN, Y., AND ZHANG, Z. 2001. Expressive expression mapping with ratio images. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 271-276.
13. LUCAS, B., AND KANADE, T. 1981. An iterative image registration technique with an application to stereo vision. In International Joint Conference on Artificial Intelligence (IJCAI81), 674-679.
14. MARSCHNER, S. R., AND GREENBERG, D. P. 1997. Inverse lighting for photography. In Proceedings of the Fifth Color Imaging Conference, Society for Imaging Science and Technology, 262-265.
15. MARSCHNER, S., WESTIN, S., LAFORTUNE, E., TORRANCE, K., AND GREENBERG, D. 1999. Image-based BRDF measurement including human skin. In Rendering Techniques '99: 10th Eurographics Workshop on Rendering, 139-152.
16. NISHINO, K., AND NAYAR, S. K. 2004. Eyes for relighting. ACM Transactions on Graphics 23, 3 (Aug.), 704-711.
17. PETSCHMGG, G., SZELISKI, R., AGRAWALA, M., COHEN, M., HOPPE, H., AND TOYAMA, K. 2004. Digital photography with, flash and. no-flash image pairs. ACM Transactions Graphics 23, 3, 664-672.
18. PIGHIN, F. H., SZELISKI, R., AND SALESIN, D. 1999. Resynthesizing facial animation through 3D model-based tracking. In International Conference on Computer Vision, 143-150.
19. RIKLIN-RAVIV, T., AND SHASHUA, A. 1999. The quotient image:lass based recognition and synthesis under varying illumination conditions. IEEE Transactions on Pattern Analysis and Machine Intelligence 02, 262-265.
20. SIM., T., AND KANADì, T. 2002. Illuminating the face. Tech. rep., CMU. CMU-RI-TR-01-31.
21. STOSCHEK, A. 2000. Image-based re-rendering of faces for continuous pose and illumination directions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 582-587.
22. TERZOPOULOS, D., AND WATERS, K. 1993. Analysis and synthesis of facial image sequences using physical, and anatomical models. IEEE Transactions on Pattern Analysis and Machine Intelligence 15, 6 (June), 569-579.
23. VLASIC, D., BRAND, M., PFISTER, H., AND POPOVIĆ, J. 2005. Face transfer with, multilinear models. ACM Transactions on Graphics 24, 3 (Aug.), 426-433.
24. WEN, Z., LIU, Z., AND HUANG, T. 2003. Face relighting with radiance environment maps. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 157-165.
25. WENGER, A., GARDNER, A., TCHOU, C., UNGER, J., HAWKINS, T., AND DEBEVEC, P. 2005. Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Transactions on Graphics 24, 3 (Aug.), 756-764.
26. WEYRICH, T., MATUSIK, W., PFISTER, H., BICKEL, B., DONNER, C., TU, C., MCANDLESS, J., LEE, J., NGAN, A., JENSEN, H. W., AND GROSS, M. 2006. Analysis of human faces using a measurement-based skin reflectance model. ACM Transactions on Graphics 25, 3 (July), 1013-1024.
27. WILLIAMS, L. 1990. Performance-driven facial animation. In Computer Graphics (Proceedings of SIGGRAPH 90), vol. 24, 235-242.