Expression flow for 3d-aware face component transfer

ACM Transactions on Graphics

Volumn 30, Issue 4, 2011, Pages

  Yang, Fei ^a   Wang, Jue ^b   Shechtman, Eli ^b   Bourdev, Lubomir ^b   Metaxas, Dimitri ^a  

^a RUTGERS UNIVERSITY   (United States)

^b ADOBE RESEARCH   (United States)

Author keywords

Face modeling; Facial component; Facial expression; Facial flow; Image warping

Indexed keywords

FACE MODELING; FACIAL COMPONENTS; FACIAL EXPRESSIONS; FACIAL FLOW; IMAGE WARPING;

BLENDING; FACE RECOGNITION; INTERACTIVE COMPUTER GRAPHICS;

THREE DIMENSIONAL;

EID: 80051876582     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1964921.1964955     Document Type: Article

References (33)

1. AGARWALA, A., DONTCHEVA, M., AGRAWALA, M., DRUCKER, S., COLBURN, A., CURLESS, B., SALESIN, D., AND COHEN, M. 2004. Interactive digital photomontage. In Proceedings of ACM SIGGRAPH, vol. 23, 294-302.
2. BITOUK, D., KUMAR, N., DHILLON, S., BELHUMEUR, P., AND NAYAR, S. K. 2008. Face swapping: automatically replacing faces in photographs. In Proceedings of ACM SIGGRAPH, 39:1- 39:8.
3. BLANZ, V., AND VETTER, T. 1999. A morphable model for the synthesis of 3d faces. In Proceedings of ACM SIGGRAPH, 187-194.
4. BLANZ, V., BASSO, C., POGGIO, T., AND VETTER. 2003. Reanimating faces in images and video. Computer Graphics Forum 22, 3.
5. BLANZ, V., SCHERBAUM, K., VETTER, T., AND SEIDEL, H.-P. 2004. Exchanging faces in images. Computer Graphics Forum 23, 3, 669-676.
6. BOYKOV, Y., VEKSLER, O., AND ZABIH, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Analysis and Machine Intelligence 23.
7. COOTES, T., TAYLOR, C., COOPER, D., AND GRAHAM, J. 1995. Active shape models: Their training and application. Computer Vision and Image Understanding 61, 1, 38-59.
8. COOTES, T. F., EDWARDS, G. J., AND TAYLOR, C. J. 2001. Active appearance models. IEEE Trans. Pattern Analysis and Machine Intelligence 23, 681-685. (Pubitemid 32585279)
9. DECARLO, D., AND METAXAS, D. 2000. Optical flow constraints on deformable models with applications to face tracking. Int. J. Comput. Vision 38, 99-127.
10. DOVGARD, R., AND BASRI, R. 2004. Statistical symmetric shape from shading for 3d structure recovery of faces. In Proceedings of ECCV, 99-113.
11. FAIGIN, G. 1991. The Artist's Complete Guide to Facial Expression. Watson-Guptill Publications Inc., New York.
12. FARBMAN, Z., HOFFER, G., LIPMAN, Y., COHEN-OR, D., AND LISCHINSKI, D. 2009. Coordinates for instant image cloning. In Proceedings of ACM SIGGRAPH, vol. 28, 67:1-67:9.
13. FATTAL, R. 2009. Edge-avoiding wavelets and their applications. In Proceedings of ACM SIGGRAPH, vol. 28.
14. FELZENSZWALB, P. F., AND HUTTENLOCHER, D. P. 2005. Pictorial structures for object recognition. International Journal of Computer Vision 61, 55-79.
15. JOSHI, N., MATUSIK, W., ADELSON, E. H., AND KRIEGMAN, D. J. 2010. Personal photo enhancement using example images. ACM Trans. Graphics 29, 12:1-12:15.
16. LEYVAND, T., COHEN-OR, D., DROR, G., AND LISCHINSKI, D. 2008. Data-driven enhancement of facial attractiveness. In Proceedings of ACM SIGGRAPH, 38:1-38:9.
17. LIANG, L., XIAO, R., WEN, F., AND SUN, J. 2008. Face alignment via component-based discriminative search. In Proceedings of ECCV.
18. LIU, Z., SHAN, Y., AND ZHANG, Z. 2001. Expressive expression mapping with ratio images. In Proceedings of ACM SIGGRAPH, 271-276. (Pubitemid 33047312)
19. LIU, C., SHUM, H.-Y., AND FREEMAN, W. T. 2007. Face hallucination: Theory and practice. International Journal of Computer Vision 75, 115-134. (Pubitemid 47120248)
20. LUCAS, B. D., AND KANADE, T. 1981. An iterative image registration technique with an application to stereo vision. In Proceedings of the 1981 DARPA Image Understanding Workshop, 121-130.
21. MILBORROW, S., AND NICOLLS, F. 2008. Locating facial features with an extended active shape model. In Proceedings of ECCV, 504-513.
22. PéREZ, P., GANGNET, M., AND BLAKE, A. 2003. Poisson image editing. In Proceedings of ACM SIGGRAPH, 313-318.
23. PIGHIN, F., HECKER, J., LISCHINSKI, D., SZELISKI, R., AND SALESIN, D. H. 1998. Synthesizing realistic facial expressions from photographs. In Proceedings of ACM SIGGRAPH, 75-84.
24. ROMDHANI, S., AND VETTER, T. 2003. Efficient, robust and accurate fitting of a 3d morphable model. In Proceedings of ICCV, 59-66.
25. SARAGIH, J., LUCEY, S., AND COHN, J. 2009. Face alignment through subspace constrained mean-shifts. In Proceedings of the 12th ICCV, 1034-1041.
26. SHLIZERMAN, I. K., AND BASRI, R. 2011. 3d face reconstruction from a single image using a single reference face shape. IEEE Trans. Pattern Analysis and Machine Intelligence 33, 394-405.
27. SHLIZERMAN, I. K., SANKAR, A., SHECHTMAN, E., AND SEITZ, S. M. 2010. Being john malkovich. In Proceedings of ECCV, 341-353.
28. SINGULAR INVERSIONS INC. 2009. Facegen modeller manual. In www.facegen.com.
29. Facegen modeller manual. In www.facegen.com. SUNKAVALLI, K., JOHNSON, M. K., MATUSIK, W., AND PFISTER, H. 2010. Multi-scale image harmonization. In Proceedings of ACM SIGGRAPH, vol. 29.
30. VLASIC, D., BRAND, M., PFISTER, H., AND POPOVIć , J. 2005. Face transfer with multilinear models. In Proceedings of ACM SIGGRAPH, vol. 24, 426-433.
31. WANG, Y., HUANG, X., LEE, C.-S., ZHANG, S., LI, Z., SAMARAS, D., METAXAS, D., ELGAMMAL, A., AND HUANG, P. 2004. High resolution acquisition, learning and transfer of dynamic 3-d facial expressions. In Proceedings of EuroGraphics, 677-686.
32. WILLIAMS, L. 1990. Performance-driven facial animation. In Proceedings of ACM SIGGRAPH, vol. 24, 235-242.
33. ZHANG, L., SNAVELY, N., CURLESS, B., AND SEITZ, S. M. 2004. Spacetime faces: High-resolution capture for modeling and animation. In Proceedings of ACM SIGGRAPH, 548-558.