Facial expression editing in video using a temporally-smooth factorization

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2012, Pages 861-868

  Yang, Fei ^a   Bourdev, Lubomir ^b   Shechtman, Eli ^c   Wang, Jue ^c   Metaxas, Dimitris ^a  

^a RUTGERS UNIVERSITY   (United States)

^b FACEBOOK   (United States)

^c ADOBE RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

3-D SHAPE; 3D FACES; 3D MODELS; FACE WARPING; FACIAL EXPRESSIONS; IDENTITY CONSTRAINTS; IMAGE PLANE; TEMPORAL CONTINUITY; VIDEO FRAME;

COMPUTER VISION; FACE RECOGNITION; GEOMETRY; THREE DIMENSIONAL COMPUTER GRAPHICS;

THREE DIMENSIONAL;

EID: 84866722262     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2012.6247759     Document Type: Conference Paper

References (22)

1. V. Blanz, C. Basso, T. Poggio, and T. Vetter. Reanimating faces in images and video. Computer Graphics Forum, 22(3), 2003.
2. C. Bregler, M. Covell, and M. Slaney. Video rewrite: driving visual speech with audio. In Proceedings of ACM SIGGRAPH, 1997.
3. T. F. Cootes. Talking face video. http://www-prima.inrialpes.fr/FGnet/ data/01-TalkingFace/talking-face.html.
4. T. F. Cootes, G. J. Edwards, and C. J. Taylor. Active appearance models. IEEE Trans. Pattern Analysis and Machine Intelligence, 23(6):681-685, 2001.
5. K. Dale, K. Sunkavalli, M. K. Johnson, D. Vlasic, W. Matusik, and H. Pfister. Video face replacement. In Proceedings of ACM SIGGRAPH Asia, 2011.
6. R. I. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, second edition, 2004.
7. I. Kemelmacher-Shlizerman, A. Sankar, E. Shechtman, and S. M. Seitz. Being John Malkovich. In Proceedings of ECCV, 2010.
8. I. Kemelmacher-Shlizerman, E. Shechtman, R. Garg, and S. M. Seitz. Exploring photobios. Proceedings of ACM SIGGRAPH, 2011.
9. C. Liu. Beyond pixels: exploring new representations and applications for motion analysis. Massachusetts Institute of Technology, PhD thesis, 2009.
10. Z. Liu, Y. Shan, and Z. Zhang. Expressive expression mapping with ratio images. In Proceedings of ACM SIGGRAPH, 2001.
11. J. Nocedal and S. J. Wright. Numerical Optimization. Springer Series in Operations Research and Financial Engineering. Springer, second edition, July 2006.
12. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D. H. Salesin. Synthesizing realistic facial expressions from photographs. In Proceedings of ACM SIGGRAPH, 1998.
13. H. Sakoe and S. Chiba. Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans. Acoustics, Speech and Signal Processing, 26(1):43-49, 1978.
14. J. Saragih, S. Lucey, and J. Cohn. Deformable Model Fitting by Regularized Landmark Mean-Shift. International Journal of Computer Vision, 91(2):200-215, Jan 2011.
15. S. Schaefer, T. Mcphail, and J. Warren. Image deformation using moving least squares. In Proceedings of ACM SIGGRAPH, 2006.
16. B. Theobald, I. Matthews, M. Mangini, J. Spies, T. Brick, J. Cohn, and S. Boker. Mapping and manipulating facial expression. Language and Speech, 52:369-386, 2009.
17. Vasilescu and D. Terzopoulos. Multilinear analysis of image ensembles: Tensorfaces. In Proceedings of the ECCV, 2002.
18. D. Vlasic, M. Brand, H. Pfister, and J. Popovic. Face transfer with multilinear models. In Proceedings of ACM SIGGRAPH, 2005.
19. W. Widanagamaachchi and A. Dharmaratne. 3D face reconstruction from 2D images. In Digital Image Computing: Techniques and Applications, pages 365-371, 2008.
20. L. Williams. Performance-driven facial animation. In Proceedings of ACM SIGGRAPH, 1990.
21. F. Yang, E. Shechtman, J. Wang, L. Bourdev, and D. Metaxas. 3D-aware appearance optimization for face morphing. In Graphics Interface, 2012.
22. F. Yang, J. Wang, E. Shechtman, L. Bourdev, and D. Metaxas. Expression flow for 3D-aware face component transfer. In Proceedings of ACM SIGGRAPH, 2011.