Automatic face reenactment

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2014, Pages 4217-4224

  Garrido, Pablo ^a   Valgaerts, Levi ^a   Rehmsen, Ole ^a   Thormählen, Thorsten ^b   Pérez, Patrick ^c   Theobalt, Christian ^a  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^b PHILIPPS UNIVERSITY MARBURG   (Germany)

^c Technicolor Inc   (United States)

Author keywords

expression matching; face reenactment; facial puppetry; temporal clustering; video editing

Indexed keywords

3D MODELING; PATTERN RECOGNITION;

EXPRESSION MATCHING; FACE REENACTMENT; FACIAL PUPPETRY; TEMPORAL CLUSTERING; VIDEO EDITING;

IMAGE RETRIEVAL;

EID: 84911366471     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2014.537     Document Type: Conference Paper

References (26)

1. T. Ahonen, A. Hadid, and M. Pietikainen. Face description with local binary patterns: Application to face recognition. IEEE TPAMI, 28(12):2037-2041, 2006.
2. O. Alexander, M. Rogers, W. Lambeth, M. Chiang, and P. Debevec. The Digital Emily Project: photoreal facial modeling and animation. In ACM SIGGRAPH Courses, pages 12:1-12:15, 2009.
3. F. Berthouzoz, W. Li, and M. Agrawala. Tools for placing cuts and transitions in interview video. ToG (Proc. SIG-GRAPH), 31(4):67:1-67:8, 2012.
4. D. Bitouk, N. Kumar, S. Dhillon, P. Belhumeur, and S. K. Nayar. Face swapping: Automatically replacing faces in photographs. ToG (Proc. SIGGRAPH), 27(3):39:1-39:8, 2008.
5. V. Blanz, K. Scherbaum, T. Vetter, and H.-P. Seidel. Exchanging faces in images. Comp. Graph. Forum, 23(3):669-676, 2004.
6. C. Bregler, M. Covell, and M. Slaney. Video rewrite: driving visual speech with audio. ToG (Proc. SIGGRAPH), pages 353-360, 1997.
7. H. Y. Chong, S. J. Gortler, and T. Zickler. A perception-based color space for illumination-invariant image processing. To G (Proc. SIGGRAPH), 27(3):61:1-61:7.
8. D. Cristinacce and T. F. Cootes. Feature detection and tracking with constrained local models. In Proc. BMVC, pages 929-938, 2006.
9. K. Dale, K. Sunkavalli, M. K. Johnson, D. Vlasic, W. Ma-tusik, and H. Pfister. Video face replacement. To G (Proc. SIGGRAPH Asia), 30(6):130:1-130:10, 2011.
10. A. A. Efros, A. C. Berg, G. Mori, and J. Malik. Recognizing action at a distance. In Proc. ICCV, pages 726-733, 2003.
11. P. Eisert and B. Girod. Analyzing facial expressions for virtual conferencing. Computer Graphics and Applications, 18(5):70-78, 1998.
12. P. Garrido, L. Valgaerts, C. Wu, and C. Theobalt. Reconstructing detailed dynamic face geometry from monocular video. ToG (Proc. SIGGRAPH Asia), 32(6):158:1-158:10, 2013.
13. A. Jones, J. Chiang, A. Ghosh, M. Lang, M. Hullin, J. Busch, and P. Debevec. Real-time geometry and reflectance capture for digital face replacement. Technical Report 4s, University of Southern California, 2008.
14. I. Kemelmacher-Shlizerman, A. Sankar, E. Shechtman, and S. M. Seitz. Being John Malkovich. In Proc. ECCV, volume 6311 of LNCS, pages 341-353. 2010.
15. I. Kemelmacher-Shlizerman, E. Shechtman, R. Garg, and S. M. Seitz. Exploring photobios. ToG (Proc. SIGGRAPH), 30(4):61:1-61:10, 2011.
16. K. Li, F. Xu, J. Wang, Q. Dai, and Y. Liu. A data-driven approach for facial expression synthesis in video. In Proc. CVPR, pages 57-64, 2012.
17. Z. Liu, Y. Shan, and Z. Zhang. Expressive expression mapping with ratio images. ToG (Proc. SIGGRAPH), pages 271-276, 2001.
18. T. Ojala, M. Pietikäinen, and T. Mäenpää. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE TPAMI, 24(7):971-987, 2002.
19. P. Pérez, M. Gangnet, and A. Blake. Poisson image editing. ToG (Proc. SIGGRAPH), 22(3):313-318, 2003.
20. J. M. Saragih, S. Lucey, and J. F. Cohn. Face alignment through subspace constrained mean-shifts. In Proc. ICCV, pages 1034-1041, 2009.
21. J. M. Saragih, S. Lucey, and J. F. Cohn. Real-time avatar animation from a single image. In Automatic Face and Gesture Recognition Workshops, pages 213-220, 2011.
22. X. Tan and B. Triggs. Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE TIP, 19(6):1635-1650, 2010.
23. B.-J. Theobald, I. Matthews, M. Mangini, J. R. Spies, T. R. Brick, J. F. Cohn, and S. M. Boker. Mapping and manipulating facial expression. Language and Speech, 52(2-3):369-386, 2009.
24. D. Vlasic, M. Brand, H. Pfister, and J. Popović. Face transfer with multilinear models. ToG (Proc. SIGGRAPH), 24(3):426-433, 2005.
25. T. Weise, S. Bouaziz, H. Li, and M. Pauly. Realtime performance-based facial animation. To G (Proc. SIG-GRAPH), 30(4):77:1-77:10, 2011.
26. T. Weise, H. Li, L. J. V. Gool, and M. Pauly. Face/Off: live facial puppetry. In Proc. SIGGRAPH/Eurographics Symposium on Computer Animation, pages 7-16, 2009.