A data-driven approach for facial expression synthesis in video

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2012, Pages 57-64

  Li, Kai ^a   Xu, Feng ^a   Wang, Jue ^b   Dai, Qionghai ^a   Liu, Yebin ^a  

^a TSINGHUA UNIVERSITY   (China)

^b ADOBE RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA-DRIVEN APPROACH; FACIAL ANIMATION; FACIAL EXPRESSION SYNTHESIS; HIGH QUALITY; MAPPING METHOD; OPTIMAL IMAGES; SHORTEST PATH ALGORITHMS; SIMILARITY METRICS; TEMPORAL COHERENCE; VIDEO FRAME;

ANIMATION;

COMPUTER VISION;

EID: 84866661849     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2012.6247658     Document Type: Conference Paper

References (30)

1. T. Beier and S. Neely. Feature-based image metamorphosis. In SIGGRAPH, pages 35-42, 1992.
2. V. Blanz, C. Basso, T. Poggio, and T. Vetter. Reanimating faces in images and video. Computer Graphics Forum, 22(3):641-650, 2003.
3. V. Blanz and T. Vetter. A morphable model for the synthesis of 3d faces. In SIGGRAPH, pages 187-194, 1999.
4. T. Cootes, G. Edwards, and C. Taylor. Active appearance models. IEEE TPAMI, 23(6):681-685, 2001.
5. T. Cootes, C. Taylor, D. Cooper, and J. Graham. Active shape models-their training and application. Computer Vision and Image Understanding, 61(1):38-59, 1995.
6. T. H. Cormen, C. E. Leiserson, R. L. Riverst, and C. Stein. Introduction to algorithms. MIT press, Cambridge, 2009.
7. K. Dale, K. Sunkavalli, M. K. Johnson, D. Vlasic, W. Matusik, and H. Pfister. Video face replacement. ACM Trans. Graph., pages 130:1-130:10, 2011.
8. Y. Deng, Q. Dai, and Z. Zhang. Graph laplace for occluded face completion and recognition. IEEE Trans. Image Process., 20(8):2329-2338, 2011.
9. P. Ekman and W. V. Friesen. Facial action coding system: a technique for the measurement of facial movement. Consulting Psychologists Press, Palo Alto, 1978.
10. I. Kemelmacher-Shlizerman, A. Sankar, E. Shechtman, and S. M. Seitz. Being john malkovich. In ECCV, pages 341-353, 2010.
11. I. Kemelmacher-Shlizerman, E. Shechtman, R. Garg, and S. M. Seitz. Exploring photobios. ACM Trans. Graphics, pages 61:1-61:10, 2011.
12. L. Kovar and M. Gleicher. Flexible automatic motion blending with registration curves. In SCA, pages 214-224, 2003.
13. Z. Li, N. Snavely, B. Curless, and S. M. Seitz. Spacetime faces: high resolution capture for modeling and animation. ACM Trans. Graph., 23(3):548-558, 2004.
14. G. Littlewort, J. Whitehill, T. Wu, I. Fasel, M. Frank, J. Movellan, and M. Bartlett. The computer expression recognition toolbox (cert). In FG, pages 298-305, 2011.
15. P. Litwinowicz and L. Williams. Animating images with drawings. In SIGGRAPH, pages 409-412, 1994.
16. C. Liu. Beyond Pixels: Exploring New Representations and Applications for Motion Analysis. PhD thesis, MIT, 2009.
17. Z. Liu, Y. Shan, and Z. Zhang. Expressive expression mapping with ratio images. In SIGGRAPH, pages 271-276, 2001.
18. P. Lucey, J. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews. The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression. In CVPR Workshops, pages 94-101, 2010.
19. M. Lyons, S. Akamatsu, M. Kamachi, and J. Gyoba. Coding facial expressions with gabor wavelets. In FG, 1998.
20. J.-y. Noh and U. Neumann. Expression cloning. In SIGGRAPH, pages 277-288, 2001.
21. T. Ojala, M. Pietikainen, and T. Maenpaa. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE TPAMI, 24(7):971-987, 2002.
22. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D. H. Salesin. Synthesizing realistic facial expressions from photographs. In SIGGRAPH, pages 75-84, 1998.
23. J. M. Saragih, S. Lucey, and J. F. Cohn. Real-time avatar animation from a single image. In FG, pages 117-124, 2011.
24. S. M. Seitz and C. R. Dyer. View morphing. In SIGGRAPH, pages 21-30, 1996.
25. D. Vlasic, M. Brand, H. Pfister, and J. Popović. Face transfer with multilinear models. ACM Trans. Graph., 24(3):426-433, 2005.
26. T. Weise, S. Bouaziz, H. Li, and M. Pauly. Realtime performance-based facial animation. ACM Trans. Graph., pages 77:1-77:10, 2011.
27. T. Weise, H. Li, L. Van Gool, and M. Pauly. Face/off: live facial puppetry. In SCA, pages 7-16, 2009.
28. L. Williams. Performance-driven facial animation. In SIGGRAPH, pages 235-242, 1990.
29. F. Xu, Y. Liu, C. Stoll, J. Tompkin, G. Bharaj, Q. Dai, H.-P. Seidel, J. Kautz, and C. Theobalt. Video-based characters: creating new human performances from a multi-view video database. ACM Trans. Graph., pages 32:1-32:10, 2011.
30. Q. Zhang, Z. Liu, B. Quo, D. Terzopoulos, and H.-Y. Shum. Geometry-driven photorealistic facial expression synthesis. IEEE TVCG, 12(1):48-60, 2006.