Displaced dynamic expression regression for real-time facial tracking and animation

ACM Transactions on Graphics

Volumn 33, Issue 4, 2014, Pages

  Cao, Chen ^a   Hou, Qiming ^a   Zhou, Kun ^a  

^a ZHEJIANG UNIVERSITY   (China)

Author keywords

Blendshape models; Face animation; Face tracking; Performance capture

Indexed keywords

ANIMATION; CALIBRATION; FACE RECOGNITION; INTERACTIVE COMPUTER GRAPHICS;

ATTRACTIVE SOLUTIONS; AUTOMATIC APPROACHES; BLENDSHAPE; FACE ANIMATION; FACE TRACKING; FACIAL EXPRESSIONS; PERFORMANCE CAPTURE; STATE-OF-THE-ART TECHNIQUES; BLENDSHAPE MODEL; BLENDSHAPES; FACIAL ANIMATION; FACIAL TRACKING; REAL- TIME;

VIDEO CAMERAS;

EID: 84905743974     PISSN: 07342071     EISSN: 15577333     Source Type: Journal    
DOI: 10.1145/2601097.2601204     Document Type: Conference Paper

References (38)

1. ASTHANA, A., ZAFEIRIOU, S., CHENG, S., AND PANTIC, M. 2013. Robust discriminative response map fitting with constrained local models. In IEEE CVPR, 3444-3451.
2. BALTRUŠAITIS, T., ROBINSON, P., AND MORENCY, L.-P. 2012. 3D constrained local model for rigid and non-rigid facial tracking. In Proceedings of IEEE CVPR, 2610-2617.
3. BEELER, T., HAHN, F., BRADLEY, D., BICKEL, B., BEARDS-LEY, P., GOTSMAN, C., SUMNER, R. W., AND GROSS, M. 2011. High-quality passive facial performance capture using anchor frames. ACM Trans. Graph. 30, 4, 75:1-75:10.
4. BLANZ, V., AND VETTER, T. 1999. A morphable model for the synthesis of 3d faces. In Proceedings of SIGGRAPH, 187-194.
5. BOUAZIZ, S., WANG, Y., AND PAULY, M. 2013. Online modeling for realtime facial animation. ACM Trans. Graph. 32, 4 (July), 40:1-40:10.
6. BRADLEY, D., HEIDRICH, W., POPA, T., AND SHEFFER, A. 2010. High resolution passive facial performance capture. ACM Trans. Graph. 29, 4, 41:1-41:10.
7. BURGOS-ARTIZZU, X. P., PERONA, P., AND DOLLÁR, P. 2013. Robust face landmark estimation under occlusion. In Proceedings of ICCV, 117-124.
8. BYRD, R. H., LU, P., NOCEDAL, J., AND ZHU, C. 1995. A limited memory algorithm for bound constrained optimization. SIAM J. Sci. Comput. 16, 5 (Sept.), 1190-1208.
9. CAO, X., WEI, Y., WEN, F., AND SUN, J. 2012. Face alignment by explicit shape regression. Proceedings of IEEE CVPR, 2887-2894.
10. CAO, C., WENG, Y., LIN, S., AND ZHOU, K. 2013. 3d shape regression for real-time facial animation. ACM Trans. Graph. 32, 4 (July), 41:1-41:10.
11. CAO, C., WENG, Y., ZHOU, S., TONG, Y., AND ZHOU, K. 2013. Facewarehouse: a 3D facial expression database for visual computing. IEEE TVCG, PrePrints.
12. CHAI, J.-X., XIAO, J., AND HODGINS, J. 2003. Vision-based control of 3d facial animation. In Symp. Comp. Anim., 193-206.
13. COOTES, T. F., TAYLOR, C. J., COOPER, D. H., AND GRAHAM, J. 1995. Active shape models-their training and application. Computer Vision and Image Understanding 61, 38-59.
14. COOTES, T. F., EDWARDS, G. J., AND TAYLOR, C. J. 1998. Active appearance models. In Proceedings of ECCV, 484-498.
15. DECARLO, D., AND METAXAS, D. 2000. Optical flow constraints on deformable models with applications to face tracking. Int. Journal of Computer Vision 38, 2, 99-127.
16. DOLLAR, P., WELINDER, P., AND PERONA, P. 2010. Cascaded pose regression. In Proceedings of IEEE CVPR, 1078-1085.
17. EKMAN, P., AND FRIESEN, W. 1978. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press.
18. ESSA, I., BASU, S., DARRELL, T., AND PENTLAND, A. 1996. Modeling, tracking and interactive animation of faces and heads: using input from video. In Computer Animation, 68-79.
19. GARRIDO, P., VALGAERT, L., WU, C., AND THEOBALT, C. 2013. Reconstructing detailed dynamic face geometry from monocular video. ACM Trans. Graph. 32, 6 (Nov.), 158:1-158:10.
20. HUANG, G. B., RAMESH, M., BERG, T., AND LEARNED-MILLER, E. 2007. Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Tech. Rep. 07-49, University of Massachusetts, Amherst, October.
21. HUANG, H., CHAI, J., TONG, X., AND WU, H.-T. 2011. Leveraging motion capture and 3d scanning for high-fidelity facial performance acquisition. ACM Trans. Graph. 30, 4, 74:1-74:10.
22. LEWIS, J. P., AND ANJYO, K. 2010. Direct manipulation blend-shapes. IEEE CG&A 30, 4, 42-50.
23. LI, H., YU, J., YE, Y., AND BREGLER, C. 2013. Realtime facial animation with on-the-fly correctives. ACM Trans. Graph. 32, 4 (July), 42:1-42:10.
24. PIGHIN, F., HECKER, J., LISCHINSKI, D., SZELISKI, R., AND SALESIN, D. H. 1998. Synthesizing realistic facial expressions from photographs. In Proceedings of SIGGRAPH, 75-84.
25. PIGHIN, F., SZELISKI, R., AND SALESIN, D. 1999. Resynthe-sizing facial animation through 3d model-based tracking. In Int. Conf. Computer Vision, 143-150.
26. SARAGIH, J. M., LUCEY, S., AND COHN, J. F. 2011. Real-time avatar animation from a single image. In IEEE International Conference on Automatic Face Gesture Recognition and Workshops, 117-124.
27. SARAGIH, J., LUCEY, S., AND COHN, J. 2011. Deformable model fitting by regularized landmark mean-shift. International Journal of Computer Vision 91, 2, 200-215.
28. TARRES, F., AND RAMA, A. GTAV Face Database.
29. http://gps-tsc.upc.es/GTAV/ResearchAreas/UPCFaceDatabase/ GTAVFaceDatabase.htm.
30. VIOLA, P., AND JONES, M. 2004. Robust real-time face detection. International Journal of Computer Vision 57, 2, 137-154.
31. VLASIC, D., BRAND, M., PFISTER, H., AND POPOVIĆ, J. 2005. Face transfer with multilinear models. ACM Trans. Graph. 24, 3, 426-433.
32. WEISE, T., LI, H., GOOL, L. V., AND PAULY, M. 2009. Face/off: Live facial puppetry. In Symp. Computer Animation, 7-16.
33. WEISE, T., BOUAZIZ, S., LI, H., AND PAULY, M. 2011. Realtime performance-based facial animation. ACM Trans. Graph. 30, 4 (July), 77:1-77:10.
34. WENG, Y., CAO, C., HOU, Q., AND ZHOU, K. 2013. Realtime facial animation on mobile devices. Graphical Models, PrePrints.
35. WILLIAMS, L. 1990. Performance-driven facial animation. In Proceedings of SIGGRAPH, 235-242.
36. XIAO, J., BAKER, S., MATTHEWS, I., AND KANADE, T. 2004. Real-time combined 2d+3d active appearance models. In Proceedings of IEEE CVPR, 535-542.
37. XIONG, X., AND DE LA TORRE, F. 2013. Supervised descent method and its applications to face alignment. In Proceedings of IEEE CVPR, 532-539.
38. ZHANG, L., SNAVELY, N., CURLESS, B., AND SEITZ, S. M. 2004. Spacetime faces: high resolution capture for modeling and animation. ACM Trans. Graph. 23, 3, 548-558.