Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisition

ACM Transactions on Graphics

Volumn 30, Issue 4, 2011, Pages

  Huang, Haoda ^a   Chai, Jinxiang ^b   Tong, Xin ^a   Wu, Hsiang Tao ^a  

^a MICROSOFT RESEARCH ASIA   (China)

^b TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Blendshape interpolation; Face modeling; Facial animation; Facial data analysis; Motion capture; Nonrigid surface registration

Indexed keywords

BLENDSHAPE INTERPOLATION; FACE MODELING; FACIAL ANIMATION; FACIAL DATA; MOTION CAPTURE; NONRIGID SURFACE REGISTRATION;

ANIMATION; DATA REDUCTION; INTERACTIVE COMPUTER GRAPHICS; INTERPOLATION;

THREE DIMENSIONAL;

EID: 80051886901     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1964921.1964969     Document Type: Article

References (28)

1. ALEXA, M. 2003. Differential coordinates for local mesh morphing and deformation. The Visual Computer. 19(2):105-114.
2. ALEXANDER, O., ROGERS, M., LAMBETH, W., CHIANG, M., AND DEBEVEC, P. 2009. The digital emily project: photoreal facial modeling and animation. In ACM SIGGRAPH 2009 Courses, 12:1-12:15.
3. BEELER, T., BICKEL, B., BEARDSLEY, P., SUMNER, B., AND GROSS, M. 2010. High-quality single-shot capture of facial geometry. ACM Trans. Graph. 29, 4, 40:1-40:9.
4. BICKEL, B., BOTSCH, M., ANGST, R., MATUSIK, W., OTADUY, M., PFISTER, H., AND GROSS, M. 2007. Multi-scale capture of facial geometry and motion. ACM Trans. Graph. 26, 3, 33:1- 33:10.
5. BLANZ, V., BASSO, C., POGGIO, T., AND VETTER, T. 2003. Reanimating faces in images and video. In Computer Graphics Forum. 22(3):641-650.
6. BORSHUKOV, G., PIPONI, D., LARSEN, O., LEWIS, J. P., AND TEMPELAAR-LIETZ, C. 2003. Universal capture: image-based facial animation for "the matrix reloaded". In ACM SIGGRAPH 2003 Sketches &Applications, 1-1.
7. BRADLEY, D., HEIDRICH, W., POPA, T., AND SHEFFER, A. 2010. High resolution passive facial performance capture. ACM Trans. Graph. 29, 4, 41:1-41:10.
8. CAZALS, F., AND POUGET, M. 2003. Estimating differential quantities using polynomial fitting of osculating jets. In Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing, 177-187.
9. CHAI, J., AND HODGINS, J. 2007. Constraint-based motion optimization using a statistical dynamic model. ACM Transactions on Graphics 26, 3, 8:1-8:9.
10. CHAI, J., XIAO, J., AND HODGINS, J. 2003. Vision-based control of 3D facial animation. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 193-206.
11. DECARLO, D., AND METAXAS, D. 2000. Optical flow constraints on deformable models with applications to face tracking. International Journal of Computer Vision. 38(2):99-127.
12. ESSA, I., BASU, S., DARRELL, T., AND PENTLAND, A. 1996. Modeling, tracking and interactive animation of faces and heads using input from video. In Proceedings of Computer Animation Conference. 68-79.
13. GUENTER, B., GRIMM, C., WOOD, D., MALVAR, H., AND PIGHIN, F. 1998. Making Faces. In Proceedings of ACM SIGGRAPH 1998, 55-66.
14. JAMES, D. L., AND TWIGG, C. D. 2005. Skinning mesh animations. ACM Transactions on Graphics 24, 3, 399-407.
15. LAU, M., CHAI, J., XU, Y.-Q., AND SHUM, H. 2009. Face poser: Interactive modeling of 3d facial expressions using facial priors. ACM Transactions on Graphics 29, 1, 3:1-3:17.
16. LI, H., ADAMS, B., GUIBAS, L. J., AND PAULY, M. 2009. Robust single-view geometry and motion reconstruction. ACM Trans. Graph. 28, 5, 175:1-175:10.
17. LI, H., WEISE, T., AND PAULY, M. 2010. Example-based facial rigging. ACM Transactions on Graphics 29, 4, 32:1-32:6.
18. MA, W.-C., JONES, A., CHIANG, J.-Y., HAWKINS, T., FREDERIKSEN, S., PEERS, P., VUKOVIC, M., OUHYOUNG, M., AND DEBEVEC, P. 2008. Facial performance synthesis using deformation-driven polynomial displacement maps. ACM Trans. Graph. 27, 5, 121:1-121:10.
19. PAPENBERG, N., BRUHN, A., BROX, T., DIDAS, S., AND WEICKERT, J. 2006. Highly accurate optic flow computation with theoretically justified warping. Int. J. Comput. Vision 67, 2, 141-158.
20. PIGHIN, F., AND LEWIS, J. P. 2006. Facial motion retargeting. In ACM SIGGRAPH 2006 Courses, SIGGRAPH '06.
21. PIGHIN, F., SZELISKI, R., AND SALESIN, D. 1999. Resynthesizing facial animation through 3D model-based tracking. In International Conference on Computer Vision. 143-150. (Pubitemid 32080032)
22. SORKINE, O., COHEN-OR, D., LIPMAN, Y., ALEXA, M., RÖSSL, C., AND SEIDEL, H.-P. 2004. Laplacian surface editing. In SGP '04: Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing, 175-184.
23. SUMNER, R. W., SCHMID, J., AND PAULY, M. Embedded deformation for shape manipulation. ACM Trans. Graph. 26, 3, 80:1-80:7.
24. VICON SYSTEMS, 2011. http://www.vicon.com.
25. VLASIC, D., BRAND, M., PFISTER, H., AND POPOVIĆ , J. 2005. Face transfer with multilinear models. ACM Transactions on Graphics 24, 3, 426-433.
26. WILLIAMS, L. 1990. Performance driven facial animation. In Proceedings of ACM SIGGRAPH 1990. 24(4):235-242.
27. XYZ RGB SYSTEMS, 2011. http://www.xyzrgb.com/.
28. ZHANG, L., SNAVELY, N., CURLESS, B., AND SEITZ, S. 2004. Spacetime faces: high resolution capture for modeling and animation. ACM Transactions on Graphics 23, 3, 548-558.