Spacetime expression cloning for blendshapes

ACM Transactions on Graphics

Volumn 31, Issue 2, 2012, Pages 1-12

  Seol, Yeongho ^a   Lewis, J P ^b   Seo, Jaewoo ^a   Choi, Byungkuk ^a   Anjyo, Ken ^c   Noh, Junyong ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^b WETA DIGITAL   (New Zealand)

^c IMAGICA GROUP   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; BOUNDARY CONDITIONS; CLONE CELLS; POISSON EQUATION;

BASIC PRINCIPLES; BAYESIAN FORMULATION; CREATIVE CONTROL; EXPRESSION CLONING; FACIAL ANIMATION; TARGET MOVEMENTS; TEMPORAL DERIVATIVES; USER-SPECIFIED CONSTRAINTS;

ANIMATION;

EID: 84860475653     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2159516.2159519     Document Type: Article

References (43)

1. BEELER, T., HAHN, F., BRADLEY, D., BICKEL, B., BEARDSLEY, P., GOTSMAN, C., SUMNER, R. W., AND GROSS, M. 2011. High-quality passive facial performance capture using anchor frames. ACM Trans. Graph. 30, 75:1-75:10.
2. BICKEL, B., BOTSCH, M., ANGST, R., MATUSIK, W., OTADUY, M., PFISTER, H., AND GROSS, M. 2007. Multi-Scale capture of facial geometry and motion. ACM Trans. Graph. 26, 3, 33.
3. BLANZ, V. AND VETTER, T. 1999. A morphable model for the synthesis of 3d faces. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive techniques. ACM Press/Addison-Wesley Publishing Co., New York, 187-194.
4. BORSHUKOV, G., PIPONI, D., LARSEN, O., LEWIS, J., AND TEMPELAAR-LIETZ, C. 2003. Universal capture: Image-based facial animation for "The Matrix Reloaded." In ACM SIGGRAPH 2003 Sketches & Applications. ACM, New York, 1-1.
5. BREGLER, C., LOEB, L., CHUANG, E., AND DESHPANDE, H. 2002. Turning to the masters: Motion capturing cartoons. ACM Trans. Graph. 21, 3, 399-407.
6. CAO, Y., FALOUTSOS, P., AND PIGHIN, F. 2003. Unsupervised learning for speech motion editing. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. Eurographics Association, 225-231.
7. CHOE, B., LEE, H., AND SEOKKO, H. 2001. Performance-driven muscle-based facial animation. J. Vis. Comput. Anim. 12, 67-79. (Pubitemid 33692528)
8. CHUANG, E. AND BREGLER, C. 2002. Performance driven facial animation using blendshape interpolation. Tech. rep., Department of Computer Science, Stanford University.
9. CHUANG, E. AND BREGLER, C. 2005. Mood swings: Expressive speech animation. ACM Trans. Graph. 24, 2, 331-347.
10. DENG, Z., CHIANG, P.-Y., FOX, P., AND NEUMANN, U. 2006. Animating blendshape faces by cross-mapping motion capture data. In Proceedings of the Symposium on Interactive 3D Graphics and Games. ACM, New York, 43-48.
11. DENG, Z. AND NOH, J. 2007. Computer Facial Animation: A Survey. Springer, London.
12. EKMAN, P. AND FRIESEN, W. 1977. Manual for the Facial Action Coding System. Consulting Psychologists Press, Palo Alto, CA.
13. HAVALDAR, P. 2006. Performance driven facial animation. In ACM SIGGRAPH '06 Course #30 Notes.
14. HERTZMANN, A. 2004. Introduction to Bayesian learning. In ACM SIGGRAPH'04 Course Notes. ACM, New York, 22.
15. JOSHI, P., TIEN, W. C., DESBRUN, M., AND PIGHIN, F. 2003. Learning controls for blend shape based realistic facial animation. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. Eurographics Association, 187-192.
16. KOVAR, L. AND GLEICHER, M. 2003. Flexible automatic motion blending with registration curves. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. Eurographics Association, 214-224.
17. KRAEVOY, V., SHEFFER, A., AND GOTSMAN, C. 2003. Matchmaker: constructing constrained texture maps. ACM SIGGRAPH'03 Papers. ACM, 326-333.
18. LAU, M., CHAI, J., XU, Y.-Q., AND SHUM, H.-Y. 2009. Face poser: Interactive modeling of 3d facial expressions using facial priors. ACM Trans. Graph. 29, 1, 1-17.
19. LEE, J., CHAI, J., REITSMA, P. S. A., HODGINS, J. K., AND POLLARD, N. S. 2002. Interactive control of avatars animated with human motion data. ACM Trans. Graph. 21, 3, 491-500.
20. LEVY, B., PETITJEAN, S., RAY, N., AND MAILLOT, J. 2002. Least squares conformal maps for automatic texture atlas generation. In ACM SIGGRAPH Conference Proceedings.
21. LEWIS, J. AND ANJYO, K. 2010. Direct manipulation blendshapes. IEEE Comput. Graph. Appl. 30, 4, 42-50.
22. LI, H., SUMNER, R. W., AND PAULY, M. 2008. Global correspondence optimization for non-rigid registration of depth scans. Comput. Graph. Forum 27, 5.
23. LI, H., WEISE, T., AND PAULY, M. 2010. Example-based facial rigging. ACM Trans. Graph. 29, 4, 1-6.
24. LI, Q. AND DENG, Z. 2008. Orthogonal blendshape based editing system for facial motion capture data. IEEE Comput. Graph. Appl., 76-82.
25. LUAMANUVAE, J. 2010. Personal communication (Weta Digital).
26. MA, W.-C., JONES, A., CHIANG, J.-Y., HAWKINS, T., FREDERIKSEN, S., PEERS, P., VUKOVIC, M., OUHYOUNG, M., AND DEBEVEC, P. 2008. Facial performance synthesis using deformation-driven polynomial displacement maps. ACM Trans. Graph. 27, 5, 1-10.
27. MA, X., LE, B. H., AND DENG, Z. 2009. Style learning and transferring for facial animation editing. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. ACM, New York, 123-132.
28. NOH, J. AND NEUMANN, U. 2001. Expression cloning. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. ACM. 277-288. (Pubitemid 33047313)
29. ORVALHO, V. C., ZACUR, E., AND SUSIN, A. 2008. Transferring the rig and animations from a character to different face models. Comput. Graph. Forum 27, 8, 1997-2012.
30. PARKE, F. I. 1972. Computer generated animation of faces. In Proceedings of the ACM Annual Conference. ACM, New York, 451-457.
31. PARKE, F. I. AND WATERS, K. 1996. Computer Facial Animation. A. K. Peters.
32. PÉREZ, P., GANGNET, M., AND BLAKE, A. 2003. Poisson image editing. ACM Trans. Graph. 22, 3, 313-318.
33. PIGHIN, F., SZELISKI, R., AND SALESIN, D. H. 2002. Modeling and animating realistic faces from images. Int. J. Comput. Vis. 50, 2, 143-169. (Pubitemid 35311925)
34. PYUN, H., KIM, Y., CHAE, W., KANG, H. W., AND SHIN, S. Y. 2003. An example-based approach for facial expression cloning. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. Eurographics Association, 167-176.
35. REVERET, L. AND ESSA, I. 2001. Visual coding and tracking of speech related facial motion. Tech. rep., IEEE CVPR International Workshop on Cues in Communication.
36. SAGAR, M. AND GROSSMAN, R. 2006. Facial performance capture and expressive translation for King Kong. In SIGGRAPH Sketches.
37. SUMNER, R. W. AND POPOVIC, J. 2004. Deformation transfer for triangle meshes. ACM SIGGRAPH Papers. ACM. 399-405.
38. SUMNER, R. W., ZWICKER, M., GOTSMAN, C., AND POPOVIĆ, J. 2005. Mesh-based inverse kinematics. In ACM SIGGRAPH Papers. ACM, New York, 488-495.
39. VLASIC, D., BRAND, M., PFISTER, H., AND POPOVIĆ, J. 2005. Face transfer with multilinear models. ACM Trans. Graph. 24, 3, 426-433.
40. WAHBA, G. 1990. Spline Models for Observational Data. SIAM.
41. WEISE, T., LI, H., VAN GOOL, L., AND PAULY, M. 2009. Face/off: Live facial puppetry. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. ACM, New York, 7-16.
42. WILLIAMS, L. 1990. Performance-driven facial animation. In Proceedings of the 17th Annual Conference on Computer Graphics and Interactive Techniques. ACM, New York, 235-242.
43. ZHANG, L., SNAVELY, N., CURLESS, B., AND SEITZ, S. M. 2004. Spacetime faces: High resolution capture for modeling and animation. ACM SIGGRAPH Papers. ACM, New York, 548-558.