Face poser: Interactive modeling of 3D facial expressions using facial priors

ACM Transactions on Graphics

Volumn 29, Issue 1, 2009, Pages

  Lau, Manfred ^a,b   Chai, Jinxiang ^a,c   Xu, Ying Qing ^a,d   Shum, Heung Yeung ^a,d  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b Carnegie Mellon University   (United States)

^c Texas AandM University   (United States)

^d MICROSOFT RESEARCH ASIA   (China)

Author keywords

3d modeling interfaces; Facial modeling and animation; Optimization; Sketching interfaces; Statistical models

Indexed keywords

3-D MODELING; FACIAL EXPRESSION DATA; FACIAL EXPRESSIONS; FACIAL MODELING; FREEFORMS; INTERACTIVE MODELING; MAXIMUM A POSTERIORI; POSTERIORI; SCREEN SPACE; SKETCHING INTERFACE; STATISTICAL MODELS; USER STUDY;

ANIMATION; OPTIMIZATION;

THREE DIMENSIONAL;

EID: 77955884624     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1640443.1640446     Document Type: Article

References (31)

1. BISHOP, C. M. ANDWINN, J. M. 2000. Non-Linear bayesian image modeling. In Proceedings of the European Conference on Computer Vision (ECCV). 3-17.
2. Bishop, C. 1996. Neural Network for Pattern Recognition. Cambridge University Press.
3. BLANZ, V. ANDVETTER, T. 1999. A morphable model for the synthesis of 3d faces. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques. 187-194.
4. BLANZ, V., BASSO, C., POOOIO, T., ANDVETTER, T. 2003. Reanimating faces in images and video. Compiit. Graph. Forum. 22, 3, 641-650.
5. BRAND, M. 2002. Incremental singular value decomposition of uncertain data with missing values. In Proceedings of the European Conference on Computer Vision (ECCV). 707-720.
6. CHAI, J. ANDHODGINS, J. 2005. Performance animation from lowdimensional control signals. ACM Trans. Graph. 24, 3, 686-696.
7. CHAI, J., XIAO, J., ANDHODOINS, J. 2003. Vision-Based control of 3D facial animation. In Proceedings of the ACM SIGGRAPH/ Eurographics Symposium on Computer Animation. 193-206.
8. CHANO, E. ANDJENKINS, O. C. 2006. Sketching articulation and pose for facial animation. In Proceedings of the ACM SIGGRAPHI Eurographics Symposium on Computer Animation. 271-280.
9. DER, K. G., SUMNER, R. W., ANDPOPOVIC, J. 2006. Inverse kinematics for reduced deformable models. ACM Trans. Graph. 25, 3, 1174-1179.
10. DUDA, R. ANDHART, P. 1973. Pattern Classification and Scene Analysis. John Wiley and Sons.
11. FENG, W.-W., KIM, B.-U., ANDYU, Y. 2008. Real-Time data driven deformation using kernel canonical correlation analysis. ACM Trans. Graph. 27, 3, Article no. 91.
12. GALASSI, M., DAVIES, J., THEILER, J., GOUOH, B., JUNGMAN, G., BOOTH, M., ANDROSSI, F. 2003. GNU Scientific Library Reference Manual, Revised 2nd Ed. Network Theory Ltd.
13. GHAHRAMANI, Z. ANDHlNTON, G. E. 1997. The EM algorithm for mixtures of factor analyzers. Tech. rep. CRG-TR-96-1.
14. GROCHOW, K., MARTIN, S. L., HERTZMANN, A., ANDPOPOVIC, Z. 2004. Style-Based inverse kinematics. ACM Trans. Graph. 23, 3, 522-531.
15. HINTON, G. E., DAYAN, P., ANDREVOW, M. 1997. Modeling the manifolds of images of handwritten digits. IEEE Trans. Neural Netw. 8, 1, 65-74.
16. IOARASHI, T., MATSUOKA, S., ANDTANAKA, H. 1999. Teddy: A sketching interface for 3D freeform design. In Proceedings of the ACM SlGGRAPH International Conference on Computer Graphics and Interactive Techniques. 409-416.
17. JOSHI, P., TIEN, W. C., DESBRUN, M., ANDPIGHIN, F. 2003. Learning controls for blendshape based realistic facial animation. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Aimation. 187-192.
18. KHO, Y. ANDGARLAND, M. 2005. Sketching mesh deformations. In Proceedings of the ACM Symposium on Interactive 3D Graphics and Games. 147-154.
19. LAU, M., CHAI, J.-X., XU, Y.-Q., ANDSHUM, H.-Y. 2007. Face poser: Interactive modeling of 3D facial expressions using model priors. In Proceedings of the ACM SIGGRAPH I Eurographics Symposium on Computer Animation. 161-170.
20. LEWIS, J. P., CORONER, M., ANDFONG, N. 2000. Pose space deformation: A unified approach to shape interpolation and skeleton-driven deformation. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques. 165-172.
21. MEYER, M. ANDANDERSON, J. 2007. Key point subspace acceleration and soft caching. ACM Trans. Graph. 26, 3, Article no. 74.
22. NEALEN, A., SORKINE, O., ALEXA, M., ANDCOHEN-OR, D. 2005. A sketch-based interface for detail-preserving mesh editing. ACM Trans. Graph. 24, 3, 1142-1147.
23. PARKE, F. I. 1972. Computer generated animation of faces. In Proceedings of the ACM National Conference. 1, 451-457.
24. PIGHIN, F., SZELISKI, R., ANDSALESIN, D. 1999. Resynthesizing facial animation through 3D model-based tracking. In Proceedings of the International Conference on Computer Vision. 143-150.
25. SLOAN, P.-R, ROSE, C., ANDCOHEN, M. F. 2001. Shape by example. In Proceedings of the ACM Symposium on Interactive 3D Graphics. 135-143.
26. SUMNER, R. W., ZWICKER, M., GOTSMAN, C, ANDPOPOVIC, J. 2005. Mesh-Based inverse kinematics. ACM Trans. Graph. 24, 3, 488-495.
27. VICON SYSTEMS. 2007. http://www.vicon.com.
28. YANG, C, SHARON, D., AND VAN DE PANNE, M. 2005. SketchBased modeling of parameterized objects. In Proceedings of the 2nd Eurographics Workshop on Sketch-Based Interfaces and Modeling.
29. ZELEZNIK, R. C., HERNDON, K. P., ANDHUGHES, J. F. 1996. Sketch: An interface for sketching 3D scenes. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques. 163-170.
30. ZHANG, Q., LIU, Z., GUO, B., ANDSHUM, H. 2003. GeometryDriven photorealistic facial expression synthesis. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer An- imation. 177-186.
31. ZHANG, L., SNAVELY, N., CURLESS, B., ANDSEITZ, S. M. 2004. Spacetime faces: High resolution capture for modeling and animation. ACM Trans. Graph. 23, 3, 548-558.