Multi-scale capture of facial geometry and motion

Proceedings of the ACM SIGGRAPH Conference on Computer Graphics

Volumn , Issue , 2007, Pages

  Bickel, Bernd ^a   Botsch, Mario ^a   Angst, Roland ^b   Matusik, Wojciech ^b   Otaduy, Miguel ^a   Pfister, Hanspeter ^b   Gross, Markus ^a  

^a ETH ZURICH   (Switzerland)

^b MERL ^*

Author keywords

Animation; Face modeling; Motion capture

Indexed keywords

FACE MODELING; HIGH RESOLUTION FACIAL GEOMETRY; MOTION CAPTURE; WRINKLE GEOMETRY; FACIAL GEOMETRIES; FACIAL MOTIONS; FACIAL SHAPES; HIGH RESOLUTIONS; MOTION SYNTHESES; MULTIPLE SCALES; NONLINEAR ENERGY OPTIMIZATIONS; PARAMETRIC FORMS; REFLECTANCE DATUMS; SALIENT FEATURES;

FEATURE EXTRACTION; GEOMETRY; IMAGE ACQUISITION; IMAGE RESOLUTION; OPTIMIZATION; VIDEO CAMERAS; ANIMATION; COMPUTER GRAPHICS; FACE RECOGNITION; INTERACTIVE COMPUTER GRAPHICS;

ANIMATION; COMPUTATIONAL GEOMETRY;

EID: 37049016671     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1275808.1276419     Document Type: Conference Paper

References (47)

1. BANDO, Y., KURATATE, T., AND NISHITA, T. 2002. A simple method for modeling wrinkles on human skin. In Proc. of Pacific Conference on Computer Graphics and Applications.
2. BLANZ, V., BASSO, C., POGGIO, T., AND VETTER, T. 2003. Reanimating faces in images and video. Computer Graphics Forum 22, 3, 641-650.
3. BORSHUKOV, G., AND LEWIS, J. 2003. Realistic human face rendering for "The Matrix Reloaded". In ACM SIGGRAPH 03 Sketches & Applications.
4. BORSHUKOV, G., PIPONI, D., LARSEN, O., LEWIS, J., AND TEMPELAAR-LIETZ, C. 2003. Universal capture - Image-based facial animation for "The Matrix Reloaded". In ACM SIGGRAPH 03 Sketches & Applications.
5. BOTSCH, M., AND KOBBELT, L. 2004. An intuitive framework for real-time freeform modeling. ACM Transactions on Graphics 23, 3, 630-634.
6. BOTSCH, M., AND KOBBELT, L. 2005. Real-time shape editing using radial basis functions. Computer Graphics Forum 24, 3, 611-621.
7. BOTSCH, M., AND SORKINE, O. 2007. On linear variational surface deformation methods. IEEE Transactions on Visualization and Computer Graphics (TVCG), to appear.
8. BOTSCH, M., BOMMES, D., AND KOBBELT, L. 2005. Efficient linear system solvers for geometry processing. In 11th IMA conference on the Mathematics of Surfaces, 62-83.
9. BRIDSON, R., MARINO, S., AND FEDKIW, R. 2003. Simulation of clothing with folds and wrinkles. In Proc. of ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA), 28-36.
10. CARR, J. C., BEATSON, R. K., CHERRIE, J. B., MITCHELL, T. J., FRIGHT, W. R., MCCALLUM, B. C., AND EVANS, T. R. 2001. Reconstruction and representation of 3D objects with radial basis functions. In Proc. of ACM SIGGRAPH 01, 67-76.
11. CELNIKER, G., AND GOSSARD, D. 1991. Deformable curve and surface finite-elements for free-form shape design. In Proc. of ACM SIGGRAPH 91, 257-266.
12. CORTES, C., AND VAPNIK, V. 1995. Support-vector networks. Machine Learning 20, 3, 273-297.
13. DECARLO, D., AND METAXAS, D. 1996. The integration of optical flow and deformable models with applications to human face shape and motion estimation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 231-238.
14. DESBRUN, M., MEYER, M., SCHRÖDER, P., AND BARR, A. H. 1999. Implicit fairing of irregular meshes using diffusion and curvature flow. In Proc. of ACM SIGGRAPH 99, 317-324.
15. DUCHON, J. 1977. Spline minimizing rotation-invariant seminorms in Sobolev spaces. In Constructive Theory of Functions of Several Variables, W Schempp and K. Zeller, Eds., no. 571 in Lecture Notes in Mathematics. Springer, 85-100.
16. ESSA, I. A., AND PENTLAND, A. 1997. Coding, analysis, interpretation, and recognition of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 19, 7, 757-763.
17. ESSA, I., BASU, S., DARRELL, T., AND PENTLAND, A. 1996. Modeling, tracking and interactive animation of faces and heads: Using input from video. In Proc. of Computer Animation 96, 68-79.
18. GRINSPUN, E., HIRANI, A. N., DESBRUN, M., AND SCHRÖDER, P. 2003. Discrete shells. In Proc. of ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA), 62-67.
19. GUENTER, B., GRIMM, C., WOOD, D., MALVAR, H., AND PIGHIN, R 1998. Making faces. In Proc. of ACM SIGGRAPH 98, 55-66.
20. HORN, B. K. 1987. Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America 4, 4, 629-642.
21. HYNEMAN, W., ITOKAZU, H., WILLIAMS, L., AND ZHAO, X. 2005. Human face project. In ACM SIGGRAPH 05 Course Notes.
22. IGARASHI, T., NISHINO, K., AND NAYAR, S. 2005. The appearance of human skin. Tech. Rep. CUCS-024-05, Department of Computer Science, Columbia University.
23. JONES, A., GARDNER, A., BOLAS, M., MCDOWALL, I., AND DEBEVEC, P. 2006. Performance geometry capture for spatially varying relighting. In 3rd European Conference on Visual Media Production (CVMP 2006).
24. KOBBELT, L., VORSATZ, J., AND SEIDEL, H.-P. 1999. Multiresolution hierarchies on unstructured triangle meshes. Comput. Geom. Theory Appl. 14, 1-3, 5-24.
25. KOCH, R. M., GROSS, M. H., CARLS, F. R., VON BÜREN, D. F., FANKHAUSER, G., AND PARISH, Y. 1996. Simulating facial surgery using finite element methods. In Proc. of ACM SIGGRAPH 96, 421-428.
26. LANIR, Y. 1987. Skin mechanics. In Handbook of Bioengineering, R. Skalak and S. Chien, Eds. McGraw-Hill, 111-1125.
27. LI, H., ROIVAINEN, P., AND FORCHHEIMER, R. 1993. 3-D motion estimation in model-based facial image coding. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 15, 6, 545-555.
28. MAGNENAT-THALMANN, N., KALRA, P., LÉVÊQUE, J. L., BAZIN, R., BATISSE, D., AND QUELEUX, B. 2002. A computational skin model: fold and wrinkle formation. IEEE Trans. on Information Technology in Biomedicine 6, 4, 317-323.
29. MEYER, M., DESBRUN, M., SCHRÖDER, P., AND BARR, A. H. 2003. Discrete differential-geometry operators for triangulated 2-manifolds. In Visualization and Mathematics 111, H.-C. Hege and K. Polthier, Eds. Springer-Verlag, Heidelberg, 35-57.
30. NEHAB, D., RUSINKIEWICZ, S., DAVIS, J., AND RAMAMOORTHI, R. 2005. Efficiently combining positions and normals for precise 3d geometry. ACMTransactions on Graphics 24, 3, 536-543.
31. NOH, J.-Y., AND NEUMANN, U. 1999. A survey of facial modeling and animation techniques. Tech. Rep. USC-TR-99-705, Univeristy of Southern Californina.
32. NOH, J.-Y., AND NEUMANN, U. 2001. Expression cloning. In Proc. of SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 277-288.
33. PIGHIN, F. H., SZELISKI, R., AND SALESIN, D. 1999. Resynthesizing facial animation through 3D model-based tracking. In International Conference on Computer Vision (ICCV), 143-150.
34. SHI, L., YU, Y., BELL, N., AND FENG, W.-W. 2006. A fast multigrid algorithm for mesh deformation. ACM Transactions on Graphics 25, 3, 1108-1117.
35. SIFAKIS, E., NEVEROV, I., AND FEDKIW, R. 2005. Automatic determination of facial muscle activations from sparse motion capture marker data. ACM Transactions on Graphics 24, 3, 411-425.
36. SVOBODA, T., MARTINEC, D., AND PAJDLA, T. 2005. A convenient multicamera self-calibration for virtual environments. Presence: Teleoper. Virtual Environ. 14, 4, 407-422.
37. TERZOPOULUS, D., AND WATERS, K. 1993. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 14, 569-579.
38. VENKATARAMAN, K., LODHA, S., AND RAGHAVAN, R. 2005. A kinematic-variational model for animating skin with wrinkles. Computers & Graphics 29, 5, 756-770.
39. VLASIC, D., BRAND, M., PFISTER, H., AND POPOVIĆ, J. 2005. Face transfer with multilinear models. ACM Transactions on Graphics 24, 3, 426-433.
40. WANG, Y., HUANG, X., LEE, C.-S., ZHANG, S., LI, Z., SAMARAS, D., METAXAS, D., ELGAMMAL, A., AND HUANG, P. 2004. High resolution acquisition, learning and transfer of dynamic 3-D facial expressions. Computer Graphics Forum 23, 3, 677-686.
41. W.ENGER, A., GARDNER, A., TCHOU, C., UNGER, J., HAWKINS, T., AND DEBEVEC, P. 2005. Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Transactions on Graphics 24, 3, 756-764.
42. WEYRICH, T., MATUSIK, W., PFISTER, H., BICKEL, B., DONNER, C., TU, C., MCANDLESS, J., LEE, J., NGAN, A., JENSEN, H. W., AND GROSS, M. 2006. Analysis of human faces using a measurement-based skin reflectance model. ACM Transactions on Graphics 25, 3, 1013-1024.
43. WILLIAMS, L. 1990. Performance-driven facial animation. In Proc. of ACM SIGGRAPH 90, vol. 24, 235-242.
44. WU, Y., KALRA, P., AND MAGNENAT- THALMANN, N. 1996. Simulation of static and dynamic wrinkles of skin. In Proc. of Computer Animation, 90-97.
45. ZHANG, S., AND HUANG, P. 2006. High-resolution, real-time three-dimensional shape measurement. Optical Engineering 45, 12.
46. ZHANG, Y., AND SIM, T. 2005. Realistic and efficient wrinkle simulation using an anatomy-based face model with adaptive refinement. In Computer Graphics International 2005, 3-10.
47. ZHANG, L., SNAVELY, N., CURLESS, B., AND SEITZ, S. M. 2004. Spacetime faces: High resolution capture for modeling and animation. ACM Transactions on Graphics 23, 3, 548-558.