High resolution passive facial performance capture

ACM Transactions on Graphics

Volumn 29, Issue 4, 2010, Pages

  Bradley, Derek ^a   Heidrich, Wolfgang ^a   Popa, Tiberiu ^a,b   Sheffer, Alla ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b ETH ZURICH   (Switzerland)

Author keywords

Face reconstruction; Markerless motion capture; Performance capture

Indexed keywords

ACTIVE LIGHTING; AUTOMATICALLY TRACKING; FACE RECONSTRUCTION; FACIAL GEOMETRY; HIGH RESOLUTION; MARKERLESS MOTION CAPTURE; MULTI-VIEW STEREO; PARAMETERIZED; PERFORMANCE CAPTURE;

FACE RECOGNITION; TEXTURES; VIDEO CAMERAS;

MOTION ESTIMATION;

EID: 77956380170     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1778765.1778778     Document Type: Article

References (31)

1. ALEXANDER, O., ROGERS, M., LAMBETH, W., CHIANG, M., AND DEBEVEC, P. 2009. The digital emily project: photoreal facial modeling and animation. In ACM SIGGRAPH Courses, 1-15.
2. BEELER, T., BICKEL, B., SUMNER, R., BEARDSLEY, P., AND GROSS, M. 2010. High-quality single-shot capture of facial geometry. ACM Trans. Graphics (Proc. SIGGRAPH).
3. BICKEL, B., BOTSCH, M., ANGST, R., MATUSIK, W., OTADUY, M., PFISTER, H., AND GROSS, M. 2007. Multi-scale capture of facial geometry and motion. ACM Trans. Graphics (Proc. SIGGRAPH), 33.
4. BLANZ, V., BASSO, C., VETTER, T., AND POGGIO, T. 2003. Reanimating faces in images and video. Computer Graphics Forum (Proc. Eurographics) 22, 3, 641-650.
5. BORSHUKOV, G., PIPONI, D., LARSEN, O., LEWIS, J. P., AND TEMPELAAR-LIETZ, C. 2003. Universal capture: image-based facial animation for "the matrix reloaded". In ACM SIGGRAPH Sketches & Applications.
6. BOUGUET, J.-Y. 1999. Pyramidal implementation of the lucas kanade feature tracker: Description of the algorithm. Tech. rep., Intel Corporation, Microprocessor Research Labs.
7. BRADLEY, D., AND HEIDRICH, W. 2010. Binocular camera calibration using rectification error. In Canadian Conference on Computer and Robot Vision.
8. BRADLEY, D., BOUBEKEUR, T., AND HEIDRICH, W. 2008. Accurate multi-view reconstruction using robust binocular stereo and surface meshing. In Proc. CVPR.
9. BRADLEY, D., POPA, T., SHEFFER, A., HEIDRICH, W., AND BOUBEKEUR, T. 2008. Markerless garment capture. ACM Trans. Graphics (Proc. SIGGRAPH) 27, 3, 99.
10. BRADLEY, D., ATCHESON, B., IHRKE, I., AND HEIDRICH, W. 2009. Synchronization and rolling shutter compensation for consumer video camera arrays. In International Workshop on Projector-Camera Systems (PROCAMS 2009).
11. CANNY, J. 1986. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8, 6, 679-698.
12. DE AGUIAR, E., STOLL, C., THEOBALT, C., AHMED, N., EIDEL, H.-P. S., AND THRUN, S. 2008. Performance capture from sparse multi-view video. ACM Trans. Graphics (Proc. SIGGRAPH), 98.
13. DECARLO, D., AND METAXAS, D. 1996. The integration of optical flow and deformable models with applications to human face shape and motion estimation. In CVPR, 231.
14. DECARLO, D., AND METAXAS, D. 2000. Optical flow constraints on deformable models with applications to face tracking. Int. Journal of Computer Vision 38, 2, 99-127.
15. ESSA, I., BASU, S., DARRELL, T., AND PENTLAND, A. 1996. Modeling, tracking and interactive animation of faces and heads using input from video. In Proceedings of Computer Animation, 68.
16. FIALA, M., AND SHU, C. 2008. Self-identifying patterns for plane-based camera calibration. Machine Vision and Applications 19, 4, 209-216.
17. FURUKAWA, Y., AND PONCE, J. 2009. Dense 3d motion capture for human faces. In CVPR.
18. GUENTER, B., GRIMM, C., WOOD, D., MALVAR, H., AND PIGHIN, F. 1998. Making faces. In SIGGRAPH'98: Proceedings of the 25th annual conference on Computer graphics and interactive techniques, 55-66.
19. KADIR, T., AND BRADY, M. 2001. Saliency, scale and image description. Int. J. Comput. Vision 45, 2, 83-105.
20. LÉVY, B., PETITJEAN, S., RAY, N., AND MAILLOT, J. 2002. Least squares conformal maps for automatic texture atlas generation. ACM Trans. Graph. 21, 3, 362-371.
21. LI, H., ROIVAINEN, P., AND FORCHEIMER, R. 1993. 3-d motion estimation in model-based facial image coding. IEEE Trans. Pattern Anal. Mach. Intell. 15, 6, 545-555.
22. LIN, I.-C., AND OUHYOUNG, M. 2005. Mirror mocap: Automatic and efficient capture of dense 3d facial motion parameters from video. The Visual Computer 21, 6, 355-372.
23. MA, W.-C., HAWKINS, T., PEERS, P., CHABERT, C.-F., WEISS, M., AND DEBEVEC, P. 2007. Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination. In Eurographics Symposium on Rendering, 183-194.
24. MA, W.-C., JONES, A., CHIANG, J.-Y., HAWKINS, T., FREDERIKSEN, S., PEERS, P., VUKOVIC, M., OUHYOUNG, M., AND DEBEVEC, P. 2008. Facial performance synthesis using deformation-driven polynomial displacement maps. ACM Trans. Graphics (Proc. SIGGRAPH Asia) 27, 5, 121.
25. MOHAMMED, U., PRINCE, S. J. D., AND KAUTZ, J. 2009. Visiolization: generating novel facial images. ACM Trans. Graph. 28, 3, 57.
26. PÉREZ, P., GANGNET, M., AND BLAKE, A. 2003. Poisson image editing. ACM Trans. Graph. 22, 3, 313-318.
27. PIGHIN, F. H., SZELISKI, R., AND SALESIN, D. 1999. Resynthesizing facial animation through 3d model-based tracking. In ICCV, 143-150.
28. SHEWCHUK, J. 1996. Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. In Applied Computational Geometry: Towards Geometric Engineering, M. C. LIN AND D. MANOCHA, Eds., vol. 1148 of Lecture Notes in Computer Science. Springer-Verlag, 203-222.
29. WANG, Y., HUANG, X., LEE, C.-S., ZHANG, S., LI, Z., SAMARAS, D., METAXAS, D., ELGAMMAL, A., AND HUANG, P. 2004. High resolution acquisition, learning and transfer of dyanmic 3-d facial expressions. In Computer Graphics Forum, 677-686.
30. WILLIAMS, L. 1990. Performance-driven facial animation. SIGGRAPH Comput. Graph. 24, 4, 235-242.
31. ZHANG, L., SNAVELY, N., CURLESS, B., AND SEITZ, S. M. 2004. Spacetime faces: high resolution capture for modeling and animation. ACM Trans. Graphics (Proc. SIGGRAPH), 548-558.