Driving high-resolution facial scans with video performance capture

ACM Transactions on Graphics

Volumn 34, Issue 1, 2014, Pages

  Fyffe, Graham ^a   Jones, Andrew ^a   Alexander, Oleg ^a   Ichikari, Ryosuke ^a   Debevec, Paul ^a  

^a University of Southern California   (United States)

Author keywords

Facial animation; Temporal correspondence

Indexed keywords

BLENDING; CONTOUR MEASUREMENT; MESH GENERATION; OPTICAL CORRELATION; OPTICAL FLOWS; REFLECTION; TRIANGULATION;

ARBITRARY ENVIRONMENT; CONFIDENCE MAPS; FACIAL ANIMATION; NORMALIZED CROSS CORRELATION; PARTIAL CORRESPONDENCES; PERFORMANCE CAPTURE; SHAPE REGULARIZATION; TEMPORAL CORRESPONDENCE;

RENDERING (COMPUTER GRAPHICS);

EID: 84920719249     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2638549     Document Type: Article

References (30)

1. O. Alexander, M. Rogers, W. Lambeth, M. Chiang, and P. Debevec. 2009. Creating a photoreal digital actor: The digital Emily project. In Proceedings of the Conference on Visual Media Production (CVMP'09). 176-187.
2. S. Baker, D. Scharstein, J. P. Lewis, S. Roth, M. J. Black, and R. Szeliski. 2011. A database and evaluation methodology for optical flow. Int. J. Comput. Vis. 92, 1, 1-31.
3. T. Beeler, B. Bickel, P. Beardsley, B. Sumner, and M. Gross. 2010. Highquality single-shot capture of facial geometry. ACM Trans. Graph. 29, 3, 40:1-40:9.
4. T. Beeler, F. Hahn, D. Bradley, B. Bickel, P. Beardsley, C. Gotsman, R. W. Sumner, and M. Gross. 2011. High-quality passive facial performance capture using anchor frames. In ACM SIGGRAPH Papers. ACM Press, New York, 75:1-75:10.
5. B. Bickel, M. Lang, M. Botsch, M. A. Otaduy, and M. Gross. 2008. Posespace animation and transfer of facial details. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Graphics and Interactive Techniques. Eurographics Association, Aire-la-Ville, Switzerland. 57-66.
6. G. Borshukov, D. Piponi, O. Larsen, J. P. Lewis, and C. Tempelaar-Lietz. 2003. Universal capture: Image-based facial animation for "the matrix reloaded." In Proceedings of the ACM SIGGRAPH Conference on Computer Graphics and Interactive Techniques, A. P. Rockwood, Ed. ACM Press, New York.
7. D. Bradley, W. Heidrich, T. Popa, and A. Sheffer. 2010. High resolution passive facial performance capture. In ACM SIGGRAPH Papers. ACM Press, New York, 41:1-41:10.
8. T. F. Cootes, G. J. Edwards, and C. J. Taylor. 1998. Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23, 6, 484-498.
9. th Annual ACM SIGGRAPH Conference on Computer Graphics and Interactive Techniques. ACM Press, New York, 189-198.
10. D. De Carlo and D. Metaxas. 1996. The integration of optical flow and deformable models with applications to human face shape and motion estimation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'96). 231-238.
11. P. Ekman and W. Friesen. 1978. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto, CA.
12. A. Ghosh, G. Fyffe, B. Tunwattanapong, J. Busch, X. Yu, and P. Debevec. 2011. Multiview face capture using polarized spherical gradient illumination. In Proceedings of the SIGGRAPH Asia Conference. ACM Press, New York, 129:1-129:10.
13. th Annual ACM SIGGRAPH Conference on Computer Graphics and Interactive Techniques. ACM Press, New York, 55-66.
14. th Eurographics Workshop on Rendering Techniques. 309-320.
15. H. Huang, J. Chai, X. Tong, and H.-T. Wu. 2011. Leveraging motion capture and 3d scanning for high-fidelity facial performance acquisition. ACM Trans. Graph. 30, 4, 74:1-74:10.
16. J. Jimenez, A. Jarabo, D. Gutierrez, E. Danvoye, and J. Von Der Pahlen. 2012. Separable subsurface scattering and photorealistic eyes rendering. In ACM SIGGRAPH Courses. ACM Press, New York.
17. M. Klaudiny and A. Hilton. 2012. High-detail 3d capture and non-sequential alignment of facial performance. In Proceedings of the International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DPVT'12).
18. M. Klaudiny, A. Hilton, and J. Edge. 2010. High-detail 3d capture of facial performance. InProceedings of the International Conference on 3D Imaging, Modeling, Processing, Visualization and Trasmission (3DPVT'10).
19. V. Kolmogorov. 2006. Convergent tree-reweighted message passing for energy minimization. IEEE Trans. Pattern Anal. Mach. Intell. 28, 10, 1568-1583.
20. H. Li, P. Roivainen, and R. Forcheimer. 1993. 3-d motion estimation in model-based facial image coding. IEEE Trans. Pattern Anal. Mach. Intell. 15, 6, 545-555.
21. W.-C. Ma, A. Jones, J.-Y. Chiang, T. Hawkins, S. Frederiksen, P. Peers, M. Vukovic, M. Ouhyoung, and P. Debevec. 2008. Facial performance synthesis using deformation-driven polynomial displacement maps. ACM Trans. Graph. 27, 5, 121:1-121:10.
22. K. Nishino and S. K. Navar. 2004. Eyes for relighting. ACM Trans. Graph. 23, 3, 704-711.
23. M. Park, S. Kashyap, R. Collins, and Y. Liu. 2010. Data driven mean-shift belief propagation for non-gaussian mrfs. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'10). 3547-3554.
24. T. Popa, I. South Ickinson, D. Bradley, A. Sheffer, and W. Heidrich. 2010. Globally consistent space-time reconstruction. In Proceedings of the Eurographics Symposium on Geometry Processing (SGP'10).
25. Y. Seol, J. Lewis, J. Seo, B. Choi, K. Anjyo, and J. Noh. 2012. Spacetime expression cloning for blendshapes. ACM Trans. Graph. 31, 2, 14:1-14:12.
26. L. Valgaerts, C. Wu, A. Bruhn, H.-P. Seidel, and C. Theobalt. 2012. Lightweight binocular facial performance capture under uncontrolled lighting. ACM Trans. Graph. 31, 6, 187:1-187:11.
27. T. Weise, S. Bouaziz, H. Li, and M. Pauly. 2011. Realtime performancebased facial animation. In ACM SIGGRAPH Papers. ACM Press, New York, 77:1-77:10.
28. M. Werlberger. 2012. Convex approaches for high performance video processing. Ph. D. thesis, Institute for Computer Graphics and Vision, Graz University of Technology, Graz, Austria.
29. L. Zhang, N. Snavely, B. Curless, and S. M. Seitz. 2004. Spacetime faces: High resolution capture for modeling and animation. In ACM SIGGRAPH Papers. ACM Press, New York, 548-558.
30. X. Zhu and D. Ramanan. 2012. Face detection, pose estimation, and landmark localization in the wild. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'12). 2879-2886.