Comprehensive facial performance capture

Computer Graphics Forum

Volumn 30, Issue 2, 2011, Pages 425-434

  Fyffe, Graham ^a   Hawkins, Tim ^b   Watts, Chris ^c   Ma, Wan Chun ^a   Debevec, Paul ^a  

^a University of Southern California ^*  (United States)

^b Lightstage LLC   (United States)

^c Bake Visual Effects Inc   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FACSIMILE; GEOMETRY; IMAGE SEGMENTATION; LIGHTING; PHOTOGRAPHY; REFLECTION; RENDERING (COMPUTER GRAPHICS); VIRTUAL REALITY;

BELIEF PROPAGATION; DYNAMIC PERFORMANCE; GEOMETRY OPTIMIZATION; LIGHTING CONDITIONS; LIKELIHOOD FUNCTIONS; PERFORMANCE CAPTURE; SPECULAR REFLECTANCE; TEMPLATE GEOMETRIES;

COMPUTER GRAPHICS;

EID: 80051868518     PISSN: 01677055     EISSN: 14678659     Source Type: Journal    
DOI: 10.1111/j.1467-8659.2011.01888.x     Document Type: Conference Paper

References (43)

1. ALEXANDER O., ROGERS M., LAMBETH W., CHIANG M., DEBEVEC P.: Creating a photoreal digital actor: The digital emily project. Conference for Visual Media Production (2009), 176-187.
2. BEELER T., BICKEL B., BEARDSLEY P., SUMNER B., GROSS M.: High-quality single-shot capture of facial geometry. In SIGGRAPH '10: ACM SIGGRAPH 2010 papers (New York, NY, USA, 2010), ACM, pp. 1-9.
3. BRADLEY D., HEIDRICH W., POPA T., SHEFFER A.: High resolution passive facial performance capture. ACM Trans. Graph. 29, 4 (2010), 1-10.
4. BICKEL B., LANG M., BOTSCH M., OTADUY M. A., GROSS M.: Pose-space animation and transfer of facial details. In SCA '08: Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (Aire-la-Ville, Switzerland, Switzerland, 2008), Eurographics Association, pp. 57-66.
5. BORSHUKOV G., PIPONI D., LARSEN O., LEWIS J. P., TEMPELAAR-LIETZ C.: Universal capture: image-based facial animation for "the matrix reloaded". In ACM SIGGRAPH 2003 Sketches & Applications (New York, NY, USA, 2003), SIGGRAPH '03, ACM, pp. 1-1.
6. BLANZ V., VETTER T.: A morphable model for the synthesis of 3d faces. In SIGGRAPH '99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1999), ACM Press/Addison-Wesley Publishing Co., pp. 187-194.
7. CHEN T., GHOSH A., DEBEVEC P.: Data-driven diffuse-specular separation of spherical gradient illumination. In SIGGRAPH '09: Posters (New York, NY, USA, 2009), SIGGRAPH '09, ACM, pp. 33:1-33:1.
8. DEBEVEC P., HAWKINS T., TCHOU C., DUIKER H.-P., SAROKIN W., SAGAR M.: Acquiring the reflectance field of a human face. In Proceedings of ACM SIGGRAPH 2000 (July 2000), Computer Graphics Proceedings, Annual Conference Series, pp. 145-156.
9. ESTEBAN C. H., VOGIATZIS G., CIPOLLA R.: Multiview photometric stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence 30 (2007), 548-554.
10. FUCHS M., BLANZ V., LENSCH H., SEIDEL H.-P.: Reflectance from images: A model-based approach for human faces. IEEE Transactions on Visualization and Computer Graphics 11 (2005), 296-305.
11. FELZENSZWALB P. F., HUTTENLOCHER D. P.: Efficient belief propagation for early vision. In CVPR (2004), pp. 261-268.
12. FURUKAWA Y., PONCE J.: Accurate camera calibration from multi-view stereo and bundle adjustment. IJCV 84, 3 (September 2009).
13. GUENTER B., GRIMM C., WOOD D., MALVAR H., PIGHIN F.: Making faces. In SIGGRAPH (1998), pp. 55-66.
14. GOESELE M., SNAVELY N., CURLESS B., HOPPE H., SEITZ S.: Multi-view stereo for community photo collections. In ICCV07 (2007), pp. 1-8.
15. HIGO N., MATSUSHITA Y., JOSHI N., IKEUCHI K.: A hand-held photometric stereo camera for 3-d modeling. In ICCV09 (2009).
16. HERNANDEZ C., VOGIATZIS G.: Self-calibrating a realtime monocular 3d facial capture system. In 3DPVT (2010).
17. HAINES T., WILSON R.: Combining shape-fromshading and stereo using gaussian-markov random fields. In ICPR08 (2008), pp. 1-4.
18. HAWKINS T., WENGER A., TCHOU C., GARDNER A., GÖRANSSON F., DEBEVEC P.: Animatable facial reflectance fields. In Rendering Techniques (2004), pp. 309-321.
19. KAZHDAN M., BOLITHO M., HOPPE H.: Poisson surface reconstruction. In SGP '06: Proceedings of the fourth Eurographics symposium on Geometry processing (Airela-Ville, Switzerland, Switzerland, 2006), Eurographics Association, pp. 61-70.
20. KLAUDINY M., HILTON A., EDGE J.: High-detail 3d capture of facial performance. In 3DPVT (2010).
21. KOLMOGOROV V.: Convergent tree-reweighted message passing for energy minimization. IEEE Trans. Pattern Anal. Mach. Intell. 28, 10 (2006), 1568-1583.
22. LEMPITSKY V., ROTHER C., ROTH S., BLAKE A.: Fusion moves for markov random field optimization. IEEE Transactions on Pattern Analysis and Machine Intelligence 99, PrePrints (2009).
23. MA W.-C., HAWKINS T., PEERS P., CHABERT C.-F., WEISS M., DEBEVEC P.: Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination. In Rendering Techniques 2007: 18th Eurographics Symposium on Rendering (June 2007), pp. 183-194.
24. MA W.-C., JONES A., HAWKINS T., CHIANG J.-Y., DEBEVEC P.: A high-resolution geometry capture system for facial performance. In ACM SIGGRAPH 2008 talks (New York, NY, USA, 2008), SIGGRAPH '08, ACM, pp. 3:1-3:1.
25. NEHAB D., RUSINKIEWICZ S., DAVIS J., RAMAMOORTHI R.: Efficiently Combining Positions and Normals for Precise 3D Geometry. SIGGRAPH (ACM Transactions on Graphics) 24, 3 (2005), 536-543.
26. SEITZ S., CURLESS B., DIEBEL J., SCHARSTEIN D., SZELISKI R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In CVPR06 (2006), pp. I: 519-528.
27. STRECHA C., FRANSENS R., VAN GOOL L.: Widebaseline stereo from multiple views: A probabilistic account. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1 (jun. 2004), I-552 - I-559 Vol.1.
28. SUN J., LI Y., KANG S., SHUM H.: Symmetric stereo matching for occlusion handling. In CVPR05 (2005), pp. II: 399-406.
29. SCHARSTEIN D., SZELISKI R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. IJCV 47, 1-3 (April 2002), 7-42.
30. SUN J., SHUM H., ZHENG N.: Stereo matching using belief propagation. In ECCV02 (2002), p. II: 510 ff.
31. SMITH B., ZHANG L., JIN H.: Stereo matching with nonparametric smoothness priors in feature space. In CVPR09 (2009), pp. 485-492.
32. TAPPEN M., FREEMAN W.: Comparison of graph cuts with belief propagation for stereo, using identical mrf parameters. In ICCV03 (2003), pp. 900-907.
33. VLASIC D., PEERS P., BARAN I., DEBEVEC P., POPOVIĆ J., RUSINKIEWICZ S., MATUSIK W.: Dynamic shape capture using multi-view photometric stereo. ACM Trans. Graphics (Proc. SIGGRAPH Asia) 28, 5 (Dec. 2009).
34. VOGIATZIS G., TORR P., SEITZ S., CIPOLLA R.: Reconstructing relief surfaces. In BMVC (2004), pp. 117-126.
35. WILSON C. A., GHOSH A., PEERS P., CHIANG J.-Y., BUSCH J., DEBEVEC P.: Temporal upsampling of performance geometry using photometric alignment. ACM Trans. Graph. 29, 2 (2010), 1-11.
36. WENGER A., GARDNER A., TCHOU C., UNGER J., HAWKINS T., DEBEVEC P.: Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Transactions on Graphics 24, 3 (Aug. 2005), 756-764.
37. WEYRICH T., MATUSIK W., PFISTER H., BICKEL B., DONNER C., TU C., MCANDLESS J., LEE J., NGAN A., WANN H., GROSS J. M.: Analysis of human faces using a measurement-based skin reflectance model. ACM Transactions on Graphics 25 (2006), 1013-1024.
38. WOODHAM R. J.: Photometric stereo: A reflectance map technique for determining surface orientation from image intensity. In Proceedings of SPIE's 22nd Annual Technical Symposium (Aug. 1978), vol. 155.
39. WOODFORD O., TORR P., REID I., FITZGIBBON A.: Global stereo reconstruction under second-order smoothness priors. PAMI 31, 12 (December 2009), 2115-2128.
40. YANG Q., WANG L., AHUJA N.: A constant-space belief propagation algorithm for stereo matching. In CVPR (2010).
41. ZHANG Z.: A flexible new technique for camera calibration. Pattern Analysis and Machine Intelligence, IEEE Transactions on 22, 11 (nov. 2000), 1330 - 1334.
42. ZHANG S., ROYER D., YAU S.-T.: Gpu-assisted highresolution, real-time 3-d shape measurement. Opt Express 14, 20 (2006), 9120-9.
43. ZHANG L., SNAVELY N., CURLESS B., SEITZ S.: Spacetime faces: high resolution capture for modeling and animation. In SIGGRAPH '04: ACM SIGGRAPH 2004 Papers (New York, NY, USA, 2004), ACM, pp. 548-558.