High-detail 3D capture and non-sequential alignment of facial performance

Proceedings - 2nd Joint 3DIM/3DPVT Conference: 3D Imaging, Modeling, Processing, Visualization and Transmission, 3DIMPVT 2012

Volumn , Issue , 2012, Pages 17-24

  Klaudiny, Martin ^a   Hilton, Adrian ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

colour photometric stereo; dense motion capture; facial performance capture; non sequential surface tracking

Indexed keywords

ERROR ACCUMULATION; LIGHTING EQUIPMENT; MINIMUM SPANNING TREES; MOTION CAPTURE; MULTI-VIEW IMAGE; NORMAL MAPS; PERFORMANCE CAPTURE; PHOTOMETRIC STEREO; QUANTITATIVE COMPARISON; STATE-OF-THE-ART SYSTEM; SURFACE ALIGNMENT; SURFACE TRACKING; TEMPORAL ALIGNMENT;

IMAGING SYSTEMS; OPTIMIZATION; THREE DIMENSIONAL COMPUTER GRAPHICS; VISUALIZATION;

ALIGNMENT;

EID: 84872020183     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/3DIMPVT.2012.67     Document Type: Conference Paper

References (24)

1. G. Vogiatzis and C. Hernández, "Self-calibrated, Multispectral Photometric Stereo for 3D Face Capture," IJCV, vol. 97, no. 1, pp. 91-103, 2012.
2. W.-C. Ma, T. Hawkins, P. Peers, C.-F. Chabert, M. Weiss, and P. Debevec, "Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination," in Eurographics Symposium on Rendering, 2007.
3. G. Fyffe, T. Hawkins, C. Watts, W.-C. Ma, and P. Debevec, "Comprehensive Facial Performance Capture," CGF, vol. 30, pp. 425-434, 2011.
4. D. Vlasic, M. Brand, H. Pfister, and J. Popović, "Face transfer with multilinear models," ACM TOG, vol. 24, pp. 426-433, 2005.
5. T. Weise, H. Li, L. Van Gool, and M. Pauly, "Face/Off: live facial puppetry," in SCA, 2009.
6. Y. Wang, X. Huang, C.-S. Lee, S. Zhang, Z. Li, D. Samaras, D. Metaxas, A. Elgammal, and P. Huang, "High Resolution Acquisition, Learning and Transfer of Dynamic 3-D Facial Expressions," CGF, vol. 23, pp. 677-686, 2004.
7. I.-C. Lin and M. Ouhyoung, "Mirror MoCap: Automatic and efficient capture of dense 3D facial motion parameters from video," The Visual Computer, vol. 21, pp. 355-372, 2005.
8. B. Bickel, M. Botsch, R. Angst, W. Matusik, M. Otaduy, H. Pfister, and M. Gross, "Multi-scale capture of facial geometry and motion," ACM TOG, vol. 26, no. 3, p. 33, 2007.
9. M. Klaudiny, A. Hilton, and J. Edge, "High-detail 3d capture of facial performance," in 3DPVT, 2010.
10. G. J. Brostow, C. Hernandez, G. Vogiatzis, B. Stenger, and R. Cipolla, "Video Normals from Colored Lights," TPAMI, vol. 33, pp. 2104 - 2114, 2011.
11. L. Zhang, N. Snavely, B. Curless, and S. M. Seitz, "Spacetime faces: high resolution capture for modeling and animation," ACM TOG, vol. 23, pp. 548-558, 2004.
12. D. Bradley, W. Heidrich, T. Popa, and A. Sheffer, "High Resolution Passive Facial Performance Capture," in SIGGRAPH, 2010.
13. W.-C. Ma, A. Jones, J.-Y. Chiang, T. Hawkins, S. Frederiksen, P. Peers, M. Vukovic, M. Ouhyoung, and P. Debevec, "Facial performance synthesis using deformation-driven polynomial displacement maps," ACM TOG, vol. 27, pp. 1-10, 2008.
14. C. A. Wilson, A. Ghosh, P. Peers, J.-Y. Chiang, J. Busch, and P. Debevec, "Temporal upsampling of performance geometry using photometric alignment," ACM TOG, vol. 29, pp. 1-11, 2010.
15. Y. Furukawa and J. Ponce, "Dense 3d motion capture for human faces," in CVPR, 2009.
16. T. Popa, I. South-Dickinson, D. Bradley, A. Sheffer, and W. Heidrich, "Globally Consistent Space-Time Reconstruction," in CGF, 2010.
17. T. Beeler, F. Hahn, D. Bradley, and B. Bickel, "High-quality passive facial performance capture using anchor frames," ACM TOG, vol. 1, no. 212, p. 1, 2011.
18. C. Budd, P. Huang, M. Klaudiny, and A. Hilton, "Global nonrigid alignment of surface sequences," International Journal of Computer Vision, pp. 1-15, 2012.
19. S. Roy, "Stereo without epipolar lines: A maximum-flow formulation," IJCV, vol. 34, pp. 147-161, 1999.
20. M. Kazhdan and M. Bolitho, "Poisson surface reconstruction," in SGP, 2006.
21. M. Klaudiny and A. Hilton, "Cooperative patch-based 3D surface tracking," in CVMP, 2011.
22. E. J. Ong, Y. Lan, B. J. Theobald, R. Harvey, and R. Bowden, "Robust Facial Feature Tracking using Selected Multi-Resolution Linear Predictors," in ICCV, 2009.
23. C. Hernández, G. Vogiatzis, and R. Cipolla, "Shadows in three-source photometric stereo," in ECCV, 2008.
24. D. Nehab, S. Rusinkiewicz, J. Davis, and R. Ramamoorthi, "Efficiently combining positions and normals for precise 3d geometry," ACM TOG, vol. 24, pp. 536-543, 2005.