Adaptive 3D Face Reconstruction from Unconstrained Photo Collections

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 4197-4206

  Roth, Joseph ^a   Tong, Yiying ^a   Liu, Xiaoming ^a  

^a Michigan State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; FACE RECOGNITION; IMAGE PROCESSING; PATTERN RECOGNITION; STEREO IMAGE PROCESSING;

3D FACE RECONSTRUCTION; 3D MORPHABLE MODEL; COARSE TO FINE; FACE RECONSTRUCTION; ILLUMINATION CONDITIONS; LOW QUALITIES; PHOTO COLLECTIONS; PHOTOMETRIC STEREO;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84986327444     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.455     Document Type: Conference Paper

References (43)

1. S. Agarwal, Y. Furukawa, N. Snavely, I. Simon, B. Curless, S. M. Seitz, and R. Szeliski. Building rome in a day. Communications ACM, 54(10):105-112, 2011.
2. A. Anjos, L. E. Shafey, R. Wallace, M. Günther, C. McCool, and S. Marcel. Bob: A free signal processing and machine learning toolbox for researchers. In ACMMM, pages 1449-1452. ACM Press, 2012.
3. M. Attene and B. Falcidieno. ReMESH: An interactive environment to edit and repair triangle meshes. In SMI, pages 271-276, 2006.
4. R. Basri and D. Jacobs. Lambertian reflectance and linear subspaces. IEEE Trans. Pattern Anal. Mach. Intell., 25(2):218-233, 2003.
5. R. Basri, D. Jacobs, and I. Kemelmacher. Photometric stereo with general, unknown lighting. Int. J. Comput. Vision, 72(3):239-257, 2007.
6. T. Beeler, B. Bickel, P. Beardsley, R. Sumner, and M. Gross. High-quality single-shot capture of facial geometry. ACM Trans. Graph., 29(3), 2010.
7. T. Beeler, F. Hahn, D. Bradley, B. Bickel, P. Beardsley, C. Gotsman, and M. Gross. High-quality passive facial performance capture using anchor frames. ACM Trans. Graph., 30(4):75:1-75:10, 2011.
8. V. Blanz and T. Vetter. Face recognition based on fitting a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell., 25(9):1063-1074, 2003.
9. C. Cao, D. Bradley, K. Zhou, and T. Beeler. Real-time highfidelity facial performance capture. ACM Trans. Graph., 34(4):46:1-46:9, 2015.
10. C. Cao, Y. Weng, S. Zhou, Y. Tong, and K. Zhou. Facewarehouse: A 3D facial expression database for visual computing. IEEE Trans. Vis. Comput. Graphics, 20(3):413-425, 2014.
11. B. Chu, S. Romdhani, and L. Chen. 3D-aided face recognition robust to expression and pose variations. In CVPR, pages 1899-1906, 2014.
12. M. Dou, J. Taylor, H. Fuchs, A. Fitzgibbon, and S. Izadi. 3D scanning deformable objects with a single RGBD sensor. In CVPR, pages 493-501, 2015.
13. P. Garrido, L. Valgaerts, C. Wu, and C. Theobalt. Reconstructing detailed dynamic face geometry from monocular video. ACM Trans. Graph., 33(6):158, 2013.
14. M. F. Hansen, G. A. Atkinson, L. N. Smith, and M. L. Smith. 3D face reconstructions from photometric stereo using near infrared and visible light. CVIU, 114(8):942-951, 2010.
15. H. Hayakawa. Photometric stereo under a light source with arbitrary motion. J. Optical Soc. America A., 11(11):3079-3089, 1994.
16. C. Hernández, G. Vogiatzis, and R. Cipolla. Multiview photometric stereo. IEEE Trans. Pattern Anal. Mach. Intell., 30(3):548-554, 2008.
17. A. E. Ichim, S. Bouaziz, and M. Pauly. Dynamic 3D avatar creation from hand-held video input. ACM Trans. Graph., 34(4):45, 2015.
18. A. Jacobson et al. gptoolbox: Geometry processing toolbox, 2015. http://github.com/alecjacobson/gptoolbox.
19. L. A. Jeni, J. F. Cohn, and T. Kanade. Dense 3D face alignment from 2D videos in real-time. In FG, 2015.
20. A. Jourabloo and X. Liu. Pose-invariant 3D face alignment. In ICCV, 2015.
21. A. Jourabloo and X. Liu. Large-pose face alignment via CNN-based dense 3D model fitting. In CVPR, 2016.
22. I. Kemelmacher-Shlizerman. Internet-based morphable model. In ICCV, 2013.
23. I. Kemelmacher-Shlizerman and S. M. Seitz. Face reconstruction in the wild. In ICCV, 2011.
24. K. Lee, J. Ho, and D. Kriegman. Nine points of light: Acquiring subspaces for face recognition under variable lighting. In CVPR, pages 129-139, 2001.
25. X. Liu and T. Chen. Pose-robust face recognition using geometry assisted probabilistic modeling. In CVPR, volume 1, pages 502-509, 2005.
26. R. Newcombe, D. Fox, and S. Seitz. Dynamicfusion: Reconstruction and tracking on non-rigid scenes in real-time. In CVPR, pages 343-352, 2015.
27. W. Peng, C. Xu, and Z. Feng. 3D face modeling based on structure optimization and surface reconstruction with bspline. Neurocomputing.
28. J. Roth, Y. Tong, and X. Liu. Unconstrained 3D face reconstruction. In CVPR, 2015.
29. B. Shi, K. Inose, Y. Matsushita, and P. Tan. Photometric stereo using internet images. In 3DV, pages 361-368, 2014.
30. F. Shi, H.-T.Wu, X. Tong, and J. Chai. Automatic acquisition of high-fidelity facial performances using monocular videos. ACM Trans. Graph., 33(6), 2014.
31. P. Snape, Y. Panagakis, and S. Zefeiriou. Automatic construction of robust spherical harmonic subspaces. In CVPR, 2015.
32. S. Suwajanakorn, I. Kemelmacher-Shlizerman, and S. M. Seitz. Total moving face reconstruction. In ECCV, pages 796-812. Springer, 2014.
33. J. Thies, M. Zollhöfer, M. Nießner, L. Valgaerts, M. Stamminger, and C. Theobalt. Real-time expression transfer for facial reenactment. ACM Trans. Graph., 34(6), 2015.
34. L. Valgaerts, C.Wu, A. Bruhn, H.-P. Seidel, and C. Theobalt. Lightweight binocular facial performance capture under uncontrolled lighting. ACM Trans. Graph., 31(6):187:1-187:11, Nov. 2012.
35. R. J. Woodham. Photometric method for determining surface orientation from multiple images. Optical Engineering, 19(1):139-144, 1980.
36. L. Wu, A. Ganesh, B. Shi, Y. Matsushita, Y. Wang, and Y. Ma. Robust photometric stereo via low-rank matrix completion and recovery. In ACCV, pages 703-717, 2010.
37. J. Yan, Z. Lei, D. Yi, and S. Z. Li. Learn to combine multiple hypotheses for accurate face alignment. In ICCVW, pages 392-396, 2013.
38. C. Yang, J. Chen, N. Su, and G. Su. Improving 3D face details based on normal map of hetero-source images. In CVPRW, pages 9-14. IEEE, 2014.
39. L. Yin, X. Chen, Y. Sun, T. Worm, and M. Reale. A highresolution 3D dynamic facial expression database. In FG, 2008.
40. A. L. Yuille, D. Snow, R. Epstein, and P. N. Belhumeur. Determining generative models of objects under varying illumination: Shape and albedo from multiple images using SVD and integrability. Int. J. Comput. Vision, 35:203-222, 1999.
41. D. Zeng, Q. Zhao, and J. Li. Examplar coherent 3D face reconstruction from forensic mugshot database. J. Image Vision Computing, 2016.
42. X. Zhu, Z. Lei, X. Liu, H. Shi, and S. Z. Li. Face alignment across large poses: A 3D solution. In CVPR, 2016.
43. X. Zhu, Z. Lei, J. Yan, D. Yi, and S. Z. Li. High-fidelity pose and expression normalization for face recognition in the wild. In CVPR, pages 787-796, 2015.