Total moving face reconstruction

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 8692 LNCS, Issue PART 4, 2014, Pages 796-812

  Suwajanakorn, Supasorn ^a   Kemelmacher Shlizerman, Ira ^a   Seitz, Steven M ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

3D reconstruction; faces; non rigid reconstruction

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER SCIENCE; COMPUTERS; FACE RECOGNITION;

3D RECONSTRUCTION; FACES; FACIAL EXPRESSIONS; IMAGING CONDITIONS; INTERNET PHOTO COLLECTIONS; LIGHTING CONDITIONS; NON-RIGID RECONSTRUCTION; SHAPE FROM SHADING;

FACE RECOGNITION; COMPUTER VISION;

EID: 84906498425     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-319-10593-2_52     Document Type: Conference Paper

References (46)

1. Agarwal, S., Mierle, K., et al.: Ceres solver, https://code.google.com/p/ ceres-solver/
2. Alexander, O., Fyffe, G., Busch, J., Yu, X., Ichikari, R., Jones, A., Debevec, P., Jimenez, J., Danvoye, E., Antionazzi, B., et al.: Digital ira: Creating a real-time photoreal digital actor. In: ACM SIGGRAPH 2013 Posters, p. 1. ACM (2013)
3. Alexander, O., Rogers, M., Lambeth, W., Chiang, M., Debevec, P.: The digital emily project: photoreal facial modeling and animation. In: ACM SIGGRAPH 2009 Courses, p. 12. ACM (2009)
4. Basha, T., Moses, Y., Kiryati, N.: Multi-view scene flow estimation: A view centered variational approach. International Journal of Computer Vision 101(1), 6-21 (2013)
5. Basri, R., Jacobs, D., Kemelmacher, I.: Photometric stereo with general, unknown lighting. International Journal of Computer Vision 72(3), 239-257 (2007)
6. Basri, R., Jacobs, D.W.: W Jacobs. Lambertian reflectance and linear subspaces. IEEE Transactions on Pattern Analysis and Machine Intelligence 25(2), 218-233 (2003)
7. Beeler, T., Bickel, B., Beardsley, P., Sumner, B., Gross, M.: High-quality singleshot capture of facial geometry. ACM Transactions on Graphics (TOG) 29(4), 40 (2010)
8. Beeler, T., Hahn, F., Bradley, D., Bickel, B., Beardsley, P., Gotsman, C., Sumner, R.W., Gross, M.: High-quality passive facial performance capture using anchor frames. In: ACM Transactions on Graphics (TOG), vol. 30, p. 75. ACM (2011)
9. Blanz, V., Vetter, T.: A morphable model for the synthesis of 3d faces. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 187-194. ACM Press/Addison-Wesley Publishing Co. (1999)
10. Bouaziz, S., Wang, Y., Pauly, M.: Online modeling for realtime facial animation. ACM Transactions on Graphics (TOG) 32(4), 40 (2013)
11. Bradley, D., Heidrich, W., Popa, T., Sheffer, A.: High resolution passive facial performance capture. ACM Transactions on Graphics (TOG) 29(4), 41 (2010)
12. Bradski, G.: Dr. Dobb's Journal of Software Tools
13. Brand, M.: A direct method for 3d factorization of nonrigid motion observed in 2d. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 2, pp. 122-128. IEEE (2005)
14. Bregler, C., Hertzmann, A., Biermann, H.: Recovering non-rigid 3d shape from image streams. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2000, vol. 2, pp. 690-696. IEEE (2000)
15. Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3024, pp. 25-36. Springer, Heidelberg (2004)
16. Alexander, O., Fyffe, G., Busch, J., Yu, X., Ichikari, R., Jones, A., Debevec, P., Jimenez, J., Danvoye, E., Antionazzi, B.: Digital ira: Creating a real-time photoreal digital actor
17. Cao, C., Weng, Y., Lin, S.: andK. Zhou. 3d shape regression for real-time facial animation. ACM TOG (Proc. SIGGRAPH) 32(4), 41 (2013)
18. Cao, C., Weng, Y., Zhou, S., Tong, Y., Zhou, K.: Facewarehouse: A 3d facial expression database for visual computing (2013)
19. Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1407, pp. 484-498. Springer, Heidelberg (1998)
20. Dai, Y., Li, H., He, M.: A simple prior-free method for non-rigid structure-frommotion factorization. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2018-2025. IEEE (2012)
21. Dale, K., Sunkavalli, K., Johnson, M.K., Vlasic, D., Matusik, W., Pfister, H.: Video face replacement. In: ACM Transactions on Graphics (TOG), vol. 30, p. 130. ACM (2011)
22. Ezzat, T., Poggio, T.: Facial analysis and synthesis using image-based models. In: Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, 1996, pp. 116-121. IEEE (1996)
23. Garg, R., Roussos, A., Agapito, L.: Dense variational reconstruction of non-rigid surfaces from monocular video. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1272-1279. IEEE (2013)
24. Garrido, P., Valgaerts, L., Wu, C., Theobalt, C.: Reconstructing detailed dynamic face geometry from monocular video. ACM Transactions on Graphics (TOG) 32(6), 158 (2013)
25. Ghosh, A., Fyffe, G., Tunwattanapong, B., Busch, J., Yu, X., Debevec, P.: Multiview face capture using polarized spherical gradient illumination. ACM Transactions on Graphics (TOG) 30(6), 129 (2011)
26. Guenter, B., Grimm, C., Wood, D., Malvar, H., Pighin, F.: Making faces. In: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 55-66. ACM (1998)
27. Hassner, T.: Viewing real-world faces in 3d. In: ICCV (2013)
28. Hassner, T., Basri, R.: Example based 3d reconstruction from single 2d images. In: Conference on Computer Vision and Pattern Recognition Workshop, CVPRW 2006, pp. 15-15. IEEE (2006)
29. Kemelmacher-Shlizerman, I.: Internet based morphable model. In: International Conference on Computer Vision, ICCV (2013)
30. Kemelmacher-Shlizerman, I., Basri, R.: face reconstruction from a single image using a single reference face shape. IEEE Transactions on Pattern Analysis and Machine Intelligence 33(2), 394-405 (2011)
31. Kemelmacher-Shlizerman, I., Seitz, S.M.: Face reconstruction in the wild. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 1746-1753. IEEE (2011)
32. Kemelmacher-Shlizerman, I., Seitz, S.M.: Collection flow. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1792-1799. IEEE (2012)
33. Li, H., Weise, T., Pauly, M.: Example-based facial rigging. ACM Transactions on Graphics (TOG) 29(4), 32 (2010)
34. Liu, C.: Beyond Pixels: Exploring New Representations and Applications for Motion Analysis. PhD thesis. MIT (2009)
35. Newcombe, R.A., Davison, A.J., Izadi, S., Kohli, P., Hilliges, O., Shotton, J., Molyneaux, D., Hodges, S., Kim, D., Fitzgibbon, A.: Kinectfusion: Real-time dense surface mapping and tracking. In: 10th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2011, pp. 127-136. IEEE (2011)
36. Saragih, J.M., Lucey, S., Cohn, J.F.: Face alignment through subspace constrained mean-shifts. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 1034-1041. IEEE (2009)
37. Valgaerts, L., Bruhn, A., Zimmer, H., Weickert, J., Stoll, C., Theobalt, C.: Joint estimation of motion, structure and geometry from stereo sequences. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 568-581. Springer, Heidelberg (2010)
38. Valgaerts, L.,Wu, C., Bruhn, A., Seidel, H.-P., Theobalt, C.: Lightweight binocular facial performance capture under uncontrolled lighting. ACM Trans. Graph. 31(6), 187 (2012)
39. Vedula, S., Baker, S., Rander, P., Collins, R., Kanade, T.: Three-dimensional scene flow. In: The Proceedings of the Seventh IEEE International Conference on Computer Vision 1999, vol. 2, pp. 722-729. IEEE (1999)
40. Vlasic, D., Brand, M., Pfister, H., Popović, J.: Face transfer with multilinear models. In: ACM Transactions on Graphics (TOG), vol. 24, pp. 426-433. ACM (2005)
41. Weise, T., Bouaziz, S., Li, H., Pauly, M.: Realtime performance-based facial animation. ACM Transactions on Graphics (TOG) 30(4), 77 (2011)
42. Wu, C., Stoll, C., Valgaerts, L., Theobalt, C.: On-set performance capture of multiple actors with a stereo camera. ACM Transactions on Graphics (TOG) 32(6) (2013)
43. Wu, C., Varanasi, K., Liu, Y., Seidel, H.-P., Theobalt, C.: Shading-based dynamic shape refinement from multi-view video under general illumination. In: International Conference on Computer Vision ICCV (2011)
44. Xiong, X., De la Torre, F.: Supervised descent method and its applications to face alignment. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 532-539. IEEE (2013)
45. Zhang, L., Snavely, N., Curless, B., Seitz, S.M.: Spacetime faces: High-resolution capture for modeling and animation. In: Data-Driven 3D Facial Animation, pp. 248-276. Springer, Heidelberg (2007)
46. Zhu, X., Ramanan, D.: Face detection, pose estimation, and landmark localization in the wild. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2879-2886. IEEE (2012)