Accurate and robust 3D facial capture using a single RGBD camera

Proceedings of the IEEE International Conference on Computer Vision

Volumn , Issue , 2013, Pages 3615-3622

  Chen, Yen Lin ^a   Wu, Hsiang Tao ^b   Shi, Fuhao ^a   Tong, Xin ^b   Chai, Jinxiang ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

3D facial modeling; facial capture; facial feature detection; kinect; nonrigid registration

Indexed keywords

ALGORITHMS; CAMERAS; IMAGE MATCHING;

FACIAL CAPTURE; FACIAL FEATURE DETECTION; FACIAL MODEL; KINECT; NONRIGID REGISTRATION;

THREE DIMENSIONAL;

EID: 84898771233     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2013.449     Document Type: Conference Paper

References (22)

1. S. Baker and I. Matthews. Lucas-kanade 20 years on: A unifying framework. International Journal of Computer Vision, 2004. 56(3):221-255.
2. B. Bickel, M. Botsch, R. Angst, W. Matusik, M. Otaduy, H. Pfister, and M. Gross. Multi-scale capture of facial geometry and motion. ACM Trans. Graph., 26(3):33:1-33:10, 2007.
3. V. Blanz, C. Basso, T. Poggio, and T. Vetter. Reanimating faces in images and video. In Computer Graphics Forum, 2003. 22(3):641-650.
4. M. Breidt, H. Biilthoff, and C. Curio. Robust semantic analysis by synthesis of 3d facial motion. In Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, pages 713-719. IEEE, 2011.
5. Q. Cai, D. Gallup, C. Zhang, and Z. Zhang. 3d deformable face tracking with a commodity depth camera. pages 229-242, 2010.
6. D. DeCarlo and D. Metaxas. Optical flow constraints on deformable models with applications to face tracking. International Journal of Computer Vision, 2000. 38(2):99-127.
7. I. Essa, S. Basu, T. Darrell, and A. Pentland. Modeling, tracking and interactive animation of faces and heads using input from video. In Proceedings of Computer Animation Conference. 1996. 68-79.
8. faceshift. http://www.faceshift.com/, 2013.
9. B. Guenter, C. Grimm, D. Wood, H. Malvar, and F. Pighin. Making Faces. In Proceedings of ACM SIGGRAPH 1998, pages 55-66, 1998.
10. H. Huang, J. Chai, X. Tong, and H.-T. Wu. Leveraging motion capture and 3d scanning for high-fidelity facial performance acquisition. ACM Trans. Graph., 30(4):74:1-74:10, 2011.
11. Kinect for Windows SDK. http://msdn.microsoft.com/enus/library/jj130970. aspx/, 2013.
12. H. Li, B. Adams, L. J. Guibas, and M. Pauly. Robust singleview geometry and motion reconstruction. ACM Trans. Graph., 28(5):175:1-175:10, 2009.
13. W.-C. Ma, A. Jones, J.-Y. Chiang, T. Hawkins, S. Frederiksen, P. Peers, M. Vukovic, M. Ouhyoung, and P. Debevec. Facial performance synthesis using deformationdriven polynomial displacement maps. ACM Trans. Graph., 27(5):121:1-121:10, 2008.
14. F. Pighin, R. Szeliski, and D. Salesin. Resynthesizing facial animation through 3D model-based tracking. In International Conference on Computer Vision. 1999. 143-150.
15. F. Shi and J. Chai. Fast and accurate facial alignment from a single rgbd image. In Computer Science and Engineering Technical Reports 2013, Texas A&M University. 2013.
16. R. W. Sumner, J. Schmid, and M. Pauly. Embedded deformation for shape manipulation. ACM Trans. Graph., 26(3):80:1-80:7, 2007.
17. R. W. Sumner, M. Zwicker, C. Gotsman, and J. Popovíc. Mesh-based inverse kinematics. ACM Trans. Graph., 24(3):488-495, July 2005.
18. Vicon Systems. http://www.vicon.com, 2013.
19. D. Vlasic, M. Brand, H. Pfister, and J. Popovíc. Face transfer with multilinear models. ACM Transactions on Graphics, 24(3):426-433, 2005.
20. T. Weise, S. Bouaziz, H. Li, and M. Pauly. Realtime performance-based facial animation. ACM Trans. Graph., 30(4):77:1-77:10, 2011.
21. T. Weise, H. Li, L. Van Gool, and M. Pauly. Face/off: live facial puppetry. In Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA '09, pages 7-16, New York, NY, USA, 2009. ACM.
22. L. Zhang, N. Snavely, B. Curless, and S. Seitz. Spacetime faces: high resolution capture for modeling and animation. ACM Transactions on Graphics, 23(3):548-558, 2004.