Unconstrained realtime facial performance capture

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 1675-1683

  Hsieh, Pei Lun ^a   Ma, Chongyang ^a   Yu, Jihun ^b   Li, Hao ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b Industrial Lights and Magic   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; PATTERN RECOGNITION;

COLOR CHANNELS; FACE SEGMENTATION; FACIAL FEATURE TRACKING; FACIAL TRACKING; ILLUMINATION CHANGES; PERFORMANCE CAPTURE; TEMPORAL FILTERING; TRACKING MODELS;

FACE RECOGNITION;

EID: 84959202764     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7298776     Document Type: Conference Paper

References (42)

1. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Ssstrunk. SLIC Superpixels Compared to State-of-the-art Superpixel Methods. TPAMI, 34(11):2274-2282, 2012
2. T. Beeler, F. Hahn, D. Bradley, B. Bickel, P. Beardsley, C. Gotsman, R. W. Sumner, and M. Gross. High-quality passive facial performance capture using anchor frames. ACM Trans. Graph., 30:75:1-75:10, 2011
3. M. J. Black and Y. Yacoob. Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion. In ICCV, pages 374-381, 1995
4. V. Blanz and T. Vetter. A morphable model for the synthesis of 3D faces. In SIGGRAPH '99, pages 187-194, 1999
5. M. Botsch and O. Sorkine. On linear variational surface deformation methods. TVCG, 14(1):213-230, 2008
6. S. Bouaziz, Y. Wang, and M. Pauly. Online modeling for realtime facial animation. ACM Trans. Graph., 32(4):40:1-40:10, 2013
7. C. Bregler and S. Omohundro. Surface learning with applications to lipreading. Advances in neural information processing systems, pages 43-43, 1994
8. X. Burgos-Artizzu, P. Perona, and P. Dollár. Robust face landmark estimation under occlusion. In ICCV, 2013
9. C. Cao, Q. Hou, and K. Zhou. Displaced dynamic expression regression for real-time facial tracking and animation. ACM Trans. Graph., 33(4):43:1-43:10, 2014
10. C. Cao, Y. Weng, S. Lin, and K. Zhou. 3D shape regression for real-time facial animation. ACM Trans. Graph., 32(4):41:1-41:10, 2013
11. C. Cao, Y. Weng, S. Zhou, Y. Tong, and K. Zhou. FaceWare-house: A 3D facial expression database for visual computing. TVCG, 20(3):413-425, 2014
12. J. Chai, J. Xiao, and J. Hodgins. Vision-based control of 3D facial animation. In SCA '03, pages 193-206, 2003
13. Y.-L. Chen, H.-T. Wu, F. Shi, X. Tong, and J. Chai. Accurate and robust 3D facial capture using a single rgbd camera. In ICCV, pages 3615-3622, 2013
14. E. Chuang and C. Bregler. Performance driven facial animation using blendshape interpolation. Technical report, Stanford University, 2002
15. T. F. Cootes, G. J. Edwards, and C. J. Taylor. Active appearance models. TPAMI, 23(6):681-685, 2001
16. D. Cristinacce and T. Cootes. Automatic feature localisation with constrained local models. Pattern Recogn., 41(10):3054-3067, 2008
17. D. Decarlo and D. Metaxas. Optical flow constraints on deformable models with applications to face tracking. Int. J. Comput. Vision, 38(2):99-127, 2000
18. P. Ekman and W. Friesen. The Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto, 1978
19. I. Essa, S. Basu, T. Darrell, and A. Pentland. Modeling, tracking and interactive animation of faces and heads using input from video. In Proceedings of the Computer Animation, pages 68-79, 1996
20. Faceshift, 2014. http://www. faceshift. com/
21. Y. Furukawa and J. Ponce. Dense 3D motion capture for human faces. In CVPR, pages 1674-1681, 2009
22. P. Garrido, L. Valgaert, C. Wu, and C. Theobalt. Reconstruct-ing detailed dynamic face geometry from monocular video. ACM Trans. Graph., 32(6):158:1-158:10, 2013
23. G. Ghiasi and C. Fowlkes. Occlusion coherence: Localizing occluded faces with a hierarchical deformable part model. In CVPR, pages 1899-1906, 2014
24. R. Gross, I. Matthews, and S. Baker. Active appearance models with occlusion. Image Vision Comput., 24(6):593-604, 2006
25. B. Guenter, C. Grimm, D. Wood, H. Malvar, and F. Pighin. Making faces. In SIGGRAPH '98, pages 55-66, 1998
26. H. Jia and A. Martinez. Support vector machines in face recognition with occlusions. In CVPR, pages 136-141, 2009
27. B. Lévy and H. R. Zhang. Spectral mesh processing. In ACM SIGGRAPH 2010 Courses, pages 8:1-8:312, 2010
28. H. Li, B. Adams, L. J. Guibas, and M. Pauly. Robust single-view geometry and motion reconstruction. ACM Trans. Graph., 28(5):175:1-175:10, 2009
29. H. Li, P. Roivainen, and R. Forcheimer. 3-d motion estimation in model-based facial image coding. TPAMI, 15(6), 1993
30. H. Li, T. Weise, and M. Pauly. Example-based facial rigging. ACM Trans. Graph., 29(4):32:1-32:6, 2010
31. H. Li, J. Yu, Y. Ye, and C. Bregler. Realtime facial animation with on-the-fly correctives. ACM Trans. Graph., 32(4):42:1-42:10, 2013
32. F. Pighin and J. P. Lewis. Performance-driven facial animation. In ACM SIGGRAPH 2006 Courses, SIGGRAPH '06, 2006
33. F. H. Pighin, R. Szeliski, and D. Salesin. Resynthesizing facial animation through 3D model-based tracking. In ICCV, pages 143-150, 1999
34. D. Ramanan. Face detection, pose estimation, and landmark localization in the wild. In CVPR, pages 2879-2886, 2012
35. S. Roberts. Control chart tests based on geometric moving averages. Technometrics, 1(3):239-250, 1959
36. S. Rusinkiewicz and M. Levoy. Efficient variants of the icp algorithm. In International conference on 3-D Digital Imaging and Modeling, pages 145-152, 2001
37. J. M. Saragih, S. Lucey, and J. F. Cohn. Deformable model fitting by regularized landmark mean-shift. Int. J. Comput. Vision, 91(2):200-215, 2011
38. T. Sugimoto, M. Fukushima, and T. Ibaraki. A parallel relaxation method for quadratic programming problems with interval constraints. Journal of Computational and Applied Mathematics, 60(12):219-236, 1995
39. T. Weise, S. Bouaziz, H. Li, and M. Pauly. Realtime performance-based facial animation. ACM Trans. Graph., 30(4):77:1-77:10, 2011
40. T. Weise, H. Li, L. Van Gool, and M. Pauly. Face/off: Live facial puppetry. In SCA '09, pages 7-16, 2009
41. X. Xiong and F. De la Torre. Supervised descent method and its application to face alignment. In CVPR, pages 532-539, 2013
42. L. Zhang, N. Snavely, B. Curless, and S. M. Seitz. Spacetime faces: High resolution capture for modeling and animation. ACM Trans. Graph., 23(3):548-558, 2004.