Dense 3D face alignment from 2D videos in real-time

2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015

Volumn , Issue , 2015, Pages

  Jeni, Laszlo A ^a   Cohn, Jeffrey F ^a,b   Kanade, Takeo ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FACE RECOGNITION; GESTURE RECOGNITION; VIDEO SIGNAL PROCESSING;

3D FACE ALIGNMENTS; 3D RECONSTRUCTION; 3D REGISTRATION; EMOTION EXPRESSION; IMAGING CONDITIONS; MULTI-VIEW RECONSTRUCTION; MULTIVIEW VIDEO; PERSON-INDEPENDENT;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84944909690     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FG.2015.7163142     Document Type: Conference Paper

References (41)

1. B. Allen, B. Curless, and Z. Popović. The space of human body shapes: Reconstruction and parameterization from range scans. ACM Trans. Graph., 22(3):587-594, July 2003.
2. A. Asthana, S. Zafeiriou, S. Cheng, and M. Pantic. Incremental face alignment in the wild. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1859-1866, June 2014.
3. M. Aubry, U. Schlickewei, and D. Cremers. The wave kernel signature: A quantum mechanical approach to shape analysis. In Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on, pages 1626-1633, Nov 2011.
4. T. Baltrusaitis, P. Robinson, and L. Morency. 3d constrained local model for rigid and non-rigid facial tracking. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 2610-2617. IEEE, 2012.
5. V. Blanz and T. Vetter. A morphable model for the synthesis of 3d faces. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '99, pages 187-194, New York, NY, USA, 1999. ACM Press/Addison-Wesley Publishing Co.
6. X. Burgos-Artizzu, P. Perona, and P. Dollar. Robust face landmark estimation under occlusion. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 1513-1520, Dec 2013.
7. M. Calonder, V. Lepetit, M. Ozuysal, T. Trzcinski, C. Strecha, and P. Fua. Brief: Computing a local binary descriptor very fast. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 34(7):1281-1298, July 2012.
8. C. Cao, Q. Hou, and K. Zhou. Displaced dynamic expression regression for real-time facial tracking and animation. ACM Trans. Graph., 33(4):43:1-43:10, July 2014.
9. C. Cao, Y. Weng, S. Lin, and K. Zhou. 3d shape regression for realtime facial animation. ACM Trans. Graph., 32(4):41:1-41:10, July 2013.
10. X. Cao, Y. Wei, F. Wen, and J. Sun. Face alignment by explicit shape regression. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 2887-2894, June 2012.
11. T. Cootes, G. Edwards, and C. Taylor. Active appearance models. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 23(6):681-685, Jun 2001.
12. D. Cristinacce and T. Cootes. Automatic feature localisation with constrained local models. Pattern Recogn., 41(10):3054-3067, Oct. 2008.
13. M. Dantone, J. Gall, G. Fanelli, and L. V. Gool. Real-time facial feature detection using conditional regression forests. In CVPR, 2012.
14. Dimensional Imaging Ltd. DI3D. http://www.di3d.com.
15. M. Dimitrijevic, S. Ilic, and P. Fua. Accurate face models from uncalibrated and ill-lit video sequences. In Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on, volume 2, pages II-1034-II-1041 Vol.2, June 2004.
16. P. Dollar, P. Welinder, and P. Perona. Cascaded pose regression. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 1078-1085, June 2010.
17. P. Ekman, W. Friesen, and J. Hager. Facial Action Coding System (FACS): Manual. Salt Lake City (USA): A Human Face, 2002.
18. L. Gu and T. Kanade. 3d alignment of face in a single image. In Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, volume 1, pages 1305-1312, June 2006.
19. N. Halko, P. Martinsson, and J. Tropp. Finding structure with randomness: Probabilistic algorithms for constructing approximate matrix decompositions. SIAM Review, 53(2):217-288, 2011.
20. T. Hassner. Viewing real-world faces in 3d. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 3607-3614, Dec 2013.
21. K. V. M. I. L. Dryden. Statistical Shape Analysis. John Wiley &Sons, 1998.
22. V. Kazemi and J. Sullivan. One millisecond face alignment with an ensemble of regression trees. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1867-1874, June 2014.
23. I. Kemelmacher-Shlizerman and R. Basri. 3d face reconstruction from a single image using a single reference face shape. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 33(2):394-405, Feb 2011.
24. L. Kobbelt. Sqrt(3)-subdivision. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '00, pages 103-112, New York, NY, USA, 2000. ACM Press/Addison-Wesley Publishing Co.
25. B. Levy. Laplace-beltrami eigenfunctions towards an algorithm that "understands" geometry. In Shape Modeling and Applications, 2006. SMI 2006. IEEE International Conference on, pages 13-13, June 2006.
26. D. G. Lowe. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision, 60(2):91-110, Nov. 2004.
27. B. Martinez, M. Valstar, X. Binefa, and M. Pantic. Local evidence aggregation for regression-based facial point detection. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35(5):1149-1163, May 2013.
28. I. Matthews and S. Baker. Active appearance models revisited. International Journal of Computer Vision, 60(2):135-164, 2004.
29. A. Y. Ng, M. I. Jordan, and Y. Weiss. On spectral clustering: Analysis and an algorithm. In ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS, pages 849-856. MIT Press, 2001.
30. S. Ren, X. Cao, Y. Wei, and J. Sun. Face alignment at 3000 fps via regressing local binary features. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1685-1692, June 2014.
31. J. M. Saragih, S. Lucey, and J. F. Cohn. Deformable model fitting by regularized landmark mean-shift. International Journal of Computer Vision, 91(2):200-215, 2011.
32. Y. Sun, X. Wang, and X. Tang. Deep convolutional network cascade for facial point detection. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 3476-3483, June 2013.
33. S. Suwajanakorn, I. Kemelmacher-Shlizerman, and S. Seitz. Total moving face reconstruction. In D. Fleet, T. Pajdla, B. Schiele, and T. Tuytelaars, editors, Computer Vision, ECCV 2014, volume 8692 of Lecture Notes in Computer Science, pages 796-812. Springer International Publishing, 2014.
34. J. R. Tena, F. De la Torre, and I. Matthews. Interactive region-based linear 3d face models. In ACM SIGGRAPH 2011 Papers, SIGGRAPH '11, pages 76:1-76:10, New York, NY, USA, 2011. ACM.
35. J. B. Tenenbaum, V. De Silva, and J. C. Langfold. A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319-2323, 2000.
36. M. Valstar, B. Martinez, X. Binefa, and M. Pantic. Facial point detection using boosted regression and graph models. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 2729-2736, June 2010.
37. X. Xiong and F. De la Torre. Supervised descent method and its applications to face alignment. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 532-539, June 2013.
38. L. Yin, X. Chen, Y. Sun, T. Worm, and M. Reale. A high-resolution 3d dynamic facial expression database. In Automatic Face Gesture Recognition, 2008. FG '08. 8th IEEE International Conference on, pages 1-6, Sept 2008.
39. J. Zhang, S. Shan, M. Kan, and X. Chen. Coarse-to-fine auto-encoder networks (cfan) for real-time face alignment. In D. Fleet, T. Pajdla, B. Schiele, and T. Tuytelaars, editors, Computer Vision, ECCV 2014, volume 8690 of Lecture Notes in Computer Science, pages 1-16. Springer International Publishing, 2014.
40. X. Zhang, L. Yin, J. F. Cohn, S. Canavan, M. Reale, A. Horowitz, P. Liu, and J. M. Girard. Bp4d-spontaneous: a high-resolution spontaneous 3d dynamic facial expression database. Image and Vision Computing, 32(10):692-706, 2014. Best of Automatic Face and Gesture Recognition 2013.
41. Z. Zhang, Z. Liu, D. Adler, M. F. Cohen, E. Hanson, and Y. Shan. Robust and rapid generation of animated faces from video images: A model-based modeling approach. Int. J. Comput. Vision, 58(2):93-119, July 2004.