Face alignment across large poses: A 3D solution

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 146-155

  Zhu, Xiangyu ^a   Lei, Zhen ^a   Liu, Xiaoming ^b   Shi, Hailin ^a   Li, Stan Z ^a  

^a INSTITUTE OF AUTOMATION   (China)

^b Michigan State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALIGNMENT; COMPUTER VISION; DATA MINING; SEMANTICS;

3-D FACE MODELING; 3D SOLUTIONS; DATA LABELLING; FACE ALIGNMENT; FACE MODELING; NEUTRAL NETWORK; STATE-OF-THE-ART METHODS; TRAINING SAMPLE;

PATTERN RECOGNITION;

EID: 84986281478     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.23     Document Type: Conference Paper

References (57)

1. O. Aldrian and W. A. Smith. Inverse rendering of faces with a 3D morphable model. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35 (5): 1080-1093, 2013.
2. A. Asthana, S. Zafeiriou, S. Cheng, and M. Pantic. Robust discriminative response map fitting with constrained local models. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 3444-3451. IEEE, 2013.
3. A. Asthana, S. Zafeiriou, S. Cheng, and M. Pantic. Incremental face alignment in the wild. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1859-1866. IEEE, 2014.
4. P. N. Belhumeur, D. W. Jacobs, D. Kriegman, and N. Kumar. Localizing parts of faces using a consensus of exemplars. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 545-552. IEEE, 2011.
5. V. Bettadapura. Face expression recognition and analysis: The state of the art. ArXiv preprint arXiv: 1203. 6722, 2012.
6. V. Blanz and T. Vetter. Face recognition based on fitting a 3D morphable model. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 25 (9): 1063-1074, 2003.
7. X. P. Burgos-Artizzu, P. Perona, and P. Dollár. Robust face landmark estimation under occlusion. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 1513-1520. IEEE, 2013.
8. C. Cao, Q. Hou, and K. Zhou. Displaced dynamic expression regression for real-time facial tracking and animation. ACM Transactions on Graphics (TOG), 33 (4): 43, 2014.
9. C. Cao, Y. Weng, S. Zhou, Y. Tong, and K. Zhou. Facewarehouse: A 3d facial expression database for visual computing. Visualization and Computer Graphics, IEEE Transactions on, 20 (3): 413-425, 2014.
10. X. Cao, Y. Wei, F. Wen, and J. Sun. Face alignment by explicit shape regression. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 2887-2894. IEEE, 2012.
11. T. F. Cootes, G. J. Edwards, and C. J. Taylor. A comparative evaluation of active appearance model algorithms. In BMVC, volume 98, pages 680-689, 1998.
12. T. F. Cootes, G. J. Edwards, and C. J. Taylor. Active appearance models. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 23 (6): 681-685, 2001.
13. T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham. Active shape models-their training and application. Computer vision and image understanding, 61 (1): 38-59, 1995.
14. T. F. Cootes, G. V. Wheeler, K. N. Walker, and C. J. Taylor. View-based active appearance models. Image and vision computing, 20 (9): 657-664, 2002.
15. D. Cristinacce and T. Cootes. Automatic feature localisation with constrained local models. Pattern Recognition, 41 (10): 3054-3067, 2008.
16. D. Cristinacce and T. F. Cootes. Feature detection and tracking with constrained local models. In BMVC, volume 17, pages 929-938, 2006.
17. P. Dollár, P. Welinder, and P. Perona. Cascaded pose regression. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 1078-1085. IEEE, 2010.
18. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan. Object detection with discriminatively trained partbased models. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 32 (9): 1627-1645, 2010.
19. L. Gu and T. Kanade. 3D alignment of face in a single image. In Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, volume 1, pages 1305-1312. IEEE, 2006.
20. T. Hassner. Viewing real-world faces in 3D. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 3607-3614. IEEE, 2013.
21. T. Hassner, S. Harel, E. Paz, and R. Enbar. Effective face frontalization in unconstrained images. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015.
22. S. Jaiswal, T. R. Almaev, and M. F. Valstar. Guided unsupervised learning of mode specific models for facial point detection in the wild. In Computer Vision Workshops (ICCVW), 2013 IEEE International Conference on, pages 370-377. IEEE, 2013.
23. L. A. Jeni, J. F. Cohn, and T. Kanade. Dense 3D face alignment from 2D videos in real-time. In Automatic Face & Gesture Recognition, 2015. FG'15. 11th IEEE International Conference on. IEEE, 2015.
24. A. Jourabloo and X. Liu. Pose-invariant 3D face alignment. In Computer Vision (ICCV), 2015 IEEE International Conference on. IEEE, 2015.
25. M. Köstinger, P. Wohlhart, P. M. Roth, and H. Bischof. Annotated facial landmarks in the wild: A large-scale, realworld database for facial landmark localization. In Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on, pages 2144-2151. IEEE, 2011.
26. V. Le, J. Brandt, Z. Lin, L. Bourdev, and T. S. Huang. Interactive facial feature localization. In Computer Vision-ECCV 2012, pages 679-692. Springer, 2012.
27. D. Lee, H. Park, and C. D. Yoo. Face alignment using cascade Gaussian process regression trees. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4204-4212, 2015.
28. Z. Liang, S. Ding, and L. Lin. Unconstrained facial landmark localization with backbone-branches fullyconvolutional networks. ArXiv preprint arXiv: 1507. 03409, 2015.
29. J. Martens. Deep learning via Hessian-free optimization. In Proceedings of the 27th International Conference on Machine Learning (ICML-10), pages 735-742, 2010.
30. K. Messer, J. Matas, J. Kittler, J. Luettin, and G. Maitre. XM2VTSDB: The extended M2VTS database. In Second international conference on audio and video-based biometric person authentication, volume 964, pages 965-966. Citeseer, 1999.
31. P. Paysan, R. Knothe, B. Amberg, S. Romdhani, and T. Vetter. A 3D face model for pose and illumination invariant face recognition. In Advanced Video and Signal Based Surveillance, 2009. AVSS'09. Sixth IEEE International Conference on, pages 296-301. IEEE, 2009.
32. S. Ren, X. Cao, Y. Wei, and J. Sun. Face alignment at 3000 FPS via regressing local binary features. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1685-1692. IEEE, 2014.
33. S. Romdhani and T. Vetter. Estimating 3D shape and texture using pixel intensity, edges, specular highlights, texture constraints and a prior. In Computer Vision and Pattern Recognition (CVPR), 2005 IEEE Conference on, volume 2, pages 986-993. IEEE, 2005.
34. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. 300 faces in-the-wild challenge: The first facial landmark localization challenge. In Computer Vision Workshops (ICCVW), 2013 IEEE International Conference on, pages 397-403. IEEE, 2013.
35. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. A semi-automatic methodology for facial landmark annotation. In Computer Vision and Pattern RecognitionWorkshops (CVPRW), 2013 IEEE Conference on, pages 896-903. IEEE, 2013.
36. J. Saragih and R. Goecke. A nonlinear discriminative approach to AAM fitting. In Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, pages 1-8. IEEE, 2007.
37. J. M. Saragih, S. Lucey, and J. F. Cohn. Deformable model fitting by regularized landmark mean-shift. International Journal of Computer Vision, 91 (2): 200-215, 2011.
38. B. M. Smith, J. Brandt, Z. Lin, and L. Zhang. Nonparametric context modeling of local appearance for pose-and expression-robust facial landmark localization. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1741-1748. IEEE, 2014.
39. Y. Sun, X. Wang, and X. Tang. Deep convolutional network cascade for facial point detection. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 3476-3483. IEEE, 2013.
40. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015.
41. Y. Taigman, M. Yang, M. Ranzato, and L. Wolf. Deepface: Closing the gap to human-level performance in face verification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1701-1708, 2013.
42. G. Tzimiropoulos and M. Pantic. Optimization problems for fast AAM fitting in-the-wild. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 593-600. IEEE, 2013.
43. M. Valstar, B. Martinez, X. Binefa, and M. Pantic. Facial point detection using boosted regression and graph models. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 2729-2736. IEEE, 2010.
44. J. Xiao, S. Baker, I. Matthews, and T. Kanade. Real-time combined 2D+3D active appearance models. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 535-542, 2004.
45. X. Xiong and F. De la Torre. Supervised descent method and its applications to face alignment. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 532-539. IEEE, 2013.
46. X. Xiong and F. De la Torre. Global supervised descent method. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2664-2673, 2015.
47. J. Yan, Z. Lei, D. Yi, and S. Z. Li. Learn to combine multiple hypotheses for accurate face alignment. In Computer Vision Workshops (ICCVW), 2013 IEEE International Conference on, pages 392-396. IEEE, 2013.
48. J. Yan, Y. Yu, X. Zhu, Z. Lei, and S. Z. Li. Object detection by labeling superpixels. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 5107-5116, 2015.
49. X. Yu, J. Huang, S. Zhang, W. Yan, and D. N. Metaxas. Posefree facial landmark fitting via optimized part mixtures and cascaded deformable shape model. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 1944-1951. IEEE, 2013.
50. J. Zhang, S. Shan, M. Kan, and X. Chen. Coarse-to-fine autoencoder networks (CFAN) for real-time face alignment. In Computer Vision-ECCV 2014, pages 1-16. Springer, 2014.
51. Z. Zhang, P. Luo, C. C. Loy, and X. Tang. Facial landmark detection by deep multi-task learning. In Computer Vision-ECCV 2014, pages 94-108. Springer, 2014.
52. E. Zhou, H. Fan, Z. Cao, Y. Jiang, and Q. Yin. Extensive facial landmark localization with coarse-to-fine convolutional network cascade. In Computer Vision Workshops (ICCVW), 2013 IEEE International Conference on, pages 386-391. IEEE, 2013.
53. Y. Zhou, W. Zhang, X. Tang, and H. Shum. A Bayesian mixture model for multi-view face alignment. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, volume 2, pages 741-746. IEEE, 2005.
54. S. Zhu, C. Li, C. C. Loy, and X. Tang. Face alignment by coarse-to-fine shape searching. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4998-5006, 2015.
55. X. Zhu, Z. Lei, J. Yan, D. Yi, and S. Z. Li. High-fidelity pose and expression normalization for face recognition in the wild. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 787-796, 2015.
56. X. Zhu and D. Ramanan. Face detection, pose estimation, and landmark localization in the wild. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 2879-2886. IEEE, 2012.
57. X. Zhu, J. Yan, D. Yi, Z. Lei, and S. Z. Li. Discriminative 3D morphable model fitting. In Automatic Face and Gesture Recognition (FG), 2015 11th IEEE International Conference and Workshops on, pages 1-8. IEEE, 2015.