Supervision-by-Registration: An Unsupervised Approach to Improve the Precision of Facial Landmark Detectors

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2018, Pages 360-368

  Dong, Xuanyi ^a   Yu, Shoou I ^a   Weng, Xinshuo ^b   Wei, Shih En ^b   Yang, Yi ^a   Sheikh, Yaser ^b  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^b FACEBOOK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; OPTICAL FLOWS;

ADJACENT FRAMES; FACIAL LANDMARK; FACIAL LANDMARK DETECTION; LABELED IMAGES; MANUAL LABELING; TEMPORAL COHERENCY; UNSUPERVISED APPROACHES; VIDEO DETECTION;

IMAGE ENHANCEMENT;

EID: 85055682668     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2018.00045     Document Type: Conference Paper

References (41)

1. S. Baker and I. Matthews. Lucas-Kanade 20 years on: A unifying framework. IJCV, 2004. 2, 3
2. C. Cao, Y. Weng, S. Lin, and K. Zhou. 3D shape regression for real-time facial animation. ACM Transactions on Graphics, 32(4):41, 2013. 1
3. X. Cao, Y. Wei, F. Wen, and J. Sun. Face alignment by explicit shape regression. IJCV, 2014. 2, 6
4. C.-H. Chang, C.-N. Chou, and E. Y. Chang. CLKN: Cascaded lucas-kanade networks for image alignment. In CVPR, 2017. 2, 3
5. J. Charles, T. Pfister, D. Magee, D. Hogg, and A. Zisserman. Personalizing human video pose estimation. In CVPR, 2016. 3, 8
6. G. G. Chrysos, E. Antonakos, S. Zafeiriou, and P. Snape. Offline deformable face tracking in arbitrary videos. In ICCVW, 2015. 5
7. X. Dong, J. Huang, Y. Yang, and S. Yan. More is less: A more complicated network with less inference complexity. In CVPR, 2017. 5
8. X. Dong, Y. Yan, W. Ouyang, and Y. Yang. Style aggregated network for facial landmark detection. In CVPR, 2018. 2, 6
9. S. Hare, S. Golodetz, A. Saffari, V. Vineet, M.-M. Cheng, S. L. Hicks, and P. H. Torr. Struck: Structured output tracking with kernels. T-PAMI, 2016. 2
10. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In CVPR, 2016. 5
11. M. Jaderberg, K. Simonyan, A. Zisserman, et al. Spatial transformer networks. In NIPS, 2015. 4
12. Z. Kalal, K. Mikolajczyk, and J. Matas. Forward-backward error: Automatic detection of tracking failures. In ICPR, 2010. 2, 5
13. M. H. Khan, J. McDonagh, and G. Tzimiropoulos. Synergy between face alignment and tracking via discriminative global consensus optimization. In ICCV, 2017. 1, 2, 5, 6
14. M. Kim, S. Kumar, V. Pavlovic, and H. Rowley. Face tracking and recognition with visual constraints in real-world videos. In CVPR, 2008. 5
15. M. Koestinger, P. Wohlhart, P. M. Roth, and H. Bischof. Annotated facial landmarks in the wild: A large-scale, realworld database for facial landmark localization. In ICCV-W, 2011. 1, 5
16. A. Krizhevsky, I. Sutskever, and G. E. Hinton. ImageNet classification with deep convolutional neural networks. In NIPS, 2012. 2
17. H. Liu, J. Lu, J. Feng, and J. Zhou. Two-stream transformer networks for video-based face alignment. T-PAMI, 2017. 2, 6
18. B. D. Lucas, T. Kanade, et al. An iterative image registration technique with an application to stereo vision. In IJCAI, 1981. 2
19. J. Lv, X. Shao, J. Xing, C. Cheng, and X. Zhou. A deep regression architecture with two-stage reinitialization for high performance facial landmark detection. In CVPR, 2017. 1, 2, 4, 5, 6
20. A. Newell, K. Yang, and J. Deng. Stacked hourglass networks for human pose estimation. In ECCV, 2016. 2, 4
21. A. Paszke, S. Gross, S. Chintala, G. Chanan, E. Yang, Z. De-Vito, Z. Lin, A. Desmaison, L. Antiga, and A. Lerer. Automatic differentiation in PyTorch. In NIPS-W, 2017. 6
22. X. Peng, R. S. Feris, X. Wang, and D. N. Metaxas. A recurrent encoder-decoder network for sequential face alignment. In ECCV, 2016. 1, 2
23. X. Peng, S. Zhang, Y. Yang, and D. N. Metaxas. PIEFA: Personalized incremental and ensemble face alignment. In ICCV, 2015. 1, 3, 5, 6
24. X. Peng, S. Zhang, Y. Yu, and D. N. Metaxas. Toward personalized modeling: Incremental and ensemble alignment for sequential faces in the wild. IJCV, 2017. 3
25. S. Ren, X. Cao, Y. Wei, and J. Sun. Face alignment at 3000 fps via regressing local binary features. In CVPR, 2014. 6
26. C. Sagonas, E. Antonakos, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. 300 faces in-The-wild challenge: Database and results. Image and Vision Computing, 47:3-18, 2016. 6
27. C. Sagonas, Y. Panagakis, S. Zafeiriou, and M. Pantic. RAPS: Robust and efficient automatic construction of person-specific deformable models. In CVPR, 2014. 3
28. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. 300 faces in-The-wild challenge: The first facial landmark localization challenge. In ICCV-W, 2013. 1, 5, 6
29. H. Shen, S.-I. Yu, Y. Yang, D. Meng, and A. Hauptmann. Unsupervised video adaptation for parsing human motion. In ECCV, 2014. 3, 8
30. J. Shen, S. Zafeiriou, G. G. Chrysos, J. Kossaifi, G. Tzimiropoulos, and M. Pantic. The first facial landmark tracking in-The-wild challenge: Benchmark and results. In ICCVW, 2015. 5
31. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. In ICLR, 2015. 5
32. J. Thies, M. Zollhofer, M. Stamminger, C. Theobalt, and M. Niebner. Face2Face: Real-time face capture and reenactment of RGB videos. In CVPR, 2016. 1
33. G. Trigeorgis, P. Snape, M. A. Nicolaou, E. Antonakos, and S. Zafeiriou. Mnemonic descent method: A recurrent process applied for end-to-end face alignment. In CVPR, 2016. 6
34. G. Tzimiropoulos. Project-out cascaded regression with an application to face alignment. In CVPR, 2015. 5
35. S.-E. Wei, V. Ramakrishna, T. Kanade, and Y. Sheikh. Convolutional pose machines. In CVPR, 2016. 4, 5
36. L. Wolf, T. Hassner, and I. Maoz. Face recognition in unconstrained videos with matched background similarity. In CVPR, 2011. 5
37. X. Xiong and F. De la Torre. Supervised descent method and its applications to face alignment. In CVPR, 2013. 1, 2, 6
38. Z. Zhang, P. Luo, C. C. Loy, and X. Tang. Facial landmark detection by deep multi-task learning. In ECCV, 2014. 2, 6
39. S. Zhu, C. Li, C. Change Loy, and X. Tang. Face alignment by coarse-to-fine shape searching. In CVPR, 2015. 5, 6
40. S. Zhu, C. Li, C.-C. Loy, and X. Tang. Unconstrained face alignment via cascaded compositional learning. In CVPR, 2016. 4, 5
41. X. Zhu. Semi-supervised learning tutorial. In ICML, 2007. 3