Learning Deep Representation for Face Alignment with Auxiliary Attributes

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 38, Issue 5, 2016, Pages 918-930

  Zhang, Zhanpeng ^a   Luo, Ping ^a   Loy, Chen Change ^a   Tang, Xiaoou ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

convolutional network; deep learning; Face Alignment; face landmark detection

Indexed keywords

ALIGNMENT; COMPLEX NETWORKS; CONSTRAINED OPTIMIZATION;

AUXILIARY INFORMATION; CONVOLUTIONAL NETWORKS; DEEP LEARNING; FACE ALIGNMENT; FACE LANDMARKS; LEARNING DIFFICULTIES; OPTIMIZATION CONVERGENCE; STATE-OF-THE-ART METHODS;

FACE RECOGNITION;

EID: 84963829815     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2015.2469286     Document Type: Article

References (52)

1. N. Kumar, P. Belhumeur, and S. Nayar, "FaceTracer: A search engine for large collections of images with faces," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 340-353.
2. C. Lu and X. Tang, "Surpassing human-level face verification performance on LFW with GaussianFace," presented at the AAAI Conf. Artif. Intell., Austin, TX, USA, 2015.
3. Z. Huang, X. Zhao, S. Shan, R. Wang, and X. Chen, "Coupling alignments with recognition for still-to-video face recognition," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 3296-3303.
4. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, Jun. 2001.
5. X. Zhu and D. Ramanan, "Face detection, pose estimation, and landmark localization in the wild," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 2879-2886.
6. X. Yu, J. Huang, S. Zhang, W. Yan, and D. N. Metaxas, "Pose-free facial landmark fitting via optimized part mixtures and cascaded deformable shape model," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 1944-1951.
7. G. Tzimiropoulos and M. Pantic, "Gauss-Newton deformable part models for face alignment in-the-wild," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1851-1858.
8. X. P. Burgos-Artizzu, P. Perona, and P. Dollar, "Robust face landmark estimation under occlusion," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 1513-1520.
9. X. Cao, Y. Wei, F. Wen, and J. Sun, "Face alignment by explicit shape regression," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 2887-2894.
10. T. F. Cootes, M. C. Ionita, C. Lindner, and P. Sauer, "Robust and accurate shape model fitting using random forest regression voting," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 278-291.
11. H. Yang and I. Patras, "Sieving regression forest votes for facial feature detection in the wild," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 1936-1943.
12. J. Zhang, S. Shan, M. Kan, and X. Chen, "Coarse-to-fine autoencoder networks (CFAN) for real-time face alignment," in Proc. Eur. Conf. Comput. Vis., 2014, pp. 1-16.
13. Y. Sun, X. Wang, and X. Tang, "Deep convolutional network cascade for facial point detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3476-3483.
14. P. N. Belhumeur, D. W. Jacobs, D. J. Kriegman, and N. Kumar, "Localizing parts of faces using a consensus of exemplars," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 545-552.
15. K. Chen, S. Gong, T. Xiang, and C. C. Loy, "Cumulative attribute space for age and crowd density estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 2467-2474.
16. P. Luo, X. Wang, and X. Tang, "A deep sum-product architecture for robust facial attributes analysis," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 2864-2871.
17. A. Ahmed, K. Yu, W. Xu, Y. Gong, and E. Xing, "Training hierarchical feed-forward visual recognition models using transfer learning from pseudo-tasks," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 69-82.
18. J. Weston, F. Ratle, H. Mobahi, and R. Collobert, "Deep learning via semi-supervised embedding," in Neural Networks: Tricks of the Trade. New York, NY, USA: Springer, 2012, pp. 639-655.
19. S. Li, Z.-Q. Liu, and A. Chan, "Heterogeneous multi-task learning for human pose estimation with deep convolutional neural network," Int. J. Comput. Vis., vol. 113, pp. 19-36, 2014.
20. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic, "300 faces in-the-wild challenge: The first facial landmark localization challenge," in Proc. IEEE Int. Conf. Comput. Vis. Workshops, 2013, pp. 397-403.
21. X. Xiong and F. De La Torre, "Supervised descent method and its applications to face alignment," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 532-539.
22. S. Ren, X. Cao, Y. Wei, and J. Sun, "Face alignment at 3000 fps via regressing local binary features," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1685-1692.
23. V. Le, J. Brandt, Z. Lin, L. Bourdev, and T. S. Huang, "Interactive facial feature localization," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 679-692.
24. Z. Zhang, P. Luo, C. C. Loy, and X. Tang, "Facial landmark detection by deep multi-task learning," in Proc. Eur. Conf. Comput. Vis., 2014, pp. 94-108.
25. M. Valstar, B. Martinez, X. Binefa, and M. Pantic, "Facial point detection using boosted regression and graph models," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 2729-2736.
26. P. Dollár, P. Welinder, and P. Perona, "Cascaded pose regression," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 1078-1085.
27. M. Dantone, J. Gall, G. Fanelli, and L. Van Gool, "Real-time facial feature detection using conditional regression forests," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 2578-2585.
28. D. Chen, S. Ren, Y. Wei, X. Cao, and J. Sun, "Joint cascade face detection and alignment," in Proc. Eur. Conf. Comput. Vis., 2014, pp. 109-122.
29. X. Liu, "Generic face alignment using boosted appearance model," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-8.
30. M. Pedersoli, R. Timofte, T. Tuytelaars, and L. V. Gool, "Using a deformation field model for localizing faces and facial points under weak supervision," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 3694-3701.
31. A. Asthana, S. Zafeiriou, S. Cheng, and M. Pantic, "Robust discriminative response map fitting with constrained local models," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3444-3451.
32. W. L. Baoguang Shi, X. Bai and J. Wang, "Deep regression for face alignment," arXiv:1409.5230, 2014.
33. R. Caruana, "Multitask learning," Mach. Learning, vol. 28, no. 1, pp. 41-75, 1997.
34. R. Collobert and J. Weston, "A unified architecture for natural language processing: Deep neural networks with multitask learning," in Proc. Int. Conf. Mach. Learning, 2008, pp. 160-167.
35. Y. Liu, A. Wu, D. Guo, K.-T. Yao, and C. Raghavendra, "Weighted task regularization for multitask learning," in Proc. Int. Conf. Data Mining Workshops, 2013, pp. 399-406.
36. P. McCullagh, J. A. Nelder, and P. McCullagh, Generalized Linear Models. London, U.K.: Chapman & Hall, 1989.
37. A. K. Gupta and D. K. Nagar, Matrix Variate Distributions. Boca Raton, FL, USA: CRC Press, 1999.
38. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 1097-1105.
39. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
40. J. Moody, S. Hanson, A. Krogh, and J. A. Hertz, "A simple weight decay can improve generalization," Proc. Adv. Neural Inf. Process. Syst., 1995, vol. 4, pp. 950-957.
41. A. L. Yuille, A. Rangarajan, and A. Yuille, "The concave-convex procedure (CCCP)," Proc. Adv. Neural Inf. Process. Syst., 2002, vol. 2, pp. 1033-1040.
42. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
43. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning representations by back-propagating errors," Nature, vol. 323, pp. 533-536, 1986.
44. Y. Sun, X. Wang, and X. Tang, "Deep learning face representation from predicting 10,000 classes," in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2014, pp. 1891-1898.
45. M. Kostinger, P. Wohlhart, P. M. Roth, and H. Bischof, "Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization," in Proc. IEEE Int. Conf. Comput. Vis. Workshops, 2011, pp. 2144-2151.
46. O. Jesorsky, K. J. Kirchberg, and R. Frischholz, "Robust face detection using the Hausdorff distance," in Proc. Int. Conf. Audio-Video-Based Biometric Person Authentication, 2001, pp. 90-95.
47. K. Messer, J. Matas, J. Kittler, J. Lttin, and G. Maitre, "XM2VTSDB: The extended M2VTS database," in Proc. Int. Conf. Audio Video-Based Biometric Person Authentication, 1999, pp. 72-77.
48. V. Kazemi and S. Josephine, "One millisecond face alignment with an ensemble of regression trees," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1867-1874.
49. S. Zhu, C. Li, C. C. Loy, and X. Tang, "Face alignment by coarseto-fine shape searching," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 4998-5006.
50. S. Milborrow and F. Nicolls, "Locating facial features with an extended active shape model," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 504-513.
51. T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham, "Active shape models - Their training and application," Comput. Vis. Image Understanding, vol. 61, no. 1, pp. 38-59, 1995.
52. Megvii Inc. Face++. [Online]. Available: http://www.faceplusplus. com, 2015.