300 Faces In-The-Wild Challenge: database and results

Image and Vision Computing

Volumn 47, Issue , 2016, Pages 3-18

  Sagonas, Christos ^a   Antonakos, Epameinondas ^a   Tzimiropoulos, Georgios ^b   Zafeiriou, Stefanos ^a   Pantic, Maja ^a,c  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF NOTTINGHAM   (United Kingdom)

^c UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Challenge; Facial database; Facial landmark localization; Semi automatic annotation tool

Indexed keywords

COMPUTER APPLICATIONS; ELECTRICAL ENGINEERING;

ANNOTATION SCHEME; CHALLENGE; ERROR METRICS; EXPERIMENTAL COMPARISON; FACIAL LANDMARK; RESEARCH ADVANCES; SEMI-AUTOMATIC ANNOTATION;

DATABASE SYSTEMS;

EID: 84962003019     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2016.01.002     Document Type: Article

References (55)

1. [1] Cootes, T.F., Edwards, G.J., Taylor, C.J., Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23:6 (2001), 681–685.
2. [2] Matthews, I., Baker, S., Active appearance models revisited. Int. J. Comput. Vis. 60:2 (2004), 135–164.
3. [3] Tzimiropoulos, G., Alabort-i-Medina, J., Zafeiriou, S., Pantic, M., Generic active appearance models revisited. Proceedings of Asian Conference on Computer Vision (ACCV), Daejeon, Korea, 2012, 650–663.
4. [4] Tzimiropoulos, G., Pantic, M., Optimization problems for fast AAM fitting in-the-wild. Proceedings of IEEE International Conference on Computer Vision (ICCV), 2013, 593–600.
5. [5] Tzimiropoulos, G., Alabort-i-Medina, J., Zafeiriou, S., Pantic, M., Active orientation models for face alignment in-the-wild, IEEE Transactions on Information Forensics and Security, Special Issue on Facial Biometrics in-the-wild 9. 2014, 2024–2034.
6. [6] Antonakos, E., Alabort-i-Medina, J., Tzimiropoulos, G., Zafeiriou, S., HOG active appearance models. Proceedings of IEEE International Conference on Image Processing (ICIP), Paris, France, 2014, 224–228.
7. [7] Alabort-i-Medina, J., Zafeiriou, S., Bayesian active appearance models. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), 2014, 3438–3445.
8. [8] Alabort-i Medina, J., Zafeiriou, S., Unifying holistic and parts-based deformable model fitting. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), 2015, 3679–3688.
9. [9] Antonakos, E., i medina, J.A., Tzimiropoulos, G., Zafeiriou, S., Feature-based Lucas–Kanade and active appearance models. IEEE Trans. Image Process. 24:9 (2015), 2617–2632.
10. [10] Tzimiropoulos, G., Pantic, M., Gauss–Newton deformable part models for face alignment in-the-wild. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), IEEE, 2014, 1851–1858.
11. [11] Felzenszwalb, P.F., Huttenlocher, D.P., Pictorial structures for object recognition. Int. J. Comput. Vis. 61:1 (2005), 55–79.
12. [12] Andriluka, M., Roth, S., Schiele, B., Pictorial structures revisited: people detection and articulated pose estimation. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), IEEE, 2009, 1014–1021.
13. [13] Antonakos, E., Alabort-i Medina, J., Zafeiriou, S., Active pictorial structures. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), 2015, 5435–5444.
14. [14] Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J., Active shape models—their training and application. Comput. Vis. Image Underst. 61:1 (1995), 38–59.
15. [15] Cristinacce, D., Cootes, T., Feature detection and tracking with constrained local models. Proceedings of British Machine Vision Conference (BMVC), 3, 2006, 929–938.
16. [16] Saragih, J.M., Lucey, S., Cohn, J.F., Deformable model fitting by regularized landmark mean-shift. Int. J. Comput. Vis. 91:2 (2011), 200–215.
17. [17] Asthana, A., Zafeiriou, S., Cheng, S., Pantic, M., Robust discriminative response map fitting with constrained local models. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), IEEE, 2013, 3444–3451.
18. [18] Zhu, X., Ramanan, D., Face detection, pose estimation, and landmark localization in the wild. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR),IEEE, 2012, 2879–2886.
19. [19] Xiong, X., De la Torre, F., Supervised descent method and its applications to face alignment. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), IEEE, 2013, 532–539.
20. [20] Cao, X., Wei, Y., Wen, F., Sun, J., Face alignment by explicit shape regression. Int. J. Comput. Vis. 107:2 (2014), 177–190.
21. [21] Asthana, A., Zafeiriou, S., Cheng, S., Pantic, M., Incremental face alignment in the wild. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), IEEE, 2014, 1859–1866.
22. [22] Tzimiropoulos, G., Project-out cascaded regression with an application to face alignment. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), IEEE, 2015, 3659–3667.
23. [23] Ren, S., Cao, X., Wei, Y., Sun, J., Face alignment at 3000 fps via regressing local binary features. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), IEEE, 2014, 1685–1692.
24. [24] Kazemi, V., Sullivan, J., One millisecond face alignment with an ensemble of regression trees. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), IEEE, 2014, 1867–1874.
25. [25] Gross, R., Matthews, I., Cohn, J., Kanade, T., Baker, S., Multi-pie. Image Vis. Comput. 28:5 (2010), 807–813.
26. [26] Messer, K., Matas, J., Kittler, J., Luettin, J., Maitre, G., XM2VTSDB: the extended M2VTS database. Second international conference on audio and video-based biometric person authentication, 964, 1999, Citeseer, 965–966.
27. [27] Phillips, P., Flynn, P., Scruggs, T., Bowyer, K., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W., Overview of the face recognition grand challenge. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), IEEE, 2005, 947–954.
28. [28] Martinez, A.M., The AR Face Database, CVC Technical Report 24. 1998.
29. [29] Belhumeur, P.N., Jacobs, D.W., Kriegman, D., Kumar, N., Localizing parts of faces using a consensus of exemplars. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), IEEE, 2011, 545–552.
30. [30] Le, V., Brandt, J., Lin, Z., Bourdev, L., Huang, T.S., Interactive facial feature localization. Proceedings of European Conference on Computer Vision (ECCV), 2012, Springer, 679–692.
31. [31] Kostinger, M., Wohlhart, P., Roth, P.M., Bischof, H., Annotated facial landmarks in the wild: a large-scale, real-world database for facial landmark localization. Proceedings of IEEE International Conference on Computer Vision (ICCV-W), Workshop on Benchmarking Facial Image Analysis Technologies, IEEE, 2011, 2144–2151.
32. [32] Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M., 300 Faces in-the-Wild Challenge: the first facial landmark localization challenge. Proceedings of IEEE International Conference on Computer Vision (ICCV-W), Workshop on 300 Faces in-the-Wild Challenge (300-W), Sydney, Australia, 2013, 397–403.
33. [33] Alabort-i-Medina, J., Antonakos, E., Booth, J., Snape, P., Zafeiriou, S., Menpo: a comprehensive platform for parametric image alignment and visual deformable models. Proceedings of the ACM International Conference on Multimedia, Open Source Software Competition, Orlando, FL, USA, 2014, 679–682.
34. [34] Jia, X., Yang, H., Lin, A., Chan, K.-P., Patras, I., Structured semi-supervised forest for facial landmarks localization with face mask reasoning. Proceedings of British Machine Vision Conference (BMVC), 2014.
35. [35] Pedersoli, M., Tuytelaars, T., Gool, L.V., Using a deformation field model for localizing faces and facial points under weak supervision. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), 2014, 3694–3701.
36. [36] Tong, Y., Liu, X., Wheeler, F.W., Tu, P.H., Semi-supervised facial landmark annotation. Comput. Vis. Image Underst. 116:8 (2012), 922–935.
37. [37] Wu, Y., Wang, Z., Ji, Q., A hierarchical probabilistic model for facial feature detection. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), 2014, 1781–1788.
38. [38] Tzimiropoulos, G., Zafeiriou, S., Pantic, M., Subspace learning from image gradient orientations. IEEE Trans. Pattern Anal. Mach. Intell. 34:12 (2012), 2454–2466.
39. [39] Papandreou, G., Maragos, P., Adaptive and constrained algorithms for inverse compositional active appearance model fitting. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), IEEE, 2008, 1–8.
40. [40] Gross, R., Matthews, I., Baker, S., Generic vs. person specific active appearance models. Image Vis. Comput. 23:12 (2005), 1080–1093.
41. [41] Baltrusaitis, T., Robinson, P., Morency, L.-P., Constrained local neural fields for robust facial landmark detection in the wild. Proceedings of IEEE International Conference on Computer Vision (ICCV-W), Workshop on 300 Faces in-the-Wild Challenge (300-W), 2013, 354–361.
42. [42] Hasan, M., Pal, C., Moalem, S., Localizing facial keypoints with global descriptor search, neighbour alignment and locally linear models. Proceedings of IEEE International Conference on Computer Vision (ICCV-W), Workshop on 300 Faces in-the-Wild Challenge (300-W), 2013, 362–369.
43. [43] Jaiswal, S., Almaev, T., Valstar, M., Guided unsupervised learning of mode specific models for facial point detection in the wild. Proceedings of IEEE International Conference on Computer Vision (ICCV-W), Workshop on 300 Faces in-the-Wild Challenge (300-W), 2013, 370–377.
44. [44] Martinez, B., Valstar, M.F., Binefa, X., Pantic, M., Local evidence aggregation for regression-based facial point detection. IEEE Trans. Pattern Anal. Mach. Intell. 35:5 (2013), 1149–1163.
45. [45] Milborrow, S., Bishop, T., Nicolls, F., Multiview active shape models with SIFT descriptors for the 300-W face landmark challenge. Proceedings of IEEE International Conference on Computer Vision (ICCV-W), Workshop on 300 Faces in-the-Wild Challenge (300-W), 2013, 378–385.
46. [46] Lowe, D.G., Object recognition from local scale-invariant features. Proceedings of IEEE International Conference on Computer Vision (ICCV), 2, 1999, IEEE, 1150–1157.
47. [47] Yan, J., Lei, Z., Yi, D., Li, S., Learn to combine multiple hypotheses for accurate face alignment. Proceedings of IEEE International Conference on Computer Vision (ICCV-W), Workshop on 300 Faces in-the-Wild Challenge (300-W), 2013, 392–396.
48. [48] Zhou, E., Fan, H., Cao, Z., Jiang, Y., Yin, Q., Extensive facial landmark localization with coarse-to-fine convolutional network cascade. Proceedings of IEEE International Conference on Computer Vision (ICCV-W), Workshop on 300 Faces in-the-Wild Challenge (300-W), 2013, 386–391.
49. [49] Viola, P., Jones, M., Rapid object detection using a boosted cascade of simple features. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR), 2001, IEEE, 511–518.
50. [50] Jain, V., Learned-Miller, E., FDDB: a benchmark for face detection in unconstrained settings, Tech. Rep. UM-CS-2010-009, University of Massachusetts, Amherst. 2010.
51. [51] Čech, J., Franc, V., Uřičář, M., Matas, J., Multi-view facial landmark detection by using a 3D shape model. Image Vis. Comput. 47 (2016), 60–70.
52. 3 CSR: multi-view, multi-scale and multi-component cascade shape regression. Image Vis. Comput. 47 (2016), 19–26.
53. [53] Fan, H., Zhou, E., Approaching human level facial landmark localization by deep learning. Image Vis. Comput. 47 (2016), 27–35.
54. [54] Martinez, B., Valstar, M.F., L2,1-based regression and prediction accumulation across views for robust facial landmark detection. Image Vis. Comput. 47 (2016), 36–44.
55. [55] Uřičář, M., Franc, V., Thomas, D., Sugimoto, A., Hlaváč, V., Multi-view facial landmark detector learned by the structured output SVM. Image Vis. Comput. 47 (2016), 45–59.