Fully automatic expression-invariant face correspondence

Machine Vision and Applications

Volumn 25, Issue 4, 2014, Pages 859-879

  Salazar, Augusto ^a   Wuhrer, Stefanie ^b   Shu, Chang ^c   Prieto, Flavio ^d  

^a UNIVERSIDAD NACIONAL DE COLOMBIA   (Colombia)

^b SAARLAND UNIVERSITY   (Germany)

^c NATIONAL RESEARCH COUNCIL CANADA   (Canada)

^d UNIVERSIDAD NACIONAL DE COLOMBIA   (Colombia)

Author keywords

Automatic landmark prediction; Blendshape model; Energy minimization; Facial expression invariant; Non rigid 3D registration

Indexed keywords

COMPUTER VISION; HARDWARE; MACHINERY;

3D FACE MODELS; 3D REGISTRATION; AUTOMATIC APPROACHES; BLENDSHAPE; ENERGY MINIMIZATION; FACIAL EXPRESSION-INVARIANT; HIGHLY ACCURATE; TEMPLATE MODELS;

FACE RECOGNITION;

EID: 84899975688     PISSN: 09328092     EISSN: 14321769     Source Type: Journal    
DOI: 10.1007/s00138-013-0579-9     Document Type: Article

References (53)

1. Dryden, I.; Mardia, K.: Statistical Shape Analysis. Wiley, New York (2002)
2. Blanz, V.; Vetter, T.: A morphable model for the synthesis of 3D faces. In: Conference on Computer Graphics and Interactive Techniques, pp. 187-194 (1999)
3. Jiang, D.; Hu, Y.; Yan, S.; Zhang, L.; Zhang, H.; Gao, W.: Efficient 3D reconstruction for face recognition. Pattern Recognit 38(6), 787-798 (2005)
4. Romdhani, S.; Blanz, V.; Vetter, T.: Face identification by fitting a 3D morphable model using linear shape and texture error functions. In: IEEE International Conference on Computer Vision, pp. 3-19 (2002)
5. Romdhani, S.; Vetter, T.: Efficient, robust and accurate fitting of a 3D morphable model. In: IEEE International Conference on Computer Vision, vol. 1, pp. 59-66 (2003)
6. Brunton, A.; Shu, C.; Lang, J.; Dubois, E.: Wavelet model-based stereo for fast, robust face reconstruction. In: Canadian Conference on Computer and Robot Vision, pp. 347-354 (2011)
7. van Kaick, O.; Zhang, H.; Hamarneh, G.; Cohen-Or, D.: A survey on shape correspondence. Comput. Graph. Forum 3(6), 1681-1707 (2011)
8. Xi, P.; Shu, C.: Consistent parameterization and statistical analysis of human head scans. Vis. Comput. 25(9), 863-871 (2009)
9. Li, H.; Weise, T.; Pauly, M.: Example-based facial rigging. ACM Trans. Graph. (SIGGRAPH) 29(4), 32:1-32:6 (2010)
10. Learned-Miller, E.: Data driven image models through continuous joint alignment. IEEE Trans. Pattern Anal. Mach. Intell. 28(2), 236-250 (2006)
11. Cox, M.; Sridharan, S.; Lucey, S.; Cohn, J.: Least squares congealing for unsupervised alignment of images. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8 (2008)
12. Tong, Y.; Liu, X.; Wheeler, F.; Tu, P.: Semi-supervised facial landmark annotation. Comput. Vis. Image Underst. 116, 922-935 (2012)
13. Cootes, T.; Edwards, G.; Taylor, C.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681-685 (2001)
14. Mehryar, S.; Martin, K.; Plataniotis, K.; Stergiopoulos, S.: Automatic landmark detection for 3D face image processing. In: IEEE Congress on Evolutionary Computation, pp. 1-7 (2010)
15. Vezzetti, E.; Marcolin, F.: 3D human face description: landmarks measures and geometrical features. Image Vis. Comput. 30(10), 750-761 (2012)
16. Ben Azouz, Z.; Shu, C.; Mantel, A.: Automatic locating of anthropometric landmarks on 3D human models. In: International Symposium on 3D Data Processing, Visualization, and Transmission, pp. 750-757 (2006)
17. Berretti, S.; Ben Amor, B.; Daoudi, M.; del Bimbo, A.: 3D facial expression recognition using SIFT descriptors of automatically detected keypoints. Vis. Comput. 27(11), 1021-1036 (2011)
18. Creusot, C.; Pears, N.; Austin, J.: 3D face landmark labelling. In: Proceedings ACM workshop on 3D object retrieval, pp. 27-32 (2010)
19. Segundo, M.; Silva, L.; Pereira, O.; Queirolo, C.: Automatic face segmentation and facial landmark detection in range images. IEEE Trans. Syst. Man. Cybern. Part B 40(5), 1319-1330 (2010)
20. Perakis, P.; Theoharis, T.; Passalis, G.; Kakadiaris, I.: Automatic 3D facial region retrieval from multi-pose facial datasets. In: Eurographics Workshop on 3D Object Retrieval, pp. 37-44 (2009)
21. Perakis, P.; Passalis, G.; Theoharis, T.; Kakadiaris, I.: 3D facial landmark detection & face registration: A 3D facial landmark model & 3D local shape descriptors approach. Technical Report TP-2010-01, Computer Graphics Laboratory, University of Athens (2010)
22. Nair, P.; Cavallaro, A.: 3-D face detection, landmark localization, and registration using a point distribution model. IEEE Trans. Multimed. 11(4), 611-623 (2009)
23. Lu, X.; Jain, A.: Automatic feature extraction for multiview 3D face recognition. In: International Conference on Automatic Face and Gesture Recognition, pp. 585-590 (2006)
24. Xiaoguang, L.; Jain, A.; Colbry, D.: Matching 2.5D face scans to 3d models. IEEE Trans. Pattern Anal. Mach. Intell. 28(1), 31-43 (2006)
25. Guo, J.; Mei, X.; Tang, K.: Automatic landmark annotation and dense correspondence registration for 3D human facial images. BMC Bioinform. 14, 232 (2013)
26. Sun, Y.; Abidi, M.: Surface matching by 3D point's fingerprint. In: IEEE International Conference on Computer Vision, vol. 2, pp. 263-269 (2001)
27. Elad, A.; Kimmel, R.: On bending invariant signatures for surfaces. IEEE Trans. Pattern Anal. Mach. Intell. 25(10), 1285-1295 (2003)
28. Chang, K.; Bowyer, K.; Flynn, P.: Multiple nose region matching for 3D face recognition under varying facial expression. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1695-1700 (2006)
29. Passalis, G.; Perakis, P.; Theoharis, T.; Kakadiaris, I.: Using facial symmetry to handle pose variations in real-world 3D face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 33(10), 1938-1951 (2011)
30. Kakadiaris, I.; Passalis, G.; Toderici, G.; Murtuza, M.; Yunliang, L.; Karampatziakis, N.; Theoharis, T.: Three-dimensional face recognition in the presence of facial expressions: an annotated deformable model approach. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 640-649 (2007)
31. Mpiperis, I.; Malassiotis, S.; Strintzis, M.: Bilinear models for 3D face and facial expression recognition. IEEE Trans. Inform. Forensics Secur. 3(3), 498-511 (2008)
32. Huang, Y.; Zhang, X.; Fan, Y.; Yin, L.; Seversky, L.; Allen, J.; Lei, T.; Dong, W.: Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysis. Image Vis. Comput. 30(10), 681-796 (2012)
33. Xiaoguang, L.; Jain, A.: Deformation modeling for robust 3D face matching. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 1377-1383 (2006)
34. Basso, C.; Paysan, P.; Vetter, T.: Registration of expressions data using a 3D morphable model. In: International Conference on Automatic Face and Gesture Recognition, pp. 205-210 (2006)
35. Amberg, B.; Knothe, R.; Vetter, T.: Expression invariant 3D face recognition with a morphable model. In: IEEE International Conference on Automatic Face Gesture Recognition, pp. 1-6 (2008)
36. Allen, B.; Curless, B.; Popović, Z.: The space of human body shapes: reconstruction and parametrisation from range scans. ACM Trans. Graph. (SIGGRAPH) 22(3), 587-594 (2003)
37. Wuhrer, S.; Shu, C.; Xi, P.: Landmark-free posture invariant human shape correspondence. Vis. Comput. 27(9), 843-852 (2011)
38. Bronstein, A.; Bronstein, M.; Kimmel, R.: Generalized multidimensional scaling: a framework for isometry-invariant partial surface matching. Proc. Natl. Acad. Sci. 103(5), 1168-1172 (2006)
39. Bronstein, A.; Bronstein, M.; Kimmel, R.: Expression-invariant representations of faces. IEEE Trans. Image Process. 16(1), 188-197 (2007)
40. Weise, T.; Bouaziz, S.; Li, H.; Pauly, M.: Realtime performance-based facial animation. ACM Trans. Graph. (SIGGRAPH) 30(4), 77:1-77:10 (2011)
41. Wuhrer, S.; Ben Azouz, Z.; Shu, C.: Semi-automatic prediction of landmarks on human models in varying poses. In: Canadian Conference on Computer and Robot Vision, pp. 136-142 (2010)
42. Cox, T.; Cox, M.: Multidimensional Scaling, 2nd edn. Chapman & Hall CRC, Boca Raton (2001)
43. Yedidia, J.; Freeman, W.; Weiss, Y.: Understanding Belief Propagation and its Generalizations. Science & Technology Books (2003)
44. Han, J.; Kamber, M.: Data Mining: Concepts and Techniques, 2nd edn. Morgan Kaufmann Publishers, Burlington (2006)
45. Cazals, F.; Pouget, M.: Smooth surfaces, umbilics, lines of curvatures, foliations, ridges and the medial axis: a concise overview. Technical Report RR-5138, INRIA (2004)
46. Li, H.; Adams, B.; Guibas, L.; Pauly, M.: Robust single-view geometry and motion reconstruction. ACM Trans. Graph. (SIGGRAPH Asia) 28(5), 175:1-175:10 (2009)
47. Liu, D.; Nocedal, J.: On the limited memory BFGS method for large scale optimization. Math. Program. 45, 503-528 (1989)
48. Yin, L.; Wei, X.; Wang, J.; Sun, Y.; Rosato, M.: A 3D facial expression database for facial behavior research. In: IEEE International Conference on Automatic Face and Gesture Recognition, pp. 211-216 (2006)
49. Gao, Y.: Efficiently comparing face images using a modified hausdorff distance. In: IEEE Conference on Vision, Image and Signal Processing, pp. 346-350 (2003)
50. Rabiu, H.; Saripan, M.; Mashohor, S.; Marhaban, M.: 3d facial expression recognition using maximum relevance minimum redundancy geometrical features. EURASIP J. Adv. Signal Process. 1, 213 (2012)
51. Duin, R.; Juszczak, P.; Paclik, P.; Pekalska, E.; de Ridder, D.; Tax, D.; Verzakov, S.: PRTools4.1, A Matlab Toolbox for Pattern Recognition. Delft University of Technology, Delft (2007)
52. Vlasic, D.; Brand, M.; Pfister, H.; Popović, J.: Face transfer with multilinear models. Trans. Graph. (Proc. SIGGRAPH) 24(3), 426-433 (2005)
53. Savran, A.; Alyüz, N.; Dibekliouǧlu, H.; Çeliktutan, O.; Gökberk, B.; Sankur, B.; Akarun, L.: Bosphorus database for 3D face analysis. In: European Workshop on Biometrics and Identity Management, pp. 47-56 (2008)