Face recognition across pose: A review

Pattern Recognition

Volumn 42, Issue 11, 2009, Pages 2876-2896

  Zhang, Xiaozheng ^a   Gao, Yongsheng ^a  

^a GRIFFITH UNIVERSITY   (Australia)

Author keywords

Face recognition; Pose variation; Review; Survey

Indexed keywords

3D FACE MODELLING; BIOMETRIC TECHNIQUES; FACE IMAGES; FACE RECOGNITION TECHNIQUE; FACE SURFACES; IMAGE-BASED; POSE VARIATION; POSE-INVARIANT FACE RECOGNITION;

BIOMETRICS; RESEARCH; ROTATION; SURVEYS; THREE DIMENSIONAL;

FACE RECOGNITION;

EID: 67649414924     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2009.04.017     Document Type: Article

References (91)

1. Abate A.F., Nappi M., Riccio D., and Sabatino G. 2D and 3D face recognition: a survey. Pattern Recognition Lett. 28 14 (2007) 1885-1906
2. Ahonen T., Hadid A., and Pietikäinen M. Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28 12 (2006) 2037-2041
3. W.A. Barrett, A survey of face recognition algorithms and testing results, in: Proceedings of the Asilomar Conference on Signals, Systems and Computers, vol. 1, 1998, pp. 301-305.
4. Bartlett M.S., Movellan J.R., and Sejnowski T.J. Face recognition by independent component analysis. IEEE Trans. Neural Network 13 6 (2002) 1450-1464
5. Basri R., and Jacobs D.W. Lambertian reflectance and linear subspaces. IEEE Trans. Pattern Anal. Mach. Intell. 25 2 (2003) 218-233
6. T. Beier, S. Neely, Feature-based image metamorphosis, in: Proceedings of SIGGRAPH 92 (Computer Graphics), vol. 26, 1992, pp. 35-42.
7. Belhumeur P.N., Hespanha J.P., and Kriegman D.J. Eigenfaces vs. Fisherfaces: recognition using class specific linear projection,. IEEE Trans. Pattern Anal. Mach. Intell. 19 7 (1997) 711-720
8. Belhumeur P.N., and Kriegman D.J. What is the set of images of an object under all possible illumination conditions. Int. J. Comput. Vision 28 3 (1998) 245-260
9. Belhumeur P.N., Kriegman D.J., and Yuille A.L. The bas-relief ambiguity. Int. J. Comput. Vision 35 1 (1999) 33-44
10. D. Beymer, T. Poggio, Face recognition from one example view, in: Proceedings of the International Conference on Computer Vision, 1995, pp. 500-507.
11. D. Beymer, Feature correspondence by interleaving shape and texture computations, in: Proceedings of the IEEE Conference on CVPR, 1996, pp. 921-928.
12. D.J. Beymer, Face recognition under varying pose, in: Proceedings of the IEEE Conference on CVPR, 1994, pp. 756-761.
13. V. Blanz, T. Vetter, A morphable model for the synthesis of 3D faces, in: Proceedings of SIGGRAPH, 1999, pp. 187-194.
14. Blanz V., and Vetter T. Face recognition based on fitting a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell. 25 9 (2003) 1063-1074
15. Bowyer K.W., Kyong C., and Flynn P. A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition. Comput. Vision Image Understanding 101 1 (2006) 1-15
16. Brunelli R., and Poggio T. Face recognition: features versus templates. IEEE Trans. Pattern Anal. Mach. Intell. 15 10 (1993) 1042-1052
17. Cass S., and Riezenman M. Improving security, preserving privacy. IEEE Spectrum 39 1 (2002) 44-49
18. C. D. Castillo and D. W. Jacobs, Using stereo matching for 2-D face recognition across pose, in: Proceedings of the IEEE Conference on CVPR, 2007, pp. 1-8.
19. Chai X., Shan S., Chen X., and Gao W. Locally linear regression for pose-invariant face recognition. IEEE Trans. Image Process. 16 7 (2007) 1716-1725
20. R. Chellappa, C.L. Wilson, S. Sirohey, Human and machine recognition of faces: a survey, Proceedings of the IEEE 83 (5) (1995) 705-741.
21. Chen S., Tan X., Zhou Z.-H., and Zhang F. Face recognition from a single image per person: a survey. Pattern Recognition 39 9 (2006) 1725-1745
22. Cootes T.F., Hill A., Taylor C.J., and Haslam J. The use of active shape models for locating structures in medical images. Image Vision Comput. 12 6 (1994) 355-366
23. Cootes T.F., Cooper D., Taylor C.J., and Graham J. Active shape models-their training and application. Comput. Vision Image Understanding 61 1 (1995) 38-59
24. Cootes T.F., Edwards G.J., and Taylor C.J. Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23 6 (2001) 681-685
25. Cootes T.F., Wheeler G.V., Walker K.N., and Taylor C.J. View-based active appearance models. Image Vision Comput. 20 (2002) 657-664
26. Gao Y., Leung M.K.H., Wang W., and Hui S.C. Fast face identification under varying pose from a single 2-D model view. IEE Proc. Vision Image Signal Process. 148 4 (2001) 248-253
27. Gao Y., and Leung M.K.H. Face recognition using line edge map. IEEE Trans. Pattern Anal. Mach. Intell. 24 6 (2002) 764-779
28. Gao Y., and Qi Y. Robust visual similarity retrieval in single model face databases. Pattern Recognition 38 (2005) 1009-1020
29. A.S. Georghiades, P.N. Belhumeur, D.J. Kriegman, From few to many: generative models for recognition under variable pose and illumination, in: Proceedings of the International Conference on Auto Face Gesture Recognition, 2000, pp. 277-284.
30. Georghiades A.S., Belhumeur P.N., and Kriegman D.J. From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23 6 (2001) 643-660
31. A.S. Georghiades, Incorporating the Torrance and Sparrow model of reflectance in uncalibrated photometric stereo, in: Proceedings of the ICCV, vol. 2, 2003, pp. 816-823.
32. González-Jiménez D., and Alba-Castro J.L. Toward pose-invariant 2-D face recognition through point distribution models and facial symmetry. IEEE Trans. Inf. Forensic Secur. 2 3-1 (2007) 413-429
33. Gross R., Matthews I., and Baker S. Appearance-based face recognition and light-fields. IEEE Trans. Pattern Anal. Mach. Intell. 26 4 (2004) 449-465
34. Haykin S. Neural Networks-A Comprehensive Foundation. second ed. (1999), Prentice-Hall, New York
35. He X., Yan S., Hu Y., Niyogi P., and Zhang H.-J. Face recognition using Laplacianfaces. IEEE Trans. Pattern Anal. Mach. Intell. 27 3 (2005) 328-340
36. Huang J., Yuen P.C., Chen W.S., and Lai J.H. Choosing parameters of kernel subspace LDA for recognition of face images under pose and illumination variations. IEEE Trans. Syst., Man, Cybern. B, Cybern. 37 4 (2007) 847-862
37. Ishiyama R., Hamanaka M., and Sakamoto S. An appearance model constructed on 3-D surface for robust face recognition against pose and illumination variations. IEEE Trans. Syst., Man, Cybern. C, Appl. Rev. 35 3 (2005) 326-334
38. Jiang D., Hu Y., Yan S., Zhang L., Zhang H., and Gao W. Efficient 3D reconstruction for face recognition. Pattern Recognition 38 6 (2005) 787-798
39. F. Kahraman, B. Kurt, M. Gokmen, Robust face alignment for illumination and pose invariant face recognition, in: Proceedings of the IEEE Conference on CVPR, 2007, pp. 1-7.
40. Kakadiaris I.A., Passalis G., Toderici G., Murtuza M.N., Lu Y., Karampatziakis N., and Theoharis T. Three-dimensional face recognition in the presence of facial expressions: an annotated deformable model approach. IEEE Trans. Pattern Anal. Mach. Intell. 29 4 (2007) 640-649
41. T. Kanade, Picture processing by computer complex and recognition of human faces, Department of Information Science, Kyoto University, Japan, 1973.
42. Kim T.K., and Kittler J. Design and fusion of pose-invariant face-identification experts. IEEE Trans. Circuits Syst. Video Technol. 16 9 (2006) 1096-1106
43. Kirby M., and Sirovich L. Application of the Karhunen-Loève procedure for the characterization of human face. IEEE Trans. Pattern Anal. Mach. Intell. 12 1 (1990) 103-108
44. Lades M., Vorbruggen J.C., Buhmann J., Lange J., van der Malsburg C., Wurtz R.P., and Konen W. Distortion invariant object recognition in the dynamic link architecture. IEEE Trans. Comput. 42 (1993) 300-311
45. J. Lambert, Photometria Sive de Mensura et Gradibus Luminus, Colorum et Umbrae, Eberhard Klett, 1760.
46. Lanitis A., Taylor C.J., and Cootes T.F. Automatic interpretation and coding of face images using flexible models. IEEE Trans. Pattern Anal. Mach. Intell. 19 7 (1997) 743-756
47. Lawrence S., Giles C.L., Tsoi A.C., and Back A.D. Face recognition: a convolutional neural-network approach. IEEE Trans. Neural Network 8 1 (1997) 98-113
48. Lee M.W., and Ranganath S. Pose-invariant face recognition using a 3D deformable model. Pattern Recognition 36 8 (2003) 1835-1846
49. Lee T.S. Image representation using 2-D Gabor wavelets. IEEE Trans. Pattern Anal. Mach. Intell. 18 10 (1996) 959-971
50. Levine M.D., and Yu Y. Face recognition subject to variations in facial expression, illumination and pose using correlation filters. Comput. Vision Image Understanding 104 1 (2006) 1-15
51. C. Li, G. Su, Y. Shang, Y. Li, Frontal face synthesis based on multiple pose-variant images for face recognition, in: Proceedings of the International Conference on Advances in Biometrics, 2007, pp. 948-957.
52. Li S.Z., and Jain A.K. Handbook of Face Recognition (2005), Springer, New York
53. Lin S.-H., Kung S.-Y., and Lin L.-J. Face recognition/detection by probabilistic decision-based neural network. IEEE Trans. Neural Network 8 1 (1997) 114-132
54. Liu C. Gabor-based kernel PCA with fractional power polynomial models for face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 26 5 (2004) 572-581
55. X. Liu, T. Chen, Pose-robust face recognition using geometry assisted probabilistic modeling, in: Proceedings of the IEEE Conference on CVPR, vol. 1, 2005, pp. 502-509.
56. Lu Y., Zhou J., and Yu S. A survey of face detection, extraction and recognition. Comput. Inf. 22 2 (2003) 163-195
57. Mahalanobis A., Kumar B.V.K.V., and Sims S.R.F. Distance-classifier correlation filters for multiclass target recognition. Appl. Opt. 35 17 (1996) 3127-3133
58. M.K. Müller, A. Heinrichs, A.H.J. Tewes, A. Schäfer, R.P. Würtz, Similarity rank correlation for face recognition under unenrolled pose, in: Proceedings of the International Conference on Biometrics, 2007, pp. 67-76.
59. Murphy-Chutorian E., and Trivedi M.M. Head pose estimation in computer vision: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 31 4 (2009) 607-626
60. Ojala T., Pietikainen M., and Maenpaa T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24 7 (2002) 971-987
61. A. Pentland, B. Moghaddam, T. Starner, View-based and modular eigenspaces for face recognition, in: Proceedings of the IEEE Conference on CVPR, 1994, pp. 84-91.
62. Phillips P.J., Wechsler H., Huang J., and Rauss P. The FERET database and evaluation procedure for face recognition algorithms. Image Vision Comput. 16 5 (1998) 295-306
63. Prince S.J.D., Warrell J., Elder J.H., and Felisberti F.M. Tied factor analysis for face recognition across large pose differences. IEEE Trans. Pattern Anal. Mach. Intell. 30 6 (2008) 970-984
64. Ramamoorthi R. Analytic PCA construction for theoretical analysis of lighting variability in images of a Lambertian object. IEEE Trans. Pattern Anal. Mach. Intell. 24 10 (2002) 1322-1333
65. A. Scheenstra, A. Ruifrok, R.C. Veltkamp, A Survey of 3D face recognition methods, in: Proceedings of the International Conference on Audio- and Video-Based Biometric Personal Authentication, vol. 3546, 2005, pp. 891-899.
66. Schölkopf B., Smola A., and Müller K.R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10 5 (1998) 1299-1319
67. Shan D., and Ward R. Face recognition under pose variations. J. Franklin Inst. 343 6 (2006) 596-613
68. T. Shan, B.C. Lovell, S. Chen, Face recognition robust to head pose from one sample image, in: Proceedings of the ICPR, vol. 1, 2006, pp. 515-518.
69. Shin H.C., Park J.H., and Kim S.D. Combination of warping robust elastic graph matching and kernel-based projection discriminant analysis for face recognition. IEEE Trans. Multimedia 9 6 (2007) 1125-1136
70. Sim T., Baker S., and Bsat M. The CMU pose, illumination, and expression database. IEEE Trans. Pattern Anal. Mach. Intell. 25 12 (2003) 1615-1618
71. Singh R., Vatsa M., Ross A., and Noore A. A mosaicing scheme for pose-invariant face recognition. IEEE Trans. Syst., Man, Cybern. B, Cybern. 37 5 (2007) 1212-1225
72. T. Stonham, Practical face recognition and verification with WISARD, in: H. Ellis, et al. (Eds.), Aspects of Face Processing, 1984, pp. 426-441.
73. Torrance K., and Sparrow E.M. Theory for off-specular reflection from roughened surfaces. J. Opt. Soc. Am. 56 7 (1967) 916-925
74. Turk M., and Pentland A. Eigenfaces for recognition. J. Cogn. Neurosci. 3 1 (1991) 71-86
75. M.A. Turk, A.P. Pentland, Face recognition using eigenfaces, in: Proceedings of the IEEE Conference on CVPR, 1991, pp. 586-591.
76. Vetter T. Synthesis of novel views from a single face image. Int. J. Comput. Vision 28 2 (1998) 103-116
77. Wang Y., and Chua C.-S. Robust face recognition from 2D and 3D images using structural Hausdorff distance. Image Vision Comput. 24 2 (2006) 176-185
78. Wechsler H. Reliable Face Recognition Methods: System Design, Implementation and Evaluation (2006), Springer, Berlin
79. Wiskott L., Fellous J.M., Kruger N., and von der Malsburg C. Face recognition by elastic bunch graph matching. IEEE Trans. Pattern Anal. Mach. Intell. 19 7 (1997) 775-779
80. Xie X., and Lam K.-M. Gabor-based kernel PCA with doubly nonlinear mapping for face recognition with a single face image. IEEE Trans. Image Process. 15 9 (2006) 2481-2492
81. F. Yang, A. Krzyzak, Face recognition under significant pose variation, in: Proceedings of the 2007 Canadian Conference on Electrical and Computer Engineering, 2007, pp. 1313-1316.
82. Yang J., Frangi A.F., Yang J., Zhang D., and Jin Z. KPCA plus LDA: A complete kernel Fisher discriminant framework for feature extraction and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 27 2 (2005) 230-244
83. Zhang L., Razdan A., Farin G., Femiani J., Bae M., and Lockwood C. 3D face authentication and recognition based on bilateral symmetry analysis. Visual Comput. 22 1 (2006) 43-55
84. X. Zhang, Y. Gao, M.K.H. Leung, Multilevel quadratic variation minimization for 3D face modeling and virtual view synthesis, in: Proceedings of the International Multimedia Modelling Conference, 2005, pp. 132-138.
85. X. Zhang, Y. Gao, M.K.H. Leung, Automatic texture synthesis for face recognition from single views, in: Proceedings of the ICPR, vol. 3, 2006, pp. 1151-1154.
86. X. Zhang, Y. Gao, B.-L. Zhang, Recognising rotated faces from two orthogonal views in mugshot databases, in: Proceedings of the ICPR, vol. 1, 2006, pp. 195-198.
87. Zhang X., Gao Y., and Leung M.K.H. Recognizing rotated faces from frontal and side views: an approach towards effective use of mugshot databases. IEEE Trans. Inf. Forensic Secur. 3 4 (2008) 684-697
88. Zhao G., and Pietikainen M. Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. Pattern Anal. Mach. Intell. 29 6 (2007) 915-928
89. Zhao W., Chellappa R., Phillips P.J., and Rosenfeld A. Face recognition: a literature survey. ACM Comput. Surv. 35 4 (2003) 399-459
90. Zhao W., and Chellappa R. Face Processing: Advanced Modeling and Methods (2005), Academic Press, New York
91. Zhou S.K., Aggarwal G., Chellappa R., and Jacobs D.W. Appearance characterization of linear Lambertian objects, generalized photometric stereo, and illumination-invariant face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 29 2 (2007) 230-245