Face recognition and verification using photometric stereo: The photoface database and a comprehensive evaluation

IEEE Transactions on Information Forensics and Security

Volumn 8, Issue 1, 2013, Pages 121-135

  Zafeiriou, Stefanos ^a   Atkinson, Gary A ^b   Hansen, Mark F ^b   Smith, William A P ^c   Argyriou, Vasileios ^d   Petrou, Maria ^a,e   Smith, Melvyn L ^b   Smith, Lyndon N ^b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF THE WEST OF ENGLAND   (United Kingdom)

^c UNIVERSITY OF YORK   (United Kingdom)

^d KINGSTON UNIVERSITY   (United Kingdom)

^e INFORMATICS AND TELEMATICS INSTITUTE   (Greece)

Author keywords

Face database; face recognition verification; photometric stereo

Indexed keywords

3D FACE RECOGNITION; AFFECT RECOGNITION; COMPREHENSIVE EVALUATION; DEPTH MAP; FACE DATABASE; FACE IMAGES; FIELD COMPUTATION; MINIMAL INTERACTIONS; PHOTOMETRIC STEREO; RECOGNITION ALGORITHM; SURFACE NORMALS; VERIFICATION ALGORITHMS;

ALGORITHMS; DATABASE SYSTEMS; EQUIPMENT TESTING; EXPERIMENTS;

FACE RECOGNITION;

EID: 84872099442     PISSN: 15566013     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIFS.2012.2224109     Document Type: Article

References (67)

1. S. Zafeiriou, M. Hansen, G. Atkinson, V. Argyriou, M. Petrou, M. Smith, and L. Smith, "The photoface database," in Proc. CVPR Workshop on Biometrics, Colorado Springs, CO, 2011, pp. 161-168.
2. R. J.Woodham, "Photometric method for determining surface orientation from multiple images," Opt. Eng., vol. 19, pp. 139-144, 1980.
3. S. Li and A. Jain, Handbook of Face Recognition. New York: Springer-Verlag, 2005.
4. P. J. Phillips, H.Wechsler, and P. Rauss, "The feret database and evaluation procedure for face-recognition algorithms," Image Vis. Comput., vol. 16, pp. 295-306, 1998. (Pubitemid 128393579)
5. T. Sim, S. Baker, and M. Bsat, "The CMU pose, illumination, and expression database," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1615-1618, Dec. 2003.
6. P.W. Hallinan, G. G. Gordon, A. L. Yuille, P. Giblin, and D.Mumford, Two-and Three-Dimensional Patterns of the Face. Natick, MA: A K Peters Ltd., 1999.
7. K.Messer, J.Matas, J. Kittler, J. Luettin, and G.Maitre, "XM2VTSDB: The extended M2VTS database," in Proc. 2nd Int. Conf. Audio and Video-based Biometric Person Authentication, 1999, vol. 964, pp. 965-966.
8. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001. (Pubitemid 32585276)
9. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997. (Pubitemid 127762263)
10. K. C. Lee, J. Ho, and D. Kriegman, "Acquiring linear subspaces for face recognition under variable lighting," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5, pp. 684-698, May 2005. (Pubitemid 40608402)
11. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker, "Multi-ie," Image Vis. Comput., vol. 28, pp. 807-813, 2010.
12. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments University of Massachusetts, Amherst, Tech. Rep. 07, 2007, vol. 49, p. 1.
13. C. Beumier and M. Acheroy, "Face verification from 3D and grey level clues," Pattern Recognit. Lett., vol. 22, no. 11, pp. 1321-1329, 2001. (Pubitemid 32784365)
14. C. Beumier andM. Acheroy, Sic db: Multi-Modal Database for Person Authentication 1999, pp. 704-708.
15. A. Savran, N. Alyuz, H. Dibeklioglu, O. Celiktutan, B. Gokberk, B. Sankur, and L. Akarun, Bosphorus Database for 3D Face Analysis 2008, pp. 47-56.
16. York 3D Database 2011 [Online]. Available: http://www-users.cs. york.ac.uk/~nep/research/3Dface/tomh/3DFaceDatabase.html
17. T. Heseltine, N. Pears, and J. Austin, "Three-dimensional face recognition using combinations of surface feature map subspace components," Image Vis. Comput., vol. 26, no. 3, pp. 382-396, 2008. (Pubitemid 350192032)
18. P. Phillips, P. Flynn, T. Scruggs, K. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, "Overview of the face recognition grand challenge," in Proc. CVPR, 2005, pp. 947-954. (Pubitemid 43897294)
19. T. Faltemier, K. Bowyer, and P. Flynn, Using Multi-Instance Enrollment to Improve Performance of 3D Face Recognition 2008, vol. 112, pp. 114-125.
20. [Online]. Available: www.konicaminolta.com/sensingusa/products/3d/non contact/vivid910 [Accessed 15 Dec 2009]
21. C. Zhong, Z. Sun, and T. Tan, Robust 3D Face Recognition Using Learned Visual Codebook 2007, pp. 1-6.
22. Casia 3D Face Database 2011.
23. A. Moreno and A. Sanchez, Gavabdb: A 3D Face Database 2004, pp. 75-80.
24. L. Yin, X. Chen, Y. Sun, T. Worm, and M. Reale, A High-Resolution 3D Dynamic Facial Expression Database 2008, pp. 1-6.
25. L. Yin, X.Wei, Y. Sun, T.Worm, J.Wang, andM. Rosato, A 3D Facial Expression Database for Facial Behavior Research 2006, pp. 211-216.
26. Texas 3D Face Recognition Database 2010.
27. S. Gupta, M. K. Markey, and A. C. Bovik, "Anthropometric 3D face recognition," Int. J. Comput. Vis., vol. 90, no. 3, pp. 331-349, 2010.
28. [Online]. Available: www.3dmd.com/3dmdface.html [Accessed 13 March 2010]
29. P. Tan, S. Lin, and L. Quan, "Subpixel photometric stereo," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 8, pp. 1460-1471, Aug. 2008.
30. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997. (Pubitemid 127762263)
31. S. Zafeiriou, A. Tefas, I. Buciu, and I. Pitas, "Exploiting discriminant information in nonnegative matrix factorization with application to frontal face verification," IEEE Trans. Neural Netw., vol. 17, no. 3, pp. 683-695, May 2006.
32. S. Zafeiriou, A. Tefas, and I. Pitas, "Learning discriminant person specific facial models using expandable graphs," IEEE Trans. Inf. Forensics Security, vol. 2, no. 1, pp. 50-55, Mar. 2007.
33. S. Zafeiriou and I. Pitas, "Discriminant graph structures for facial expression recognition," IEEE Trans. Multimedia, vol. 9, no. 10, pp. 1528-1540, Dec. 2008.
34. S. Zafeiriou and M. Petrou, "2.5d elastic graph matching," Comput. Vis. Image Understand., vol. 115, no. 7, pp. 1062-1072, Jul. 2011.
35. K. I. Chang, K. W. Bowyer, and P. J. Flynn, "An evaluation of multimodal 2D 3D face biometrics," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 4, pp. 619-624, Apr. 2005.
36. B. Gokberk, H. Dutagaci, A. Ulas, L. Akarun, and B. Sankur, "Representation plurality and fusion for 3-D face recognition," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 1, pp. 155-173, Feb. 2008. (Pubitemid 351285022)
37. R. Lienhart and J. Maydt, "An extended set of Haar-like features for rapid object detection," in Proc. IEEE ICIP, 2002, pp. 900-903.
38. D. A. Forsyth and J. Ponce, Computer Vision, A Modern Approach. Upper Saddle River, NJ: Prentice-Hall, 2003.
39. V. Argyriou and M. Petrou, "Recursive photometric stereo when multiple shadows and highlights are present," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008, pp. 1-6.
40. M. F. Hansen, G. A. Atkinson, L. N. Smith, and M. L. Smith, "3D face reconstructions from photometric stereo using near infrared and visible light," Comp. Vis. Image Understand., to be published.
41. R. T. Frankot and R. Chellappa, "A method for enforcing integrability in shape from shading algorithms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 10, no. 4, pp. 439-451, Apr. 1988. (Pubitemid 18665916)
42. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001. (Pubitemid 32585276)
43. T. Simchony, R. Chellappa, andM. Shao, "Direct analytical methods for solving Poisson equations in computer vision problems," IEEE Trans. Pattern Anal.Mach. Intell., vol. 12, no. 5, pp. 435-446, May 1990. (Pubitemid 20702886)
44. A. Agrawal, R. Chellappa, and R. Raskar, "An algebraic approach to surface reconstruction from gradient fields," in Proc. Intl Conf. Comput. Vis., 2005, vol. 1, pp. 174-181. (Pubitemid 44054956)
45. A. Agrawal, R. Raskar, and R. Chellappa, "What is the range of surface reconstructions from a gradient field?," in Proc. Lecture Notes in Computer Science (Eur. Conf. Computer Vision (ECCV 2006)), 2006, vol. 3951, p. 578.
46. B. K. P. Horn and M. J. Brooks, "Shape and source from shading," in Proc. Int. Joint Conf. Artificial Intelligence, 1985, pp. 932-936.
47. M. Turk and A. P. Pentland, "Eigenfaces for recognition," J. Cognitive Neurosci., vol. 3, no. 1, pp. 71-86, 1991.
48. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," NIPS, pp. 556-562, 2000.
49. M. S. Bartlett, J. R. Movellan, and T. J. Sejnowski, "Face recognition by independent component analysis," IEEE Trans. Neural Netw., vol. 13, no. 6, pp. 1450-1464, Nov. 2002. (Pubitemid 35428531)
50. J. Yang, A. F. Frangi, J. Yang, D. Zhang, and Z. Jin, "KPCA plus LDA: A complete kernel Fisher discriminant framework for feature extraction and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 2, pp. 230-244, Feb. 2005. (Pubitemid 40377316)
51. H. Li, T. Jiang, and K. Zhang, "Efficient and robust feature extraction by maximum margin criterion," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 157-165, Jan. 2006. (Pubitemid 43263948)
52. X. Jiang, B. Mandal, and A. Kot, "Eigenfeature regularization and extraction in face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 3, pp. 383-394, Mar. 2008. (Pubitemid 351280047)
53. S. Zafeiriou, A. Tefas, and I. Pitas, "Discriminant nmf-faces for frontal face verification," in Proc. IEEE Int. Workshop on Machine Learning for Signal Processing, Mystic, CT, 2005.
54. C. Kotropoulos, A. Tefas, and I. Pitas, "Frontal face authentication using discriminating grids with morphological feature vectors," IEEE Trans. Multimedia, vol. 2, no. 1, pp. 14-26, Mar. 2000.
55. H.-C. Shin, J. H. Park, and S.-D. Kim, "Combination of warping robust elastic graph matching and kernel-based projection discriminant analysis for face recognition," IEEE Trans. Multimedia, vol. 9, no. 6, pp. 1125-1136, Oct. 2007. (Pubitemid 47460395)
56. S. Zafeiriou, A. Tefas, and I. Pitas, "The discriminant elastic graph matching algorithm applied to frontal face verification," Pattern Recognit., vol. 40, no. 10, pp. 2798-2810, 2007. (Pubitemid 46782860)
57. J. Cook, V. Chandran, and C. Fookes, "3D face recognition using loggabor templates," in Proc. BritishMachine Vision Conf. Citeseer, 2006, vol. 2, pp. 769-778.
58. I. Mpiperis, S. Malassiotis, and M. G. Strintzis, "3-D face recognition with the geodesic polar representation," IEEE Trans. Inf. Forensics Security, vol. 2, no. 3, pp. 537-547, Sep. 2007. (Pubitemid 47290587)
59. E. Pekalska, P. Paclik, and R. P. W. Duin, "A generalized kernel approach to dissimilarity-based classification," J. Mach. Learning Res., vol. 2, pp. 175-211, 2002.
60. M. H.Yang, "Kernel eigenfaces vs. kernel fisherfaces: Face recognition using kernel methods," in fgr., 2002, p. 0215, published by the IEEE Computer Society.
61. X. Tan, S. Chen, Z. H. Zhou, and F. Zhang, "Face recognition from a single image per person: A survey," Pattern Recognit., vol. 39, no. 9, pp. 1725-1745, 2006. (Pubitemid 43867575)
62. W. Chen, M. J. Er, and S. Wu, "Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 36, no. 2, pp. 458-466, Apr. 2006.
63. X. Tan and B. Triggs, "Enhanced local texture feature sets for face recognition under difficult lighting conditions," IEEE Trans. Image Process., vol. 19, no. 6, pp. 1635-1650, Jun. 2010.
64. B. Wang, W. Li, W. Yang, and Q. Liao, "Illumination normalization based on Weber's law with application to face recognition," IEEE Signal Process. Lett., vol. 18, no. 8, pp. 462-465, Aug. 2011.
65. A. Martinez and A. Kak, "PCA versus LDA," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 2, pp. 228-233, Feb. 2001. (Pubitemid 32254716)
66. A. Jain, K. Nandakumar, and A. Ross, "Score normalization in multimodal biometric systems," Pattern Recognit., vol. 38, no. 12, pp. 2270-2285, 2005. (Pubitemid 41336698)
67. S. A. Rizvi, P. J. Phillips, and H. Moon, "The FERET verification testing protocol for face recognition algorithms," in Proc. FG98, 2008, pp. 48-53.