Face recognition using 3-D models: Pose and illumination

Proceedings of the IEEE

Volumn 94, Issue 11, 2006, Pages 1977-1998

  Romdhani, Sami ^b   Ho, Jeffrey ^a,c   Vetter, Thomas ^a,b   Kriegman, David J ^d  

^a IEEE

^b UNIVERSITY OF BASEL   (Switzerland)

^c UNIVERSITY OF FLORIDA   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Biometrics; Computer vision; Face image analysis; Face recognition; Illumination invariant; Inverse rendering; Pose invariant

Indexed keywords

ALGORITHMS; BIOMETRICS; COMPUTER SIMULATION; COMPUTER VISION; IMAGE ANALYSIS; MATHEMATICAL MODELS; PHOTOGRAPHY;

FACE IMAGE ANALYSIS; ILLUMINATION INVARIANT; INVERSE RENDERING; POSE INVARIANT;

FACE RECOGNITION;

EID: 33947383709     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2006.886019     Document Type: Article

References (59)

1. G. Aggarwal and R. Chellappa, "Face recognition in the presence of multiple illumination sources," in Proc. Int. Conf. Computer Vision, 2005, pp. 1169-1176.
2. R. Basri and D. Jacobs, "Lambertian reflectance and linear subspaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 2, pp. 383-390, Feb. 2003.
3. P. Belhumeur, J. Hespanha, and D. J. Kriegman, "Eigenfaces versus fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
4. P. Belhumeur and D. J. Kriegman, "What is the set of images of an object under all possible lighting conditions," Int. J. Comput. Vis., vol. 28, pp. 245-260, 1998.
5. P. Belhumeur, D. J. Kriegman, and A. Yuille, "The bas-relief ambiguity," Int. J. Comput. Vis., vol. 35, no. 1, pp. 33-44, 1999.
6. V. Blanz, P. Grother, J. Phillips, and T. Vetter, "Face recognition based on frontal views generated from non-frontal images," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005, pp. 454-461.
7. V. Blanz and T. Vetter, "A morphable model for the synthesis of 3D faces," in Proc. 26th Annu. Conf. Computer Graphics and Interactive Techniques (SIGGRAPH 99), 1999, pp. 187-194.
8. _, "Face recognition based on fitting a 3-D morphable model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1063-1074, Sep. 2003.
9. A. M. Bronstein, M. M. Bronstein, and R. Kimmel, "Three-dimensional face recognition," Int. J. Comput. Vis., vol. 64, no. 1, pp. 5-30, 2005.
10. R. Brunelli and T. Poggio, "Face recognition: Features versus templates," IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 10, pp. 1042-1053, Oct. 1993.
11. K. I. Chang, K. W. Bowyer, and P. J. Flynn, "An evaluation of multimodal 2D + 3D face biometrics," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 4, pp. 619-624, Apr. 2005.
12. H. Chen, P. Belhumeur, and D. Jacobs, "In search of illumination invariants," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2000, pp. 1-8.
13. R. L. Cook and K. E. Torrance, "A reflectance model for computer graphics," ACM Trans. Graph., vol. 1, no. 1, pp. 7-24, 1982.
14. R. Epstein, P. Hallinan, and A. Yuille, "5+ / -2 eigenimages suffice: An empirical investigation of low-dimensional lighting models," in Proc. Workshop Physics-Based Modeling in Computer Vision, 1995, p. 108.
15. J. D. Foley, A. van Dam, S. K. Feiner, and J. F. Hughes, Computer Graphics: Principles and Practice. Reading, MA: Addison-Wesley, 1996.
16. A. Georghiades, "Incorporating the Torrance and Sparrow model of reflectance in uncalibrated photometric stereo," in Proc. Int. Conf. Computer Vision, 2003, pp. 816-825.
17. A. Georghiades, D. J. Kriegman, and P. Belhumeur, "From few to many: Generative models for recognition under variable pose and illumination," IEEE Trans. Pattern Anaf. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.
18. G. Golub and C. van Loan, Matrix Computation. Baltimore, MD: John Hopkins Univ. Press, 1989.
19. R. Gross, S. Baker, I. Matthews, and T. Kanade, Handbook of Face Recognition, Chapter Face Recognition Across Pose and Illumination. New York: Springer-Verlag, 2004.
20. R. Gross, I. Matthews, and S. Baker, "Eigen light-fields and face recognition across pose," in Proc. Int. Conf. Automatic Face and Gesture Recognition, 2002, pp. 1-7.
21. P. Hallinan, "A low-dimensional representation of human faces for arbitrary lighting conditions," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994, pp. 995-999.
22. J. Ho and D. J. Kriegman, "On the effect of illumination and face recognition," in Face Processing: Advanced Modeling and Methods, R. Chellappa and W. Zhao, Eds. Burlington, MA: Elsevier, 2005.
23. T. Igarashi, K. Nishino, and S. K. Nayar, 'The appearance of human skin," Columbia Univ. Comput. Sci., Tech. Rep., 2005.
24. H. Jensen, S. Marschner, M. Levoy, and P. Hanrahan, "A practical model for subsurface light transport," in Proc. SIGGRAPH, 2001, pp. 511-518.
25. T. Kanade and A. Yamada, "Multi-subregion based probabilistic approach toward pose-invariant face recognition," in Proc. IEEE Int. Symp. Computational Intelligence in Robotics and Automation, 2003, pp. 954-959.
26. E. P. F. Lafortune, S.-C. Foo, K. E. Torrance, and D. P. Greenberg, "Non-linear approximation of reflectance functions," in Proc. 24th Annu. Conf. Computer Graphics and Interactive Techniques, 1997, pp. 117-126.
27. J. Lee, B. Moghaddam, H. Pfister, and R. Machiraju, "A bilinear illumination model for robust face recognition," in Proc. Int. Conf. Computer Vision, 2005, pp. 1177-1184.
28. K. Lee, J. Ho, and D. J. Kriegman, "Nine points of lights: Acquiring subspaces for face recognition under variable lighting," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001, pp. 519-526.
29. K.-C. Lee, J. Ho, and D. J. Kriegman, "Acquiring linear subspaces for face recognition under variable lighting," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5, pp. 684-698, May 2005.
30. S. R. Marschner, H. W. Jensen, M. Cammarano, S. Worley, and P. Hanrahan, "Light scattering from human hair fibers," ACM Trans. Graph., vol. 22, no. 3, pp. 780-791, 2003.
31. P. J. Phillips, P. Grother, R. J. Micheals, - D. M. Blackburn, E. Tabassi, and M. Bone, "FRVT 2002: Evaluation report," NIST, Tech. Rep. NISTIR 6965, 2003.
32. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical Recipes in C: The Art of Scientific Computing. Cambridge, MA: Cambridge Univ. Press, 1992.
33. R. Ramamoorthi and P. Hanrahan, "An efficient representation for irradiance environment," in Proc. SICGRAPH, 2001, pp. 497-500.
34. _, "A signal-processing framework for inverse rendering," in Proc. SIGGRAPH, 2001. pp. 117-228.
35. S. Romdhani, "Face image analysis using a multiple feature fitting strategy," Ph.D. dissertation, Univ. Basel, Basel, Switzerland, Jan. 2005.
36. S. Romdhani, V. Blanz, and T. Vetter, "Face identification by fitting a 3D morphable model using linear shape and texture error functions," in Proc. Eur. Conf. Computer Vision, 2002. pp. 3-19.
37. S. Romdhani and T. Vetter, "Efficient, robust and accurate fitting of a 3-D morphable model," in Proc. Int. Conf. Computer Vision, 2003, pp. 59-66.
38. _, "Estimating 3-D shape and texture using pixel intensity, edges, specular highlights, texture constraints and a prior," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005, pp. 986-993.
39. A. Shashua, "On photometric issues in 3-D visual recognition form a single image," Int. J. Comput. Vis., vol. 21, pp. 99-122, 1997.
40. T. Sim, S. Baker, and M. Bsat, "The CMU pose, illumination and expression (PIE) database of human faces," CMU, Tech. Rep., 2000.
41. _, "The CMU pose, illumination and expression (PIE) database," in Proc. IEEE Conf Automatic Facial and Gesture Recognition, 2002, pp. 53-58.
42. T. Sim and T. Kanade, "Combining models and exemplars for face recognition: An illuminating example," presented at the Workshop Models Versus Exemplars in Computer Vision, Kauai, HI, 2001.
43. L. Sirovitch and M. Kirby, "Low-dimensional procedure for the characterization of human faces," J. Opt. Soc. Amer. A, vol. 2, pp. 519-524, 1987.
44. K. Torrance and E. Sparrow, "Theory for off-specular reflection from roughened surfaces," J. Opt. Soc. Amer., vol. 57, no. 9, pp. 1105-1114, 1967.
45. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cogn. Neurosci., vol. 3, no. 1, pp. 71-96, 1991.
46. T. Vetter, "Learning novel views to a single face image," in Proc. Int. Conf. Automatic Face and Gesture Recognition, 1996, pp. 22-27.
47. T. Vetter and V. Blanz, "Estimating coloured 3-D face models from single images: An example based approach," in Proc. Eur. Conf. Computer Vision (ECCV98), pp. 499-513.
48. T. Vetter and T. Poggio, "Linear object classes and image synthesis from a single example image," IEEE Trans. Pattern Anal. Mach. Intell. vol. 19, no. 7, pp. 733-742, Jul. 1997.
49. M.-H. Yang, D. J. Kriegman, and N. Ahuja, "Detecting faces in images: A survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 1, pp. 34-58, Jan. 2002.
50. Z. Yue, W. Zhao, and R. Chellappa, "Pose-encoded spherical harmonics for robust face recognition using a single image," in Proc. IEEE Int. Workshop Analysis and Modeling of Faces and Gestures, 2005, pp. 229-243.
51. A. Yuille and D. Snow, "Shape and albedo from multiple images using integrability," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997, pp. 158-164.
52. L. Zhang and D. Samaras, "Face recognition under variable lighting using harmonic image examplars," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003, pp. 19-25.
53. _, "Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics," IEEE Trans. Pattern Anal Mach. Intell., vol. 28, no. 3, pp. 351-363, Mar. 2006.
54. L. Zhang, S. Wang, and D. Samaras, "Face synthesis and recognition from a single image under arbitrary unknown lighting using a spherical harmonic basis morphable model," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 209-216.
55. R. Zhang, P. Tsai, J. Cryer, and M. Shah, "Shape from shading: A survey," IEEE Trans. Pattern Anal. Mach. Intell, vol. 21, no. 8, pp. 690-706, Aug. 1999.
56. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," ACM Comput. Surv., vol. 35, no. 4, pp. 399-458, 2003.
57. Q. Zheng and R. Cheltappa, "Estimation of illuminant direction, albedo and shape from shading," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 7, pp. 680-702, Jul. 1991.
58. K. Zhou, R. Chellappa, and D. Jacobs, "Characterization of human faces under illumination variations using rank integrability, and symmetry constraints," in Proc. Eur. Conf. Computer Vision, 2004, pp. 588-601.
59. S. K. Zhou and R. Chellappa, "Image-based face recognition under illumination and pose variations," J. Opt. Soc. Amer. A, vol. 22, pp. 217-229, 2005.