3D face reconstructions from photometric stereo using near infrared and visible light

Computer Vision and Image Understanding

Volumn 114, Issue 8, 2010, Pages 942-951

  Hansen, Mark F ^a   Atkinson, Gary A ^a   Smith, Lyndon N ^a   Smith, Melvyn L ^a  

^a UNIVERSITY OF THE WEST OF ENGLAND   (United Kingdom)

Author keywords

3D face recognition; 3D reconstruction; Near infrared; Photometric stereo; Skin reflectance

Indexed keywords

3D DATA; 3D FACE RECOGNITION; 3D FACE RECONSTRUCTION; 3D FACES; 3D RECONSTRUCTION; COMMERCIAL SETTINGS; EXPECTED VALUES; FACE RECOGNITION METHODS; GROUND TRUTH; LAMBERTIAN MODEL; NEAR INFRARED; NEAR INFRARED LIGHT; NEW HIGH; PHOTOMETRIC STEREO; RAW IMAGES; REFLECTANCE PROPERTIES; SHADOW BOUNDARIES; SHADOWED REGIONS; SKIN SAMPLES; SURFACE NORMALS; VISIBLE LIGHT;

ALGORITHMS; IMAGE RECONSTRUCTION; INFRARED DEVICES; LIGHT SOURCES; PHOTOMETRY; PIXELS; REFLECTION; REPAIR; THREE DIMENSIONAL;

FACE RECOGNITION;

EID: 77953959862     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2010.03.001     Document Type: Article

References (44)

1. Zhao W., and Chellappa R. Face Processing: Advanced Modeling and Methods (2006), Academic Press
2. Bowyer K.W., Chang K., and Flynn P. A survey of approaches and challenges in 3D and multi-modal 3D+ 2D face recognition. Comput. Vis. Image Und. 101 1 (2006) 1-15
3. Oren M., and Nayar S.K. Generalization of the Lambertian model and implications for machine vision. Int. J. Comput. Vis. 14 (1995) 227-251
4. Zhao W., Chellappa R., Phillips P.J., and Rosenfeld A. Face recognition: a literature survey. ACM Comput. Surv. (2003) 399-458
5. Gökberk B., İrfanoǧlu M.O., and Akarun L. 3D shape-based face representation and feature extraction for face recognition. Image Vis. Comput. 24 8 (2006) 857-869
6. Blanz V., and Vetter T. Face recognition based on fitting a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell. (2003) 1063-1074
7. Bronstein A.M., Bronstein M.M., and Kimmel R. Three-dimensional face recognition. Int. J. Comput. Vis. (2005) 5-30
8. Mpiperis I., Malassiotis S., and Strintzis M.G. 3-D face recognition with the geodesic polar representation. IEEE Trans. Inform. Forensic Security (2007) 537-547
9. P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, W. Worek, Overview of the face recognition grand challenge, in: Proceedings of the CVPR, vol. 1, 2005.
10. (accessed 31.03.10).
11. Chen F., Brown G.M., and Song M. Overview of three-dimensional shape measurement using optical methods. Opt. Eng. 39 (2000) 10
12. (accessed 31.03.10).
13. B.K.P. Horn, Shape from shading: a method for obtaining the shape of a smooth opaque object from one view, Ph.D. thesis, MIT, 1970.
14. Belhumeur P.N., Kriegman D.J., and Yuille A.L. The bas-relief ambiguity. Int. J. Comput. Vis. 35 (1999) 33-44
15. Woodham R.J. Photometric method for determining surface orientation from multiple images. Opt. Eng. 19 1 (1980) 139-144
16. Smith W., and Hancock E. Facial shape-from-shading and recognition using principal geodesic analysis and robust statistics. Int. J. Comput. Vis. 76 (2008) 71-91
17. C. Hernández, G. Vogiatzis, R. Cipolla, Shadows in three-source photometric stereo, in: Proceedings of the ECCV, 2008, pp. 290-303.
18. Coleman E.N., and Jain R. Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry. Comput. Vis. Image Process. (1982) 309-328
19. Solomon F., and Ikeuchi K. Extracting the shape and roughness of specular lobe objects using four light photometric stereo. IEEE Trans. Pattern Anal. Mach. Intell. 18 (1996) 449-454
20. Barsky S., and Petrou M. The 4-source photometric stereo technique for three-dimensional surfaces in the presence of highlights and shadows. IEEE Trans. Pattern Anal. Mach. Intell. 25 (2003) 1239-1252
21. Torrance K.E., and Sparrow E.M. Theory for off-specular reflection from roughened surfaces. J. Opt. Soc. Am. A 57 9 (1967) 1105-1112
22. Georghiades A.S. Recovering 3-D shape and reflectance from a small number of photographs. Proceedings on Eurographics Workshop on Rendering (2003), Eurographics Association, Leuven, Belgium 230-240
23. Sun J., Smith M., Smith L., Midha S., and Bamber J. Object surface recovery using a multi-light photometric stereo technique for non-Lambertian surfaces subject to shadows and specularities. Image Vis. Comput. 25 7 (2007) 1050-1057
24. A. Ghosh, T. Hawkins, P. Peers, S. Frederiksen, P. Debevec, Practical modeling and acquisition of layered facial reflectance, in: International Conference on Computer Graphics and Interactive Techniques, 2008.
25. Kee S.C., Lee K.M., and Lee S.U. Illumination invariant face recognition using photometric stereo. IEICE Trans. Inf. Syst. E Ser. D 83 7 (2000) 1466-1474
26. Zhou S.K., Chellappa R., and Jacobs D.W. Characterization of human faces under illumination variations using rank, integrability, and symmetry constraints. Proc. ECCV (2004) 588-601
27. Zhou S.K., Aggarwal G., Chellappa R., and Jacobs D.W. Appearance characterization of linear Lambertian objects, generalized photometric stereo, and illumination-invariant face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 29 2 (2007) 230-245
28. Georghiades A.S., Belhumeur P.N., and Kriegman D.J. From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. (2001) 643-660
29. Anderson R.R., and Parrish J.A. The optics of human skin. J. Invest. Dermatol. 77 1 (1981) 13-19
30. J. Zivanov, P. Paysan, T. Vetter, Facial normal map capture using four lights - an effective and inexpensive method of capturing the fine scale detail of human faces using four point lights, in: GRAPP, 2009, pp. 13-20.
31. Li S.Z., Chu R.F., Liao S.C., and Zhang L. Illumination invariant face recognition using near-infrared images. IEEE Trans. Pattern Anal. Mach. Intell. (2007) 627-639
32. Kong S.G., Heo J., Abidi B.R., Paik J., and Abidi M.A. Recent advances in visual and infrared face recognition - a review. Comput. Vis. Image Und. 97 1 (2005) 103-135
33. Morimoto C.H., Koons D., Amir A., and Flickner M. Pupil detection and tracking using multiple light sources. Image Vis. Comput. 18 4 (2000) 331-335
34. R. Lienhart, J. Maydt, An extended set of haar-like features for rapid object detection, in: IEEE ICIP, vol. 1, 2002, pp. 900-903.
35. D.A. Forsyth, J. Ponce, Computer Vision: A Modern Approach, Prentice Hall Professional Technical Reference, 2002.
36. Frankot R.T., and Chellappa R. A method for enforcing integrability in shape from shading algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 10 4 (1988) 439-451
37. Besl P.J., and McKay H.D. A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14 2 (1992) 239-256
38. A. Moorhouse, A.N. Evans, G.A. Atkinson, J. Sun, M.L. Smith, The nose on your face may not be so plain: using the nose as a biometric, in: International Conference on Imaging for Crime Detection and Prevention, 2009.
39. Hsaio J.H.W., and Cottrell G. Two fixations suffice in face recognition. Psychol. Sci. 19 (2008) 998-1006
40. C. Fredembach, N. Barbuscia, S. Süsstrunk, Combining visible and near-infrared images for realistic skin smoothing, in: Proceedings of the IS&T/SID Color Imaging Conference, 2009.
41. Torrance K., and Sparrow M. Theory for off-specular reflection from roughened surfaces. J. Opt. Soc. Am. 57 (1967) 1105-1114
42. Donner C., and Jensen H.W. Light diffusion in multi-layered translucent materials. ACM Trans. Graph. 24 (2005) 1032-1039
43. Li L., and Ng C.S. Rendering human skin using a multi-layer reflection model. Int. J. Math. Comput. Simul. 3 (2009) 44-53
44. G. Atkinson, M. Smith, Facial feature extraction and change analysis using photometric stereo, in: Proceedings of the IbPRIA, 2009, pp. 96-103.