Fast facial shape recovery from a single image with general, unknown lighting by using tensor representation

Pattern Recognition

Volumn 44, Issue 7, 2011, Pages 1487-1496

  Lee, Minsik ^a   Choi, Chong Ho ^a  

^a Seoul National University   (South Korea)

Author keywords

Facial shape recovery; Shape from shading; Statistical face model

Indexed keywords

FACIAL SHAPE; HUMAN FACES; LEAST SQUARE PROBLEMS; LIGHT CONDITIONS; PERFORMANCE IMPROVEMENTS; PERSONAL IDENTITY; PRIOR INFORMATION; SHAPE FROM SHADING; SHAPE RECOVERY; SINGLE IMAGES; SPHERICAL HARMONICS; STATISTICAL FACE MODEL; SURFACE NORMALS; TENSOR ALGEBRA; TENSOR DECOMPOSITION; TENSOR REPRESENTATION; TWO PARAMETER;

ALGORITHMS; FACE RECOGNITION; HARMONIC ANALYSIS; LIGHTING; RECOVERY; TENSORS; THREE DIMENSIONAL;

SHAPE OPTIMIZATION;

EID: 79952184061     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2010.12.018     Document Type: Article

References (39)

1. R. Zhang, and P.-S. Tsai Shape from shading: a survey IEEE Transactions on Pattern Analysis and Machine Intelligence 21 8 1999 690 706
2. B.K. Horn Height and gradient from shading International Journal of Computer Vision 5 1 1990 584 595
3. Q. Zheng, and R. Chellappa Estimation of illuminant direction, albedo, and shape from shading IEEE Transactions on Pattern Analysis and Machine Intelligence 13 7 1991 680 702 (Pubitemid 21674673)
4. P.-S. Tsai, and M. Shah Shape from shading using linear approximation Image and Vision Computing 12 8 1994 487 498
5. P.N. Belhumeur, D.J. Kriegman, and A.L. Yuille The bas-relief ambiguity International Journal of Computer Vision 35 1 1999 33 44
6. E. Prados, O. Faugeras, Shape from shading: a well-posed problem? in: Computer Vision and Pattern Recognition, 2005.
7. W. Zhao, and R. Chellappa Symmetric shape-from-shading using self-ratio image International Journal of Computer Vision 45 1 2001 55 75 (Pubitemid 33109997)
8. R. Dovgard, R. Basri, Statistical symmetric shape from shading for 3D structure recovery of faces, in: European Conference on Computer Vision, 2004.
9. J.J. Atick, P.A. Griffin, and A.N. Redlich Statistical approach to shape from shading: reconstruction of three-dimensional face surfaces from single two-dimensional images Neural Computation 8 6 1996 1321 1340 (Pubitemid 126449972)
10. V. Blanz, T. Vetter, A morphable model for the synthesis of 3D faces, in: SIGGRAPH, 1999.
11. D. Nandy, and J. Ben-Arie Shape from recognition: a novel approach for 3-D face shape recovery IEEE Transactions on Image Processing 10 2 2001 206 217 (Pubitemid 32254591)
12. T. Sim, T. Kanade, Combining models and exemplars for face recognition: an illuminating example, in: Workshop on Models Versus Exemplars in Computer Vision, CVPR 2001, 2001.
13. D. Samaras, and D. Metaxas Incorporating illumination constraints in deformable models for shape from shading and light direction estimation IEEE Transactions on Pattern Analysis and Machine Intelligence 25 2 2003 247 264
14. I. Kemelmacher, R. Basri, Molding face shapes by example, in: European Conference on Computer Vision, 2006.
15. M. Reiter, R. Donner, G. Langs, H. Bischof, 3D and infrared face reconstruction from RGB data using canonical correlation analysis, in: International Conference on Pattern Recognition, 2006.
16. M. Casteln, W.A. Smith, and E.R. Hancock A coupled statistical model for face shape recovery from brightness images IEEE Transactions on Pattern Analysis and Machine Intelligence 16 4 2007 1139 1151 (Pubitemid 46542400)
17. L. Zhang, and D. Samaras Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics IEEE Transactions on Pattern Analysis and Machine Intelligence 28 3 2006 351 363 (Pubitemid 43159632)
18. Z. Lei, Q. Bai, R. He, S.Z. Li, Face shape recovery from a single image using CCA mapping between tensor spaces, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2008.
19. W.A. Smith, and E.R. Hancock Recovering facial shape using a statistical model of surface normal direction IEEE Transactions on Pattern Analysis and Machine Intelligence 28 12 2006 1914 1930
20. S. Biswas, G. Aggarwal, and R. Chellappa Robust estimation of albedo for illumination-invariant matching and shape recovery IEEE Transactions on Pattern Analysis and Machine Intelligence 31 5 2009 884 899
21. N. Kwak, and C.-H. Choi Feature extraction based on ICA for binary classification problems IEEE Transactions on Knowledge and Data Engineering 15 6 2003 1374 1388
22. V. Blanz, and T. Vetter Face recognition based on fitting a 3D morphable model IEEE Transactions on Pattern Analysis and Machine Intelligence 25 9 2003 1063 1074
23. Y. Hu, D. Jiang, S. Yan, L. Zhang, H. Zhang, Automatic 3D reconstruction for face recognition, in: IEEE International Conference on Automatic Face and Gesture Recognition, 2004.
24. D. Jiang, Y. Hu, S. Yan, L. Zhang, H. Zhang, and W. Gao Efficient 3D reconstruction for face recognition Pattern Recognition 38 6 2005 787 798 (Pubitemid 40308630)
25. S. Romdhani, T. Vetter, Estimating 3D shape and texure using pixel intensity, edges, specular highlights, texture constraints and a prior, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2005.
26. Y. Wang, Z. Liu, G. Hua, Z. Wen, Z. Zhang, D. Samaras, Face re-lighting from a single image under harsh lighting conditions, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2007.
27. R. Basri, and D.W. Jacobs Lambertian reflectance and linear subspaces IEEE Transactions on Pattern Analysis and Machine Intelligence 25 2 2003 218 233
28. M.A.O. Vasilescu, D. Terzopoulos, Multilinear subspace analysis of image ensembles: tensorfaces, in: European Conference on Computer Vision, 2002.
29. M.A.O. Vasilescu, D. Terzopoulos, Multilinear subspace analysis of image ensembles, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2003.
30. D.T. Kuan, A.A. Sawchuk, T.C. Strand, and P. Chavel Adaptive noise smoothing filter for images with signal-dependent noise IEEE Transactions on Pattern Analysis and Machine Intelligence 7 2 1985 165 177 (Pubitemid 15463696)
31. M. Lee, C.-H. Choi, Facial shape recovery from a single image with an arbitrary directional light using linearly independent representation, in: International Symposium on Visual Computing, 2009.
32. R. Basri, and D.W. Jacobs Lambertian reflectance and linear subspaces IEEE Transactions on Pattern Analysis and Machine Intelligence 25 2 2003 218 233
33. T.F. Cootes, G.J. Edwards, and C.J. Taylor Active appearance models IEEE Transactions on Pattern Analysis and Machine Intelligence 23 6 2001 681 685 (Pubitemid 32585279)
34. R.T. Frankot, and R. Chellappa A method for enforcing integrability in shape from shading algorithms IEEE Transactions on Pattern Analysis and Machine Intelligence 10 4 1988 439 451 (Pubitemid 18665916)
35. H.-S. Ng, T.-P. Wu, and C.-K. Tang Surface-from-gradients without discrete integrability enforcement: a Gaussian kernel approach, in: IEEE Transactions on Pattern Analysis and Machine Intelligence 32 11 2010 2085 2099
36. P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, W. Worek, Overview of the face recognition grand challenge, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2005.
37. D. Frolova, D. Simakov, D. Basri, Accuracy of spherical harmonic approximations for images of Lambertian objects under far and near lighting, in: European Conference on Computer Vision, 2006.
38. S. Romdhani, and J. Ho Face recognition using 3-D models: pose and illumination Proceedings of the IEEE 94 11 2006 1977 1999
39. N. Bourbakis, P. Yuan, and P. Kakumanu A graph based object description and recognition methodology International Journal on Artificial Intelligence Tools 17 6 2008 1161 1194