Real-time facial shape recovery from a single image under general, unknown lighting by rank relaxation

Computer Vision and Image Understanding

Volumn 120, Issue , 2014, Pages 59-69

  Lee, Minsik ^a   Choi, Chong Ho ^a  

^a Department of Aerospace Engineering   (South Korea)

Author keywords

Bilinear model; Facial shape recovery; Rank relaxation; Shape from shading; Statistical face model

Indexed keywords

EID: 84894093602     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2013.12.010     Document Type: Article

References (37)

1. J.J. Atick, P.A. Griffin, and A.N. Redlich Statistical approach to shape from shading: reconstruction of three-dimensional face surfaces from single two-dimensional images Neural Comput. 8 6 1996 1321 1340 (Pubitemid 126449972)
2. V. Blanz, T. Vetter, A Morphable model for the synthesis of 3D faces, in: Proc. ACM SIGGRAPH, August 1999.
3. M. Reiter, R. Donner, G. Langs, H. Bischof, 3D and Infrared Face Reconstruction from RGB data using canonical correlation analysis, in: Proc. Int'l Conf. Pattern Recognition, August 2006.
4. M. Castelán, W.A. Smith, and E.R. Hancock A coupled statistical model for face shape recovery from brightness images IEEE Trans. Pattern Anal. Mach. Intell. 16 4 2007 1139 1151 (Pubitemid 46542400)
5. L. Zhang, and D. Samaras Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics IEEE Trans. Pattern Anal. Mach. Intell. 28 3 2006 351 363 (Pubitemid 43159632)
6. Z. Lei, Q. Bai, R. He, S.Z. Li, Face shape recovery from a single image using CCA mapping between tensor spaces, in: Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2008.
7. W.A. Smith, and E.R. Hancock Recovering facial shape using a statistical model of surface normal direction IEEE Trans. Pattern Anal. Mach. Intell. 28 12 2006 1914 1930
8. S. Biswas, G. Aggarwal, and R. Chellappa Robust estimation of Albedo for illumination-invariant matching and shape recovery IEEE Trans. Pattern Anal. Mach. Intell. 31 5 2009 884 899
9. I. Kemelmacher-Shlizerman, and R. Basri 3D face reconstruction from a single image using a single reference face shape IEEE Trans. Pattern Anal. Mach. Intell. 33 2 2011 394 405
10. M. Lee, and C.-H. Choi Fast facial shape recovery from a single image with general, unknown lighting by using tensor representation Pattern Recogn. 44 7 2011 1487 1496
11. M. Lee, and C.-H. Choi A robust real-time algorithm for facial shape recovery from a single image containing cast shadow under general, unknown lighting Pattern Recogn. 46 1 2013 38 44
12. R. Zhang, and P.-S. Tsai Shape from Shading: a survey IEEE Trans. Pattern Anal. Mach. Intell. 21 8 1999 690 706
13. P.N. Belhumeur, D.J. Kriegman, and A.L. Yuille The bas-relief ambiguity Int. J Comput. Vis. 35 1 1999 33 44
14. E. Prados, O. Faugeras, Shape from shading: a well-posed problem? in: Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2005.
15. V. Blanz, and T. Vetter Face recognition based on fitting a 3D morphable model IEEE Trans. Pattern Anal. Mach. Intell. 25 9 2003 1063 1074
16. W.A.P. Smith, E.R. Hancock, Estimating cast shadows using SFS and class-based surface completion, in: Proc. Int'l Conf. Pattern Recognition, August 2006.
17. H. Hotelling Relations between two sets of variates Biometrika 28 1936 321 377
18. M.A.O. Vasilescu, D. Terzopoulos, Multilinear subspace analysis of image ensembles, in: Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2003.
19. D.T. Kuan, A.A. Sawchuk, T.C. Strand, and P. Chavel Adaptive noise smoothing filter for images with signal-dependent noise IEEE Trans. Pattern Anal. Mach. Intell. 7 2 1985 165 177 (Pubitemid 15463696)
20. F. Cuzzolin, Using bilinear models for view-invariant action and identity recognition, in: Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2006.
21. O. Aldrian, W. Smith, Inverse rendering with a morphable model: a multilinear approach, in: Proc. British Machine Vision Conf., August-September 2011.
22. J. Lee, B. Moghaddam, H. Pfister, R. Machiraju, A bilinear illumination model for robust face recognition, in: Proc. IEEE Int'l Conf. Computer Vision, October 2005.
23. D. Vlasic, M. Brand, H. Pfister, J. Popović, Face transfer with multilinear models, in: Proc. ACM SIGGRAPH, July 2005.
24. R. Basri, and D.W. Jacobs Lambertian reflectance and linear subspaces IEEE Trans. Pattern Anal. Mach. Intell. 25 2 2003 218 233
25. P. Comon, X. Luciani, and A.L.F.D. Almeida Tensor decompositions, alternating least squares and other tales J. Chemometr. 23 7-8 2009 393 405
26. Z.-Q. Luo, W.-K. Ma, A.M.-C. So, Y. Ye, and S. Zhang Semidefinite relaxation of quadratic optimization problems IEEE Signal Process. Mag. 27 3 2010 20 34
27. C. Eckart, and G. Young The approximation of one matrix by another of lower rank Psychometrika 1 3 1936 211 218
28. S.D. Conte, and C. de Boor Elementary Numerical Analysis: An Algorithmic Approach second ed. 1972 McGrawHill
29. M. Turk, and A. Pentland Eigenfaces for recognition J. Cognitive Neurosci. 3 1 1991 71 86
30. P. Bourke, Distributing Points on a Sphere, June 1996. < http://paulbourke.net/geometry/spherepoints/ >.
31. J.L. Bentley Multidimensional binary search trees used for associative searching Commun. ACM 18 9 1975 509 517
32. T.F. Cootes, G.J. Edwards, and C.J. Taylor Active appearance models IEEE Trans. Pattern Anal. Mach. Intell. 23 6 2001 681 685 (Pubitemid 32585279)
33. P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, W. Worek, Overview of the face recognition grand challenge, in: Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2005.
34. A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman From few to many: illumination cone models for face recognition under variable lighting and pose IEEE Trans. Pattern Anal. Mach. Intell. 23 6 2001 643 660 (Pubitemid 32585276)
35. R. Gross, I. Matthews, J. Cohn, T. Kanade, S. Baker, Multi-PIE, in: Proc. IEEE Conf. Automatic Face and Gesture Recognition, September 2008.
36. J.C. Gower Generalized procrustes analysis Psychometrika 40 1 1975 33 51
37. R. Kumar, A. Barmpoutis, A. Banerjee, and B.C. Vemuri Non-Lambertian reflectance modeling and shape recovery of faces using tensor splines IEEE Trans. Pattern Anal. Mach. Intell. 33 3 2011 533 567