Depth estimation of face images using the nonlinear least-squares model

IEEE Transactions on Image Processing

Volumn 22, Issue 1, 2013, Pages 17-30

  Sun, Zhan Li ^a,b   Lam, Kin Man ^b   Gao, Qing Wei ^a  

^a ANHUI UNIVERSITY   (China)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

3D face reconstruction; face recognition; nonlinear least squares model

Indexed keywords

2D IMAGES; 3D DATABASE; 3D FACE RECONSTRUCTION; 3D STRUCTURE; ACCURACY LEVEL; DEPTH ESTIMATION; DEPTH VALUE; FACE IMAGES; FACIAL FEATURE POINTS; HUMAN FACES; LINEAR CORRELATION; NONLINEAR LEAST SQUARES; OBJECTIVE FUNCTIONS; OPTIMIZATION PROCEDURES; OPTIMIZATION SCHEME; TRAINING TIME;

ALGORITHMS; ESTIMATION; MATHEMATICAL TRANSFORMATIONS; OPTIMIZATION; THREE DIMENSIONAL COMPUTER GRAPHICS;

FACE RECOGNITION;

ARTICLE; BIOMETRY; FACE; FACTUAL DATABASE; HISTOLOGY; HUMAN; METHODOLOGY; NONLINEAR SYSTEM; REGRESSION ANALYSIS; THREE DIMENSIONAL IMAGING;

BIOMETRIC IDENTIFICATION; DATABASES, FACTUAL; FACE; HUMANS; IMAGING, THREE-DIMENSIONAL; LEAST-SQUARES ANALYSIS; NONLINEAR DYNAMICS;

EID: 84871651020     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2204269     Document Type: Article

References (35)

1. K. W. Bowyer, K. Chang, and P. Flynn, "A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition," Comput. Vis. Image Understand., vol. 101, no. 1, pp. 1-15, Jan. 2006. (Pubitemid 41642085)
2. J. Gonzalez-Mora, F. De la Torre, R. Murthi, N. Guil, and E. L. Zapata, "Bilinear active appearance models," in Proc. 11th Int. Conf. Comput. Vis., 2007, pp. 1-8.
3. J. Gonzalez-Mora, N. Guil, E. L. Zapata, and F. De la Torre, "Efficient image alignment using linear appearance models," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 2230-2237.
4. A. Thelen, S. Frey, S. Hirsch, and P. Hering, "Improvements in shape-from-focus for holographic reconstructions with regard to focus operators, neighborhood-size, and height value interpolation," IEEE Trans. Image Process., vol. 18, no. 1, pp. 151-157, Jan. 2009.
5. M. D. Levine and Y. F. Yu, "State-of-the-art of 3D facial reconstruction methods for face recognition based on a single 2D training image per person," Pattern Recognit. Lett., vol. 30, no. 10, pp. 908-913, Jul. 2009.
6. A. K. Roy-Chowdhury and R. Chellappa, "Statistical bias in 3D reconstruction from a monocular video," IEEE Trans. Image Process., vol. 14, no. 8, pp. 1057-1062, Aug. 2005. (Pubitemid 41236137)
7. H. S. Koo and K. M. Lam, "Recovering the 3D shape and poses of face images based on the similarity transform," Pattern Recognit. Lett., vol. 29, pp. 712-723, Apr. 2008.
8. M. Castelán and E. R. Hancock, "Acquiring height data from a single image of a face using local shape indicators," Comput. Vis. Image Understand., vol. 103, no. 1, pp. 64-79, Jul. 2006. (Pubitemid 43767068)
9. M. Castelán, W. A. P. Smith, and E. R. Hancock, "A coupled statistical model for face shape recovery from brightness images," IEEE Trans. Image Process., vol. 16, no. 4, pp. 1139-1151, Apr. 2007. (Pubitemid 46542400)
10. D. L. Jiang, Y. X. Hu, S. H. Yan, L. Zhang, H. J. Zhang, and W. Gao, "Efficient 3D reconstruction for face recognition," Pattern Recognit., vol. 38, no. 6, pp. 787-798, Jun. 2005. (Pubitemid 40308630)
11. S. Romdhani and T. Vetter, "Efficient, robust and accurate fitting of a 3D morphable model," in Proc. IEEE Int. Conf. Comput. Vis., vol. 1. Oct. 2003, pp. 59-66.
12. C. Z. Zhang and F. S. Cohen, "3D face structure extraction and recognition from images using 3D morphing and distance mapping," IEEE Trans. Image Process., vol. 11, no. 11, pp. 1249-1259, Nov. 2002.
13. C. Bregler, A. Hertzmann, and H. Biermann, "Recovering non-rigid 3D shape from image streams," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., vol. 2. Jun. 2000, pp. 690-696.
14. T. F. Coleman and Y. Li, "An interior, trust region approach for nonlinear minimization subject to bounds," SIAM J. Optim., vol. 6, no. 2, pp. 418-445, 1996.
15. R. Zhang, P. S. Tsai, J. E. Cryer, and M. Shah, "Shape-from-shading: A survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 8, pp. 690-706, Aug. 1999.
16. V. Blanz and T. Vetter, "Face recognition based on fitting a 3D morphable model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1063-1074, Sep. 2003.
17. A. Doshi and A. G. Bors, "Robust processing of optical flow of fluids," IEEE Trans. Image Process., vol. 19, no. 9, pp. 2332-2344, Sep. 2010.
18. A. Doshi and A. G. Bors, "Smoothing of optical flow using robustified diffusion kernels," Image Vis. Comput., vol. 28, no. 12, pp. 1575-1589, Dec. 2010.
19. C. Tomasi and T. Kanade, "Shape and motion from image streams under orthography: A factorization method," Int. J. Comput. Vis., vol. 9, no. 2, pp. 137-154, 1992. (Pubitemid 23621943)
20. J. Fortuna and A. M. Martinez, "Rigid structure from motion from a blind source separation perspective," Int. J. Comput. Vis., vol. 88, no. 3, pp. 404-424, Jul. 2010.
21. L. Torresani, A. Hertzmann, and C. Bregler, "Nonrigid structure-from-motion: Estimating shape and motion with hierarchical priors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 5, pp. 878-892, May 2008. (Pubitemid 351486755)
22. I. Akhter, Y. Sheikh, S. Khan, and T. Kanade, "Trajectory space: A dual representation for nonrigid structure from motion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 7, pp. 1442-1456, Jul. 2011.
23. J. Gonzalez-Mora, F. De la Torre, N. Guil, and E. L. Zapata, "Learning a generic 3D face model from 2D image databases using incremental structure-from-motion," Image Vis. Comput., vol. 28, no. 7, pp. 1-33, Jul. 2010.
24. J. Ahlberg, "CANDIDE-3-An updated parameterised face," Dept. Electr. Eng., Linkoping Univ., Linköping, Sweden, Tech. Rep. LiTH-ISY-R-2325, 2001.
25. X. D. Xie and K. M. Lam, "Elastic shape-texture matching for human face recognition," Pattern Recognit., vol. 41, no. 1, pp. 396-405, Jan. 2008.
26. M. Hollander and D. A. Wolfe, Nonparametric Statistical Methods. New York: Wiley, 1973.
27. Z. L. Sun, "An extension of MISEP for post-nonlinear-linear mixture separation," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 56, no. 8, pp. 654-658, Aug. 2009.
28. Z. L. Sun and L. Shang, "An improved constrained ICA with reference based unmixing matrix initialization," Neurocomputing, vol. 73, nos. 4-6, pp. 1013-1017, Jan. 2010.
29. S. M. Stigler, "Do robust estimators work with real data?" Ann. Stat., vol. 5, no. 6, pp. 1055-1098, 1977.
30. R. R. Wilcox, Introduction to Robust Estimation and Hypothesis Testing. New York: Academic, 2005.
31. K. M. Lam and H. Yan, "Locating and extracting the eye in human face images," Pattern Recognit., vol. 29, no. 5, pp. 771-779, 1996. (Pubitemid 126376471)
32. J. J. Moré, "The Levenberg-Marquardt algorithm: Implementation and theory" in Numerical Analysis (Lecture Notes in Mathematics), vol. 630. Berlin, Germany: Springer-Verlag, 1977, pp. 105-116.
33. P. J. Phillips, M. Hyeonjoon, S. A. Rizvi, and P. J. Rauss, "The FERET evaluation methodology for face-recognition algorithms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
34. P. Nair and A. Cavallaro, "3D face detection, landmark localization, and registration using a point distribution model," IEEE Trans. Multimedia, vol. 11, no. 4, pp. 611-623, Jun. 2009.
35. A. Savran, N. Alyüz, H. Dibekliog̈lu, O. Çliktutan, B. Göberk, B. Sankur, and L. Akarun, "Bosphorus database for 3D face analysis," in Proc. 1st COST Workshop Biometrics Identity Manage., May 2008, pp. 47-56.