Three-dimensional face reconstruction from a single image by a coupled RBF network

IEEE Transactions on Image Processing

Volumn 21, Issue 5, 2012, Pages 2887-2897

  Song, Mingli ^a   Tao, Dacheng ^b   Huang, Xiaoqin ^a   Chen, Chun ^a   Bu, Jiajun ^a  

^a ZHEJIANG UNIVERSITY   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

3 D face reconstruction; Coupled RBF network; single image

Indexed keywords

3D FACES; BACKGROUND CLUTTER; FACE IMAGE RECONSTRUCTION; FACE IMAGES; FACE RECONSTRUCTION; LINEAR COMBINATION COEFFICIENTS; NEAREST NEIGHBORS; SINGLE IMAGES; TRAINING SETS;

ANIMATION; C (PROGRAMMING LANGUAGE); FACE RECOGNITION; IMAGE RECONSTRUCTION; RADIAL BASIS FUNCTION NETWORKS;

THREE DIMENSIONAL;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; COMPUTER ASSISTED DIAGNOSIS; FACE; HISTOLOGY; HUMAN; IMAGE ENHANCEMENT; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRY; FACE; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 84860110906     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2183882     Document Type: Article

References (42)

1. A. L. Yuille, D. Snow, R. Epstein, and P. N. Belhumeur, "Determining generative models of objects under varying illumination: Shape and albedo from multiple images using svd and integrability," Int. J. Comput. Vis., vol. 35, no. 3, pp. 203-222, Dec. 1999.
2. F. Tsalakanidou, S. Malassiotis, and M. G. Strintzis, "Face localization and authentication using color and depth images," IEEE Trans. Image Process., vol. 14, no. 2, pp. 152-168, Feb. 2005.
3. B. K. P. Horn and M. J. Brooks, Shape-From-Shading. Cambridge, MA: MIT Press, 1989.
4. R. Zhang, P. S. Tsai, J. E. Cryer, and M. Shah, "Shape-from-shading: A survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 8, pp. 690-706, Aug. 1999.
5. P. Dupuis and J. Oliensis, "Direct method for reconstructing shape from shading," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2002, pp. 453-458.
6. K. Ikeuchi and B. K. P. Horn, "Numerical shape from shading and occluding boundaries," Artif. Intell., vol. 17, no. 1-3, pp. 141-184, Aug. 1981.
7. Q. Zheng and R. Chellappa, "Estimation of illuminant direction, albedo, and shape from shading," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 7, pp. 680-702, Jul. 1991.
8. I. Shimshoni, Y. Moses, and M. Lindenbaum, "Shape reconstruction of 3-D bilaterally symmetric surfaces," Int. J. Comput. Vis., vol. 39, no. 2, pp. 97-110, Sep. 2000.
9. E. R. Hancock, "Acquiring height data from a single image of a face using local shape indicators," Comput. Vis. Image Understand., vol. 103, no. 1, pp. 64-79, Jul. 2006.
10. J. J. Atick, P. A. Griffin, and A. N. Redlich, "Statistical approach to shape from shading: Reconstruction of 3-D face surfaces from single 2-D images," Neural Comput., vol. 8, no. 6, pp. 1321-1340, 1996.
11. C. Zhang and F. S. Cohen, "3-D face structure extraction and recognition from images using 3-D morphing and distance mapping," IEEE Trans. Image Process., vol. 11, no. 11, pp. 1249-1259, Nov. 2002.
12. V. Blanz and T. Vetter, "A morphable model for the synthesis of 3-D faces," in Proc. 26th Annu. Conf. Comput. Graph. Interactive Techn., 1999, pp. 187-194.
13. V. Blanz and T. Vetter, "Face recognition based on fitting a 3-D morphable model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1063-1074, Sep. 2003.
14. S. Romdhani and T. Vetter, "Estimating 3-D shape and texture using pixel intensity, edges, specular highlights, texture constraints and a prior," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2005, pp. 986-993.
15. G. Puerto-Souza and J. Van Horebeek, "Using subspace multiple linear regression for 3-D face shape prediction from a single image," in Proc. Adv. Visual Comput., 2009, pp. 662-673.
16. A. Li, S. Shan, X. Chen, X. Chai, and W. Gao, "Recovering 3-D facial shape via coupled 2D/3D space learning," in Proc. 8th IEEE Int. Conf. Autom. Face Gesture Recognit., 2008, pp. 1-6.
17. M. Castelan and J. Van Horebeek, "3D face shape approximation from intensities using partial least squares," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, 2008, pp. 1-8.
18. D. Nandy and J. Ben-Arie, "Shape from recognition: A novel approach for 3-D face shape recovery," IEEE Trans. Image Process., vol. 10, no. 2, pp. 206-217, Feb. 2001.
19. M. Castelan and E. R. Hancock, "A simple coupled statistical model for 3-D face shape recovery," in Proc. 18th Int. Conf. Pattern Recognit., 2006, pp. 231-234.
20. X.Wang and R. Yang, "Learning 3-D shape from a single facial image via non-linear manifold embedding and alignment," in Proc. IEEE CVPR, 2010, pp. 414-421.
21. A. G. Bors and I. Pitas, "Object classification in 3-D images using alpha-trimmed mean radial basis function network," IEEE Trans. Image Process., vol. 8, no. 12, pp. 1744-1756, Dec. 1999.
22. F. Girosi, "Some extensions of radial basis functions and their applications in artificial intelligence," Comput. Math. Appl., vol. 24, no. 12, pp. 61-80, Dec. 1992.
23. S. Mukherjee and S. K. Nayar, "Automatic generation of GRBF networks for visual learning," in Proc. 5th Int. Conf. Comput. Vis., 1995, pp. 794-800.
24. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000.
25. J. Yang, Z. Wang, C. Zhu, and Q. Peng, "Implicit surface reconstruction with radial basis functions," in Proc. Comput. Vis. Comput. Graph. Theory Appl., 2009, pp. 5-12.
26. M. A Carreira-Perpinan and L. Zhengdong, "Dimensionality reduction by unsupervised regression," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
27. K. Q. Weinberger, F. Sha, and L. K. Saul, "Learning a kernel matrix for nonlinear dimensionality reduction," in Proc. 21st Int. Conf. Mach. Learn., 2004, p. 106.
28. M. Song, Z. Dong, C. Theobalt, H.Wang, Z. Liu, and H.-P. Seidel, "A generic framework for efficient 2-D and 3-D facial expression analogy," IEEE Trans. Multimedia, vol. 9, no. 7, pp. 1384-1395, Nov. 2007.
29. D. Tao, M. Song, X. Li, J. Shen, J. Sun, X. Wu, C. Faloutsos, and S. J. Maybank, "Bayesian tensor approach for 3-D face modelling," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 10, pp. 1397-1410, Oct. 2008.
30. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Localityconstrained linear coding for image classification," in Proc. IEEE Conf. CVPR, 2010, pp. 3360-3367.
31. M. Reiter, R. Donner, G. Langs, and H. Bischof, "3D and infrared face reconstruction from rgb data using canonical correlation analysis," in Proc. 18th Int. Conf. Pattern Recognit., 2006, pp. 425-428.
32. I. Kemelmacher and R. Basri, "Molding face shapes by example," in Proc. ECCV, 2006, vol. 3951, no. 1, pp. 277-288.
33. S. Biswas, G. Aggrawal, and R. Chellappa, "Robust estimation of Albedo for illumination-invariant matching and shape recovery," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 5, pp. 884-899, May 2009.
34. A. Ecker and A. D. Japson, "Polynomial shape from shading," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 145-152.
35. V. Le, H. Tang, L. Cao, and T. S. Huang, "Accurate and efficient reconstruction of 3-D faces from stereo images," in Proc. IEEE Int. Conf. Image Process., 2010, pp. 4265-4268.
36. J. Zhang and Y. Zhuang, "Sample based 3-D face reconstruction from a single frontal image by adaptive locally linear embedding," J. Zhejiang Univ. Sci. A, vol. 8, no. 4, pp. 550-558, Apr. 2007.
37. C. D. Silva, T. Yamasaki, and K. Aizawa, "Embedded tags and visual querying for face photo retrieval," in Proc. Pacific Rim Conf. Multimedia, 2008, pp. 446-455.
38. Y. Wang, J. Liu, and X. Tang, "Robust 3-D face recognition by local shape difference boosting," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 10, pp. 1858-1870, Oct. 2010.
39. S. Gupta, M. K. Markey, and A. C. Bovik, "Anthropometric 3-D face recognition," Int. J. Comput. Vis., vol. 90, no. 3, pp. 331-349, Dec. 2010.
40. J. B. Tenenbaum, V. Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, Dec. 2000.
41. J. A. Snyman, Practical Mathematical Optimization: An Introduction to Basic Optimization Theory and Classical and New Gradient-Based Algorithms. New York: Springer-Verlag, 2005.
42. J. H. Challis, "A procedure for determining rigid body transformation parameters," J. Biomech., vol. 28, no. 6, pp. 733-737, Jun. 1995.