IMAGE BASED 3D FACE RECONSTRUCTION: A SURVEY

International Journal of Image and Graphics

Volumn 9, Issue 2, 2009, Pages 217-250

  Stylianou, Georgios ^a   Lanitis, Andreas ^b  

^a EUROPEAN UNIVERSITY CYPRUS   (Cyprus)

^b CYPRUS UNIVERSITY OF TECHNOLOGY   (Cyprus)

Author keywords

3D face image processing; 3D face models; 3D face reconstruction; 3D image databases

Indexed keywords

REAL TIME SYSTEMS; STEREO IMAGE PROCESSING; SURVEYS; THREE DIMENSIONAL COMPUTER GRAPHICS; VIDEO CAMERAS;

3-D IMAGE; 3D FACE MODELS; 3D FACE RECONSTRUCTION; 3D FACES; EXAMPLE-BASED METHODS; FACE IMAGE PROCESSING; REAL TIME ACQUISITION; RECONSTRUCTION PROCESS;

IMAGE RECONSTRUCTION;

EID: 85073195047     PISSN: 02194678     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219467809003411     Document Type: Article

References (85)

1. Face-Recognition, "Vendors, " http://www. face-rec. org/vendors/, Last Accessed June 2008.
2. W. Zhao, R. Chellappa, A. Rosenfeld and P. J. Phillips, "Face recognition: A literature survey, " ACM Computing Surveys, pp. 399-458 (2003).
3. W. Zhao and R. Chellapa, "Face processing - advanced modeling and methods, " AP Academic Press (2006).
4. K. W. Bowyer, K. Chang and P. Flynn, "A survey of approaches and challenges in 3D and multi-model 3d+2d face recognition, " Computer Vision and Image Understanding 101(1), 1-15 (2006).
5. A. Scheenstra, A. Ruifrok and R. C. Veltkamp, "A survey of 3D face recognition methods, " in Proceedings of the 5th International Conference of Audio-and Video-Based Biometric Person Authentication (2005).
6. J. Kittler, A. Hilton, M. Hamouz and J. Illingworth, "3D assisted face recognition: A survey of 3D imaging, modeling and recognition approaches, " Proceedings of the IEEE Workshop on Advanced 3D Imaging for Safety and Security (2005).
7. Z. Wen and T. S. Huang, "3D face processing, " Kluwer Academic Publishers (2004).
8. V. Blanz and T. Vetter, "A morphable model for the synthesis of 3D faces, " Siggraph, pp. 187-194 (1999) ACM.
9. V. Blanz and T. Vetter, "Face recognition based on fitting a 3D morphable model, " IEEE Transactions of Pattern Analysis and Machine Intelligence 25(9), 1063-1074 (2003).
10. BJUT, "Bjut 3D face database, " http://www. bjut. edu. cn/sci/multimedia/mul-lab/ 3dface/face database. htm, Last Accessed December 2007.
11. MPI, "Max Planck Institute face database, " http://faces. kyb. tuebingen. mpg. de, Last Accessed June 2008.
12. USF, "Human id database, " http://www. cse. usf. edu/?sarkar/index files/DataAnd Code. htm, Last Accessed June 2008.
13. Cyberware, "Rapid 3D scanners, " http://www. cyberware. com/, Last Accessed June 2008.
14. Y. Hu, Z. Zhang, Y. Hu, X. Fu and T. S. Huang, Building Large Scale 3D Face Database for Face Analysis 4577, 343-350 (2007).
15. J. J. Atick, P. A. Griffin and N. A. Redlich, "Statistical approach to shape from shading: Reconstruction of 3D face surfaces from single 2D images, " Neural Computation 8, 1321-1340 (1996).
16. P. Besl and N. McKay, "A method for registration of 3D shapes, " IEEE Transactions on Pattern Analysis and Machine Intelligence 14(2), 239-256 (1992).
17. T. J. Hutton, B. F. Buxton, P. Hammond and H. W. Potts, "Estimating average growth trajectories in shape-space using kernel smoothing, " IEEE Transactions on Medical Imaging 22(6) (2003).
18. T. J. Hutton, B. F. Buxton and P. Hammond, "Dense surface point distribution model of the human face, " Proceedings of the CVPR Workshop on Mathematical Methods in Biomedical Image Analysis (2001).
19. T. Akimoto, Y. Suenaga and R. S. Wallace, "Automatic creation of 3D facial models, " IEEE Computer Graphics and Applications (1993).
20. T. Goto, W.-S. Lee and N. Magnenat-Thalmann, "Facial feature extraction for quick 3D face modeling, " Signal Processing: Image Communication (2001).
21. I. K. Park, H. Zhang and V. Vezhnevets, "Image-based 3D face modeling system, " EURASIP Journal on Applied Signal Processing 13, 2072-2090 (2005).
22. M. Brand, Morphable 3D Models from Video, Technical Report, Mitsubishi Electric Research Lab (2001).
23. C. Bregler, A. Hertzmann and H. Biermann, "Recovering non-rigid 3D shape from image streams, " Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, IEEE (2000).
24. S. Huq, B. Abidi, A. Goshtasby and M. Abidi, "Stereo matching with energy minimizing snake grid for 3D face modeling, " Defense and Security Symposium (2004).
25. W. Y. Zhao and R. Chellappa, "Illumination-insensitive face recognition using symmetric shape from shading, " Computer Vision and Pattern Recognition (2000).
26. I. Shimshoni, Y. Mose and Y. Lindenbaum, "Shape reconstruction of 3D bilaterally symmetric surfaces, " Int. Journal of Computer Vision 39(2), 97-110 (2000).
27. R. Dovgard and R. Basri, "Statistical symmetric shape from shading for 3D structure recovery of faces, " European Conference on Computer Vision (2004).
28. D. Nandy and J. Ben-Arie, "Shape from recognition and learning: Recovery of 3D face shapes, " CVPR, pp. 2-7 (1999).
29. M. Reiter, R. Donner, G. Langs and H. Bischof, "Estimation of face depth maps from color textures using canonical correlation, " Computer Vision Winter Workshop (February 2006).
30. J. Ahlberg, Candide-3 - An Updated Parameterized Face - Techical Report, Tech. Rep. 2326, Dept. of Electrical Engineering, Linkoping University, Sweden (2001).
31. M. Rydfalk, Candice, A Parameterized Face, Tech. Rep., Department of Electrical Engineering, Linkoping University (1987).
32. M. Kirby and L. Sirovich, "Application of the karhumen-loeve procedure for the characterization of human faces, " IEEE Transactions on Pattern Analysis and Machine Intelligence 12(1), 103-108 (1991).
33. M. Turk and A. Pentland, "Eigenfaces for recognition, " Journal of Cognitive Neuroscience 3(1), 71-86 (1991).
34. T. J. Hutton, Dense Surface Models of the Human Face, PhD thesis, University College London (2004).
35. T. F. Cootes, C. J. Taylor, D. H. Cooper and J. Graham, "Active shape models - their training and application, " Computer Vision Graphics and Image Understanding 61(1), 38-59 (1995).
36. V. Blanz and T. Vetter, "Reconstructing the complete 3D shape of faces from partial information, " Informationstechnik und Technische Informatik (2002).
37. V. Blanz and T. Vetter, "Face recognition based on fitting a 3D morphable model, " IEEE Trans. on Pattern Analysis and Machine Intelligence 25, 1063-1074 (2003).
38. S. Baker, I. Matthews, J. Xiao, R. Gross, T. Kanade and T. Ishikawa, "Real time nonrigid driver head tracking for driver mental state estimation, " 11th World Congress on Intelligent Transportation Systems (2004).
39. V. Blanz, C. Basso, T. Poggio and T. Vetter, "Reanimating faces in images and video, " Computer Graphics Forum 22(3), 641-650 (2003).
40. C. Basso and T. Vetter, "Statistically motivated 3D faces reconstruction, " Proceedings of the 2nd International Conference on Reconstruction of Soft Facial Parts. 2005, Vol. 31 of BKA Research Series, Luchterhand Publishers.
41. C. Basso, P. Paysan and T. Vetter, "Registration of expressions data using a 3D morphable model, " Proceedings of the 7th IEEE International Conference Automatic Face and Gesture Recognition (2006).
42. V. Blanz and T. Vetter, Reconstructing the Complete 3D Shape of Faces from Partial Information, Tech. Rep., University of Freiburg, 2002.
43. A. J. O'Toole, T. Vetter, H. Volz and E. Salter, "Three-dimensional caricatures of human heads: Distinctiveness and the perception of age, " Perception 26, 719-732 (1997).
44. T. Vetter and V. Blanz, "Estimating colored 3D face models from single images: An example-based approach, " Proceedings of the European Conference on Computer Vision (1998).
45. S. Romdhani, Face Image Analysis using a Multiple Features Fitting Strategy, PhD thesis, University of Basel (2005).
46. Y. Hu, D. Jiang, S. Yan, L. Zhang and H. Zhang, "Automatic 3D reconstruction for face recognition, " IEEE Int. Conf. on Automatic Face and Gesture Recognition (2004).
47. J. Lee, R. Machiraju, H. Pfister and B. Moghaddam, "Estimation of 3D faces and illumination from single photographs using a bilinear illumination model, " Proc. of the Eurographics Symposium on Rendering Techniques, pp. 73-82 (2005).
48. W. Lee, P. Kalra and N. M. Thalmann, "Model-based face reconstruction for animation, " Int. Conf. on Multimedia Modeling (1997).
49. W. Lee, Y. Wu and N. Magnenat-Thalmann, "Cloning and aging in a VR family, " Proceedings of IEEE VR'99 (Virtual Reality) (1999).
50. D. Onofrio, S. Tubaro, A. Rama and F. Tarres, "3D face reconstruction with a four camera acquisition system, " Int. Workshop on Very Low Bit-Rate Video-Coding (2005).
51. R. Lengagne, J. Tarel and O. Monga, "From 2D images to 3D face geometry, " Int. Conf. on Automatic Face and Gesture Recognition (1996).
52. R. Lengagne, P. Fua and O. Monga, "3D stereo reconstruction of human faces driven by differential constraints, " Image and Vision Computing 18(4), 337-343 (2000).
53. P. Fua, "Regularized bundle-adjustment to model heads from image sequences without calibration data, " Int. Journal of Computer Vision 38(2), 153-171 (2000).
54. L. Xin, Q. Wang, J. Tao, X. Tang, T. Tan and H. Shum, "Automatic 3D face modeling from video, " IEEE Int. Conf. on Computer Vision (2005).
55. W. H. Leung, B. L. Tseng, Z. Shae, F. Hendriks and T. Chen, "Realistic video avatar, " Multimedia and Expo. IEEE (2000).
56. Z. Liu, Z. Zhang, C. Jacobs and M. Cohen, "Rapid modeling of animated faces from video, " The Journal of Visualization and Computer Animation 12(4), 227-240 (2001).
57. A. R. K. Chowdhury, R. Chellappa, T. Vo and S. Krishnamurthy, "3D face reconstruction from video using a generic model, " Proc of Int. Conf. on Multimedia, pp. 449-452 (2002).
58. A. R. K. Chowdhury and R. Chellappa, "Face reconstruction from monocular video using uncertainty analysis and a generic model, " Computer Vision and Image Understanding, Special Issue on Face Recognition 91(1-2), 188-213 (2003).
59. B. Moghaddam, J. Lee, H. Pfister and R. Machiraju, "Model-based 3D face capture with shape from silhouettes, " Analysis and Modeling of Faces and Gestures (October 2003).
60. S. Wang, L. Zhang and D. Samaras, "Face reconstruction across different poses and arbitrary illumination conditions, " Proc. of Audio-and Video-based Biometric Person Authentication, pp. 91-101 (2005).
61. L. Gu and T. Kanade, "3D alignment of face in a single image, " 1, 1305-1312 (2006).
62. J. Xiao, S. Baker, I. Matthews and T. Kanade, "Real time combined 2d+3d active appearance models, " Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2004).
63. G. J. Edwards, C. J. Taylor and T. F. Cootes, "Interpreting face images using active appearance models, " Proceedings of the 5th European Conference on Computer Vision, pp. 581-595 (1998).
64. T. F. Cootes, G. J. Edwards and C. J. Taylor, "Active appearance models, " IEEE Transactions of Pattern Analysis and Machine Intelligence 23, 681-685 (2001).
65. J. Lee, B. Moghaddam, H. Pfister and R. Machiraju, "Silhouette-based 3D face shape recovery, " Graphics Interface (June 2003).
66. W. S. Lee, M. Escher, G. Sannier and N. Magnenat-Thalmann, "Mpeg-4 compatible faces from orthogonal photos, " Computer Animation, pp. 186-194 (1999).
67. MPEG, "Mpeg4 description, " http://www. chiariglione. org/MPEG/standards/mpeg-4/mpeg-4. htm, Last Accessed June 2008.
68. I. S. Pandzic and R. Forchheimer, "Mpeg-4 facial animation: The standard, implementation and applications, " John Wiley & Sons (2002).
69. G. Farin, "Surfaces over Dirichlet tessellations, " Computer Aided Geometric Design 7(1-4), 281-292 (1990).
70. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski and D. H. Salesin, "Synthesizing realistic facial expressions from photographs, " Int. Conf. on Computer Graphics and Interactive Techniques, pp. 75-84 (1998).
71. Q. Chen and G. Medioni, "Building 3D human face model from two photographs, " Journal of VSLI Signal Processing, pp. 127-140 (2001).
72. P. Leclercq, J. Liu, A. Woodward and P. Delmas, "Which stereo matching algorithm for accurate 3D face creation?, " Int. Workshop on Combinatorial Image Analysis, Lecture Notes in Computer Science (2004).
73. M. Chan, C. Chen and G. Barton, "A strategy for 3D face analysis and synthesis, " Proc. of Image and Vision Computing (2003).
74. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms, " International Journal of Computer Vision 47(1-3), 7-42 (2002).
75. R. Enciso, J. Li, D. Fidaleo, T. Kim, J. Y. Noh and U. Neumann, "Synthesis of 3D faces, " 1st USF International Workshop on Digital and Computational Video (DCV 99), December, pp. 8-15, 1999.
76. A. Yilmaz, O. Javed and M. Shah, "Object tracking: A survey, " ACM Computing Surveys 38(4) (2006).
77. S. Srinivasan, "Extracting structure from optical flow using fast error search technique, " International Journal of Computer Vision 37, 203-230 (2000).
78. P. Fua and C. Miccio, "From regular images to animated heads: A least squares approach, " European Conf. on Computer Vision, pp. 188-202 (1998).
79. P. Fua and C. Miccio, "Animated heads from ordinary images: A least squares approach, " Computer Vision and Image Understanding 75(3), 247-259 (1999).
80. D. Jiang, Y. Hu, S. Yan, L. Zhang, H. Zhang andW. Gao, "Efficient 3D reconstruction for face recognition, " Pattern Recognition, Special Issue on Image Understanding for Digital Photographs (2005).
81. Y. Wang and C. Chua, "Face recognition from 2D and 3D images using 3D Gabor filters, " Image and Vision Computing 23(1), 1018-1028 (2005).
82. V. Blanz, A. Mehl, T. Vetter and H. Seidel, "A statistical method for robust 3D surface reconstruction from sparse data, " Proc. of Int. Symposium on 3D Data Processing, Visualization and Transmission (2004).
83. Georgy Gimel'farb, "Binocular stereo by maximizing the likelihood ratio relative to a random terrain, " Proceedings of International Workshop RobVis 2001. Springer.
84. B. Tiddeman, M. Burt and D. Perrett, "Prototyping and transforming facial textures for perception research, " Computer Graphics and Applications 21(5), 42-50 (2001).
85. Y. Shan, Z. Liu and Z. Zhang, "Image-based surface detail transfer, " Proceedings of Computer Vision and Pattern Recognition (2001).