Learning a generic 3D face model from 2D image databases using incremental Structure-from-Motion

Image and Vision Computing

Volumn 28, Issue 7, 2010, Pages 1117-1129

  Gonzalez Mora, Jose ^a   De la Torre, Fernando ^b   Guil, Nicolas ^a,b   Zapata, Emilio L ^a  

^a UNIVERSITY OF MÁLAGA   (Spain)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Active Appearance Models; Incremental learning; Morphable Models; Structure from Motion

Indexed keywords

ANIMATION; COMPUTER VISION; DATABASE SYSTEMS; FACE RECOGNITION; THREE DIMENSIONAL COMPUTER GRAPHICS;

2D DATABASE; 2D IMAGES; 3D DATA; 3D DATABASE; 3D FACE MODELS; 3D MODELS; 3D MORPHABLE MODEL; ACTIVE APPEARANCE MODELS; BUILDING PROCESS; ERROR-PRONE PROCESS; FACE MODELS; FACIAL ANIMATION; FACIAL EXPRESSION ANALYSIS; INCREMENTAL LEARNING; LABELED IMAGES; LABOR INTENSIVE; LASER SCANS; MISSING DATA; MORPHABLE MODEL; STRUCTURE FROM MOTION;

THREE DIMENSIONAL;

EID: 77950861830     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2010.01.005     Document Type: Article

References (49)

1. Blanz V., Basso C., Poggio T., and Vetter T. Reanimating faces in images and video. Computer Graphics Forum 22 (2003) 641-650
2. Edwards G., Cootes T., and Taylor C. Face recognition using active appearance models. ECCV '98: Proceedings of the 5th European Conference on Computer Vision vol. II (1998), Springer-Verlag, London, UK 581-595
3. Blanz V., and Vetter T. Face recognition based on fitting a 3d morphable model. IEEE Transactions on Pattern Analysis and Machine Intelligence 9 (2003) 1063-1074
4. S. Ramanathan, A. Kassim, Y. Venkatesh, W. Wah, Human facial expression recognition using a 3d morphable model, in: ICIP06, 2006, pp. 661-664.
5. Baker S., Matthews I., and Schneider J. Automatic construction of active appearance models as an image coding problem. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 10 (2004) 1380-1384
6. Black M.J., and Jepson A.D. Eigentracking: robust matching and tracking of objects using view-based representation. International Journal of Computer Vision 26 1 (1998) 63-84
7. Matthews I., and Baker S. Active appearance models revisited. International Journal of Computer Vision 60 (2004) 135-164
8. Baker S., Matthews I., and Schneider J. Automatic construction of active appearance models as an image coding problem. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 (2004) 1380-1384
9. T.F. Cootes, G.V. Wheeler, K.N. Walker, C.J. Taylor, Coupled-view active appearance models, in: British Machine Vision Conference, 2000, pp. 52-61.
10. F. De la Torre, J. Vitrià, P. Radeva, J. Melenchón, Eigenfiltering for flexible eigentracking, in: International Conference on Pattern Recognition, 2000, pp. 1118-1121.
11. Cootes T., Edwards G., and Taylor C. Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 6 (2001) 681-685
12. F. De la Torre, M.H. Nguyen, Parameterized kernel principal component analysis: theory and applications to supervised and unsupervised image alignment, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2008.
13. V. Blanz, T. Vetter, A morphable model for the synthesis of 3D faces, in: Siggraph, 1999, pp. 187-194.
14. L. Gu, T. Kanade, 3D alignment of face in a single image, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, 2006, pp. 1305-1312.
15. V. Blanz, T. Vetter, A morphable model for the synthesis of 3D faces, in: Siggraph, 1999, pp. 187-194.
16. C. Bregler, A. Hertzmann, H. Biermann, Recovering non-rigid 3D shape from image streams, in: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, 2000.
17. M. Brand, Morphable 3D models from video, in: International Conference on Computer Vision and Pattern Recognition, 2001, p. 456463.
18. Xiao J., Chai J., and Kanade T. A closed-form solution to non-rigid shape and motion recovery. International Journal of Computer Vision 67 (2006) 233-246
19. M. Brand, A direct method for 3D factorization of nonrigid motion observed in 2D, in: Internation Conference on Computer Vision and Pattern Recognition, 2005.
20. Torresani L., Hertzmann A., and Bregler C. Nonrigid structure-from-motion: estimating shape and motion with hierarchical priors. IEEE Transactions on Pattern Analysis and Machine Intelligence 30 5 (2008) 878-892
21. L. Torresani, A. Hertzmann, C. Bregler, Learning non-rigid 3D shape from 2D motion, in: Neural Information Processing Systems, 2003.
22. Torr P., Fitzgibbon A.W., and Zisserman A. The problem of degeneracy in structure and motion recovey from uncalibrated image sequences. International Journal of Computer Vision 32 (1999) 27-44
23. A. Buchanan, A. Fitzgibbon, Damped newton algorithms for matrix factorization with missing data, in: International Conference on Computer Vision and Pattern Recognition, vol. 2, 2005, pp. 312-322.
24. D. Nister, F. Kahl, H. Stewenius, Structure from motion with missing data is NP-hard, in: International Conference on Computer Vision, 2007, pp. 1-7.
25. Tomasi C., and Kanade T. Shape and motion from image streams under orthography: a factorization method. International Journal of Computer Vision 9 (1992) 137-154
26. M. Maruyama, S. Kurumi, Bidirectional optimization for reconstructing 3D shape from an image sequence with missing data, in: IEEE International Conference on Image Processing, 1999, pp. 120-124.
27. R. Guerreiro, P. Aguiar, 3D structure from video streams with partially overlapping images, in: IEEE International Conference on Image Processing, 2002, pp. 897-900.
28. L. Torresani, D. Yang, E. Alexander, C. Bregler, Tracking and modeling non-rigid objects with rank constraints, in: International Conference on Computer Vision and Pattern Recognition, 2001.
29. C. Julia, A. Sappa, F. Lumbreras, J. Serrat, A. Lopez, Factorization with missing and noisy data, in: Internation Conference on Computational Science, 2006.
30. A.M. Buchanan, Investigation into matrix factorization when elements are unknown. Technical report, University of Oxford, 2004. Available from: .
31. A.D. Bue, F. Smeraldi, L. Agapito, Non-rigid structure from motion using nonparametric tracking and non-linear optimization, in: IEEE Workshop in Articulated and Nonrigid Motion held in conjunction with CVPR2004, 2004.
32. S. Olsen, A. Bartoli, Using priors for improving generalization in non-rigid structure-from-motion, in: British Machine Vision Conference, 2007.
33. A.D. Bue, A factorization approach to structure from motion with shape priors, in: International Conference on Computer Vision and Pattern Recognition, 2008.
34. J. Xiao, B. Georgescu, X. Zhou, D. Comaniciu, T. Kanade, Simultaneous registration and modeling of deformable shapes, in: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, 2006, pp. 2429-2436.
35. J. Xiao, S. Baker, I. Matthews, T. Kanade, Real-time combined 2D + 3D active appearance models, in: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, 2004, pp. 535-542.
36. Matthews I., Xiao J., and Baker S. 2D vs. 3D deformable face models: representational power, construction and real-time fitting. International Journal of Computer Vision 75 1 (2007) 93-113
37. Lu X., and Jain A.K. Deformation modeling for robust 3D face matching. IEEE Transactions on Pattern Analysis and Machine Intelligence 30 8 (2008) 5-10
38. Al-Osaimi F., Bennamoun M., and Milan A. An expression deformation approach to non-rigid 3D face recognition. International Journal of Computer Vision 81 3 (2008) 302-316
39. Kim Y., Chung S., Kim B., and Cho S. 3D face modeling based on 3D dense morphable face shape model. International Journal of Computer Science and Engineering 2 3 (2008) 107-113
40. De la Torre F., and Black M.J. A framework for robust subspace learning. International Journal of Computer Vision. 54 (2003) 117-142
41. D. Jacobs, Linear fitting with missing data: applications to structure-from-motion and to characterizing intensity images, in: International Conference on Computer Vision and Pattern Recognition, 1997.
42. V. Blanz, A. Mehl, T. Vetter, H. Seidel, A statistical method for robust 3D surface reconstruction from sparse data, in: International Symposium on 3D Data Processing, Visualization, and Transmission, 2004, pp. 293-300.
43. M. Brand, Incremental singular value decomposition of uncertain data with missing values, in: European Conference on Computer Vision, 2002.
44. Skočaj D., and Leonardis A. Incremental and robust learning of subspace representations. Image and Vision Computing 26 (2008) 27-38
45. Levy A., and Lindenbaum M. Sequential karhunen-loeve basis extraction and its application to images. IEEE Transactions on Image Processing 9 8 (2000) 1371-1374
46. Bookstein F. Principal warps: thin-plate splines and the decomposition of deformations. IEEE Transactions on Pattern Analysis and Machine Intelligence 11 (1989) 567-585
47. J. Foley, A. van Dam, Fundamentals of Interactive Computer Graphics. The Systems Programming Series, 1984.
48. R. Gross, I. Matthews, J. Cohn, S. Baker, Guide to CMU Multi-PIE Face Database, 2002.
49. Bishop C.M. Neural Networks for Pattern Recognition (1996), Oxford University Press