Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysis

Image and Vision Computing

Volumn 30, Issue 10, 2012, Pages 750-761

  Huang, Yanhui ^a   Zhang, Xing ^b   Fan, Yangyu ^a   Yin, Lijun ^b   Seversky, Lee ^b,c   Allen, James ^b   Lei, Tao ^a   Dong, Weijun ^d  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b BINGHAMTON UNIVERSITY   (United States)

^c AIR FORCE RESEARCH LABORATORY   (United States)

^d NORTHWEST UNIVERSITY   (China)

Author keywords

3D face modeling; 3D face scans; 3D facial expression recognition; 3D model mapping

Indexed keywords

BLENDING; CONFORMAL MAPPING; FACE RECOGNITION; GESTURE RECOGNITION; THREE DIMENSIONAL;

3-D FACIAL EXPRESSION RECOGNITION; 3D FACE MODELING; 3D FACES; 3D MODELS; DISPLACEMENT MAPPING; FACE MODELING; FACE MODELS; FACIAL APPEARANCE; FACIAL DATA; FACIAL EXPRESSION ANALYSIS; FACIAL SHAPE; FACIAL SURFACES; FEATURE DETECTION; GENERIC MODELS; HYBRID APPROACH; INDIVIDUAL MODELS; MAPPING ALGORITHMS; POINT CLOUD; POINT CORRESPONDENCE; REGIONAL INFORMATION; STATE OF THE ART;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84866729893     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2011.12.008     Document Type: Article

References (40)

1. V. Blanz, and T. Vetter A morphable model for the synthesis of 3D faces In SIGGRAPH'99 1999 187 194
2. K. Bowyer, K. Chang, and P. Flynn A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition Comput. Vis. Image Und. 101 1 2006 1 15
3. Y. Chang, M. Vieira, M. Turk, and L. Velho Automatic 3D facial expression analysis in videos In IEEE ICCV05 Workshop on Analysis and Modeling of Faces and Gestures 2005
4. T. Cootes, G. Edwards, and C. Taylor Active appearance models IEEE Trans. Pattern Anal. Mach. Intell. 23 6 June 2001 681 685
5. I. Kakadiaris, G. Passalis, G. Toderici, M. Murtuza, Y. Lu, N. Karampatziakis, and T. Theoharis Three-dimensional face recognition in the presence of facial expressions: an annotated deformable model approach IEEE Trans. Pattern Anal. Mach. Intell. 29 4 April 2007
6. I. Kemelmacher-Shlizerman, and R. Basri 3D face reconstruction from a single image using a single reference face shape IEEE Trans. Pattern Anal. Mach. Intell. 32 8 2010 1 14
7. J. Kittler, A. Hilton, M. Hamouz, and J. Illingworth 3D assisted face recognition: a survey of 3D imaging, modelling and recognition approaches CVPR05 Workshop on Advanced 3D Imaging for Safety and Security 2005
8. W. Lee, and A. Soon Facial shape and 3D skin Comput. Anim. Virtual Worlds 17 3-4 2006 501 512
9. X. Lu, A. Jain, and D. Colbry Matching 2.5D face scans to 3D models IEEE Trans. Pattern Anal. Mach. Intell. 28 1 Jan. 2006 31 43
10. P. Phillips, P. Flynn, T. Scruggs, K. Bowyer, J. Chang, K. Hoffman, and J. Marques Overview of the face recognition grand challenge IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2005
11. F. Pighin, R. Szeliski, and D. Salesin Modeling & animating realistic faces from images Int. J. Comput. Vis. 50 2 2002 143 169
12. Y. Sun, X. Chen, M. Rosato, and L. Yin Tracking vertex flow and model adaptation for 3D spatio-temporal face analysis IEEE Trans. Syst. Man Cybern. 40 3 2010 461 474
13. S. Wang, Y. Wang, X. Gu, and D. Samaras 3D surface matching and recognition using conformal geometry IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2006
14. Y. Wang, M. Gupta, S. Zhang, S. Wang, X. Gu, D. Samaras, and P. Huang High resolution tracking of non-rigid motion of densely sampled 3D data using harmonic maps Int. J. Comput. Vis. 76 3 Mar. 2008 283 300
15. L. Yin, X. Chen, Y. Sun, T. Worm, and M. Reale A high-resolution 3D dynamic facial expression database IEEE International Conference on Face and Gesture Recognition 2008 (Amsterdam, the Netherlands)
16. L. Yin, X. Wei, Y. Sun, J. Wang, and M. Rosato A 3D facial expression database for facial behavior research IEEE International Conference on Face and Gesture Recognition 2006 Southampton UK 211 216
17. Y. Zeng, C. Wang, Y. Wang, X. Gu, D. Samaras, and N. Paragios Dense non-rigid surface registration using high-order graph matching IEEE International Conference on Computer Vision and Pattern recognition (CVPR) 2010
18. Z. Zeng, M. Pantic, G. Roisman, and T. Huang A survey of affect recognition methods: audio, visual, and spontaneous expressions IEEE Trans. Pattern Anal. Mach. Intell. 31 1 Jan. 2009 39 58
19. Y. Zhang, T. Sim, and C.L. Tan Adaptation-based individualized face modeling for animation using displacement map Computer Graphics International (CGI'04) 2004 518 521
20. M. Pantic, and L. Rothkrantz Automatic analysis of facial expressions: the state of the art IEEE Trans. Pattern Anal. Mach. Intell. 22 12 2000
21. Y. Wang, X. Huang, C. Lee, S. Zhang, Z. Li, D. Samaras, D. Metaxas, A. Elgammal, and P. Huang High resolution acquisition, learning, transfer of dynamic 3D face expression Computer Graphics Forum 23(3) - EUROGRAPHICS '04 2004
22. I. Cohen, N. Sebe, A. Garg, L. Chen, and T. Huang Facial expression recognition from video sequences: temporal and static modeling Comput. Vis. Image Und. 91 1 2003 160 187
23. M. Lyons, J. Budynek, and S. Akamatsu Automatic classification of single facial images IEEE Trans. Pattern Anal. Mach. Intell. 21 12 1999 1357 1362
24. G. Zhao, and M. Pietikainen Dynamic texture recognition using local binary patterns with an application to facial expressions IEEE Trans. Pattern Anal. Mach. Intell. 29 6 2007 915 928
25. S. Koelstra, M. Pantic, and I. Patras A dynamic texture-based approach to recognition of facial actions and their temporal models IEEE Trans. Pattern Anal. Mach. Intell. 32 11 2010 1940 1954
26. A. Savran, B. Sankur, and M.T. Bilge Facial Action Unit Detection: 3D versus 2D Modality, CVPR'10 Workshop on Human Communicative Behavior Analysis 2010
27. I. Mpiperis, S. Malassiotis, and M. Strintzis Bilinear models for 3-D face and facial expression recognition IEEE Trans. Inf. Foren. Sec. 3 3 Sept 2008 498 511
28. M. Bartlett, G. Littlewort, I. Fasel, J. Chenu, and J. Movellan Fully automatic facial action recognition in spontaneous behavior IEEE International Conference on Face and Gesture Recognition 2006 223 228 (Southampton, UK)
29. C. Dorai, and A. Jain Cosmosa representation scheme for 3d free-form objects IEEE Trans. Pattern Anal. Mach. Intell. 19 10 1997
30. V. Blanz, K. Scherbaum, and H. Seidel Fitting a morphable model to 3D scans of faces IEEE International Conference on Computer Vision (ICCV) 2007
31. X. Lu, and A. Jain Deformation modeling for robust 3d face matching IEEE CVPR 2006 1377 1383 (Washington D.C.)
32. E.W. Dijkstra A note on two problems in connection with graphs Numer. Math. 1 1959 269 271
33. Y. Sun, and L. Yin Automatic pose estimation of 3D facial models IEEE/IAPR International Conference on Pattern Recognition (ICPR) 2008
34. S. Berretti, A. Bimbo, and P. Pala Description and retrieval of 3d face models using iso-geodesic stripes Proceedings of the 8th ACM international workshop on Multimedia information retrieval (MIR) 2006
35. P. Besl The free-form surface matching problem H. Freeman, Machine Vision for Three-Dimensional Scenes 1990 Academic Press 25 71
36. J. Milnor Morse Theory 1963 Princeton University Press Princeton, NJ
37. J. Wang, L. Yin, and J. Moore Using geometric property of topographic manifold to detect and track eyes for human computer interaction ACM Trans. Multim. Comput. 3 4 December 2007 1 19
38. M. Reale, S. Canavan, L. Yin, K. Hu, and T. Hung A multi-gesture interaction system using a 3D iris disk model for gaze estimation and an active appearance model for 3D hand pointing IEEE Trans. Multimedia 13 3 June 2011 474 486
39. Y. Zeng, C. Wang, Y. Wang, D. Gu, D. Samaras, and N. Paragios Intrinsic Dense 3D Surface Tracking, CVPR 2011 (Colorado Springs, CO)
40. K. Sidorov, S. Richmond, and D. Marchall Efficient Groupwise Non-Rigid Registration of Textured Surfaces, CVPR 2011 (Colorado Springs, CO)