3D/4D facial expression analysis: An advanced annotated face model approach

Image and Vision Computing

Volumn 30, Issue 10, 2012, Pages 738-749

  Fang, Tianhong ^a   Zhao, Xi ^a   Ocegueda, Omar ^a   Shah, Shishir K ^a   Kakadiaris, Ioannis A ^a  

^a University of Houston   (United States)

Author keywords

3D face models; 4D face videos; Expression recognition; Mesh registration

Indexed keywords

ANIMATION; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION; SEMANTICS; THREE DIMENSIONAL; THREE DIMENSIONAL COMPUTER GRAPHICS;

3-D IMAGE; 3D DATA; 3D FACE MODELS; 3D FACES; 3D VIDEO; 4D FACE VIDEOS; AFM; COMPARATIVE STUDIES; DATA SETS; EXPRESSION RECOGNITION; FACE MODELS; FACIAL ANIMATION; FACIAL DATA; FACIAL EXPRESSION ANALYSIS; FACIAL EXPRESSION RECOGNITION; FACIAL EXPRESSIONS; HEAD POSE; HUMAN FACES; ILLUMINATION CONDITIONS; MESH REGISTRATION; ON DYNAMICS; POINT CORRESPONDENCE; POINT DISTRIBUTION MODELS; POTENTIAL APPLICATIONS;

FACE RECOGNITION;

EID: 84866734270     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2012.02.004     Document Type: Article

References (74)

1. K. Etemad, and R. Chellappa Discriminant analysis for recognition of human face images J. Opt. Soc. Am. A 14 1997 1724 1733
2. B. Fasel, and J. Luettin Automatic facial expression analysis: a survey Pattern Recognit. 36 1999 259 275
3. M. Pantic, and L. Rothkrantz Automatic analysis of facial expressions: the state of the art IEEE Trans. Pattern Anal. Mach. Intell. 22 2000 1424 1445
4. Z. Zeng, M. Pantic, G. Roisman, and T. Huang A survey of affect recognition methods: audio, visual, and spontaneous expressions IEEE Trans. Pattern Anal. Mach. Intell. 31 2007 39 58
5. I.A. Kakadiaris, G. Passalis, G. Toderici, M.N. Murtuza, Y. Lu, N. Karampatziakis, and T. Theoharis Three-dimensional face recognition in the presence of facial expressions: an annotated deformable model approach IEEE Trans. Pattern Anal. Mach. Intell. 29 2007 640 649
6. P.J. Phillips, W.T. Scruggs, A.J. O'Toole, P.J. Flynn, K.W. Bowyer, C.L. Schott, and M. Sharpe FRVT 2006 and ICE 2006 large-scale experimental results IEEE Trans. Pattern Anal. Mach. Intell. 32 2010 831 846
7. th IEEE International Conference on Automatic Face and Gesture Recognition 2006 Southampton UK 211 216
8. th IEEE International Conference on Automatic Face and Gesture Recognition 2011 Santa Barbara CA 603 610
9. th IEEE International Conference on Automatic Face and Gesture Recognition 2008 Amsterdam The Netherlands 1 6
10. G. Zhao, and M. Pietikäinen Dynamic texture recognition using local binary patterns with an application to facial expressions IEEE Trans. Pattern Anal. Mach. Intell. 29 2007 915 928
11. Y. Chang, M. Vieira, M. Turk, and L. Velho Automatic 3D facial expression analysis in videos Proc. Analysis and Modeling of Faces and Gestures 2005 Beijing China 293 307
12. J. Wang, L. Yin, X. Wei, and Y. Sun 3D facial expression recognition based on primitive surface feature distribution in: Proc. IEEE International Conference on Computer Vision and Pattern Recognition 2006 New York NY 1399 1406
13. th International Conference on Pattern Recognition 2006 Atlanta GA 1248 1251
14. S. Ramanathan, A. Kassim, Y. Venkatesh, and W.S. Wah Human facial expression recognition using a 3D morphable model in: Proc. IEEE International Conference on Image Processing 2006 Atlanta GA 661 664
15. H. Soyel, and H. Demirel Facial expression recognition using 3D facial feature distances in: Proc. International Conference on Image Analysis and Recognition 2008 Montreal Canada 831 838
16. P. Wang, C. Kohler, F. Barrett, R. Gur, and R. Verma Quantifying facial expression abnormality in schizophrenia by combining 2D and 3D features in: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2007 Minneapolis Minnesota 1 8
17. th IEEE International Conference on Automatic Face and Gesture Recognition, Amsterdam, The Netherlands.
18. th European Conference on Computer Vision 2008 Marseille France 58 71
19. I. Mpiperis, S. Malassiotis, V. Petridis, and M. Strintzis 3D facial expression recognition using swarm intelligence in: Proc. IEEE International Conference on Acoustics, Speech and Signal Processing 2008 Las Vegas NV 2133 2136
20. I. Mpiperis, S. Malassiotis, and M. Strintzis Bilinear models for 3D face and facial expression recognition IEEE Trans. Inf. Forensics Secur. 3 2008 498 511
21. rd International Symposium on Computer and Information Sciences 2008 Istanbul Turkey
22. H. Tang, and T. Huang 3D facial expression recognition based on automatically selected features in: Proceedings. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops 2008 Anchorage AK 1 8
23. th IEEE International Conference on Automatic Face and Gesture Recognition 2008 Amsterdam The Netherlands 1 6
24. nd IEEE International Conference on Biometrics: Theory 2008 Applications and Systems, Arlington Arlington, VA 1 7
25. Y. Venkatesh, A. Kassim, and O. Murthy A novel approach to classification of facial expressions from 3D-mesh datasets using modified PCA Pattern Recognit. Lett. 30 2009 1128 1137
26. H. Soyel, and H. Demirel Optimal feature selection for 3D facial expression recognition with geometrically localized facial features in: Proc. Soft Computing, Computing with Words and Perceptions in System Analysis, Decision and Control, Famagusta, Cyprus 2009
27. H. Soyel, and H. Demirel Optimal feature selection for 3D facial expression recognition using coarse-to-fine classification Turk. J. Electr. Eng. Comput. Sci. 18 2010 1031 1040
28. th ACM International Conference on Multimedia 2008 New York, NY 569 572
29. rd International Symposium on Computer and Information Sciences 2006 Guzelyurt, Turkey 35 38
30. th IEEE International Conference on Computer Vision Workshops 2009 Kyoto, Japan 1993 2000
31. X. Zhao, E. Dellandréa, L. Chen, and D. Samaras AU recognition on 3D faces based on an extended statistical facial feature model in: Proc. 4th IEEE International Conference on Biometrics: Theory 2010 Applications and Systems Washington, DC 1 6
32. A. Savran, B. Sankur, and M. Bilge Facial action unit detection: 3D versus 2D modality in: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops 2010 San Francisco, CA 71 78
33. th International Conference on Pattern Recognition 2010 Istanbul, Turkey 4125 4128
34. th International Conference on Pattern Recognition 2010 Istanbul, Turkey 3724 3727
35. th International Conference on Pattern Recognition 2010 Istanbul, Turkey 4129 4132
36. th International Conference on Pattern Recognition 2010 Istanbul, Turkey 3772 3775
37. F. Tsalakanidou, and S. Malassiotis Real-time 2D+3D facial action and expression recognition Pattern Recognit. 43 2010 1763 1775
38. th IEEE International Conference on Automatic Face and Gesture Recognition 2011 Santa Barbara, CA
39. th IEEE Conference on Automatic Face and Gesture Recognition 2011 Santa Barbara
40. J. Goldfeather, and V. Interrante A novel cubic-order algorithm for approximating principal direction vectors ACM Trans. Graph. 23 2004 45 63
41. I. Pandzic, and R. Forchheimer MPEG-4 Facial Animation: The Standard, Implementation and Applications 2002 John Wiley & Sons Ltd Chichester
42. J. Bourgain On Lipschitz embedding of finite metric spaces in Hilbert space Isr. J. Math. 52 1985 46 52
43. L. Yin, and A. Basu Generating realistic facial expressions with wrinkles for model-based coding Comput. Vision Image Understanding 84 2001 201 240
44. L. Kharevych, B. Springborn, and P. Schröder Discrete conformal mappings via circle patterns ACM Trans. Graph. 25 2006 412 438
45. P. Besl, and N. McKay A method for registration of 3D shapes IEEE Trans. Pattern Anal. Mach. Intell. 14 1992 239 256
46. P. Siarry, G. Berthiau, F. Durbin, and J. Haussy Enhanced simulated annealing for globally minimizing functions of many-continuous variables ACM Trans. Math. Softw. 23 1997 209 228
47. G. Papaioannou, E. Karabassi, and T. Theoharis Reconstruction of three-dimensional objects through matching of their parts IEEE Trans. Pattern Anal. Mach. Intell. 24 2002 114 124
48. G. Passalis, I. Kakadiaris, and T. Theoharis Intraclass retrieval of non-rigid 3D objects: application to face recognition IEEE Trans. Pattern Anal. Mach. Intell. 29 2007 218 229
49. T. Fang, G. Toderici, T. Theoharis, and I Kakadiaris Gender and ethnicity classification of 3D face models using support vector machines in: Proc. Eurographics Workshop on 3D Object Retrieval 2009
50. G. Toderici, S. O'Malley, G. Passalis, T. Theoharis, and I.A. Kakadiaris Ethnicity- and gender-based subject retrieval using 3D face-recognition techniques Int. J. Comput. Vision 89 2010 382 391 Special Issue on 3D Object Retrieval
51. G. Passalis, P. Perakis, T. Theoharis, and I. Kakadiaris Using facial symmetry to handle pose variations in real-world 3D face recognition IEEE Trans. Pattern Anal. Mach. Intell. 33 Oct 2011 1938 1951
52. rd IEEE International Conference on Biometrics: Theory, Applications and Systems, Arlington, VA, (2009) pp. 439-446.
53. P. Nair, and A. Cavallaro 3D face detection, landmark localization, and registration using a point distribution model IEEE Trans. Multimedia 11 2009 611 623
54. X. Zhao, E. Dellandrea, L. Chen, and I.A. Kakadiaris Accurate landmarking of three-dimensional facial data in the presence of facial expressions and occlusions using a three-dimensional statistical facial feature model, systems, man, and cybernetics, Part B: cybernetics IEEE Trans. 41 2011 1417 1428
55. I. Dryden, and K. Mardia Statistical Shape Analysis 1998 Wiley
56. T. Cootes, and C. Taylor Statistical models of appearance for computer vision Technical Report, Imaging Science and Biomedical Engineering 2004 University of Manchester
57. th European Conference on Visual Media Production 2006 London, England 1 7
58. D.C. Schneider, and P. Eisert Algorithms for automatic and robust registration of 3D head scans J. Virtual Real. Broadcast. 7 2010
59. O. Ocegueda, S.K. Shah, and I.A. Kakadiaris Which parts of the face give out your identity? in: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2011 Colorado Springs, CO 641 648
60. A. Johnson, A representation for 3D surface matching, Ph.D. thesis, Carnegie Mellon University, 1997.
61. A. Zaharescu, E. Boyer, K. Varanasi, and R. Horaud Surface feature detection and description with applications to mesh matching in: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2009 Miami Beach, FL 373 380
62. C. Dorai, and A. Jain Cosmos - a representation scheme for 3D free-form objects IEEE Trans. Pattern Anal. Mach. Intell. 19 1997 1115 1130
63. th Alvey Vision Conference 1988 University of Manchester 147 151
64. A. Johnson, and M. Hebert Surface matching for object recognition in complex 3D scenes Image Vision Comput. 16 1998 635 651
65. D. Marr, and E. Hildreth Theory of edge detection Proc. R. Soc. London, Ser. B 207 1980 187 217
66. D. Lowe Distinctive image features from scale-invariant keypoints Int. J. Comput. Vis. 60 2004 91 110
67. N. Dalal, and B. Triggs Histograms of oriented gradients for human detection in: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2005 San Diego, CA, USA 886 893
68. M.A. Fischler, and R.C. Bolles Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography Commun. Assoc. Comput. Mach. 24 1981 381 395
69. C. Goodall Procrustes methods in the statistical analysis of shape J. R. Stat. Soc. 53 1991 285 339
70. C. Shan, S. Gong, and P. McOwan Facial expression recognition based on local binary patterns: a comprehensive study Image Vision Comput. 27 2009 803 816
71. T. Ojala, M. Pietikäinen, and D. Harwood A comparative study of texture measures with classification based on featured distributions Pattern Recognit. 29 1996 51 59
72. C.-C. Chang, and C.-J. Lin LIBSVM: a library for support vector machines Software 2001 available at http://www.csie.ntu.edu.tw/
73. T. Fang, X. Zhao, O. Ocegueda, S. Shah, and I. Kakadiaris Supplementary Demo Videos http://www.cbl.uh.edu/URxd/supplementary/IVC2012/demo.rar 2011
74. Z. Ying, and X. Fang Combining LBP and Adaboost for facial expression recognition in: Proc. 9th International Conference on Signal Processing 2008 1461 1464