3D faces in motion: Fully automatic registration and statistical analysis

Computer Vision and Image Understanding

Volumn 131, Issue , 2015, Pages 100-115

  Bolkart, Timo ^a   Wuhrer, Stefanie ^a  

^a SAARLAND UNIVERSITY   (Germany)

Author keywords

Motion sequence registration; Statistical analysis; Statistical model fitting; Statistical shape space

Indexed keywords

FACE RECOGNITION; MARKOV PROCESSES; STATISTICAL METHODS;

AUTOMATIC REGISTRATION; COMPACT REPRESENTATION; DYNAMIC FACIAL EXPRESSION; EXPRESSION RECOGNITION; MARKOV RANDOM FIELDS; MOTION SEQUENCES; STATISTICAL MODELING; STATISTICAL SHAPES;

STATISTICS;

EID: 84918820441     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2014.06.013     Document Type: Article

References (60)

1. O. Aldrian, and W. Smith Inverse rendering of faces with a 3D morphable model IEEE Trans. Pattern Anal. Mach. Intell. 35 5 2013 1080 1093
2. B. Amberg, R. Knothe, T. Vetter, Expression invariant 3D face recognition with a morphable model, in: IEEE International Conference on Automatic Face Gesture Recognition, 2008, pp. 1-6.
3. B. Amberg, P. Paysan, T. Vetter, Weight, sex, and facial expressions: on the manipulation of attributes in generative 3D face models, in: 5th International Symposium on Advances in Visual Computing: Part I, 2009, pp. 875-885.
4. R. Anderson, B. Stenger, V. Wan, R. Cipolla, Expressive visual text-to-speech using active appearance models, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2013.
5. ANN. < http://www.cs.umd.edu/mount/ANN/ >.
6. T. Beeler, B. Bickel, P. Beardsley, B. Sumner, and M. Gross High-quality single-shot capture of facial geometry ACM Trans. Graph. (Proc. SIGGRAPH) 29 4 2010 40:1 40:9
7. T. Beeler, F. Hahn, D. Bradley, B. Bickel, P. Beardsley, C. Gotsman, R.W. Sumner, and M. Gross High-quality passive facial performance capture using anchor frames ACM Trans. Graph. (Proc. SIGGRAPH) 30 4 2011 75:1 75:10
8. S. Berretti, B.B. Amor, M. Daoudi, and A. Bimbo 3D facial expression recognition using sift descriptors of automatically detected keypoints Visual Comput. 27 11 2011 1021 1036
9. B. Bickel, P. Kaufmann, M. Skouras, B. Thomaszewski, D. Bradley, T. Beeler, P. Jackson, S. Marschner, W. Matusik, and M. Gross Physical face cloning ACM Trans. Graph. (Proc. SIGGRAPH) 31 4 2012 118:1 118:10
10. V. Blanz, K. Scherbaum, H.-P. Seidel, Fitting a morphable model to 3D scans of faces, in: IEEE International Conference on Computer Vision, 2007.
11. V. Blanz, T. Vetter, A morphable model for the synthesis of 3D faces, in: SIGGRAPH, 1999, pp. 187-194.
12. T. Bolkart, A. Brunton, A. Salazar, S. Wuhrer, Statistical 3d shape models of human faces, 2013. < http://statistical-face-models.mmci.uni-saarland.de/ >.
13. T. Bolkart and S. Wuhrer, Statistical analysis of 3D faces in motion, In 3D Vision (3DV), 2013.
14. D. Bradley, W. Heidrich, T. Popa, and A. Sheffer High resolution passive facial performance capture ACM Trans. Graph. (Proc. SIGGRAPH) 29 4 2010 41:1 41:10
15. A. Brunton, C. Shu, J. Lang, E. Dubois, Wavelet model-based stereo for fast, robust face reconstruction, in: Eighth Canadian Conference on Computer and Robot Vision, 2011.
16. C. Cao, Y. Weng, S. Lin, and K. Zhou 3D shape regression for real-time facial animation ACM Trans. Graph. (Proc. SIGGRAPH) 32 4 2013 41:1 41:10
17. C. Creusot, N. Pears, and J. Austin A machine-learning approach to keypoint detection and landmarking on 3D meshes Int. J. Comput. Vis. 102 1-3 2013 146 179
18. K. Dale, K. Sunkavalli, M.K. Johnson, D. Vlasic, W. Matusik, and H. Pfister Video face replacement ACM Trans. Graph. (Proc. SIGGRAPH Asia) 30 6 2011 130:1 130:10
19. R. Davies, C. Twining, and C. Taylor Statistical Models of Shape: Optimisation and Evaluation 2008 Springer
20. L. Ding, X. Ding, and C. Fang 3D face sparse reconstruction based on local linear fitting Visual Comput. 2013 1 12
21. T. Fang, X. Zhao, O. Ocegueda, S.K. Shah, and I.A. Kakadiaris 3D/4D facial expression analysis: an advanced annotated face model approach Image Vis. Comput. 30 10 2012 738 749
22. M.A. Fischler, and R.C. Bolles Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography Commun. ACM 24 6 1981 381 395
23. A. Golovinskiy, W. Matusik, H. Pfister, S. Rusinkiewicz, and T. Funkhouser A statistical model for synthesis of detailed facial geometry ACM Trans. Graph. (Proc. SIGGRAPH) 25 3 2006 1025 1034
24. J. Guo, X. Mei, and K. Tang Automatic landmark annotation and dense correspondence registration for 3D human facial images BMC Bioinformatics 14 1 2013
25. P. Hammond, C. Foster-Gibson, A.E. Chudley, J.E. Allanson, T.J. Hutton, S.A. Farrell, J. McKenzie, J.J.A. Holden, and M.E.S. Lewis Face-brain asymmetry in autism spectrum disorders Mol. Psychiatr. 13 6 2008 614 623
26. T. Hierl, S. Arnold, D. Kruber, F.-P. Schulze, and H. Hmpfner-Hierl Cad-cam-assisted esthetic facial surgery J. Oral Max. Surg. 71 1 2013 e15 e23
27. Y. Huang, X. Zhang, Y. Fan, L. Yin, L. Seversky, J. Allen, T. Lei, and W. Dong Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysis Image Vis. Comput. 30 10 2012 750 761
28. A.E. Johnson, M. Hebert, Recognizing objects by matching oriented points, in: IEEE International Conference on Computer Vision and Pattern Recognition, 1997, pp. 684-692.
29. I. Kakadiaris, G. Passalis, T. Theoharis, G. Toderici, I. Konstantinidis, N. Murtuza, Multimodal face recognition: combination of geometry with physiological information, in: IEEE International Conference on Computer Vision and Pattern Recognition, vol. 2, 2005, pp. 1022-1029.
30. L.D. Lathauwer, Signal processing based on multilinear algebra, PhD thesis, K.U. Leuven, Belgium, 1997.
31. V. Le, H. Tang, T.S. Huang, Expression recognition from 3D dynamic faces using robust spatio-temporal shape features, in: IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, 2011, pp. 414-421.
32. D. Lee, and C. Wong Worst-case analysis for region and partial region searches in multidimensional binary search trees and balanced quad trees Acta Inform. 9 1 1977 23 29
33. H. Li, T. Weise, and M. Pauly Example-based facial rigging ACM Trans. Graph. (Proc. SIGGRAPH) 29 4 2010 32:1 32:6
34. H. Li, J. Yu, Y. Ye, and C. Bregler Realtime facial animation with on-the-fly correctives ACM Trans. Graph. (Proc. SIGGRAPH) 32 4 2013 42:1 42:10
35. D. Liu, and J. Nocedal On the limited memory method for large scale optimization Math. Program.: Ser. A and B 45 3 1989 503 528
36. I. Mpiperis, S. Malassiotis, and M.G. Strintzis Bilinear models for 3-D face and facial expression recognition IEEE Trans. Inform. Forens. Secur. 3 2008 498 511
37. T. Neumann, K. Varanasi, S. Wenger, M. Wacker, M. Magnor, and C. Theobalt Sparse localized deformation components ACM Trans. Graph. (Proc. SIGGRAPH Asia) 32 6 2013 179:1 179:10
38. OpenCV. < http://opencv.org/ >.
39. G. Passalis, P. Perakis, T. Theoharis, and I. Kakadiaris Using facial symmetry to handle pose variations in real-world 3D face recognition IEEE Trans. Pattern Anal. Mach. Intell. 33 10 2011 1938 1951
40. A. Patel, W. Smith, 3D morphable face models revisited, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2009, pp. 1327-1334.
41. A. Patel, W. Smith, Simplification of 3D morphable models, in: IEEE International Conference on Computer Vision, 2011, pp. 271-278.
42. L. Rabiner, and B.-H. Juang Fundamentals of Speech Recognition 1993 Prentice-Hall, Inc. Upper Saddle River, NJ, USA
43. A. Salazar, S. Wuhrer, C. Shu, and F. Prieto Fully automatic expression-invariant face correspondence Mach. Vis. Appl. 2013 1 21
44. G. Sandbach, S. Zafeiriou, M. Pantic, D. Rueckert, A dynamic approach to the recognition of 3D facial expressions and their temporal models, in: IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, 2011, pp. 406-413.
45. G. Sandbach, S. Zafeiriou, M. Pantic, and L. Yin Static and dynamic 3D facial expression recognition: a comprehensive survey Image Vis. Comput. 30 2012 683 697
46. A. Savran, N. Alyuz, H. Dibeklioglu, O. Celiktutan, B. Gökberk, B. Sankur, L. Akarun, Bosphorus database for 3D face analysis, in: Biometrics and Identity Management, 2008, pp. 47-56.
47. K. Scherbaum, T. Ritschel, M. Hullin, T. Thormählen, V. Blanz, H.-P. Seidel, Computer-suggested facial makeup, in: Eurographics, 2011.
48. M. Styner, K. Rajamani, L. Nolte, G. Zsemlye, G. Szkely, C. Taylor, and R. Davies Evaluation of 3D correspondence methods for model building Inform. Process. Med. Imag. 18 2003 63 75
49. G. Tam, Z.-Q. Cheng, Y.-K. Lai, F. Langbein, Y. Liu, D. Marshall, R. Martin, X.-F. Sun, and P. Rosin Registration of 3D point clouds and meshes: a survey from rigid to nonrigid IEEE Trans. Vis. Comput. Graph. 19 7 2013 1199 1217
50. L. Valgaerts, C. Wu, A. Bruhn, H.-P. Seidel, and C. Theobalt Lightweight binocular facial performance capture under uncontrolled lighting ACM Trans. Graph. (Proc. SIGGRAPH Asia) 31 6 2012 187:1 187:11
51. O. van Kaick, H. Zhang, G. Hamarneh, and D. Cohen-Or A survey on shape correspondence Comput. Graph. Forum 30 6 2011 1681 1707
52. D. Vlasic, M. Brand, H. Pfister, and J. Popović Face transfer with multilinear models ACM Trans. Graph. (Proc. SIGGRAPH) 24 3 2005 426 433
53. T. Weise, S. Bouaziz, H. Li, and M. Pauly Realtime performance-based facial animation ACM Trans. Graph. (Proc. SIGGRAPH) 30 4 2011 77:1 77:10
54. S. Wuhrer, C. Shu, and P. Bose Automatically creating design models from 3D anthropometry data J. Comput. Inform. Sci. Eng. 12 4 2012
55. F. Yang, L. Bourdev, J. Wang, E. Shechtman, D. Metaxas, Facial expression editing in video using a temporally-smooth factorization, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2012, pp. 861-868.
56. F. Yang, J. Wang, E. Shechtman, L. Bourdev, and D. Metaxas Expression flow for 3D-aware face component transfer ACM Trans. Graph. (Proc. SIGGRAPH) 30 4 2011 60:1 60:10
57. J.S. Yedidia, W.T. Freeman, and Y. Weiss Exploring Artificial Intelligence in the New Millennium Chapter Understanding Belief Propagation and its Generalizations 2003 Morgan Kaufmann Publishers Inc. pp. 239-269
58. L. Yin, X. Chen, Y. Sun, T. Worm, M. Reale, A high-resolution 3D dynamic facial expression database, in: IEEE International Conference on Automatic Face and Gesture Recognition, 2008, pp. 1-6.
59. L. Yin, X. Wei, Y. Sun, J. Wang, M.J. Rosato, A 3D facial expression database for facial behavior research, in: IEEE International Conference on Automatic Face and Gesture Recognition, 2006, pp. 211-216.
60. Y. Zhang, and W. Wei A realistic dynamic facial expression transfer method Neurocomputing 89 2012 21 29