Review of statistical shape spaces for 3D data with comparative analysis for human faces

Computer Vision and Image Understanding

Volumn 128, Issue , 2014, Pages 1-17

  Brunton, Alan ^a,b   Salazar, Augusto ^c   Bolkart, Timo ^d   Wuhrer, Stefanie ^d  

^a FRAUNHOFER IGD   (Germany)

^b MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^c INSTITUTO TECNOLÓGICO METROPOLITANO   (Colombia)

^d SAARLAND UNIVERSITY   (Germany)

Author keywords

3D data; 3D vision; Generative models; Statistical model fitting; Statistical shape spaces

Indexed keywords

IMAGE UNDERSTANDING; SOFTWARE ENGINEERING;

3-D VISION; 3D DATA; GENERATIVE MODEL; STATISTICAL MODELING; STATISTICAL SHAPES;

STATISTICS;

EID: 84906951108     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2014.05.005     Document Type: Article

References (75)

1. T. Bolkart, A. Brunton, A. Salazar, S. Wuhrer, Statistical 3d Shape Models of Human Faces, 2013. .
2. H. Li, T. Weise, and M. Pauly Example-based facial rigging ACM Trans. Graph. 29 4 2010 32:1 6
3. O. van Kaick, H. Zhang, G. Hamarneh, and D. Cohen-Or A survey on shape correspondence Comput. Graph. Forum 30 6 2011 1681 1707
4. G. Tam, Z.-Q. Cheng, Y.-K. Lai, F. Langbein, Y. Liu, D. Marshall, R. Martin, X.-F. Sun, and P. Rosin Registration of 3d point clouds and meshes: a survey from rigid to non-rigid IEEE Trans. Visual. Comput. Graph. 19 7 2013 1199 1217
5. T. Cashman, and A. Fitzgibbon What shape are dolphins? Building 3d morphable models from 2d images IEEE Trans. Pattern Anal. Machine Intell. 35 2013 232 244
6. D.A. Alcantara, O. Carmichael, W. Harcourt-Smith, K. Sterner, S.R. Frost, R. Dutton, P. Thompson, E. Delson, and N. Amenta Exploration of shape variation using localized components analysis IEEE Trans. Pattern Anal. Machine Intell. 31 8 2009 1510 1516
7. V. Blanz, T. Vetter, A morphable model for the synthesis of 3d faces, in: ACM Conference on Computer Graphics and Interactive Techniques, 1999, pp. 187-194.
8. B. Amberg, A. Blake, A. Fitzgibbon, S. Romdhani, T. Vetter, Reconstructing high quality face-surfaces using model based stereo, in: IEEE International Conference on Computer Vision, 2007, pp. 1-8.
9. A. Patel, W. Smith, 3d morphable face models revisited, in: IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 1327-1334.
10. F. Yang, J. Wang, E. Shechtman, L. Bourdev, and D. Metaxas Expression flow for 3d-aware face component transfer ACM Trans. Graph. 30 4 2011 60:1 10
11. B. Amberg, R. Knothe, T. Vetter, Expression invariant 3D face recognition with a morphable model, in: IEEE International Conference on Automatic Face and Gesture Recognition, 2008, pp. 1-6.
12. D. Vlasic, M. Brand, H. Pfister, and J. Popović Face transfer with multilinear models ACM Trans. Graph. 24 3 2005 426 433
13. K. Dale, K. Sunkavalli, M. Johnson, D. Vlasic, W. Matusik, and H. Pfister Video face replacement ACM Trans. Graph. 30 6 2011 130:1 10
14. F. Yang, L. Bourdev, J. Wang, E. Shechtman, D. Metaxas, Facial expression editing in video using a temporally-smooth factorization, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2012, pp. 861-868.
15. T. Bolkart, S. Wuhrer, Statistical analysis of 3d faces in motion, in: IEEE International Conference on 3D Vision, 2013, pp. 103-110.
16. C. Basso, A. Verri, Fitting 3d morphable models using implicit representations, in: Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2007, pp. 45-52.
17. F. ter Haar, R. Veltkamp, 3d face model fitting for recognition, in: European Conference on Computer Vision, 2008, pp. 652-664.
18. M. Smet, L.V. Gool, Optimal regions for linear model-based 3d face reconstruction, in: Asian Conference on Computer Vision, 2010, pp. 276-289.
19. I. Kakadiaris, G. Passalis, G. Toderici, M. Murtuza, Y. Lu, N. Karamelpatzis, and T. Theoharis Three-dimensional face recognition in the presence of facial expressions: an annotated deformable model approach IEEE Trans. Pattern Anal. Machine Intell. 29 4 2007 640 649 (Pubitemid 46464404)
20. A. Golovinskiy, W. Matusik, H. Pfister, S. Rusinkiewicz, and T. Funkhouser A statistical model for synthesis of detailed facial geometry ACM Trans. Graph. 25 3 2006 1025 1034 (Pubitemid 44481064)
21. A. Brunton, C. Shu, J. Lang, E. Dubois, Wavelet model-based stereo for fast, robust face reconstruction, in: Canadian Conference on Computer and Robot Vision, 2011, pp. 347-354.
22. B. Allen, B. Curless, and Z. Popović The space of human body shapes: reconstruction and parameterization from range scans ACM Trans. Graph. 22 3 2003 587 594
23. H. Seo, Y.I. Yeo, and K. Wohn 3d body reconstruction from photos based on range scan Technol. E-Learn. Digital Entertain. 2006 849 860 (Pubitemid 44029376)
24. Y. Chen, R. Cipolla, Learning shape priors for single view reconstruction, in: IEEE International Workshop on 3-D Digital Imaging and Modeling, 2009, pp. 1425-1432.
25. J. Boisvert, C. Shu, S. Wuhrer, and P. Xi Three-dimensional human shape inference from silhouettes: reconstruction and validation Machine Vis. Appl. 24 1 2013 145 157
26. S. Wuhrer, and C. Shu Estimating 3d human shapes from measurements Machine Vis. Appl. 24 6 2013 1133 1147
27. D. Anguelov, P. Srinivasan, D. Koller, S. Thrun, J. Rodgers, and J. Davis Scape: shape completion and animation of people ACM Trans. Graph. 24 3 2005 408 416
28. P. Guan, A. Weiss, A.O. Balan, M.J. Black, Estimating human shape and pose from a single image, in: International Conference on Computer Vision, 2009, pp. 1381-1388.
29. A. Balan, M. Black, The naked truth: estimating body shape under clothing, in: European Conference on Computer Vision, 2008, pp. 15-29.
30. S. Zhou, H. Fu, L. Liu, D. Cohen-Or, and X. Han Parametric reshaping of human bodies in images ACM Trans. Graph. 29 4 2010 126:1 10
31. A. Jain, T. Thormählen, H.-P. Seidel, and C. Theobalt Movie reshape: tracking and reshaping of humans in videos ACM Trans. Graph. 29 5 2010 148:1 10
32. A. Weiss, D. Hirshberg, M. Black, Home 3d body scans from noisy image and range data, in: International Conference on Computer Vision, 2011, pp. 1951-1958.
33. D. Hirshberg, M. Loper, E. Rachlin, M. Black, Coregistration: simultaneous alignment and modeling of articulated 3d shape, in: European Conference on Computer Vision, 2012, pp. 242-255.
34. N. Hasler, C. Stoll, M. Sunkel, B. Rosenhahn, and H.-P. Seidel A statistical model of human pose and body shape Comput. Graph. Forum 28 2 2009 337 346
35. N. Hasler, C. Stoll, B. Rosenhahn, T. Thormählen, and H.-P. Seidel Estimating body shape of dressed humans Comput. Graph. 33 3 2009 211 216
36. N. Hasler, H. Ackermann, B. Rosenhahn, T. Thormählen, H.-P. Seidel, Multilinear pose and body shape estimation of dressed subjects from image sets, in: IEEE Conference on Computer Vision and Pattern Recognition, 2010, pp. 1823-1830.
37. S. Wuhrer, C. Shu, and P. Xi Posture-invariant statistical shape analysis using laplace operator Comput. Graph. 36 2012 410 416
38. P. Xi, W.-S. Lee, C. Shu, A data-driven approach to human body cloning using a segmented body database, in: Pacific Graphics, 2007, pp. 139-147.
39. Y. Chen, Z. Liu, Z. Zhang, Tensor-based human body modeling, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2013, pp. 105-112.
40. T. Cootes, C. Taylor, D. Cooper, and J. Graham Active shape models - their training and application Comput. Vis. Image Understand. 61 1 1995 38 59
41. T. Cootes, C. Taylor, Statistical models of appearance for medical image analysis and computer vision, in: SPIE Medical Imaging, 2001, pp. 236-248. (Pubitemid 32839821)
42. R. Davies, C. Twining, and C. Taylor Statistical Models of Shape: Optimisation and Evaluation 2008 Springer
43. P. Fletcher, C. Lu, S. Pizer, and S. Joshi Principal geodesic analysis for the study of nonlinear statistics of shape IEEE Trans. Med. Imaging 23 8 2004 995 1005
44. M. Toews, D. Collins, T. Arbel, A statistical parts-based appearance model of inter-subject variability, in: International Conference on Medical Image Computing and Computer Assisted Intervention, 2006, pp. 232-240. (Pubitemid 44609111)
45. F. Lecron, J. Boisvert, S. Mahmoudi, H. Labelle, M. Benjelloun, Fast 3d spine reconstruction of postoperative patients using a multilevel statistical model, in: International Conference on Medical Image Computing and Computer Assisted Intervention, 2012, pp. 446-453.
46. C. Davatzikos, X. Tao, and D. Shen Hierarchical active shape models, using the wavelet transform IEEE Trans. Med. Imaging 22 3 2003 414 423
47. D. Nain, S. Haker, A. Bobick, A. Tannenbaum, Multiscale 3d shape analysis using spherical wavelets, in: International Conference on Medical Image Computing and Computer Assisted Intervention, 2005, pp. 459-467. (Pubitemid 43828397)
48. D. Nain, S. Haker, A. Bobick, A. Tannenbaum, Shape-driven 3d segmentation using spherical wavelets, in: International Conference on Medical Image Computing and Computer Assisted Intervention, 2006, pp. 66-74. (Pubitemid 44609091)
49. Y. Li, T.-S. Tan, I. Volkau, W. Nowinski, Model-guided segmentation of 3D neuroradiological image using statistical surface wavelet model, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2007, pp. 1-7.
50. S. Essafi, G. Langs, Hierarchical 3D diffusion wavelet shape priors, in: IEEE International Conference on Computer Vision, 2009, pp. 1717-1724.
51. P. Yu, B.T.T. Yeo, P.E. Grant, B. Fischl, P. Golland, Cortical folding development study based on over-complete spherical wavelets, in: IEEE International Conference on Computer Vision, 2007, pp. 1-8.
52. T. Weise, S. Bouaziz, H. Li, and M. Pauly Realtime performance-based facial animation ACM Trans. Graph. 30 4 2011 77:1 10
53. I. Dryden, and K. Mardia Statistical Shape Analysis 2002 Wiley
54. M. Styner, K. Rajamani, L.-P. Nolte, G. Zsemlye, G. Szekely, C. Taylor, R. Davies, Evaluation of 3d correspondence methods for model building, in: Information Processing in Medical Imaging, 2003, pp. 63-75.
55. W. Sweldens The lifting scheme: a custom-design construction of biorthogonal wavelets Appl. Comput. Harmonic Anal. 3 2 1996 186 200 (Pubitemid 126375198)
56. S. Mallat A Wavelet Tour of Signal Processing 1999 Elsevier
57. P. Schröder, W. Sweldens, Spherical wavelets: efficiently representing functions on the sphere, in: ACM Conference on Computer Graphics and Interactive Techniques, 1995, pp. 161-172.
58. M. Bertram, M. Duchaineau, B. Hamann, and K.I. Joy Generalized B-spline subdivision-surface wavelets for geometry compression IEEE Trans. Visual. Graph. 10 3 2004 326 338
59. C. Creusot, N. Pears, J. Austin, 3D face landmark labelling, in: ACM Workshop on 3D Object Retrieval, 2010, pp. 27-32.
60. A. Salazar, S. Wuhrer, S. Chu, and F. Prieto Fully automatic expression-invariant face correspondence Machine Vis. Appl. 2013 1 21
61. A. Johnson, M. Hebert, Recognizing objects by matching oriented points, in: Conference on Computer Vision and Pattern Recognition, 1997, pp. 684-692.
62. M. Fischler, and R. Bolles Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography Commun. ACM 24 6 1981 381 395 (Pubitemid 12444102)
63. D. Mount, S. Arya, ANN: A Library for Approximate Nearest Neighbor Searching, 2010. .
64. A. Patel, W. Smith, Exploring the identity manifold: constrained operations in face space, in: European Conference on Computer Vision, 2010, pp. 112-125.
65. D. Liu, and J. Nocedal On the limited memory method for large scale optimization Math. Program. 45 3 1989 503 528 (Pubitemid 20660315)
66. D. Lee, and C. Wong Worst-case analysis for region and partial region searches in multidimensional binary search trees and balanced quad trees Acta Inform. 9 1 1977 23 29 (Pubitemid 8574823)
67. L. Yin, X. We, Y. Sun, J. Wang, M. Rosato, A 3D facial expression database for facial behavior research, in: IEEE International Conference on Automatic Face and Gesture Recognition, 2006, pp. 211-216. (Pubitemid 44711352)
68. A. Savran, N. Alyuz, H. Dibeklioglu, O. Celiktutan, B. Gökberk, B. Sankur, L. Akarun, Bosphorus database for 3D face analysis, in: Workshop on Biometrics and Identity Management, 2008, pp. 47-56.
69. A. Brunton, J. Lang, E. Dubois, Efficient multi-scale stereo of high-resolution planar and spherical images, in: IEEE Conference on 3D Imaging, Modeling, Processing, Visualization, and Transmission, 2012, pp. 120-127.
70. P. Garrido, L. Valgaerts, C. Wu, and C. Theobalt Reconstructing detailed dynamic face geometry from monocular video ACM Trans. Graph. 32 6 2013 158:1 10
71. T. Beeler, F. Hahn, D. Bradley, B. Bickel, P. Beardsley, C. Gotsman, R.W. Sumner, and M. Gross High-quality passive facial performance capture using anchor frames ACM Trans. Graph. 30 2011 75:1 10
72. K. Scherbaum, J. Petterson, R.S. Feris, V. Blanz, H.-P. Seidel, Fast face detector training using tailored views, in: IEEE International Conference on Computer Vision, 2013.
73. I. Mpiperis, S. Malassiotis, and M.G. Strintzis Bilinear models for 3-d face and facial expression recognition IEEE Trans. Inform. Forensics Security 3 3 2008 498 511
74. H. Li, J. Yu, Y. Ye, and C. Bregler Realtime facial animation with on-the-fly correctives ACM Trans. Graph. 32 4 2013
75. T. Neumann, K. Varanasi, S. Wenger, M. Wacker, M. Magnor, and C. Theobalt Sparse localized deformation components ACM Trans. Graph. 32 6 2013 179:1 10