Model-based human shape reconstruction from multiple views

Computer Vision and Image Understanding

Volumn 111, Issue 2, 2008, Pages 179-194

  Starck, Jonathan ^a   Hilton, Adrian ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Character animation; Deformable model; Image based modelling; Multiple resolution mesh; Shape from silhouette; Stereo vision

Indexed keywords

ANIMATION; CANNING; DEFORMATION; HIERARCHICAL SYSTEMS; IMAGE ENHANCEMENT; REPAIR; RESTORATION;

ANIMATED MODELS; COARSE TO FINE STRATEGY; DEFORMABLE MODELING; DEFORMABLE SURFACES; DIGITAL MODELING; FEATURE DATA; HIERARCHICAL MODELLING; IMAGE FITTING; IMAGE-BASED; MODEL BASED (OPC); MODEL BASED APPROACHES; MODEL HIERARCHY; MULTIPLE LEVELS; MULTIPLE VIEWS; REAL-WORLD OBJECTS; RECONSTRUCTION ACCURACY; REDUCED MODELS; REGULARISATION; SHAPE RECONSTRUCTION; SURFACE DEFORMATIONS; SURFACE MODELING; TRUTH DATA; VIDEO IMAGING; VISUAL CUES;

CURVE FITTING;

EID: 47049125741     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2007.10.001     Document Type: Article

References (53)

1. Kanade T., Rander P., and Narayanan P. Virtualized reality: constructing virtual worlds from real scenes. IEEE Multimedia 4 1 (1997) 34-47
2. Matusik W., Buehler C., Raskar R., Gortler S., and McMillan L. Image-based visual hulls. ACM Transactions on Graphics (ACM SIGGRAPH 2000) (2000) 369-374
3. Terzopoulos D., Platt J., Barr A., and Fleischer K. Elastically deformable models. Computer Graphics Annual Conference Series 21 4 (1987) 205-214
4. Carranza J., Theobalt C.M., Magnor M., and Seidel H. Free-viewpoint video of human actors. ACM Transactions on Graphics (ACM SIGGRAPH 2003) 22 3 (2003) 569-577
5. Zhang Z., Liu Z., Adler D., Cohen M.F., Hanson E., and Shan Y. Robust and rapid generation of animated faces from video images: a model-based modeling approach. International Journal of Computer Vision 58 2 (2004) 93-119
6. Allen B., Curless B., and Popović Z. Articulated body deformation from range scan data. ACM Transactions on Graphics (ACM SIGGRAPH 2002) 21 3 (2002) 612-619
7. Hilton A., Beresford D., Gentils T., Smith R., Sun W., and Illingworth J. Whole-body modelling of people from multiview images to populate virtual worlds. The Visual Computer 16 7 (2000) 411-436
8. Kakadiaris I., and Metaxas D. Three-dimensional human body model acquisition from multiple views. International Journal of Computer Vision 30 3 (1998) 191-218
9. J. Starck, A. Hilton, Model-based multiple view reconstruction of people, in: 9th IEEE International Conference on Computer Vision (ICCV 2003), 2003, pp. 915-922.
10. Moezzi S., Tai L., and Gerard P. Virtual view generation for 3D digital video. IEEE Multimedia 4 1 (1997) 18-25
11. Starck J., and Hilton A. Virtual view synthesis of people from multiple view video sequences. Graphical Models 67 6 (2005) 600-620
12. Narayanan P., Rander P., and Kanade T. Constructing virtual worlds using dense stereo. IEEE International Conference on Computer Vision (1998) 3-10
13. Vedula S., Rander P., Saito H., and Kanade T. Modeling, combining, and rendering dynamic real-world events from image sequences. Proceedings of Virtual Systems and Multimedia (1998) 323-344
14. Fua P., and Leclerc Y. Object-centered surface reconstruction: combining multi-image stereo and shading. International Journal of Computer Vision 16 (1995) 35-56
15. D. Samaras, D. Metaxas, P. Fua, Y. Leclerc, Variable albedo surface reconstruction from stereo and shape from shading, in: CVPR, IEEE Computer Society, 2000, pp. 1480-1487.
16. J. Isidoro, J. Sclaroff, Stochastic refinement of the visual hull to satisfy photometric and silhouette consistency constraints, in: 9th IEEE International Conference on Computer Vision (ICCV 2003), 2003, pp. 1335-1342.
17. Esteban C., and Schmitt F. Silhouette and stereo fusion for 3D object modeling. Computer Vision and Image Understanding 96 3 (2004) 367-392
18. D. Terzopoulos, From physics-based representation to functional modeling of highly complex objects, NSF-ARPA Workshop on Object Representation in Computer Vision, 1994, pp. 347-359.
19. Zhang L., Snavely N., Curless B., and Seitz S. Spacetime faces: high resolution capture for modeling and animation. ACM Transactions on Graphics (ACM SIGGRAPH 2004) 23 3 (2004) 548-558
20. Cheung K., Baker S., and Kanade T. Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture. IEEE Conference on Computer Vision and Pattern Recognition 1 (2003) 77-84
21. Sand P., McMillan L., and Popovic J. Continuous capture of skin deformation. ACM Transactions on Graphics (ACM SIGGRAPH 2003) 22 3 (2003) 578-586
22. Montagnat J., Delingette H., and Ayache N. A review of deformable surfaces: topology, geometry and deformation. Image and Vision Computing 19 (2001) 1023-1040
23. McInerney T., and Terzopoulos D. Deformable models in medical image analysis: a survey. Medical Image Analysis 1 2 (1996) 91-108
24. A. Nealen, M. Mller, R. Keiser, E. Boxerman, M. Carlson, Physically based deformable models in computer graphics, Eurographics 2005 state of the art report (STAR) (2005) STAR4.
25. Kass M., Witkin A., and Terzopoulos D. Snakes: active contour models. International Journal of Computer Vision 1 (1988) 321-331
26. Delingette H., Hebert M., and Ikeuchi K. Shape representation and image segmentation using deformable surfaces. Image and Vision Computing 10 3 (1992) 132-144
27. J. Montagnat, O. Faugeras, Spatial and temporal shape constrained deformable surfaces for 3D and 4D medical image segmentation, Technical Report 4078, INRIA, 2000.
28. Lurig C., Kobbelt L., and Ertl T. Deformable surfaces for feature based indirect volume rendering. Computer Graphics International (1998) 752-760
29. Szeliski R., and Tonnesen D. Surface modeling with orientated particle systems. Computer Graphics 26 2 (1992) 185-194
30. Terzopoulos D., and Metaxas D. Dynamic 3D models with local and global deformations: deformable superquadrics. IEEE Transactions on Pattern Analysis and Machine Intelligence 13 (1991) 703-714
31. Whitaker R. Volumetric deformable models: active blobs. Visualization in Biomedical Computing (1994) 122-134
32. Cohen L., and Cohen I. Finite element methods for active contour models and balloons for 2D and 3D images. IEEE Transactions on Pattern Analysis and Machine Intelligence 15 11 (1993) 1131-1147
33. Malladi R., Sethian J., and Vemuri B. Shape modelling with front propagation: a level set approach. IEEE Transactions on Pattern Analysis and Machine Intelligence 17 2 (1995) 158-174
34. Plaenkers R., and Fua P. Articulated soft objects for multiview shape and motion capture. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 9 (2003) 1182-1187
35. Sclaroff S., and Liu L. Deformable shape detection and description via model-based region grouping. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 5 (2001) 475-489
36. Bardinet E., Cohen L., and Ayache N. A parametric deformable model to fit unstructured 3D data. Computer Vision and Image Understanding 71 1 (1998) 39-54
37. Lachaud J.-O., and Montanvert A. Deformable meshes with automated topology changes for coarse-to-fine three-dimensional surface extraction. Medical Image Analysis 3 2 (1999) 187-207
38. Duan Y., and Qin H. A subdivision-based deformable model for surface reconstruction of unknown topology. Graphical Models 66 4 (2004) 181-202
39. Guskov I., Sweldens W., and Schroder P. Multiresolution signal processing for meshes. ACM Transactions on Graphics (ACM SIGGRAPH 1999) (1999) 325-334
40. Delingette H. General object reconstruction based on simplex meshes. International Journal of Computer Vision 32 2 (1999) 111-146
41. Hoppe H., DeRose T., Duchamp T., McDonald J., and Stuetzle W. Mesh optimization. ACM Transactions on Graphics (ACM SIGGRAPH 1993) 27 (1993) 19-26
42. Hoppe H. Progressive meshes. ACM Transactions on Graphics (ACM SIGGRAPH 1996) (1996) 99-108
43. Lee A.W.F., Sweldens W., Schröder P., Cowsar L., and Dobkin D. Maps: multiresolution adaptive parameterization of surfaces. ACM Transactions on Graphics (ACM SIGGRAPH 1998) (1998) 95-104
44. R. Szeliski, D. Tonnesen, D. Terzopoulos, Modeling surfaces of arbitrary topology with dynamic particles, in: CVPR, IEEE Computer Society, 1993, pp. 82-87.
45. O. Faugeras, B. Hotz, H. Mathieu, T. Vieville, Z. Zhang, P. Fua, E. Theron, L. Moll, G. Berry, J. Vuillemin, P. Bertin, C. Proy, Real-time correlation-based stereo: algorithm, implementation and applications, Technical Report 2013, INRIA, 1993.
46. Laurentini A. The visual hull concept for silhouette based image understanding. IEEE Transactions on Pattern Analysis and Machine Intelligence 16 2 (1994) 150-162
47. Egnal G., Mintz M., and Wildes R.P. A stereo confidence metric using single view imagery with comparison to five alternative approaches. Image and Vision Computing 22 12 (2004) 943-957
48. Baraff D., and Witkin A. Large steps in cloth simulation. ACM Transactions on Graphics (ACM SIGGRAPH 1998) (2003) 43-54
49. Desbrun M., Meyer M., Schröder P., and Barr A.H. Implicit fairing of irregular meshes using diffusion and curvature flow. ACM Transactions on Graphics (ACM SIGGRAPH 1999) (1999) 317-324
50. X. Provot, Deformation constraints in a mass-spring model to describe rigid cloth behavior, in: Graphics Interface, 1995, pp. 147-154.
51. I. Ypsilos, A. Hilton, S. Rowe, Video-rate capture of dynamic face shape and appearance, 2004, pp. 117-122.
52. Pighin F., Hecker J., Lischinski D., Szeliski R., and Salesin D. Synthesizing realistic facial expressions from photographs. ACM Transactions on Graphics (ACM SIGGRAPH 1998) (1998) 75-84
53. Burt P., and Adelson E. A multiresolution spline with application to image mosaics. ACM Transactions on Graphics 2 4 (1983) 217-236