Virtual view synthesis of people from multiple view video sequences

Graphical Models

Volumn 67, Issue 6, 2005, Pages 600-620

  Starck, J ^a   Hilton, A ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Free viewpoint video; Image based rendering; View dependent reconstruction; Virtual view rendering; Visual reconstruction

Indexed keywords

BROADCASTING; CAMERAS; ERROR ANALYSIS; IMAGE QUALITY; OPTIMIZATION; VIRTUAL REALITY;

FREE-VIEWPONT VIDEO; IMAGE-BASED RENDERING; VIEW-DEPENDENT RECONSTRUCTION; VIRTUAL VIEW RENDERING; VISUAL RECONSTRUCTION;

IMAGE ANALYSIS;

VIDEOGRAPHY;

EID: 27644515629     PISSN: 15240703     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.gmod.2005.01.008     Document Type: Conference Paper

References (36)

1. Camera Calibration Toolbox. Available from: < http://www.vision. caltech.edu/bouguetj/calib-doc >.
2. Open Source Computer Vision Library. Available from: < http://www.intel.com/research/mrl/research/opencv >.
3. Video Results. Available from: < http://www.ee.surrey.ac.uk/Research/ VSSP/VMRG/VCPhuman.html >.
4. C. Buehler, M. Bosse, L. McMillan, S. Gortler, M. Cohen, Unstructured lumigraph rendering, in: Proc. ACM SIGGRAPH, 2001, pp. 425-432.
5. J. Carranza, C. Theobalt, M. Magnor, H.-P. Seidel, Free-viewpoint video of human actors, in: Proc. ACM SIGGRAPH, 2003, pp. 565-577.
6. P. Debevec, C. Taylor, J. Malik, Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach, in: Proc. ACM SIGGRAPH, 1996, pp. 11-20.
7. P. Debevec, Y. Yu, G. Borshukov, Efficient view-dependent image-based rendering with projective texture-mapping, in: 9th Eurographics Rendering Workshop, 1998.
8. C. Dyer Volumetric scene reconstruction from multiple views L.S. Davis Computational models of visual processing 2001 Kluwer Boston 469 489
9. P. Fua, and Y. Leclerc Object-centered surface reconstruction: combining multi-image stereo and shading Int. J. Comput. Vision 16 1995 35 56
10. A. Fusiello, E. Trucco, A. Verri, Rectification with unconstrained stereo geometry, in: 8th British Machine Vision Conference, 1997, pp. 400-409.
11. O.Grau, G. Thomas, 3D image sequence acquisition for TV and film production, in: 1st International Symposium on 3D Data Processing Visualization and Transmission, 2002, pp. 320-326.
12. B. Goldluecke, M. Magnor, Space-time isosurface evolution for temporally coherent 3D reconstruction, in: IEEE International Conference on Computer Vision and Pattern Recognition, 2004, pp. 350-355.
13. R. Hartley, and A. Zisserman Multiple-View geometry in computer vision 2000 Cambridge University Press Cambridge, UK
14. J. Isidoro, S. Sclaro, Stochastic refinement of the visual hull to satisfy photometric and silhouette consistency constraints, in: IEEE International Conference on Computer Vision, 2003, pp. 1335-1342.
15. T. Kanade, P.W. Rander, and P. Narayanan Virtualized reality: constructing virtual worlds from real scenes IEEE Multimedia 4 1 1997 34 47
16. L. Kobbelt, S. Campagna, J. Vorsatz, H. Seidel, Interactive multi-resolution modeling on arbitrary meshes, in: Proc. ACM SIGGRAPH, 1998, pp. 105-114.
17. K. Kutulakos, and S. Seitz A theory of shape by space carving Int. J. Comput. Vision 38 3 2000 199 218
18. A. Laurentini The visual hull concept for silhouette based image understanding IEEE Trans. Pattern Anal. Mach. Intell. 16 2 1994 150 162
19. W.E. Lorensen, and H.E. Cline Marching cubes: a high resolution 3D surface construction algorithm Comput. Graph. 21 4 1987 163 169
20. T. Matsuyama, T. Takai, Generation, visualization, and editing of 3D video, in: 1st International Symposium on 3D Data Processing Visualization and Transmission, 2002, pp. 234-245.
21. W. Matusik, C. Buehler, and L. McMillan Polyhedral visual hulls for real-time rendering Eurographics Workshop on Rendering 2001 115 125
22. W. Matusik, C. Buehler, R. Raskar, S. Gortler, L. McMillan, Image-based visual hulls, in: Proc. ACM SIGGRAPH, 2000, pp. 369-374.
23. S. Moezzi, L. Tai, and P. Gerard Virtual view generation for 3D digital video IEEE Multimedia 4 1 1997 18 25
24. P. Narayanan, P. Rander, T. Kanade, Constructing virtual worlds using dense stereo, in: 6th IEEE International Conference on Computer Vision, 1998, pp. 3-10.
25. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, Synthesizing realistic facial expressions from photographs, in: Proc. ACM SIGGRAPH, 1998, pp. 75-84.
26. R. Plankers, P. Fua, Articulated soft objects for video-based body modeling, in: IEEE International Conference on Computer Vision, 2001, pp. 394-401.
27. M. Price, J. Chandaria, O. Grau, G.A. Thomas, D. Chatting, J. Thorne, G. Milnthorpe, P. Woodward, L. Bull, E.-J. Ong, A. Hilton, J. Mitchelson, J. Starck, Real-time production and delivery of 3D media, in: Proceedings of the International Broadcasting Convention, 2002, pp. 348-356.
28. K. Pulli, M. Cohen, T. Duchamp, H. Hoppe, L. Shapiro, W. Stuetzle, View-based rendering: visualizing real objects from scanned range and color data, in: 8th Eurographics workshop on Rendering, 1997, pp. 23-34.
29. J. Saito, S. Baba, M. Kimura, S. Vedula, T. Kanade, Appearance-based virtual view generation of temporally-varying events from multi-camera images in the 3D room, in: 2nd International Conference on 3-D Digital Imaging and Modeling, 1999, pp. 516-525.
30. C. Seitz, and C. Dyer Photorealistic scene reconstruction by voxel coloring Int. J. Comput. Vision 35 2 1999 1 23
31. J. Starck, A. Hilton, Model-based multiple view reconstruction of people, in: IEEE International Conference on Computer Vision, 2003, pp. 915-922.
32. R. Szeliski Rapid octree construction from image sequences Comput. Vision Graph. Image Process. Image Understand. 58 1 1993 23 32
33. D. Terzopoulos The computation of visible-surface representations IEEE Trans. Pattern Anal. Mach. Intell. 10 4 1988 417 438
34. S. Vedula, S. Baker, and T. Kanade Spatio-temporal view interpolation Eurographics Workshop on Rendering 2002 1 11
35. D.N. Wood, D.I. Azuma, K. Aldinger, B. Curless, T. Duchamp, D.H. Salesin, W. Stuetzle, Surface light fields for 3D photography, in: Proc. ACM SIGGRAPH, 2000, pp. 287-296.
36. C.L. Zitnick, S.B. Kang, M. Uyttendaele, S. Winder, R. Szeliski, High-quality video view interpolation using a layered representation, in: Proc. ACM SIGGRAPH, 2004, pp. 600-608.