Interactive pixel-accurate free viewpoint rendering from images with silhouette aware sampling

Computer Graphics Forum

Volumn 28, Issue 8, 2009, Pages 2090-2103

  Hornung, A ^a   Kobbelt, L ^b  

^a ETH ZURICH   (Switzerland)

^b RWTH AACHEN UNIVERSITY   (Germany)

Author keywords

3D reconstruction; Free viewpoint rendering; Pixel accuracy; Silhouette aware sampling

Indexed keywords

GRAPHICS PROCESSING UNIT; PIPELINE PROCESSING SYSTEMS; PIPELINES; PIXELS; STEREO IMAGE PROCESSING; THREE DIMENSIONAL COMPUTER GRAPHICS;

3D RECONSTRUCTION; DEPTH DISCONTINUITIES; FREE VIEWPOINT RENDERINGS; ILLUMINATION EFFECT; MEMORY EFFICIENT; MULTI-VIEW STEREO; PROCESSING STAGE; TWO-STEP PROCEDURE;

RENDERING (COMPUTER GRAPHICS);

EID: 72249121845     PISSN: 01677055     EISSN: 14678659     Source Type: Journal    
DOI: 10.1111/j.1467-8659.2009.01416.x     Document Type: Article

References (37)

1. Andujar C., Boo J., Brunet P., Fairen M., Navazo I., Vazquez P., Vinacua A. : Omni-directional relief impostors. Computer Graphics Forum 26, 3 (2007 553 560.
2. Buehler C., Bosse M., McMillan L., Gortler S., Cohen M. : Unstructured lumigraph rendering. In Proc. SIGGRAPH '01 (2001 pp. 425 432.
3. Botsch M., Hornung A., Zwicker M., Kobbelt L. : High-quality surface splatting on today's GPUs. In Proceedings of Symposium on Point-Based Graphics (New York, NY, USA, 2005 Stony Brook, pp. 17 24.
4. Beardsley P. A., Zisserman A., Murray D. W. : Sequential updating of projective and affine structure from motion. International Journal of Computer Vision 23, 3 (1997 235 259. (Pubitemid 127506546)
5. Chai J., Chan S.-C., Shum H.-Y., Tong X. : Plenoptic sampling. In Proc. SIGGRAPH '00 (2000 pp. 307 318.
6. Carranza J., Theobalt C., Magnor M., Seidel H.-P. : Free-viewpoint video of human actors. ACM Transactions on Graphics 22, 3 (2003).
7. Eisemann M., de Decker B., Magnor M. A., Bekaert P., de Aguiar E., Ahmed N., Theobalt C., Sellent A. : Floating textures. Computer Graphics Forum 27, 2 (2008 409 418.
8. Fitzgibbon A., Wexler Y., Zisserman A. : Image-based rendering using image-based priors. International Journal of Computer Vision 63, 2 (2005 141 151.
9. Gortler S. J., Grzeszczuk R., Szeliski R., Cohen M. F. : The lumigraph. In Proc. SIGGRAPH '96 (1996 pp. 43 54.
10. Geys I., Van Gool L. J. : View synthesis by the parallel use of GPU and CPU. Image and Vision Computing 25, 7 (2007 1154 1164.
11. Hirschmuller H., Innocent P., Garibaldi J. : Real-time correlation-based stereo vision with reduced border errors. International Journal of Computer Vision 47, 1-3 (2002 229 246.
12. Hornung A., Kobbelt L. : Robust and efficient photo-consistency estimation for volumetric 3D reconstruction. In Proceedings of the European Conference on Computer Vision (New York, USA, 2006 pp. 179 190.
13. Habbecke M., Kobbelt L. : A surface-growing approach to multi-view stereo reconstruction. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition '07 (Minneapolis, MN, USA, 2007).
14. Kazhdan M., Bolitho M., Hoppe H. : Poisson surface reconstruction. In Proceedings of the Symposium on Geometry Processing (2006 pp. 61 70.
15. Kang S. B., Szeliski R., Chai J. : Handling occlusions in dense multi-view stereo. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition '01 (Hawaii, USA, 2001 pp. 103 110.
16. Levoy M., Hanrahan P. : Light field rendering. In Proc. SIGGRAPH '96 (1996 pp. 31 42.
17. Li M., Magnor M., Seidel H.-P. : Hardware-accelerated rendering of photo hulls. Computer Graphics Forum 23, 3 (2004 635 642.
18. Lin Z., Shum H.-Y. : A geometric analysis of light field rendering. International Journal of Computer Vision 58, 2 (2004 121 138.
19. Merrell P., Akbarzadeh A., Wang L., Mordohai P., Frahm J.-M., Yang R., Nister D., Pollefeys M. : Real-time visibility-based fusion of depth maps. In Proceedings of the IEEE International Conference on Computer Vision '07 (Rio de Janeiro, Brazil, 2007).
20. Matusik W., Buehler C., Raskar R., Gortler S. J., McMillan L. : Image-based visual hulls. In Proc. SIGGRAPH '00 (2000 pp. 369 374.
21. Middlebury multi-view stereo evaluation. http://vision.middlebury.edu/ mview/, June 2008.
22. Middlebury stereo evaluation. http://vision.middlebury.edu/stereo/, June 2008.
23. Matusik W., Pfister H. : 3D TV: A scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes. ACM Transactions on Graphics 23, 3 (2004 814 824.
24. Pulli K., Cohen M., Duchamp T., Hoppe H., Shapiro L., Stuetzle W. : View-based rendering: Visualizing real objects from scanned range and color data. In Eurographics Workshop on Rendering (1997 pp. 23 34.
25. Press W. H., Flannery B. P., Teukolsky S. A., Vetterling W. T. : Numerical Recipes: The Art of Scientific Computing, 2nd ed. Cambridge University Press, 1992.
26. Seitz S. M., Dyer C. R. : Photorealistic scene reconstruction by voxel coloring. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (San Juan, Puerto Rico, 1997 pp. 1067 1073.
27. Shade J., Gortler S., Wei He L., Szeliski R. : Layered depth images. In Proc. SIGGRAPH '98 (1998 pp. 231 242.
28. Vedula S., Baker S., Kanade T. : Spatio-temporal view interpolation. In Proceedings of the Eurographics workshop on Rendering (2002 pp. 65 76.
29. Viola I., Kanitsar A., Groller M. E. : Hardware-based nonlinear filtering and segmentation using high-level shading languages. In IEEE Visualization (2003 pp. 309 316.
30. Würmlin S., Lamboray E., Gross M. : 3D video fragments: Dynamic point samples for real-time free-viewpoint video. Computers and Graphics 28, 1 (2004 3 14.
31. Wimmer M., Scherzer D., Purgathofer W. : Light space perspective shadow maps. In Rendering Techniques (2004 pp. 143 152.
32. Waschbüsch M., Würmlin S., Cotting D., Gross M. : Point-sampled 3D video of real-world scenes. Signal Processing: Image Communication 22, 2 (2007 203 216.
33. Waschbüsch M., Würmlin S., Gross M. : 3D video billboard clouds. Computer Graphics Forum 26, 3 (2007).
34. Yoon K.-J., Kweon I. S. : Adaptive support-weight approach for correspondence search. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 4 (2006 650 656.
35. Yang R., Pollefeys M., Yang H., Welch G. : A unified approach to real-time, multi-resolution, multi-baseline 2D view synthesis and 3D depth estimation using commodity graphics hardware. International Journal of Image and Graphics 4, 4 (2004 627 651.
36. Zhang G., Jia J., Wong T. T., Bao H. : Recovering consistent video depth maps via bundle optimization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (Anchorage, AK, USA, 2008).
37. Zitnick C. L., Kang S. B., Uyttendaele M., Winder S., Szeliski R. : High-quality video view interpolation using a layered representation. ACM Transactions on Graphics) 23, 3 (2004 600 608.