GPU-based spherical light field rendering with per-fragment depth correction

Computer Graphics Forum

Volumn 27, Issue 8, 2008, Pages 2081-2095

  Todt, S ^a   Rezk Salama, C ^a   Kolb, A ^a   Kuhnert, K D ^a  

^a UNIVERSITY OF SIEGEN   (Germany)

Author keywords

Image based rendering; Light field rendering; Light fields

Indexed keywords

COMPUTER GRAPHICS; DEGREES OF FREEDOM (MECHANICS); GRAPHICS PROCESSING UNIT; IMAGE PROCESSING; IMAGE RECONSTRUCTION; ITERATIVE METHODS; PIXELS; THREE DIMENSIONAL COMPUTER GRAPHICS;

3-D OBJECT RECONSTRUCTION; HIGH QUALITY RECONSTRUCTION; IMAGE BASED RENDERING; LIGHT FIELD RENDERING; LIGHT FIELDS; RENDERING ALGORITHMS; SIX DEGREES OF FREEDOM; VIRTUAL VIEW SYNTHESIS;

RENDERING (COMPUTER GRAPHICS);

EID: 51849116195     PISSN: 01677055     EISSN: 14678659     Source Type: Journal    
DOI: 10.1111/j.1467-8659.2008.01191.x     Document Type: Article

References (34)

1. Adelson E. H., Bergen J. R. : The plenoptic function and the elements of early vision. In Computational Models of Visual Processing. MIT Press, 1991, pp. 3 20.
2. Andujar C., Boo J., Brunet P., Fairen M., Navazo I., Vazquez P., Vinacua A. : Omni-directional relief impostors. Computer Graphics Forum 26, 3 (2007 553 560.
3. Advanced Realtime Tracking GmbH: Dtrack tracking system. http://www.ar-tracking.de, last visited 16.06.2008.
4. Buehler C., Bosse M., McMillan L., Gortler S., Cohen M. : : Unstructured lumigraph rendering. In Proc. ACM SIGGRAPH (2001 pp. 425 432.
5. Baboud L., Décoret X. : Rendering geometry with relief textures. In GI'06: Proc. Graphics Interface 2006 (2006 Canadian Information Processing Society, pp. 195 201.
6. Blinn J., Newell M. : Texture and reflection in computer generated images. ACM SIGGRAPH Comput. Graph. 10, 2 (1976 266 266.
7. Chai J.-X., Chan S.-C., Shum H.-Y., Tong X. : Plenoptic sampling. In SIGGRAPH'00: Proc. Conf. on Computer graphics and interactive techniques (2000 ACM Press/Addison-Wesley Publishing Co., pp. 307 318.
8. Camahort E., Lerios A., Fussell D. : Uniformly Sampled Light Fields. Tech. rep., University of Texas at Austin, 1998.
9. Gasson P. : Geometry of Spatial Forms: Analysis, Synthesis, Concept Formulation and Space Vision for CAD. Ellis Horwood Series in Mathematics and its Applications. Ellis Horwood, 1983.
10. Gortler S., Grzeszczuk R., Szeliski R., Cohen M. : The lumigraph. In Proc. ACM SIGGRAPH (1996 pp. 43 54.
11. Greene N. : Environment mapping and other applications of world projections. IEEE Computer Graphics and Applications 6, 11 (1986 21 29.
12. Gokturk S., Yalcin H., Bamji C. : A time-of-flight depth sensor - system description, issues and solutions. In Proc. IEEE Comp. Vis. and Pat. Rec. Workshop (CVPRW'04) (2004 p. 35.
13. Heidrich W., Seidel H.-P. : Realistic, hardware-accelerated shading and lighting. In Proceedings of ACM SIGGRAPH (1999 pp. 171 178.
14. Iourcha K., Nayak K., Hong Z. : System and method for fixed-rate block-based image compression with inferred pixel values. United States Patent 5,956,431, 1999. S3 Incorporated (Santa Clara, USA).
15. Ihm I., Park S., Lee R. : Rendering of spherical light fields. In Proc. Pacific Graphics (1997 IEEE Computer Society, p. 59.
16. Levoy M., Hanrahan P. : Light field rendering. In Proc. ACM SIGGRAPH (1996 pp. 31 42.
17. Lindner M., Kolb A. : Lateral and depth calibration of PMD-distance sensors. In Advances in Visual Computing (2006 vol. 2, Springer, pp. 524 533.
18. Lindner M., Kolb A. : Data-fusion of PMD-based distance-information and high-resolution RGB-images. In Proc. of the Int. IEEE Symp. on Signals, Circuits & Systems (ISSCS) (2007 vol. 1, pp. 121 124.
19. Lindner M., Lambers M., Kolb A. : Data fusion and edge-enhanced distance refinement for 2D RGB and 3D range images. International Journal on Intelligent Systems and Technologies and Applications (IJISTA), Issue on Dynamic 3D Imaging (2008).
20. Levoy M., Pulli K., Curless B., Rusinkiewicz S., Koller D., Pereira L., Ginzton M., Anderson S., Davis J., Ginsberg J., Shade J., Fulk D. : The digital michelangelo project: 3d scanning of large statues. In SIGGRAPH'00: Proc. Conf. on Computer graphics and interactive techniques (2000 ACM Press/Addison-Wesley Publishing Co., pp. 131 144.
21. McMillan L., Bishop G. : Head-tracked stereoscopic display using image warping. In Proc. ACM SIGGRAPH (1995 pp. 39 46.
22. Miller G., Hoffman C. : Illumination and reflection maps: Simulated objects in simulated and real environments. In ACM SIGGRAPH Course Notes for Advanced Computer Graphics Animation (1984).
23. Oggier T., Büttgen B., Lustenberger F., Becker G., Rüegg B., Hodac A. : Swissranger™ SR3000 and first experiences based on miniaturized 3D-TOF cameras. In Proc. Range Imaging Research Day (2005 pp. 97 108.
24. Oliveira M. M., Bishop G., McAllister D. : Relief texture mapping. In SIGGRAPH'00: Proc. Conf. on Computer graphics and interactive techniques (2000 ACM Press/Addison-Wesley Publishing Co., pp. 359 368.
25. Prasad T., Hartmann K., Wolfgang W., Ghobadi S., Sluiter A. : First steps in enhancing 3D vision technique using 2D/3D sensors. In Computer Vision Winter Workshop 2006 (2006 Czech Society for Cybernetics and Informatics, pp. 82 86.
26. Policarpo F., Oliveira M. M., Jo A. L. D. C. : Real-time relief mapping on arbitrary polygonal surfaces. In I3D'05: Proc. Symposium on Interactive 3D graphics and games (2005 ACM, pp. 155 162.
27. Shum H.-Y., Chan S.-C., Kang S. B. : Image-Based Rendering. Springer, 2007.
28. Schirmacher H., Vogelgsang C., Seidel H.-P., Greiner G. : Efficient free form light field rendering. In VMV'01: Proc. Vision Modeling and Visualization (2001 Aka GmbH, pp. 249 256.
29. Todt S. S., Rezk-Salama C., Kolb A. : Real time fusion of range and light field images. In ACM SIGGRAPH 2005 Posters (2005 p. 65.
30. Vogelgsang C., Greiner G. : Adaptive lumigraph rendering with depth maps. Technical Report 3, IMMD 9, Universitaet Erlangen-Nuernberg (2000).
31. Vogelgsang C., Greiner G. : Ray-tracing in depth-maps for image-based rendering. Technical Report, IMMD 9, Universitaet Erlangen-Nuernberg (2001).
32. Wang J., Tong X., Snyder J., Chen Y., Guo B., Shum H.-Y. : Capturing and rendering geometry details for btf-mapped surfaces. The Visual Computer 21, 8-10 (2005 559 568.
33. Wang L., Wang X., Tong X., Lin S., Hu S., Guo B., Shum H.-Y. : View-dependent displacement mapping. ACM Transactions on Graphics 22, 3 (2003 334 339.
34. Yahav G., Iddan G. J., Mandelboum D. : 3D imaging camera for gaming application. Technical Report, 3DV Systems Ltd. (2006).