Consistent interactive augmentation of live camera images with correct near-field illumination

Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST

Volumn , Issue , 2007, Pages 125-132

  Grosch, Thorsten ^a   Eble, Tobias ^b   Mueller, Stefan ^b  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^b University of Koblenz Landau ^*  (Germany)

Author keywords

augmented image synthesis; global illumination

Indexed keywords

ACTIVE AREA; AUGMENTED IMAGES; CAMERA IMAGES; FAR-FIELD; FISH-EYE LENS; GLOBAL ILLUMINATION; HIGH DYNAMIC RANGE; IMPORTANCE SAMPLING; INCOMING LIGHT; INTERACTIVE FRAME RATES; LIVE CAMERA; NEAR-FIELD; OBJECT MOVEMENTS; REAL OBJECTS; REAL-TIME UPDATES; SHADOW MAPS; VIRTUAL OBJECTS;

MAPS; USER INTERFACES; VIRTUAL REALITY;

CAMERAS;

EID: 77949798514     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1315184.1315207     Document Type: Conference Paper

References (42)

1. AGUSANTO, K., LI, L., CHUANGUI, Z., AND SING, N. W. 2003. Photorealistic rendering for augmented reality using environment illumination. In ISMAR, 208-216.
2. ANNEN, T., KAUTZ, J., DURAND, F., AND SEIDEL, H.-P. 2004. Spherical Harmonic Gradients for Mid-Range Illumination. In Proceedings of the Eurographics Symposium on Rendering, 331-336.
3. DEBEVEC, P. 1998. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proc. SIGGRAPH '98, 189-198.
4. DMITRIEV, K., ANNEN, T., KRAWCZYK, G., MYSZKOWSKI, K., AND SEIDEL, H.-P. 2004. A cave system for interactive modeling of global illumination in car interior. In ACM Symposium on Virtual Reality Software and Technology (VRST 2004), ACM, Hong Kong, R. Lau and G. Baciu, Eds., 137-145.
5. DRETTAKIS, G., ROBERT, L., AND BOUGNOUX, S. 1997. Interactive common illumination for computer augmented reality. In Eighth Eurographics Workshop on Rendering, 45-56.
6. FOURNIER, A., GUNAVAN, A., AND ROMANZIN, C. 1993. Common illumination between real and computer generated scenes. In Proc. of Graphics Interface 1993, 254-262.
7. GIBSON, S., AND HOWARD, T. 2000. Interactive reconstruction of virtual environments from photographs, with application to scene-of-crime analysis. In Proc. of ACM Symposium on Virtual Reality Software and Technology 2000, Seoul, Korea, October 2000, 41-48.
8. GIBSON, S., AND MURTA, A. 2000. Interactive rendering with real-world illumination. In Eleventh Eurographics Workshop on Rendering, 365-376.
9. GIBSON, S., COOK, J., HOWARD, T., AND HUBBOLD, R. 2003. Rapid shadow generation in real-world lighting environments. In Eurographics Symposium on Rendering, 219-229.
10. GOESELE, M., GRANIER, X., HEIDRICH, W., AND SEIDEL, H.-P. 2003. Accurate light source acquisition and rendering. In SIGGRAPH '03: ACM SIGGRAPH 2003 Papers, ACM Press, New York, NY, USA, 621-630.
11. GREGER, G., SHIRLEY, P., HUBBARD, P. M., AND GREENBERG, D. P. 1998. The irradiance volume. IEEE Computer Graphics and Applications 18, 2, 32-43.
12. GROSCH, T., MUELLER, S., AND KRESSE, W. 2003. Goniometric light reconstruction for augmented reality image synthesis. In Graphiktag im Rahmen der GI Jahrestagung, Frankfurt am Main,.
13. GROSCH, T. 2005. Differential photon mapping: Consistent augmentation of photographs with correction of all light paths. In Eurographics 2005, Trinity College, Dublin, Ireland.
14. GROSCH, T. 2005. PanoAR: Interactive augmentation of omni-directional images with consistent lighting. In Mirage 2005, Computer Vision / Computer Graphics Collaboration Techniques and Applications, 25-34.
15. HALLER, M., DRAB, S., AND HARTMANN, W. 2003. A real-time shadow approach for an augmented reality application using shadow volumes. In VRST '03: Proceedings of the ACM symposium on Virtual reality software and technology, ACM Press, New York, NY, USA, 56-65.
16. HARTLEY, R., AND ZISSERMAN, A. 2004. Multiple View Geometry in Computer Vision. Cambridge University Press.
17. HASAN, M., PELLACINI, F., AND BALA, K. 2006. Direct-to-Indirect Transfer for Cinematic Relighting. ACM Trans. Graph. 25, 3, 1089-1097.
18. HAVRAN, V., SMYK, M., KRAWCZYK, G., MYSZKOWSKI, K., AND SEIDEL, H.-P. 2005. Importance Sampling for Video Environment Maps. In Eurographics Symposium on Rendering 2005, ACM SIGGRAPH, Konstanz, Germany, K. Bala and P. Dutré, Eds., 31-42.
19. HOEFFLINGER, B. 2007. High-Dynamic-Range (HDR) Vision: Microelectronics, Image Processing, Computer Graphics (Springer Series in Advanced Microelectronics). Springer-Verlag New York, Inc., Secaucus, NJ, USA.
20. KANBARA, M., AND YOKOYA, N. 2002. Geometric and photometric registration for real-time augmented reality. In In IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR) (September 2002), 279.
21. KANBARA, M., AND YOKOYA, N. 2004. Real-time estimation of light source environment for photorealistic augmented reality. In ICPR (2), 911-914.
22. KATO, H., AND BILLINGHURST, M. 1999. Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In Proceedings of the 2nd International Workshop on Augmented Reality (IWAR 99).
23. KONTKANEN, J., AND LAINE, S. 2006. Sampling precomputed volumetric lighting. Journal of Graphics Tools 11, 3.
24. KONTKANEN, J., TURQUIN, E., HOLZSCHUCH, N., AND SILLION, F. X. 2006. Wavelet Radiance Transport for Interactive Indirect Lighting. In 17th Eurographics Symposium on Rendering, 161-172.
25. KORN, M., STANGE, M., VON ARB, A., BLUM, L., KREIL, M., KUNZE, K., ANHENN, J., WALLRATH, T., AND GROSCH, T. 2006. Interactive augmentation of live images using a HDR stereo camera. In Dritter Workshop Virtuelle und Erweiterte Realitt der GI-Fachgruppe VR/AR, vol. 3, 107-118.
26. KRAWCZYK, G., GOESELE, M., AND SEIDEL, H.-P. 2005. Photometric calibration of high dynamic range cameras. Research Report MPI-I-2005-4-005, Max-Planck-Institut für Informatik, Stuhlsatzenhausweg 85, 66123 Saarbrücken, Germany, April.
27. KRISTENSEN, A.W., AKENINE-MLLER, T., AND JENSEN, H.W. 2005. Precomputed Local Radiance Transfer for Real-Time Lighting Design. ACM Trans. Graph. 24, 3, 1208-1215.
28. LOSCOS, C., FRASSON, M., DRETTAKIS, G., WALTER, B., GRANIER, X., AND POULIN, P. 1999. Interactive virtual relighting and remodeling of real scenes. In Tenth Eurographics Workshop on Rendering, 329-340.
29. MANTIUK, R., PATTANAIK, S., AND MYSZKOWSKI, K. 2002. Cube-map data structure for interactive global illumination computation in dynamic diffuse environments. In ICCVG.
30. NAKAMAE, E., HARADA, K., ISHIZAKI, T., AND NISHITA, T. 1986. A montage method: The overlaying of the computer generated images onto a background photograph. In Computer Graphics (Proceedings of SIGGRAPH 86), 207-214.
31. NG, R., RAMAMOORTHI, R., AND HANRAHAN, P. 2003. All-frequency shadows using non-linear wavelet lighting approximation. ACM Trans. Graph. 22, 3, 376-381.
32. NIJASURE, M., PATTANAIK, S. N., AND GOEL, V. 2005. Real-time global illumination on GPUs. journal of graphics tools 10, 2, 55-71.
33. NIMEROFF, J. S., SIMONCELLI, E., AND DORSEY, J. 1994. Efficient Re-rendering of Naturally Illuminated Environments. In Fifth Eurographics Workshop on Rendering, Springer-Verlag, Darmstadt, Germany, 359-373.
34. PEREZ, R., SEALS, R., AND MICHALSKY, J. 1993. All-weather model for sky luminance distribution-preliminary configuration and validation. In Solar Energy 50, 3, 235-245.
35. PHARR, M., AND HUMPHREYS, G. 2004. Physically Based Rendering : From Theory to Implementation. Morgan Kaufmann, August.
36. RAMAMOORTHI, R., AND HANRAHAN, P. 2001. An efficient representation for irradiance environment maps. In SIGGRAPH, 497-500.
37. REINHARD, E., WARD, G., PATTANAIK, S., AND DEBEVEC, P. 2005. High Dynamic Range Imaging: Acquisition, Display and Image-Based Lighting. Morgan Kaufmann Publishers, Dec.
38. RITSCHEL, T., AND GROSCH, T. 2006. On-line estimation of diffuse materials. In Dritter Workshop Virtuelle und Erweiterte Realitt der GI-Fachgruppe VR/AR, vol. 3, 95-106.
39. SATO, I., SATO, Y., AND IKEUCHI, K. 1999. Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Trans. Vis. Comput. Graph. 5, 1, 1-12.
40. SILLION, F. X., AND PUECH, C. 1994. Radiosity and Global Illumination. Morgan Kaufmann Publishers, Inc., San Francisco, California.
41. SLOAN, P.-P. J., KAUTZ, J., AND SNYDER, J. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. ACM Trans. Graph. 21, 3, 527-536.
42. WILLIAMS, L. 1978. Casting curved shadows on curved surfaces. In SIGGRAPH '78: Proceedings of the 5th annual conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, 270-274.