RPR-SORS: Real-time photorealistic rendering of synthetic objects into real scenes

Computers and Graphics (Pergamon)

Volumn 36, Issue 2, 2012, Pages 50-69

  Pessoa, Saulo A ^a   Moura, Guilherme De S ^a   Lima, Joao Paulo S Do M ^a   Teichrieb, Veronica ^a   Kelner, Judith ^a  

^a FEDERAL UNIVERSITY OF PERNAMBUCO   (Brazil)

Author keywords

Augmented reality; Authoring toolkit; Computer graphics; Photorealism; Pipeline

Indexed keywords

AUGMENTED REALITY; COLOR COMPUTER GRAPHICS; COMPUTER GRAPHICS; PIPELINES;

AUGMENTED REALITY APPLICATIONS; AUTHORING TOOLKIT; DEVELOPMENT PRODUCTIVITY; PERFORMANCE METRICS; PHOTOREALISM; PHOTOREALISTIC RENDERING; RENDERING PIPELINES; SPECULAR REFLECTIONS;

RENDERING (COMPUTER GRAPHICS);

EID: 84856844907     PISSN: 00978493     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cag.2011.12.003     Document Type: Conference Paper

References (64)

1. Sony Computer Entertainment. Eyepet TM, 2011. Available from: 〈 http://www.eyepet.com 〉.
2. Kakuta T, Oishi T, Ikeuchi K. Virtual kawaradera: fast shadow texture for augmented reality. In: Proceedings of international society on virtual systems and multimedia; 2008. p. 14150. doi:10.1.1.80.8246.
3. S. Gibson, J. Cook, T. Howard, and R. Hubbold Rapid shadow generation in real-world lighting environments Proceedings of the 14th Eurographics workshop on rendering (EGRW 03) 2003 Eurographics Association Aire-la-Ville, Switzerland 219 229 doi:10.1109/882404.882436. ISBN 3-905673-03-7
4. H.P.A. Lensch, M. Goesele, Y.Y. Chuang, T. Hawkins, S. Marschner, and W. Matusik Realistic materials in computer graphics ACM SIGGRAPH 2005 courses (SIGGRAPH 05) 2005 ACM New York, NY, USA 10.1145/1198555.1198601
5. Pessoa SA, Apolinário EL, Moura GdS, Lima JPSM, Teichrieb V, Kelner J. Illumination techniques for photorealistic rendering in augmented reality. In: Proceedings of the X symposium on virtual and augmented reality (SVR 08); 2008. p. 22332.
6. Pessoa SA, Moura GdS, Lima JPSM, Teichrieb V, Kelner J. A global illumination and BRDF solution applied to photorealistic augmented reality. In: Proceedings of the 2009 IEEE virtual reality conference. Washington, DC, USA: IEEE Computer Society: 2009. p. 2434. doi:10.1109/VR.2009.4811036. ISBN 978-1-4244-3943-0.
7. Pessoa S, Moura G, Lima J, Teichrieb V, Kelner J. Photorealistic rendering for augmented reality: a global illumination and BRDF solution. In: Virtual reality conference (VR). IEEE; 2010. p. 310. doi:10.1109/VR.2010. 5444836.
8. Moura GdS, Pessoa SA, Lima JPSM, Teichrieb V, Kelner J. RPR-SORS: an authoring toolkit for photorealistic AR. In: Proceedings of the XIII symposium on virtual and augmented reality (SVR 11); 2011. p. 17887. doi:10.1109/SVR.2011. 14.
9. Fournier A, Gunawan AS, Romanzin C. Common illumination between real and computer generated scenes. Technical Report, Vancouver, BC, Canada; 1992.
10. Drettakis G, Robert L, Bugnoux S. Interactive common illumination for computer augmented reality. In: 8th Eurographics workshop on rendering, Saint Etienne, France; 1997. p. 4556.
11. C. Loscos, M.C. Frasson, G. Drettakis, B. Walter, X. Granier, and P. Poulin Interactive virtual relighting and remodeling of real scenes D. Lischinski, G. Larson, Rendering techniques 99 (Proceedings of the 10th Eurographics workshop on rendering) vol. 10 1999 Springer-Verlag, Wien New York, USA 235 246
12. I. Sato, Y. Sato, and K. Ikeuchi Acquiring a radiance distribution to superimpose virtual objects onto a real scene IEEE Trans Vis Comput Graph 5 1 1999 1 12 10.1109/2945.764865
13. C. Loscos, G. Drettakis, and L. Robert Interactive virtual relighting of real scenes IEEE Trans Vis Comput Graph 6 4 2000 289 305 10.1109/2945.895874 (Pubitemid 32136389)
14. Debevec PE, Malik J. Recovering high dynamic range radiance maps from photographs. In: Proceedings of the 24th annual conference on computer graphics and interactive techniques (SIGGRAPH 97). ACM Press/Addison-Wesley Publishing Co.; 1997. 36978. doi:10.1145/258734.258884. ISBN 0-89791-896-7.
15. Debevec P. Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: Proceedings of the 25th annual conference on computer graphics and interactive techniques (SIGGRAPH 98). New York, NY, USA: ACM; 1998. p. 18998. doi:10.1145/280814.280864. ISBN 0-89791-999-8.
16. D.E. Breen, R.T. Whitaker, E. Rose, and M. Tuceryan Interactive occlusion and automatic object placement for augmented reality Comput Graph Forum 15 3 1996 11 22 10.1111/1467-8659.1530011
17. Wloka MM, Anderson BG. Resolving occlusion in augmented reality. In: Proceedings of the 1995 symposium on interactive 3D graphics (I3D 95). New York, NY, USA: ACM; 1995. p. 512. doi:10.1145/199404.199405. ISBN 0-89791-736-7.
18. J. Stauder Augmented reality with automatic illumination control incorporating ellipsoidal models IEEE Trans Multimedia 1 2 1999 136 143 10.1109/6046.766735
19. Kanbara M, Yokoya N. Real-time estimation of light source environment for photorealistic augmented reality. In: Proceedings of the 17th international conference on pattern recognition (ICPR 04), vol. 2; 2004. p. 9114. doi:10.1109/ICPR.2004.1334407.
20. Grosch T, Müller S, Kresse W. Goniometric light reconstruction for augmented reality image synthesis. In: Graphiktag 2003; 2003. p. 313.
21. Y. Wang, and D. Samaras Estimation of multiple directional light sources for synthesis of augmented reality images Graph Models 65 2003 185 205 10.1016/S1524-0703(03)00043-2 (Pubitemid 36984483)
22. Gibson S, Murta A, Interactive rendering with real-world illumination. In: Proceedings of the eurographics workshop on rendering techniques 2000. London, UK: Springer-Verlag; 2000. p. 36576. ISBN 3-211-83535-0.
23. T. Grosch, T. Eble, and S. Mueller Consistent interactive augmentation of live camera images with correct near-field illumination Proceedings of the 2007 ACM symposium on virtual reality software and technology (VRST 07) 2007 ACM New York, NY, USA 125 132 10.1145/1315184.1315207 ISBN 978-1-59593-863-3
24. Agusanto K, Li L, Chuangui Z, Sing NW, Photorealistic rendering for augmented reality using environment illumination. In: Proceedings of the 2nd IEEE/ACM international symposium on mixed and augmented reality (ISMAR 03). Washington, DC, USA: IEEE Computer Society; 2003. p. 208. ISBN 0-7695-2006-5.
25. Heymann S, Smolic A, Müller K, Froehlich B. Illumination reconstruction from real-time video for interactive augmented reality. In: 6th international workshop on image analysis for multimedia interactive services (WIAMIS), 2005.
26. Hughes C, Konttinen J, Pattanaik S. The future of mixed reality: issues in illumination and shadows. In: Proceedings of the interservice/industry training, simulation & education conference (I/ITSEC); 2004.
27. Nishina Y, Okumura B, Kanbara M, Yokoya N. Photometric registration by adaptive high dynamic range image generation for augmented reality. In: 7th IEEE/ACM international symposium on mixed and augmented reality (ISMAR 08); 2008. p. 536. doi:10.1109/ISMAR.2008.4637323.
28. Jensen T, Andersen MS, Madsen CB. Real-time image based lighting for outdoor augmented reality under dynamically changing illumination conditions. In: Proceedings of the international conference graphics theory and applications; 2006. p. 36471.
29. Y. Feng Estimation of light source environment for illumination consistency of augmented reality Congress on image and signal processing 3 2008 771 775 10.1109/CISP.2008.87
30. Madsen CB, Nielsen M. Towards probe-less augmented reality. In: Proceedings of the international conference on graphics theory and applications (GRAPP); 2008. p. 25561.
31. Haller M, Drab S, Hartmann W, A real-time shadow approach for an augmented reality application using shadow volumes. In: Proceedings of the ACM symposium on virtual reality software and technology (VRST 03). New York, NY, USA: ACM; 2003. p. 5665. doi:10.1145/1008653.1008665. ISBN 1-58113-569-6.
32. Madsen CB. Using real shadows to create virtual ones. In: Proceedings of the 13th Scandinavian conference image analysis, 2003. p. 8207.
33. Jacobs K, Nahmias JD, Angus C, Reche A, Loscos C, Steed A. Automatic generation of consistent shadows for augmented reality. In: Proceedings of graphics interface 2005 (GI 05). School of Computer Science, University of Waterloo, Waterloo, Ontario, Canada: Canadian HumanComputer Communications Society; 2005. p. 11320, ISBN 1-56881-265-5.
34. P. Supan, I. Stuppacher, and M. Haller Image based shadowing in real-time augmented reality Int J Virtual Reality 5 3 2006 1 7
35. Madsen CB, Laursen RE. A scalable GPU-based approach to shading and shadowing for photorealistic real-time augmented reality. In: Proceedings of computer graphics theory and applications; 2007. p. 25261.
36. Frahm JM, Koeser K, Grest D, Koch R. Markerless augmented reality with light source estimation for direct illumination. In: Proceedings of the 2nd IEE European conference on visual media production (CVMP 05); 2005. p. 21120.
37. Bimber O, Grundhöfer A, Wetzstein G, Knödel S, Consistent illumination within optical see-through augmented environments. In: Proceedings of the 2nd IEEE/ACM international symposium on mixed and augmented reality (ISMAR 03). Washington, DC, USA: IEEE Computer Society; 2003. p. 198. ISBN 0-7695-2006-5.
38. Bradley D, Roth G. Augmenting non-rigid objects with realistic lighting. Technical Report, NRC Institute for Information Technology; 2004.
39. D. Bradley, G. Roth, and Bose Augmented reality on cloth with realistic illumination Mach Vision Appl 20 2 2009 85 92 10.1007/s00138-007-0108-9
40. Grosch T. Panoar: interactive augmentation of omni-directional images with consistent lighting. In: Proceedings of MIRAGE; 2005. p. 2534.
41. Okumura B, Kanbara M, Yokoya N. Augmented reality based on estimation of defocusing and motion blurring from captured images. In: Proceedings of the 5th IEEE and ACM international symposium on mixed and augmented reality (ISMAR 06). Washington, DC, USA: IEEE Computer Society; 2006. p. 21925. doi:10.1109/ISMAR. 2006.297817. ISBN 1-4244-0650-1.
42. Scheer F, Abert O, Muller S. Towards using realistic ray tracing in augmented reality applications with natural lighting. In: Proceedings of the 4th workshop virtual and augmented reality of the GI-group (VR/AR); 2007.
43. Microsoft. The directx software development kit, 2011. Available from 〈 http://msdn.microsoft.com/en-us/library/ee416398(v=VS.85).aspx 〉.
44. Ramamoorthi R, Hanrahan P. An efficient representation for irradiance environment maps. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques (SIGGRAPH 01). New York, NY, USA: ACM; 2001. p. 497500. doi:10.1145/383259.383317. ISBN 1-58113-374-X.
45. G. King Real-time computation of dynamic irradiance environment maps GPU Gems 2 2005 Addison-Wesley 167 176
46. L. Wan, T.T. Wong, and C.S. Leung Isocube: exploiting the cubemap hardware IEEE Trans Vis Comput Graph 13 4 2007 720 731 10.1109/TVCG.2007.1020 (Pubitemid 47304020)
47. University of Southern California. HDR shop, 2011. Available from 〈 http://gl.ict.usc.edu/HDRShop 〉.
48. J. Hensley, T. Scheuermann, G. Coombe, M. Singh, and A. Lastra Fast summed-area table generation and its applications Comput Graph Forum 24 3 2005 547 555 10.1111/j.1467-8659.2005.00880.x (Pubitemid 43934672)
49. Mikkelsen M. Simulation of wrinkled surfaces revisited. Master thesis, Department of Computer Science at the University of Copenhagen; 2008.
50. Lafortune EPF, Foo SC, Torrance KE, Greenberg DP. Non-linear approximation of reflectance functions. In: Proceedings of the 24th annual conference on computer graphics and interactive techniques (SIGGRAPH 97). New York, NY, USA: ACM Press, Addison-Wesley Publishing Co.; 1997. p. 11726. doi:10.1145/258734.258801. ISBN 0-89791-896-7.
51. McAllister DK, Lastra A, Heidrich W. Efficient rendering of spatial bi-directional reflectance distribution functions. In: Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on graphics hardware (HWWS 02). Aire-la-Ville, Switzerland: Eurographics Association; 2002. p. 7988. ISBN 1-58113-580-7.
52. Foo SC. A gonioreflectometer for measuring the bidirectional reflectance of material for use in illumination computation. Master thesis. Cornell University, Ithaca, NY, USA; 1997
53. R. Fernando, and M.J. Kilgard Environment mapping techniques The Cg tutorial 2003 Addison-Wesley 162 188
54. Debevec, P. A median cut algorithm for light probe sampling. In: ACM SIGGRAPH 2008 classes (SIGGRAPH 08). New York, NY, USA: ACM; 2008. pp. 13. doi:10.1145/1401132.1401176.
55. Fernando R, Percentage-closer soft shadows. In: ACM SIGGRAPH 2005 sketches. SIGGRAPH 05. New York, NY, USA: ACM; 2005. p. 35. doi:10.1145/1187112. 1187153.
56. Wyman C, Hansen C. Penumbra maps: approximate soft shadows in real-time. In: Proceedings of the 14th eurographics workshop on rendering (EGRW 03). Aire-la-Ville, Switzerland: Eurographics Association; 2003. p. 2027. ISBN 3-905673-03-7.
57. Kawase M. RTHDRIBL - real-time high dynamic range image-based lighting; 2011. Available from 〈 http://www.daionet.gr.jp/∼masa/rthdribl 〉.
58. E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda Photographic tone reproduction for digital images ACM Trans Graph 21 3 2002 267 276 10.1145/566654.566575
59. OGRE, OGRE - open source 3d graphics engine; 2011. Available from 〈 http://www.ogre3d.org 〉.
60. Farias T, Lima JPSM, Teichrieb V, Kelner J. OGREAR: construction of augmented reality applications using high-level libraries. Technical Report, Federal University of Pernambuco, Recife, Pernambuco; 2007.
61. Laboratory CD. Handheld AR project; 2011. Available from 〈 http://studierstube.icg.tu-graz.ac.at/handheld-ar/artoolkitplus.php 〉.
62. wxWidgets Team, wxWidgets cross-platform GUI library; 2011. Available from 〈 http://www.wxwidgets.org 〉.
63. J.P.S. do Monte Lima, F.P.M. Simoes, L.S. Figueiredo, and J. Kelner Model based markerless 3D tracking applied to augmented reality SBC J 3D Interact Syst 1 2010 2 15
64. S. DiVerdi, J. Wither, and T. Höllerer All around the map: online spherical panorama construction Comput Graph 33 1 2009 73 84 10.1016/j.cag.2008.11.002