Real-time illumination estimation from faces for coherent rendering

ISMAR 2014 - IEEE International Symposium on Mixed and Augmented Reality - Science and Technology 2014, Proceedings

Volumn , Issue , 2014, Pages 113-122

  Knorr, Sebastian B ^a   Kurz, Daniel ^a  

^a Metaio GmbH   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

AUGMENTED REALITY; CAMERAS; LIGHTING;

AUGMENTED REALITY APPLICATIONS; ILLUMINATION ESTIMATION; LIGHTING CONDITIONS; MONOCULAR CAMERAS; OPTICAL TRACKING; SPATIAL RELATIONSHIPS; SPHERICAL HARMONICS; VISUAL APPEARANCE;

RENDERING (COMPUTER GRAPHICS);

EID: 84943792876     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISMAR.2014.6948416     Document Type: Conference Paper

References (37)

1. E. H. Adelson and J. R. Bergen. The Plenoptic Function and the Elements of Early Vision. Computational Models of Visual Processing, 1(2):3-20, 1991.
2. M. Aittala. Inverse lighting and photorealistic rendering for augmented reality. The Visual Computer, 26(6-8):669-678, 2010.
3. I. Arief, S. McCallum, and J. Y. Hardeberg. Realtime Estimation of Illumination Direction for Augmented Reality on Mobile Devices. In Color and Imaging Conference, 2012.
4. R. Basri and D. W. Jacobs. Lambertian Reflectance and Linear Subspaces. TPAMI, 25(2):218-233, 2003.
5. V. Blanz and T. Vetter. A Morphable Model For The Synthesis Of 3D Faces. In Proc. SIGGRAPH, 1999.
6. D. A. Calian, K. Mitchell, D. Nowrouzezahrai, and J. Kautz. The Shading Probe: Fast Appearance Acquisition for Mobile AR. In SIGGRAPH Asia 2013 Technical Briefs, page 20, 2013.
7. P. Debevec. Rendering Synthetic Objects into Real Scenes: Bridging Traditional and Image-based Graphics with Global Illumination and High Dynamic Range Photography. In Proc. SIGGRAPH, 1998.
8. P. Debevec, T. Hawkins, C. Tchou, H.-P. Duiker, W. Sarokin, and M. Sagar. Acquiring the Reflectance Field of a Human Face. In Proc. SIGGRAPH, 2000.
9. R. Epstein, P. W. Hallinan, and A. L. Yuille. 5-2 Eigenimages Suffice: An Empirical Investigation of Low-Dimensional Lighting Models. In Proc. Workshop on Physics-Based Modeling in Computer Vision, 1995.
10. A. Fournier, A. S. Gunawan, and C. Romanzin. Common Illumination between Real and Computer Generated Scenes. In Graphics Interface, 1993.
11. M. Fuchs, V. Blanz, H. Lensch, and H.-P. Seidel. Reflectance from Images: A Model-Based Approach for Human Faces. TVCG, 11(3):296-305, 2005.
12. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman. From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose. TPAMI, 23(6):643-660, 2001.
13. R. Green. Spherical Harmonic Lighting: The Gritty Details. In Archives of the Game Developers Conference, 2003.
14. L. Gruber, T. Richter-Trummer, and D. Schmalstieg. Real-Time Photometric Registration from Arbitrary Geometry. In Proc. ISMAR, 2012.
15. J. Jachnik, R. A. Newcombe, and A. J. Davison. Real-Time Surface Light-field Capture for Augmentation of Planar Specular Surfaces. In Proc. ISMAR, 2012.
16. J. T. Kajiya. THE RENDERING EQUATION. In ACM Siggraph Computer Graphics, volume 20, 1986.
17. M. Kanbara and N. Yokoya. Real-time Estimation of Light Source Environment for Photorealistic Augmented Reality. In Proc. ICPR, 2004.
18. A. Keller. Instant Radiosity. In Proc. SIGGRAPH, pages 49-56, 1997.
19. G. Klein and D. W. Murray. Simulating Low-Cost Cameras for Augmented Reality Compositing. TVCG, 16(3):369-380, 2010.
20. M. Knecht, C. Traxler, O. Mattausch, and M. Wimmer. Reciprocal Shading for Mixed Reality. C&G, 36:846-856, 2012.
21. K.-C. Lee, J. Ho, and D. J. Kriegman. Acquiring Linear Subspaces for Face Recognition under Variable Lighting. TPAMI, 27(5):684-698, 2005.
22. X. Liu, P.-P. Sloan, H.-Y. Shum, and J. Snyder. All-Frequency Precomputed Radiance Transfer for Glossy Objects. In Proc. EG, 2004.
23. S. R. Marschner and D. P. Greenberg. Inverse Lighting for Photography. In Color and Imaging Conference, 1997.
24. M. Meilland, C. Barat, and A. Comport. 3D High Dynamic Range Dense Visual SLAM and Its Application to Real-time Object Relighting. In Proc. ISMAR, 2013.
25. E. Nakamae, K. Harada, T. Ishizaki, and T. Nishita. A Montage Method: The Overlaying of The Computer Generated Images onto a Background Photograph. In ACM SIGGRAPH, volume 20, 1986.
26. F. Nicodemus, J. Richmond, J. Hsia, I. Ginsberg, and T. Limperis. Geometrical Considerations and Nomenclature for Reflectance. Final Report National Bureau of Standards, 1, 1977.
27. K. Nishino and S. K. Nayar. Eyes for Relighting. In ACM Transactions on Graphics (TOG), volume 23, pages 704-711, 2004.
28. L. Qing, S. Shan, and W. Gao. Eigen-Harmonics Faces: Face Recognition under Generic Lighting. In Proc. Int. Conf. on Automatic Face and Gesture Recognition, 2004.
29. R. Ramamoorthi. Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object. TPAMI, 24(10):1322-1333, 2002.
30. R. Ramamoorthi. Modeling Illumination Variation with Spherical Harmonics. Face Processing: Advanced Modeling Methods, pages 385-424, 2006.
31. R. Ramamoorthi and P. Hanrahan. A signal-processing framework for inverse rendering. In Proc. SIGGRAPH, 2001.
32. I. Sato, Y. Sato, and K. Ikeuchi. Acquiring a Radiance Distribution to Superimpose Virtual Objects onto a Real Scene. TVCG, 5(1):1-12, 1999.
33. T. Sim and T. Kanade. Illuminating the Face. Technical Report CMURI-TR-01-31, Robotics Institute, 2001.
34. P.-P. Sloan. Stupid Spherical Harmonics (SH) Tricks. In Game Developers Conference, volume 9, 2008.
35. Y. Yao, H. Kawamura, and A. Kojima. The Hand as a Shading Probe. In ACM SIGGRAPH 2013 Posters, page 108, 2013.
36. L. Zhang and D. Samaras. Face Recognition Under Variable Lighting using Harmonic Image Exemplars. In Proc. CVPR, 2003.
37. L. Zhang, S. Wang, and D. Samaras. Face Synthesis and Recognition from a Single Image under Arbitrary Unknown Lighting using a Spherical Harmonic Basis Morphable Model. In Proc. CVPR, 2005.