Compositing images through light source detection

Computers and Graphics (Pergamon)

Volumn 34, Issue 6, 2010, Pages 698-707

  Lopez Moreno, Jorge ^a   Hadap, Sunil ^b   Reinhard, Erik ^c   Gutierrez, Diego ^a  

^a UNIVERSITY OF ZARAGOZA   (Spain)

^b ADOBE RESEARCH   (United States)

^c UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

Image compositing; Light detection; Psychophysics; Relighting

Indexed keywords

AUGMENTED REALITY; LIGHT SOURCES;

HUMAN VISUAL SYSTEMS; IMAGE COMPOSITING; LIGHT CONDITIONS; LIGHT DETECTION; PSYCHOPHYSICAL STUDIES; PSYCHOPHYSICS; RELIGHTING; SOURCE DETECTION;

IMAGE PROCESSING;

EID: 78649515936     PISSN: 00978493     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cag.2010.08.004     Document Type: Conference Paper

References (49)

1. P. Debevec Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography SIGGRAPH '98: proceedings of the 25th annual conference on computer graphics and interactive techniques 1998 ACM New York, NY, USA 189 198 doi: 〈 http://doi.acm.org/10.1145/280814.280864 〉
2. K. Jacobs, A.H. Nielsen, J. Vesterbaek, and C. Loscos Coherent radiance capture of scenes under changing illumination conditions for relighting applications The Visual Computer 26 3 2010 171 185 doi: 〈 http://dx.doi.org/10.1007/s00371-009-0360-2 〉
3. S. Gibson, T. Howard, and R. Hubbold Flexible image-based photometric reconstruction using virtual light sources Computer Graphics Forum 19 3 2001 C203 C214
4. Madsen CB, Nielsen M. Towards probe-less augmented realitya position paper. In: GRAPP, 2008. p. 25561.
5. R. Zhang, P. Tsai, J. Cryer, and M. Shah Shape from shading: a survey IEEE Transactions on Pattern Analysis and Machine Intelligence 28 8 1999 690 706
6. Oh BM, Chen M, Dorsey J, Durand F. Image-based modeling and photo editing. In: SIGGRAPH '01: proceedings of the 28th annual conference on computer graphics and interactive techniques, 2001. p. 43342.
7. Lalonde J-F, Hoiem D, Efros AA, Rother C, Winn J, Criminisi A. Photo clip art. ACM Transactions on Graphics (SIGGRAPH 2007) 2007;26(3).
8. A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Colburn, and B. Curless Interactive digital photomontage ACM Transactions on Graphics 23 3 2004 294 302
9. N. Snavely, S.M. Seitz, and R. Szeliski Photo tourism: exploring photo collections in 3d ACM Transactions on Graphics 25 3 2006 835 846
10. A. Pentland Finding the illuminant direction Journal of the Optical Society of America A 72 4 1982 448 455
11. Brooks M, Horn B. Shape and source from shading. In: Proceedings of the international joint conference on artificial intelligence, 1985. p. 9326.
12. C. Lee, and A. Rosenfeld Improved methods of estimated shape from shading using the light source coordinate system B. Horn, M. Brooks, Shape from shading 1989 MIT Press 323 569
13. B. Horn Robot vision 1986 McGraw-Hill
14. Nillius P, Eklundh J-O. In: CVPR, 2001. p. I:107683 〈 citeseer.ist.psu.edu/nillius01automatic.html 〉.
15. J.J. Koenderink, and S.C. Pont Irradiation direction from texture Journal of the Optical Society of America 20 10 2003 1875 1882
16. Varma M, Zisserman A. Estimating illumination direction from textured images. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Washington, DC, vol. 1, 2004. p. 17986.
17. Hougen D, Ahuja N. Estimation of the light source distribution and its use in integrated shape recovery from stereo shading. In: ICCV, 1993. p. 2934.
18. Y. Zhang, and Y.-H. Yang Multiple illuminant direction detection with application to image synthesis IEEE Transactions on Pattern Analysis and Machine Intelligence 23 8 2001 915 920 doi: 〈 http://dx.doi.org/10.1109/34.946995 〉
19. M. Powell, S. Sarkar, and D. Goldgof A simple strategy for calibrating the geometry of light sources IEEE Transactions on Pattern Analysis and Machine Intelligence 23 9 2001 1022 1027 doi: 〈 http://doi.ieeecomputersociety.org/ 10.1109/34.955114 〉
20. P. Lagger, and P. Fua Using specularities to recover multiple light sources in the presence of texture ICPR '06: proceedings of the 18th international conference on pattern recognition 2006 IEEE Computer Society Washington, DC, USA 587 590 doi: 〈 http://dx.doi.org/10.1109/ICPR.2006.1156 〉
21. W. Zhou, and C. Kambhamettu Estimation of illuminant direction and intensity of multiple light sources ECCV'02: proceedings of the seventh European conference on computer visionpart IV 2002 Springer-Verlag London, UK 206 220
22. K. Nishino, and S.K. Nayar Eyes for relighting ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH) 23 3 2004 704 711
23. Marschner SR, Greenberg DP. Inverse lighting for photography. In: Fifth IST/SID color imaging conference, 1997. p. 2625.
24. Wang Y, Samaras D. Estimation of multiple illuminants from a single image of arbitrary known geometry. In: ECCV02, vol. 3, 2002. p. 27288.
25. Sato I, Sato Y, Ikeuchi K. Illumination distribution from brightness in shadows: adaptive estimation of illumination distribution with unknown reflectance properties in shadow regions. In: International conference on computer vision (ICCV), vol. 2, 1999. p. 87582.
26. Dror RO, Leung TK, Adelson EH, Willsky AS. Statistics of real-world illumination. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Kauai, Hawaii, 2001.
27. Pouli T, Cunningham D, Reinhard E. EUROGRAPHICS 2010 STAR: image statistics and their applications in computer graphics, 2010.
28. R.O. Dror, A.S. Willsky, and E.H. Adelson Statistical characterization of real-world illumination Journal of Vision 4 2004 821 837
29. A.A. Mury, S.C. Pont, and J.J. Koenderink Light field constancy within natural scenes Applied Optics 46 29 2007 7308 7316
30. M.S. Langer, and H.H. Blthoff A prior for global convexity in local shape-from-shading Perception 30 2001 403 410
31. Y. Ostrovsky, P. Cavanagh, and P. Sinha Perceiving illumination inconsistencies in scenes Perception 34 2005 1301 1314
32. J Enns, and R. Rensik Influence of scene-based properties on visual search Science 247 1990 721 723
33. D. Kleffner, and V. Ramachandran On the perception of shape from shading Perception and Psychophysics 52 1992 18 36
34. Lopez-Moreno J, Sangorrin F, Latorre P, Gutierrez D. Where are the lights? Measuring the accuracy of human vision. In: CEIG '09: Congreso Espaol de Informtica Grfica, 2009. p. 14552.
35. J. Lopez-Moreno, V. Sundstedt, F. Sangorrin, and D. Gutierrez Measuring the perception of light inconsistencies APGV '10: proceedings of the seventh symposium on applied perception in graphics and visualization 2010 ACM 25 32
36. J.J. Koenderink, A.J. van Doorn, and S.C. Pont Light direction from shad(ow)ed random Gaussian surfaces Perception 33 12 2004 1405 1420
37. J. Wang, M. Agrawala, and M. Cohen Soft scissors: an interactive tool for realtime high quality matting ACM Transactions on Graphics 26 3 2007
38. E.A. Khan, E. Reinhard, R. Fleming, and H. Blthoff Image-based material editing ACM Transactions on Graphics (SIGGRAPH 2006) 25 3 2006 654 663
39. Yang Y, Yuille A. Sources from shading. In: Computer vision and pattern recognition, 1991. p. 5349.
40. E. Vega, and Y.-H. Yang Default shape theory: with the application to the computation of the direction of the light source Journal of the Optical Society of America A 60 1994 285 299
41. J. Jia, J. Sun, C.-K. Tang, and H.-Y. Shum Drag-and-drop pasting SIGGRAPH '06: ACM SIGGRAPH 2006 papers 2006 ACM New York, NY, USA 631 637 doi: 〈 http://doi.acm.org/10.1145/1179352.1141934 〉
42. E. Reinhard, M. Ashikhmin, B. Gooch, and P. Shirley Color transfer between images IEEE Computer Graphics and Applications 21 5 2001 34 41
43. Igarashi T, Matsuoka S, Tanaka H. Teddy: a sketching interface for 3d freeform design. In: SIGGRAPH '99: proceedings of the 26th annual conference on computer graphics and interactive techniques, 1999. p. 40916.
44. D. Gutierrez, J. Lopez-Moreno, J. Fandos, F. Seron, M. Sanchez, and E. Reinhard Depicting procedural caustics in single images ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) 27 5 2008 1201 1209
45. Tomasi C, Manduchi R. Bilateral filtering for gray and color images. In: Proceedings of the IEEE international conference on computer vision, 1998. p. 83646.
46. J. Foley, A. van Dam, S. Feiner, and J. Hughes Computer graphics principles and practice 2nd ed 1990 Addison-Wesley
47. D. Samaras, and D. Metaxas Coupled lighting direction and shape estimation from single images ICCV '99: proceedings of the international conference on computer vision vol. 2 1999 IEEE Computer Society Washington, DC, USA 868
48. J.-D. Durou, M. Falcone, and M. Sagona Numerical methods for shape-from-shading: a new survey with benchmarks Computer Vision and Image Understanding 109 1 2008 22 43
49. M.F. Tappen, W.T. Freeman, and E.H. Adelson Recovering intrinsic images from a single image IEEE Transactions on Pattern Analysis and Machine Intelligence 27 9 2005 1459 1472