Rendering synthetic objects into legacy photographs

ACM Transactions on Graphics

Volumn 30, Issue 6, 2011, Pages

  Karsch, Kevin ^a   Hedau, Varsha ^a   Forsyth, David ^a   Hoiem, Derek ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Computational photography; Image based rendering; Light estimation; Photo editing

Indexed keywords

COMPUTATIONAL PHOTOGRAPHY; CONTENT CREATION; DATA SETS; GROUND TRUTH; IMAGE-BASED RENDERING; INSERTION METHODS; PHOTOEDITING; PHYSICAL MODEL; REAL SCENES; SINGLE IMAGES; SYNTHETIC IMAGES; USER STUDY;

IMAGE RECONSTRUCTION;

COLOR PHOTOGRAPHY;

EID: 82455162641     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2024156.2024191     Document Type: Article

References (48)

1. ALNASSER, M., AND FOROOSH, H. 2006. Image-based rendering of synthetic diffuse objects in natural scenes. In ICPR, 787-790. (Pubitemid 46553538)
2. BARROW, H., AND TENENBAUM, J. 1978. Recovering intrinsic scene characteristics from images. In Comp. Vision Sys., 3-26.
3. BLAKE, A. 1985. Boundary conditions for lightness computation in mondrian world. Computer Vision, Graphics and Image Processing 32, 314-327. (Pubitemid 16459911)
4. BOIVIN, S., AND GAGALOWICZ, A. 2001. Image-based rendering of diffuse, specular and glossy surfaces from a single image. In Proc. ACM SIGGRAPH, 107-116. (Pubitemid 33047295)
5. BRELSTAFF, G., AND BLAKE, A. 1987. Computing lightness. Pattern Recognition Letters 5, 2, 129-138.
6. CARROLL, R., RAMAMOORTHI, R., AND AGRAWALA, M. 2011. Illumination decomposition for material recoloring with consistent interreflections. ACM Trans. Graph. 30 (August), 43:1- 43:10.
7. COSSAIRT, O., NAYAR, S., AND RAMAMOORTHI, R. 2008. Light field transfer: global illumination between real and synthetic objects. ACM Trans. Graph. 27 (August), 57:1-57:6.
8. CRIMINISI, A., REID, I., AND ZISSERMAN, A. 2000. Single view metrology. Int. J. Comput. Vision 40 (November), 123-148. (Pubitemid 32136369)
9. DEBEVEC, P. 1998. Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques, SIGGRAPH '98, 189-198.
10. FARENZENA, M., AND FUSIELLO, A. 2007. Recovering intrinsic images using an illumination invariant image. In ICIP, 485-488.
11. FOURNIER, A., GUNAWAN, A. S., AND ROMANZIN, C. 1993. Common illumination between real and computer generated scenes. In Proceedings of Graphics Interface '93, 254-262.
12. FUNT, B. V., DREW, M. S., AND BROCKINGTON, M. 1992. Recovering shading from color images. In ECCV, 124-132.
13. FURUKAWA, Y., AND PONCE, J. 2010. Accurate, dense, and robust multiview stereopsis. IEEE PAMI 32 (August), 1362-1376.
14. GREGER, G., SHIRLEY, P., HUBBARD, P. M., AND GREENBERG, D. P. 1998. The irradiance volume. IEEE Computer Graphics and Applications 18, 32-43. (Pubitemid 128564936)
15. GROSSE, R., JOHNSON, M. K., ADELSON, E. H., AND FREEMAN, W. T. 2009. Ground-truth dataset and baseline evaluations for intrinsic image algorithms. In ICCV, 2335-2342.
16. GUO, R., DAI, Q., AND HOIEM, D. 2011. Single-image shadow detection and removal using paired regions. In CVPR, 2033-2040.
17. HARTLEY, R., AND ZISSERMAN, A. 2003. Multiple View Geometry in Computer Vision, 2 ed. Cambridge University Press, New York, NY, USA.
18. HEDAU, V., HOIEM, D., AND FORSYTH, D. 2009. Recovering the spatial layout of cluttered rooms. In ICCV, 1849-1856.
19. HOIEM, D., EFROS, A. A., AND HEBERT, M. 2005. Automatic photo pop-up. ACM Trans. Graph. 24 (July), 577-584.
20. HORN, B. K. P. 1974. Determining lightness from an image. Computer Vision, Graphics and Image Processing 3, 277-299.
21. HORRY, Y., ANJYO, K.-I., AND ARAI, K. 1997. Tour into the picture: using a spidery mesh interface to make animation from a single image. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques, SIGGRAPH '97, 225-232.
22. KANG, H. W., PYO, S. H., ANJYO, K., AND SHIN, S. Y. 2001. Tour into the picture using a vanishing line and its extension to panoramic images. Computer Graphics Forum 20, 3, 132-141.
23. KEE, E., AND FARID, H. 2010. Exposing digital forgeries from 3-d lighting environments. In WIFS, 1-6.
24. KHAN, E. A., REINHARD, E., FLEMING, R. W., AND B ÜLTHOFF, H. H. 2006. Image-based material editing. ACM Trans. Graph. 25 (July), 654-663. (Pubitemid 44481025)
25. LALONDE, J.-F., AND EFROS, A. A. 2007. Using color compatibility for assessing image realism. In ICCV, 1-8.
26. LALONDE, J.-F., HOIEM, D., EFROS, A. A., ROTHER, C., WINN, J., AND CRIMINISI, A. 2007. Photo clip art. ACM Trans. Graph. 26 (July).
27. LALONDE, J.-F., EFROS, A. A., AND NARASIMHAN, S. G. 2009. Webcam clip art: appearance and illuminant transfer from timelapse sequences. ACM Trans. Graph. 28 (December), 131:1- 131:10.
28. LAND, E., AND MCCANN, J. 1971. Lightness and retinex theory. J. Opt. Soc. Am. 61, 1, 1-11.
29. LEE, D. C., HEBERT, M., AND KANADE, T. 2009. Geometric reasoning for single image structure recovery. In CVPR, 2136-2143.
30. LEE, D. C., GUPTA, A., HEBERT, M., AND KANADE, T. 2010. Estimating spatial layout of rooms using volumetric reasoning about objects and surfaces. Advances in Neural Information Processing Systems (NIPS) 24 (November), 1288-1296.
31. LEVIN, A., RAV-ACHA, A., AND LISCHINSKI, D. 2008. Spectral matting. IEEE PAMI 30 (October), 1699-1712.
32. LIEBOWITZ, D., CRIMINISI, A., AND ZISSERMAN, A. 1999. Creating architectural models from images. In Eurographics, vol. 18, 39-50.
33. LOPEZ-MORENO, J., HADAP, S., REINHARD, E., AND GUTIERREZ, D. 2010. Compositing images through light source detection. Computers & Graphics 34, 6, 698-707.
34. MERRELL, P., SCHKUFZA, E., LI, Z., AGRAWALA, M., AND KOLTUN, V. 2011. Interactive furniture layout using interior design guidelines. ACM Trans. Graph. 30 (August), 87:1-87:10.
35. MURY, A. A., PONT, S. C., AND KOENDERINK, J. J. 2009. Representing the light field in finite three-dimensional spaces from sparse discrete samples. Applied Optics 48, 3 (Jan), 450-457.
36. OH, B. M., CHEN, M., DORSEY, J., AND DURAND, F. 2001. Image-based modeling and photo editing. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, SIGGRAPH '01, 433-442.
37. ROTHER, C. 2002. A new approach to vanishing point detection in architectural environments. IVC 20, 9-10 (August), 647-655. (Pubitemid 34862735)
38. SATO, I., SATO, Y., AND IKEUCHI, K. 2003. Illumination from shadows. IEEE PAMI 25, 3, 290-300.
39. SAXENA, A., SUN, M., AND NG, A. Y. 2008. Make3d: depth perception from a single still image. In Proceedings of the 23rd national conference on Artificial intelligence - Volume 3, AAAI Press, 1571-1576.
40. SINHA, S. N., STEEDLY, D., SZELISKI, R., AGRAWALA, M., AND POLLEFEYS, M. 2008. Interactive 3d architectural modeling from unordered photo collections. ACM Trans. Graph. 27 (December), 159:1-159:10.
41. TAPPEN, M. F., FREEMAN, W. T., AND ADELSON, E. H. 2005. Recovering intrinsic images from a single image. IEEE Trans. Pattern Anal. Mach. Intell. 27 (September), 1459-1472. (Pubitemid 41387776)
42. TAPPEN, M. F., ADELSON, E. H., AND FREEMAN, W. T. 2006. Estimating intrinsic component images using non-linear regression. In CVPR, vol. 2, 1992-1999.
43. WANG, Y., AND SAMARAS, D. 2003. Estimation of multiple directional light sources for synthesis of augmented reality images. Graphical Models 65, 4, 185-205. (Pubitemid 36984483)
44. WEISS, Y. 2001. Deriving intrinsic images from image sequences. In ICCV, II: 68-75. (Pubitemid 32795042)
45. YEUNG, S.-K., TANG, C.-K., BROWN, M. S., AND KANG, S. B. 2011. Matting and compositing of transparent and refractive objects. ACM Trans. Graph. 30 (February), 2:1-2:13.
46. YU, Y., DEBEVEC, P., MALIK, J., AND HAWKINS, T. 1999. Inverse global illumination: recovering reflectance models of real scenes from photographs. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques, SIGGRAPH '99, 215-224.
47. YU, L.-F., YEUNG, S.-K., TANG, C.-K., TERZOPOULOS, D., CHAN, T. F., AND OSHER, S. J. 2011. Make it home: automatic optimization of furniture arrangement. ACM Trans. Graph. 30 (August), 86:1-86:12.
48. ZHANG, L., DUGAS-PHOCION, G., SAMSON, J., AND SEITZ, S. 2001. Single view modeling of free-form scenes. In CVPR, 990-997.