Interactive images: Cuboid proxies for smart image manipulation

ACM Transactions on Graphics

Volumn 31, Issue 4, 2012, Pages

  Zheng, Youyi ^a   Chen, Xiang ^a,b   Cheng, Ming Ming ^c   Zhou, Kun ^b   Hu, Shi Min ^c   Mitra, Niloy J ^a,d  

^a KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Saudi Arabia)

^b ZHEJIANG UNIVERSITY   (China)

^c TSINGHUA UNIVERSITY   (China)

^d UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Coupled optimization; Cuboid proxies; Image manipulation; Non local relations; Scene understanding

Indexed keywords

3D SCENES; COPLANARITY; CUBOID PROXIES; DEPTH INFORMATION; HIGH LEVEL SEMANTICS; IMAGE MANIPULATION; NONLOCAL; REAL-WORLD IMAGE; SCENE RECONSTRUCTION; SCENE UNDERSTANDING; USER INTERACTION; USER STUDY;

COMPUTER GRAPHICS;

SEMANTICS;

EID: 84866668557     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2185520.2185595     Document Type: Article

References (40)

1. BARNES, C., SHECHTMAN, E., FINKELSTEIN, A., AND GOLDMAN, D. B. 2009. Patchmatch: a randomized correspondence algorithm for structural image editing. ACM TOG (SIGGRAPH) 28, 3, 24:1-11.
2. BIEDERMAN, I., MEZZANOTTE, R., AND RABINOWITZ, J. 1982. Scene perception: Detecing and judging objects undergoing relational violations. Cognitive Psychology 14, 143-177.
3. CARROLL, R., AGARWALA, A., AND AGRAWALA, M. 2010. Image warps for artistic perspective manipulation. ACM TOG (SIGGRAPH) 29, 4, 127:1-127:9.
4. CHENG, M.-M., ZHANG, F.-L., MITRA, N. J., HUANG, X., AND HU, S.-M. 2010. RepFinder: Finding approximately repeated scene elements for image editing. ACM TOG (SIGGRAPH) 29, 4, 83:1-83:8.
5. EFROS, A. A., AND LEUNG, T. K. 1999. Texture synthesis by non-parametric sampling. In IEEE ICCV, 1033-1038.
6. FISHER, M., SAVVA, M., AND HANRAHAN, P. 2011. Characterizing structural relationships in scenes using graph kernels. ACM TOG (SIGGRAPH) 30, 34:1-34:12.
7. GAL, R., SORKINE, O., MITRA, N. J., AND COHEN-OR, D. 2009. iWIRES: an analyze-and-edit approach to shape manipulation. ACM TOG (SIGGRAPH) 28, 33:1-33:10.
8. GIBSON, J. J. 1979. The Ecological Approach to Visual Perception. MIT Press.
9. GUO, R., DAI, Q., AND HOIEM, D. 2011. Single-image shadow detection and removal using paired regions. In IEEE CVPR, 2033-2040.
10. GUPTA, A., EFROS, A. A., AND HEBERT, M. 2010. Blocks world revisited: Image understanding using qualitative geometry and mechanics. In ECCV, 119-153.
11. GUPTA, A., SATKIN, S., EFROS, A. A., AND HEBERT, M. 2011. From 3d scene geometry to human workspace. In IEEE CVPR, 1961-1968.
12. HARTLEY, A., AND ZISSERMAN, A. 2006. Multiple view geometry in computer vision (2. Ed.). Cambridge University Press.
13. HAYS, J., AND EFROS, A. 2007. Scene completion using millions of photographs. ACM TOG (SIGGRAPH) 26, 3, 87-94.
14. HEDAU, V., HOIEM, D., AND FORSYTH, D. 2010. Thinking inside the box: Using appearance models and context based on room geometry. In ECCV, 224-237.
15. HOIEM, D., EFROS, A. A., AND HEBERT, M. 2005. Automatic photo pop-up. ACM TOG (SIGGRAPH) 24, 3, 577-584.
16. JAIN, A., THORMÄHLEN, T., SEIDEL, H.-P., AND THEOBALT, C. 2010. Moviereshape: Tracking and reshaping of humans in videos. ACM TOG (SIGGRAPH Asia) 29, 5, 148:1-148:9.
17. JIANG, N., TAN, P., AND CHEONG, L.-F. 2009. Symmetric architecture modeling with a single image. ACM TOG (SIGGRAPH Asia) 28, 5, 113:1-113:8.
18. KARSCH, K., HEDAU, V., FORSYTH, D., AND HOIEM, D. 2011. Rendering synthetic objects into legacy photographs. ACM TOG (SIGGRAPH Asia) 30, 6, 157:1-157:12.
19. LALONDE, J.-F., HOIEM, D., EFROS, A. A., ROTHER, C., WINN, J., AND CRIMINISI, A. 2007. Photo clip art. ACM TOG (SIGGRAPH) 26, 3 (August), 3.
20. LOURAKIS, M., 2004. levmar: Levenberg-marquardt nonlinear least squares algorithms in C/C++. [web page] http://www.ics.forth.gr/~lourakis/levmar/.
21. MITRA, N. J., YANG, Y.-L., YAN, D.-M., LI, W., AND AGRAWALA, M. 2010. Illustrating how mechanical assemblies work. ACM TOG (SIGGRAPH) 29, 4, 58:1-58:12.
22. NORMAN, D. 1990. Design of Everyday Things. MIT Press.
23. OH, B. M., CHEN, M., DORSEY, J., AND DURAND, F. 2001. Image-based modeling and photo editing. In ACM SIGGRAPH, 433-442.
24. PÉREZ, P., GANGNET, M., AND BLAKE, A. 2003. Poisson image editing. ACM TOG (SIGGRAPH) 22, 3, 313-318.
25. ROTHER, C., KOLMOGOROV, V., AND BLAKE, A. 2004. "grabcut": interactive foreground extraction using iterated graph cuts. ACM TOG (SIGGRAPH) 23, 3, 309-314.
26. RUBINSTEIN, M., SHAMIR, A., AND AVIDAN, S. 2009. Multioperator media retargeting. ACM TOG (SIGGRAPH) 28, 3, 23:1-23:11.
27. SAXENA, A., SUN, M., AND NG, A. 2009. Make3D: Learning 3D scene structure from a single still image. IEEE PAMI 31, 5, 824-840.
28. SEITZ, S. M., CURLESS, B., DIEBEL, J., SCHARSTEIN, D., AND SZELISKI, R. 2006. A comparison and evaluation of multi-view stereo reconstruction algorithms. In IEEE CVPR, 519-528.
29. SHAPIRA, L., SHAMIR, A., AND COHEN-OR, D. 2009. Image appearance exploration by model-based navigation. CGF 28, 2, 629-638.
30. SINHA, S. N., STEEDLY, D., SZELISKI, R., AGRAWALA, M., AND POLLEFEYS, M. 2008. Interactive 3D architectural modeling from unordered photo collections. ACM TOG (SIGGRAPH Asia) 27, 5, 159:1-159:10.
31. SUN, J., YUAN, L., JIA, J., AND SHUM, H. 2005. Image completion with structure propagation. ACM TOG (SIGGRAPH) 24, 3, 861-868.
32. WANG, Y.-S., TAI, C.-L., SORKINE, O., AND LEE, T.-Y. 2008. Optimized scale-and-stretch for image resizing. ACM TOG (SIGGRAPH Asia) 27, 5, 118:1-118:8.
33. WEI, L.-Y., LEFEBVRE, S., KWATRA, V., AND TURK, G. 2009. State of the art in example-based texture synthesis. In EG-STAR, 93-117.
34. WILCZKOWIAK, M., STURM, P. F., AND BOYER, E. 2005. Using geometric constraints through parallelepipeds for calibration and 3D modeling. IEEE PAMI 27, 2, 194-207.
35. WU, H., WANG, Y.-S., FENG, K.-C., WONG, T.-T., LEE, T.-Y., AND HENG, P.-A. 2010. Resizing by symmetry-summarization. ACM TOG (SIGGRAPH Asia) 29, 6, 159:1-159:9.
36. XUE, T., LIU, J., AND TANG, X. 2010. Object cut: Complex 3d object reconstruction through line drawing separation. In IEEE CVPR, 1149-1156.
37. YANG, Y.-L., YANG, Y.-J., POTTMANN, H., AND MITRA, N. J. 2011. Shape space exploration of constrained meshes. ACM TOG (SIGGRAPH Asia) 30, 6.
38. ZHENG, Y., FU, H., COHEN-OR, D., AU, O. K.-C., AND TAI, C.-L. 2011. Component-wise controllers for structurepreserving shape manipulation. CGF 30, 2, 563-572.
39. ZHOU, S., FU, H., LIU, L., COHEN-OR, D., AND HAN, X. 2010. Parametric reshaping of human bodies in images. ACM TOG (SIGGRAPH) 29, 4, 126:1-126:10.
40. ZISSERMAN, A., REID, I. D., AND CRIMINISI, A. 1999. Single view metrology. In IEEE ICCV, 434-441.