Image melding: Combining inconsistent images using patch-based synthesis

ACM Transactions on Graphics

Volumn 31, Issue 4, 2012, Pages

  Darabi, Soheil ^a   Shechtman, Eli ^b   Barnes, Connelly ^b   Dan B Goldman, ^b   Sen, Pradeep ^a  

^a UNIVERSITY OF NEW MEXICO   (United States)

^b ADOBE RESEARCH   (United States)

Author keywords

Image completion; Image stitching; Morphing; Object cloning; Patch based synthesis; Texture interpolation

Indexed keywords

GRADUAL TRANSITION; HOLE FILLING; IMAGE COMPLETION; IMAGE GRADIENTS; IMAGE STITCHING; MORPHING; PHOTOMETRIC TRANSFORMATION; SEARCH SPACES; STATE-OF-THE-ART METHODS; TEXTURE INTERPOLATION; TEXTURE SHARPNESS; TRANSITION REGIONS; TWO SOURCES; UNIFIED METHOD;

CLONING; COLOR; OBJECT RECOGNITION; POISSON EQUATION; TEXTURES;

IMAGE TEXTURE;

EID: 84870821434     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2185520.2185578     Document Type: Article

References (34)

1. ADOBE, 2010. Photoshop cs5 content-aware fill. http://www.adobe.com/ technology/projects/content-aware-fill.html.
2. AGARWALA, A., DONTCHEVA, M., AGRAWALA, M., DRUCKER, S., COLBURN, A., CURLESS, B., SALESIN, D., AND COHEN, M. 2004. Interactive digital photomontage. In ACM SIGGRAPH, vol. 23, 294-302.
3. ARIAS, P., FACCIOLO, G., CASELLES, V., AND SAPIRO, G. 2011. A variational framework for exemplar-based image inpainting. IJCV 93 (July), 319-347.
4. BARNES, C., SHECHTMAN, E., FINKELSTEIN, A., AND GOLDMAN, D. B. 2009. PatchMatch: A randomized correspondence algorithm for structural image editing. In ACM SIGGRAPH, vol. 28, 24:1-24:11.
5. BARNES, C., SHECHTMAN, E., GOLDMAN, D. B., AND FINKELSTEIN, A. 2010. The Generalized PatchMatch correspondence algorithm. In ECCV.
6. BHAT, P., CURLESS, B., COHEN, M., AND ZITNICK, L. 2008. Fourier analysis of the 2D screened Poisson equation for gradient domain problems. In ECCV.
7. BHAT, P., ZITNICK, C. L., COHEN, M., AND CURLESS, B. 2010. Gradientshop: A gradient-domain optimization framework for image and video filtering. ACM Trans. Graphics 29 (April), 10:1-10:14.
8. BUGEAU, A., BERTALMÍO, M., CASELLES, V., AND SAPIRO, G. 2010. A comprehensive framework for image inpainting. IEEE Trans. on Image Processing 19, 10 (oct.), 2634-2645.
9. BURT, P. J., AND ADELSON, E. H. 1983. A multiresolution spline with application to image mosaics. ACM Trans. Graphics 2 (October), 217-236.
10. CANDES, E., RUDELSON, M., TAO, T., AND VERSHYNIN, R. 2005. Error correction via linear programming. In IEEE Symposium on Foundations of Computer Science, 668-681.
11. EFROS, A. A., AND LEUNG, T. K. 1999. Texture synthesis by non-parametric sampling. IEEE Computer Society, Los Alamitos, CA, USA.
12. FANG, H., AND HART, J. C. 2007. Detail preserving shape deformation in image editing. In ACM SIGGRAPH, vol. 26, 1-5.
13. FARBMAN, Z., FATTAL, R., AND LISCHINSKI, D. 2011. Convolution pyramids. In ACM SIGGRAPH Asia, vol. 30, 175:1-175:8.
14. HACOHEN, Y., SHECHTMAN, E., GOLDMAN, D. B., AND LISCHINSKI, D. 2011. Non-rigid dense correspondence with applications for image enhancement. In ACM SIGGRAPH, vol. 30, 70:1-70:10.
15. HAYS, J., AND EFROS, A. A. 2007. Scene completion using millions of photographs. In ACM SIGGRAPH, vol. 26, 4:1-4:7.
16. KANEVA, B., SIVIC, J., TORRALBA, A., AVIDAN, S., AND FREEMAN, W. T. 2010. Infinite images: Creating and exploring a large photorealistic virtual space. In Proceedings of the IEEE.
17. KWATRA, V., SCHÖDL, A., ESSA, I., TURK, G., AND BOBICK, A. 2003. Graphcut textures: image and video synthesis using graph cuts. In ACM SIGGRAPH, vol. 22, 277-286.
18. KWATRA, V., ESSA, I., BOBICK, A., AND KWATRA, N. 2005. Texture optimization for example-based synthesis. In ACM SIGGRAPH, vol. 24, 795-802.
19. LIN, W.-Y., LIU, S., MATSUSHITA, Y., NG, T.-T., AND CHEONG, L.-F. 2011. Smoothly varying affine stitching. In CVPR.
20. MANSFIELD, A., PRASAD, M., ROTHER, C., SHARP, T., KOHLI, P., AND VAN GOOL, L. 2011. Transforming image completion. In Proc. BMVC.
21. PÉREZ, P., GANGNET, M., AND BLAKE, A. 2003. Poisson image editing. In ACM SIGGRAPH, vol. 22, 313-318.
22. PRITCH, Y., KAV-VENAKI, E., AND PELEG, S. 2009. Shift-map image editing. In ICCV.
23. ROTHER, C., BORDEAUX, L., HAMADI, Y., AND BLAKE, A. 2006. Autocollage. In ACM SIGGRAPH, vol. 25, 847-852.
24. RUITERS, R., SCHNABEL, R., AND KLEIN, R. 2010. Patch-based texture interpolation. Computer Graphics Forum 29, 4 (June), 1421-1429.
25. SHECHTMAN, E., RAV-ACHA, A., IRANI, M., AND SEITZ, S. 2010. Regenerative morphing. In CVPR.
26. SIMAKOV, D., CASPI, Y., SHECHTMAN, E., AND IRANI, M. 2008. Summarizing visual data using bidirectional similarity. In CVPR.
27. SUNKAVALLI, K., JOHNSON, M. K., MATUSIK, W., AND PFISTER, H. 2010. Multi-scale image harmonization. In ACM SIGGRAPH, vol. 29, 125:1-125:10.
28. SZELISKI, R., AND SHUM, H.-Y. 1997. Creating full view panoramic image mosaics and environment maps. In ACM SIGGRAPH, 251-258.
29. TAPPEN, M., FREEMAN, W., AND ADELSON, E. 2005. Recovering intrinsic images from a single image. IEEE Trans. PAMI 27, 9 (sept.), 1459-1472.
30. TROPP, J., AND GILBERT, A. 2007. Signal recovery from random measurements via orthogonal matching pursuit. IEEE Trans. Information Theory 53, 12 (dec.), 4655-4666.
31. WEI, L. Y., AND LEVOY, M. 2000. Fast texture synthesis using tree-structured vector quantization. In ACM SIGGRAPH, 479-488.
32. WEXLER, Y., SHECHTMAN, E., AND IRANI, M. 2007. Spacetime completion of video. IEEE Trans. PAMI 29, 3 (march), 463-476.
33. WHYTE, O., SIVIC, J., AND ZISSERMAN, A. 2009. Get out of my picture! internet-based inpainting. In BMVC.
34. XU, L., LU, C., XU, Y., AND JIA, J. 2011. Image smoothing via L0 gradient minimization. In ACM SIGGRAPH Asia, vol. 30, 174:1-174:12.