Image inpainting by patch propagation using patch sparsity

IEEE Transactions on Image Processing

Volumn 19, Issue 5, 2010, Pages 1153-1165

  Xu, Zongben ^a   Sun, Jian ^a  

^a XI'AN JIAOTONG UNIVERSITY   (China)

Author keywords

Image inpainting; Patch propagation; Patch sparsity; Sparse representation; Texture synthesis

Indexed keywords

CONSISTENCY CONSTRAINTS; IMAGE INPAINTING; IMAGE STRUCTURES; INPAINTING; LINEAR COMBINATIONS; NATURAL IMAGES; NOVEL CONCEPT; PATCH STRUCTURE; SPARSE REPRESENTATION; TEXTURE SYNTHESIS;

DISCRETE COSINE TRANSFORMS; IMAGE ANALYSIS; TEXTURES;

EDGE DETECTION;

ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; METHODOLOGY; PAINTING; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING;

IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PAINTINGS; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 77951292197     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2010.2042098     Document Type: Article

References (46)

1. M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, "Image inpainting," in Proc. SIGGRAPH, 2000, pp. 417-424. (Pubitemid 32394006)
2. M. Bertalmio, A. L. Bertozzi, and G. Sapiro, "Navier-Strokes, fluid dynamics, and image and video inpainting," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2001, pp. 417-424. (Pubitemid 34068977)
3. T. Chan and J. Shen, "Local inpainting models and tv inpainting," SIAM J. Appl. Math., vol.62, no.3, pp. 1019-1043, 2001.
4. T. Chan and J. Shen, "Non-texture inpainting by curvature-driven diffusions," J. Vis. Commun. Image Represent., vol.4, no.12, pp. 436-449, 2001.
5. C. Bertalmio, M. Bertalmio, V. Caselles, G. Sapiro, and J. Verdera, "Filling-in by joint interpolation of vector fields and gray levels," IEEE Trans. Image Process., vol.10, pp. 1200-1211, 2001. (Pubitemid 32732681)
6. A. Levin, A. Zomet, and Y. Weiss, "Learning how to inpaint from global image statistics," in Proc. Int. Conf. Comp. Vision, pp. 305-313.
7. S. Roth and M. J. Black, "Fields of experts: A framework for learning image priors," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2005, pp. 860-867. (Pubitemid 43897448)
8. S. Roth and M. J. Black, "Steerable random fields," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2007, pp. 1-8.
9. A. Efros and T. Leung, "Texture synthesis by non-parametric sampling," in Proc. Int. Conf. Comp. Vision, 1999, pp. 1033-1038. (Pubitemid 32079980)
10. M. Bertalmio, L. Vese, G. Sapiro, and S. Osher, "Simultaneous structure and texture image inpainting," IEEE Trans. Image Process., vol.12, pp. 882-889, 2003.
11. A. Criminisi, P. Perez, and K. Toyama, "Object removal by examplarbased image inpainting," in Proc. Int. Conf. Comp. Vision, 2003, pp. 721-728.
12. J.Wu and Q. Ruan, "Object removal by cross isophotes examplar-based image inpainting," in Proc. Int. Conf. Pattern Recognition, 2006, pp. 810-813.
13. A. Wong and J. Orchard, "A nonlocal-means approach to examplarbased inpainting," presented at the IEEE Int. Conf. Image Processing, 2008.
14. G. T. N. Komodakis, "Image completion using efficient belief propagation via priority scheduling and dynamic pruning," IEEE Trans. Image Process., vol.16, pp. 2649-2661, 2007.
15. J. Jia and C. K. Tang, "Image repairing: Robust image synthesis by adaptive nd tensor voting," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recogition, 2003, pp. 643-650.
16. I. Drori, D. Cohen-Or, and H. Yeshurun, "Fragment-based image completion," ACM Trans. Graph., vol.22, no.2003, pp. 303-312, 2005.
17. M. Elad, J. L. Starck, P. Querre, and D. L. Donoho, "Simultaneous cartoon and texture image inpainting using morphological component analysis," Appl. Comput. Harmon. Anal., vol.19, pp. 340-358, 2005. (Pubitemid 41660098)
18. O. G. Guleryuz, "Nonlinear approximation based image recovery using adaptive sparse reconstructions," presented at the IEEE Int. Conf. Image Processing, 2003.
19. O. G. Guleryuz, "Nonlinear approximation based image recovery using adaptive sparse reconstructures and iterated denoising-part i: Theory," IEEE Trans. Image Process., vol.15, pp. 539-554, 2006. (Pubitemid 43257554)
20. O. G. Guleryuz, "Nonlinear approximation based image recovery using adaptive sparse reconstructures and iterated denoising-part ii: Adaptive algorithms," IEEE Trans. Image Process., vol.15, pp. 555-571, 2006. (Pubitemid 43257555)
21. M. J. Fadili, J. L. Starck, and F. Murtagh, "Inpainting and zooming using sparse representations," The Comput. J., vol.52, no.1, pp. 64-79, 2009.
22. A. Criminisi, P. Perez, and K. Toyama, "Region filling and object removal by examplar-based image inpainting," IEEE Trans. Image Process., vol.13, pp. 1200-1212, 2004.
23. Y. P. Li and D. Huttenlocher, "Sparse long-range random field and its application to image denoising," presented at the European Conf. Computer Vision, 2008.
24. M. F. Tappen, B. C. Russell, and W. T. Freeman, "Exploiting the sparse derivative prior for super-resolution and image demosaicing," presented at the IEEE Workshop on Statistical and Computational Theories of Vision, 2003.
25. J. Sun, J. Sun, Z. B. Xu, and H.-Y. Shum, "Image super-resolution using gradient profile prior," presented at the IEEE Computer Society Conf. Computer Vision and Pattern Recogition, 2008.
26. R. Fergus, B. Singh, A. Hertzmann, S. T. Roweis, and W. T. Freeman, "Removing camera shake from a single photograph," ACM Trans. Graph., vol.25, no.3, pp. 787-794, 2006. (Pubitemid 44481040)
27. A. Levin, R. Fergus, F. Durand, and W. T. Freeman, "Image and depth from a conventional camera and depth from a conventional camera with a coded aperture," ACM Trans. Graph., vol.26, no.3, pp. 70:1-70:9, 2007.
28. B. Olshausen and D. Field, "Sparse coding with an overcomplete basis set: A strategy employed by v1?," Vis. Res., vol.37, no.33, pp. 3311-3325, 1997. (Pubitemid 27493805)
29. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. Image Process., vol.15, pp. 3736-3745, 2006. (Pubitemid 44811686)
30. J. Maire, M. Elad, and G. Sapiro, "Sparse representation for color image restoration," IEEE Trans. Image Process., vol.17, pp. 53-69, 2008.
31. J. Mairal, M. Leordeanu, F. Bach, M. Hebert, and J. Ponce, "Discriminative sparse image models for class-specific edge detextion and image interpretation," presented at the IEEE Computer Society Conf. Computer Vision and Pattern Recogition, 2008.
32. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Discriminative learned dictionary for local image analysis," presented at the European Conf. Computer Vision, 2008.
33. J. Winn, A. Criminisi, and N. Cristianini, "Object categorization by learned universal visual dictionary," presented at the Int. Conf. Comp. Vision, 2005. (Pubitemid 44042395)
34. J. C. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution as sparse representation of raw image patches," presented at the IEEE Computer Society Conf. Computer Vision and Pattern Recogition, 2008.
35. G. Peyre, "Non-negative sparse modeling of textures," presented at the Scale Space and Variational Methods in Computer Vision, 2007. (Pubitemid 350269832)
36. H. Chang, D. Y. Yeung, and Y. Xiong, "Super-resolution through neighbor embedding," presented at the IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2004.
37. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol.290, pp. 2323-2326, 2000. (Pubitemid 32041578)
38. S. Mallat and Z. Zhang, "Matching pursuit in a time-frequency dictionary," IEEE Trans. Signal Process., vol.41, pp. 3397-3415, 1993.
39. Y. C. Pati, R. Rezaiifar, and P. S. Krishnaprasad, "Non-negative sparse modeling of textures," presented at the Scale Space and Variational Methods in Computer Vision, 2007.
40. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM Rev., vol.43, no.1, pp. 129-159, 2001.
41. R. Tibshirani, "Regression shrinkge and selection via the lasso," J. Roy. Statist. Soc. B., vol.58, no.1, pp. 267-288, 1996.
42. R. F. IVentura, P.Vandergheynst, P. Frossard, and A. Cavallaro, "Color image scalable coding with matching pursuit," IEEE Acoust. Speech, Signal Process., 2004. (Pubitemid 40359924)
43. R. Gribonval, C. Fvotte, and E. Vincent, "Performance measurement in blind audio source separation," IEEE Trans. Speech, Audio, Lang. Process., vol.14, no.4, pp. 1462-1469, 2006. (Pubitemid 46547636)
44. B. Shen, W. Hu, Y. Zhang, and Y. Zhang, "Image inpainting via sparse representation," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing, 2009, pp. 697-700.
45. J. Sun, Y. Lu, J. Jia, and H.-Y. Shum, "Image completion with structure propagation," in Proc. ACM SIGGRAPH, 2005, pp. 861-868.
46. J. L. Starck, M. Elad, and D. L. Donoho, "Image decomposition via the combination of sparse representations and a variational approach," IEEE Trans. Image Process., vol.14, pp. 1570-1582, 2005. (Pubitemid 41623087)