Image and video restorations via nonlocal kernel regression

IEEE Transactions on Cybernetics

Volumn 43, Issue 3, 2013, Pages 1035-1046

  Zhang, Haichao ^a   Yang, Jianchao ^b   Zhang, Yanning ^a   Huang, Thomas S ^c  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b ADOBE RESEARCH   (United States)

^c University of Illinois at Urbana Champaign   (United States)

Author keywords

Deblurring; Denoising; Local structural regression; Nonlocal self similarity; Restoration; Superresolution (SR)

Indexed keywords

DE-NOISING; DEBLURRING; SELF-SIMILARITIES; STRUCTURAL REGRESSION; SUPERRESOLUTION;

IMAGE RECONSTRUCTION; OPTICAL RESOLVING POWER; REGRESSION ANALYSIS; RESTORATION;

IMAGE ENHANCEMENT;

ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE SUBTRACTION; PHOTOGRAPHY; PROCEDURES; REGRESSION ANALYSIS; STATISTICAL ANALYSIS; VIDEORECORDING; ARTICLE; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DATA INTERPRETATION, STATISTICAL; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REGRESSION ANALYSIS; SUBTRACTION TECHNIQUE; VIDEO RECORDING;

EID: 84884536129     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2222375     Document Type: Article

References (45)

1. D. Tschumperlé, "PDE's Based Regularization of Multivalued Images and Applications," Ph.D. Thesis, Université de Nice Sophia-Antipolis, Nice, France, 2002.
2. H. Takeda, S. Farsiu, and P. Milanfar, "Kernel regression for image processing and reconstruction," IEEE Trans. Image Process., vol. 16, no. 2, pp. 349-366, Feb. 2007.
3. M. Elad and M. Aharon, "Image denoising via learned dictionaries and sparse representation," in Proc. IEEE Conf. CVPR, 2006, pp. 895-900.
4. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
5. H. Zhang and Y. Zhang, "Sparse representation based iterative incremental image deblurring," in Proc. IEEE ICIP, 2009, pp. 1293-1296.
6. V. M. Patel, G. R. Easley, and D. M. Healy, Jr., "Shearlet-based deconvolution," IEEE Trans. Image Process., vol. 18, no. 12, pp. 2673-2685, Dec. 2009.
7. H. Zhang, J. Yang, Y. Zhang, and T. S. Huang, "Sparse representation based blind image deblurring," in Proc. IEEE ICME, 2011, pp. 1-6.
8. H. Zhang, J. Yang, Y. Zhang, N. M. Nasrabadi, and T. S. Huang, "Close the loop: Joint blind image restoration and recognition with sparse representation prior," in Proc. IEEE ICCV, 2011, pp. 770-777.
9. H. Zhang, Y. Zhang, and T. S. Huang, "Exploiting structured sparsity for image deblurring," in Proc. IEEE ICME, 2012, pp. 616-621.
10. J. Yang, Z.Wang, Z. Lin, S. Cohen, and T. S. Huang, "Coupled dictionary training for image super-resolution," IEEE Trans. Image Process., vol. 21, no. 8, pp. 3467-3478, Aug. 2012.
11. H. Zhang, Y. Zhang, H. Li, and T. S. Huang, "Generative Bayesian image super resolution with natural image prior," IEEE Trans. Image Process., vol. 21, no. 9, pp. 4054-4067, Sep. 2012.
12. G. Peyré, "Manifold models for signals and images," Comput. Vis. Image Und., vol. 113, no. 2, pp. 249-260, Feb. 2009.
13. J. Ni, P. K. Turaga, V. M. Patel, and R. Chellappa, "Example-driven manifold priors for image deconvolution," IEEE Trans. Image Process., vol. 20, no. 11, pp. 3086-3096, Nov. 2011.
14. C. Tomasi, "Bilateral filtering for gray and color images," in Proc. ICCV, 1998, pp. 839-846.
15. X. Li and M. Orchard, "New edge-directed interpolation," IEEE Trans. Image Process., vol. 10, no. 10, pp. 1521-1527, Oct. 2001.
16. X. Li, "Video processing via implicit and mixture motion models," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 8, pp. 953-963, Aug. 2007.
17. H. Takeda, P.Milanfar, M. Protter, and M. Elad, "Super-resolution without explicit subpixelmotion estimation," IEEE Trans. Image Process., vol. 18, no. 9, pp. 1958-1975, Sep. 2009.
18. A. Efros and T. Leung, "Texture synthesis by non-parametric sampling," in Proc. IEEE ICCV, 1999, pp. 1033-1038.
19. A. Buades and B. Coll, "A non-local algorithm for image denoising," in Proc. IEEE CVPR, 2005, pp. 60-65.
20. M. Protter, M. Elad, H. Takeda, and P. Milanfar, "Generalizing the non-local-means to super-resolution reconstruction," IEEE Trans. Image Process., vol. 18, no. 1, pp. 36-51, Jan. 2009.
21. D. Glasner, S. Bagon, and M. Irani, "Super-resolution from a single image," in Proc. IEEE ICCV, 2009, pp. 349-356.
22. G. Peyré, S. Bougleux, and L. Cohen, "Non-local regularization of inverse problems," in Proc. ECCV, 2008, pp. 57-68.
23. H. Zhang, J. Yang, Y. Zhang, and T. S. Huang, "Non-local kernel regression for image and video restoration," in Proc. ECCV, 2010, pp. 566-579.
24. T. Q. Pham, L. J. Van Vliet, and K. Schutte, "Robust fusion of irregularly sampled data using adaptive normalized convolution," EURASIP J. Appl. Signal Process., vol. 2006, p. 236, Feb. 2006.
25. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Nonlocal sparse models for image restoration," in Proc. ICCV, 2009, pp. 2272-2279.
26. M. Protter and M. Elad, "Super resolution with probabilistic motion estimation," IEEE Trans. Image Process., vol. 18, no. 8, pp. 1899-1904, Aug. 2009.
27. P. Chatterjee and P. Milanfar, "A generalization of non-local means via kernel regression," in Proc. SPIE Conf. Comput. Imaging, 2008, pp. 1-9.
28. H. Chang, D.-Y. Yeung, and Y. Xiong, "Super-resolution through neighbor embedding," in Proc. IEEE CVPR, 2004, pp. I-275-I-282.
29. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, Dec. 2006.
30. A. Danielyan, A. Foi, V. Katkovnik, and K. Egiazarian, "Image and video super-resolution via spatially adaptive block-matching filtering," in Proc. Int. Workshop Local Non-Local Approx. Image Process., 2008, pp. 1-8.
31. R. Neelamani, H. Choi, and R. Baraniuk, "ForWaRD: Fourier-wavelet regularized deconvolution for ill-conditioned systems," IEEE Trans. Signal Process., vol. 52, no. 2, pp. 418-433, Feb. 2004.
32. H. Takeda, S. Farsiu, and P. Milanfar, "Deblurring using regularized locally adaptive kernel regression," IEEE Trans. Image Process., vol. 17, no. 4, pp. 550-563, Apr. 2008.
33. K. V. Suresh, G.Mahesh Kumar, and A. N. Rajagopalan, " Superresolution of license plates in real traffic videos," IEEE Trans. Intell. Transp. Syst., vol. 8, no. 2, pp. 321-331, Jun. 2007.
34. R. Tsai and T. S. Huang, "Multiframe image restoration and registration," in Proc. Adv. Comput. Vis. Image Process., 1984, vol. 1, pp. 317-339.
35. S. Farsiu, D. Robinson, M. Elad, and P. Milanfar, "Fast and robust multiframe super-resolution," IEEE Trans. Image Process., vol. 13, no. 10, pp. 1327-1344, Oct. 2003.
36. P. Getreuer, 2012. [Online]. Available: http://www.getreuer.info/home/ tvreg
37. C. Barnes, E. Shechtman, and A. Finkelstein, "PatchMatch: A randomized correspondence algorithm for structural image editing," ACM Trans. Graph.- Proc. SIGGRAPH, vol. 28, no. 3, p. 24, Aug. 2009.
38. A. Adams, N. Gelfand, J. Dolson, and M. Levoy, "Gaussian KD-trees for fast high-dimensional filtering," ACM Trans. Graph.-SIGGRAPH, vol. 28, no. 3, p. 21, Aug. 2009.
39. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
40. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, "Image denoising by sparse 3D transform-domain collaborative filtering," IEEE Trans. Image Process., vol. 16, no. 8, pp. 2080-2095, Aug. 2007.
41. K. Dabov, A. Foi, V. Katkovnik, and K. O. Egiazarian, "Image restoration by sparse 3D transform-domain collaborative filtering," in Proc. Image Process.: Algorithms Syst., 2008, p. 681 207.
42. K. I. Kim and Y. Kwon, "Example-Based Learning for Single-Image Super-Resolution and jpeg Artifact Removal," Max Planck Inst. Biol. Cybern., Tübingen, Germany, Tech. Rep., 2008.
43. R. Fattal, "Image upsampling via imposed edge statistics," ACM Trans. Graph.-SIGGRAPH, vol. 26, no. 3, p. 95, Jul. 2007.
44. H. Zhang, J. Yang, Y. Zhang, and T. S. Huang, "Multi-scale non-local kernel regression for super resolution," in Proc. IEEE ICIP, 2011, pp. 1353-1356.
45. C. Barnes, E. Shechtman, and A. Finkelstein, "The generalized Patch-Match correspondence algorithm," in Proc. ECCV, 2010, pp. 29-43.