Single image super-resolution with non-local means and steering kernel regression

IEEE Transactions on Image Processing

Volumn 21, Issue 11, 2012, Pages 4544-4556

  Zhang, Kaibing ^a   Gao, Xinbo ^a   Tao, Dacheng ^b   Li, Xuelong ^c  

^a XIDIAN UNIVERSITY   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^c XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Image super resolution; non local means; regularization prior; self similarity; steering kernel regression

Indexed keywords

IMAGE SUPER-RESOLUTION; KERNEL REGRESSION; NONLOCAL; REGULARIZATION PRIOR; SELF-SIMILARITIES;

PROBABILITY DISTRIBUTIONS; REGRESSION ANALYSIS;

OPTICAL RESOLVING POWER;

ALGORITHM; ANIMAL; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; FACTUAL DATABASE; HUMAN; IMAGE PROCESSING; METHODOLOGY; REGRESSION ANALYSIS; REPRODUCIBILITY;

ALGORITHMS; ANIMALS; ARTIFICIAL INTELLIGENCE; DATABASES, FACTUAL; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REGRESSION ANALYSIS; REPRODUCIBILITY OF RESULTS;

EID: 84867853644     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2208977     Document Type: Article

References (53)

1. T. S. Huang and R. Y. Tsai, "Multi-frame image restoration and registration," Adv. Comput. Vision Image Process., vol. 1, no. 2, pp. 317-339, 1984.
2. H. S. Hou and H. C. Andrews, "Cubic splines for image interpolation and digital filtering," IEEE Trans. Signal Process., vol. 26, no. 6, pp. 508-517, Dec. 1978.
3. X. Li and M. T. Orchard, "New edge-directed interpolation," IEEE Trans. Image Process., vol. 10, no. 10, pp. 1521-1527, Oct. 2001. (Pubitemid 32981825)
4. L. Zhang and X. Wu, "An edge-guided image interpolation algorithm via directional filtering and data fusion," IEEE Trans. Image Process., vol. 15, no. 8, pp. 2226-2238, Aug. 2006. (Pubitemid 44089097)
5. M. Li and T. Nguyen, "Markov random field model-based edge-directed image interpolation," IEEE Trans. Image Process., vol. 17, no. 7, pp. 1121-1128, Jul. 2008.
6. S. P. Kim, N. K. Bose, and H. M. Valenzuela, "Recursive reconstruction of high resolution image from noisy undersampled multiframes," IEEE Trans. Acoust. Speech Signal Process., vol. 38, no. 6, pp. 1013-1027, Jun. 1990. (Pubitemid 20713538)
7. S. P. Kim and W. Y. Su, "Recursive high-resolution reconstruction of blurred multiframe images," IEEE Trans. Image Process., vol. 2, no. 4, pp. 534-539, Oct. 1993.
8. S. Farsiu, M. D. Robinson, M. Elad, and P. Milanfar, "Fast and robust multi-frame super resolution," IEEE Trans. Image Process., vol. 13, no. 10, pp. 1327-1344, Oct. 2004.
9. X. Li, X. Gao, Y. Hu, D. Tao, and B. Ning, "A multi-frame image su-per-resolution method," Signal Process., vol. 90, no. 2, pp. 405-414, 2010.
10. X. Gao, Q. Wang, X. Li, D. Tao, and K. Zhang, "Zernike-moment-based image super resolution," IEEE Trans. Image Process., vol. 20, no. 10, pp. 2738-2747, Oct. 2011.
11. M. Protter, M. Elad, H. Takeda, and P. Milanfar, "Generalizing the nonlocal-means to super-resolution reconstruction," IEEE Trans. Image Process., vol. 18, no. 1, pp. 36-51, Jan. 2009.
12. H. Zhang, J. Yang, Y. Zhang, and T. S. Huang, "Non-local kernel re-gression for image and video restoration," in Proc. Eur. Conf. Comput. Vision, Jul. 2010, pp. 566-579.
13. W. T. Freeman, T. R. Jones, and E. C. Pasztor, "Example based super resolution," IEEE Comput. Graphics Appl., vol. 22, no. 2, pp. 56-65, Mar. 2002.
14. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE. Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
15. R. Zeyde, M. Elad, and M. Protter, "On single image scale-up using sparse-representations," in Proc. 7th Int. Conf. Curves Surfaces, 2010, pp. 711-730.
16. H. Chang, D.-Y. Yeung, and Y Xiong, "Super-resolution through neigh-bor embedding," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., Jul. 2004, pp. 275-282.
17. K. Zhang, X. Gao, X. Li, and D. Tao, "Partially supervised neighbor embedding for example-based image super-resolution," IEEE J. Sel. Topic Signal Process., vol. 5, no. 2, pp. 230-239, Apr. 2011.
18. K. I. Kim and Y Kwon, "Single-image super-resolution using sparse regression and natural image prior," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 6, pp. 1127-1133, Jun. 2010.
19. Y Tang, Y Yuan, P. Yan, and X. Li, "Single-image super-resolution via sparse coding regression," in Proc. IEEE Int. Conf. Image Graphics, Aug. 2011, pp. 267-272.
20. K. Zhang, X. Gao, D. Tao, and X. Li, "Single image super-resolution with sparse neighbor embedding," IEEE Trans. Image Process., vol. 21, no. 7, pp. 3194-3205, Jun. 2012.
21. Y Tang, X. Pan, Y Yuan, P. Yan, L. Li, and X. Li, "Local semi-supervised regression for single-image super-resolution," in Proc. IEEE Int. Workshop Multimedia Signal Process., Oct. 2011, pp. 52-56.
22. X. Lu, H. Yuan, Y. Yuan, P. Yan, L. Li, and X. Li, "Local learning-based image super-resolution," in Proc. IEEE Int. Workshop Multimedia Signal Process., Oct. 2011, pp. 1-5.
23. Y. Tang, P. Yan, Y Yuan, and X. Li, "Single-image super-resolution via local learning," Int. J. Mach. Learn. Cybern., vol. 2, no. 1, pp. 15-23, 2011.
24. X. Lu, H. Yuan, P. Yan, Y Yuan, and X. Li, "Utilizing homotopy for single image superresolution," in Proc. Asian Conf. Pattern Recogn., 2011, pp. 316-320.
25. X. Gao, K. Zhang, X. Li, and D. Tao, "Joint learning for single-image super-resolution via a coupled constraint," IEEE Trans. Image Process., vol. 21, no. 2, pp. 469-480, Feb. 2012.
26. Y Tang, X. Pan, Y Yuan, P. Yan, L. Li, and X. Li, "Single-image super-resolution based on semi-supervised learning," in Proc. Asian Conf. Pattern Recogn., 2011, pp. 52-56.
27. G. Mu, X. Gao, K. Zhang, X. Li, and D. Tao, "Single image super resolution with high resolution dictionary," in Proc. IEEE Int. Conf. Image Process., Sep. 2011, pp. 1165-1168.
28. H. Knutsson and C.-F. Westin, "Normalized and differential convolution: Methods for interpolation and filtering of incomplete and uncertain data," in Proc. IEEE Conf. Comput. Vision Pattern Recog., Jun. 1993, pp. 515-523.
29. C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," in Proc. IEEE Int. Conf. Comput. Vision, Jan. 1998, pp. 836-846.
30. M. Elad, "On the origin of the bilateral filter and ways to improve it," IEEE Trans. Image Process., vol. 11, no. 10, pp. 1141-151, Oct. 2002. (Pubitemid 35359385)
31. H. Takeda, S. Farsiu, and P. Milanfar, "Kernel regression for image processing and reconstruction," IEEE Trans. Image Process., vol. 16, no. 2, pp. 349-366, Feb. 2007. (Pubitemid 46421678)
32. A. Buades, B. Coll, and J. M. Morel, "A non-local algorithm for image denoising," in Proc. IEEE Conf. Comput. Vision Pattern Recog., Jun. 2005, pp. 60-65.
33. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Non-local sparse models for image restoration," in Proc. Int. Conf. Comput. Vision, 2009, pp. 2272-2279.
34. A. Wong and J. Orchard, "A nonlocal-means approach to exemplar-based inpainting," in Proc. IEEEInt. Conf. Image Process., Dec. 2008, pp. 2600-2603.
35. Y.-W. Tai, S. Liu, M. S. Brown, and S. Lin, "Super resolution using edge prior and single image detail synthesis," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., Jun. 2010, pp. 2400-2407.
36. J. Sun, Z. Xu, and H. Shum, "Image superresolution using gradient profile prior," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., Jun. 2008, pp. 1-8.
37. K. Turkowski, "Filters for common resampling tasks," in Graphics Gems. New York: Academic, 1990.
38. W. Dong, L. Zhang, G. Shi, and X. Wu, "Image deblurring and su-per-resolution by adaptive sparse domain selection and adaptive regularization," IEEE Trans. Image Process., vol. 20, no. 7, pp. 1838-1857, Jul. 2011.
39. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
40. X. Gao, W. Lu, D. Tao, and X. Li, "Image quality assessment based on multiscale geometric analysis," IEEE Trans. Image Process., vol. 18, no. 7, pp. 1409-1423, Jul. 2009.
41. L. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Phys. D, vol. 60, nos. 1-4, pp. 259-268, 1992.
42. W. Dong, G. Shi, L. Zhang, and X. Wu, "Super-resolution with nonlocal regularized sparse representation," in Proc. SPIE Vis. Comm. Image Process. (VCIP), vol. 7744. pp. 77440H-1-77440H-10, Jul. 2010.
43. D. Martin, C. Fowlkes, D. Tal, and J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics," in Proc. Int. Conf. Comput. Vision, Jul. 2001, pp. 416-423. (Pubitemid 32795086)
44. D. Tao, X. Li, X. Wu, and S. J. Maybank, "General tensor discriminant analysis and gabor features for gait recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 10, pp. 1700-1715, Oct. 2007.
45. D. Tao, X. Li, X. Wu, and S. J. Maybank, "Geometric mean for subspace selection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 260-274, Feb. 2009.
46. B. Geng, D. Tao, C. Xu, L. Yang, and X. Hua, "Ensemble manifold regularization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 6, pp. 1227-1233, Jun. 2012.
47. M. Song, D. Tao, C. Chen, J. Bu, J. Luo, and C. Zhang, "Probabilistic exposure fusion," IEEE Trans. Image Process., vol. 21, no. 1, pp. 341-357, Jan. 2012.
48. M. Song, D. Tao, C. Chen, X. Li, and C. Chen, "Color to gray: Visual cue preservation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1537-1552, Sep. 2010.
49. T. Zhou, D. Tao, and X. Wu, "Manifold elastic net: A unified framework for sparse dimension reduction," Data Min. Knowl. Discov., vol. 22, no. 3, pp. 340-371, 2011.
50. X. Tian, D. Tao, and Y Rui, "Sparse transfer learning for interactive video search reranking," ACM Trans. Multimedia Comput. Commun. Appl., 2012, to be published.
51. N. Guan, D. Tao, Z. Luo, and B. Yuan, "Online nonnegative matrix factorization with robust stochastic approximation," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 7, pp. 1087-1099, Jul. 2012.
52. N. Guan, D. Tao, Z. Luo, and B. Yuan, "NeNMF: An optimal gradi-ent method for nonnegative matrix factorization," IEEE Trans. Signal Process., vol. 60, no. 6, pp. 2882-2898, Jun. 2012.
53. N. Guan, D. Tao, Z. Luo, and B. Yuan, "Non-negative patch alignment framework," IEEE Trans. Neural Netw., vol. 22, no. 8, pp. 1218-1230, Aug. 2011.