Image super-resolution based on structure-modulated sparse representation

IEEE Transactions on Image Processing

Volumn 24, Issue 9, 2015, Pages 2797-2810

  Zhang, Yongqin ^a   Liu, Jiaying ^b   Yang, Wenhan ^b   Guo, Zongming ^b,c  

^a NORTHWEST UNIVERSITY   (China)

^b PEKING UNIVERSITY   (China)

^c Cooperative Medianet Innovation Center ^*  (China)

Author keywords

dictionary learning; gradient histogram; ridge regression; sparse representation; Super resolution

Indexed keywords

ALGORITHMS; CONSTRAINED OPTIMIZATION; GRAPHIC METHODS; IMAGE RECONSTRUCTION; OPTICAL RESOLVING POWER; OPTIMIZATION; REGRESSION ANALYSIS;

DICTIONARY LEARNING; GRADIENT HISTOGRAMS; RIDGE REGRESSION; SPARSE REPRESENTATION; SUPER RESOLUTION;

IMAGE CODING;

EID: 84930934622     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2431435     Document Type: Article

References (62)

1. P. Milanfar, Ed., Super-resolution Imaging (Digital Imaging and Computer Vision). New York, NY, USA: CRC Press, Sep. 2010.
2. R. Y. Tsai and T. S. Huang, "Multiple frame image restoration and registration," in Advances in Computer Vision and Image Processing, vol. 1. Greenwich, CT, USA: JAI Press, 1984.
3. W.-C. Siu and K.-W. Hung, "Review of image interpolation and superresolution," in Proc. Asia-Pacific Signal Inf. Process. Assoc. Annu. Summit Conf., Dec. 2012, pp. 1-10.
4. M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP, Graph. Models Image Process., vol. 53, no. 3, pp. 231-239, 1991.
5. R. C. Hardie, K. J. Barnard, and E. E. Armstrong, "Joint MAP registration and high-resolution image estimation using a sequence of undersampled images," IEEE Trans. Image Process., vol. 6, no. 12, pp. 1621-1633, Dec. 1997.
6. S. Farsiu, M. Elad, and P. Milanfar, "Video-to-video dynamic superresolution for grayscale and color sequences," EURASIP J. Appl. Signal Process., vol. 2006, pp. 1-15, Feb. 2006, Art. ID 061859.
7. A. Marquina and S. J. Osher, "Image super-resolution by TV-regularization and Bregman iteration," J. Sci. Comput., vol. 37, no. 3, pp. 367-382, 2008.
8. X. Zhang, J. Jiang, and S. Peng, "Commutability of blur and affine warping in super-resolution with application to joint estimation of triple-coupled variables," IEEE Trans. Image Process., vol. 21, no. 4, pp. 1796-1808, Apr. 2012.
9. W. T. Freeman, T. R. Jones, and E. C. Pasztor, "Example-based superresolution," IEEE Comput. Graph. Appl., vol. 22, no. 2, pp. 56-65, Mar./Apr. 2002.
10. D. Glasner, S. Bagon, and M. Irani, "Super-resolution from a single image," in Proc. IEEE Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 349-356.
11. J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
12. K. I. Kim and Y. Kwon, "Single-image super-resolution using sparse regression and natural image prior," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 6, pp. 1127-1133, Jun. 2010.
13. J. Sun, J. Sun, Z. Xu, and H.-Y. Shum, "Gradient profile prior and its applications in image super-resolution and enhancement," IEEE Trans. Image Process., vol. 20, no. 6, pp. 1529-1542, Jun. 2011.
14. X. Gao, K. Zhang, D. Tao, and X. Li, "Joint learning for single-image super-resolution via a coupled constraint," IEEE Trans. Image Process., vol. 21, no. 2, pp. 469-480, Feb. 2012.
15. S. P. Kim, N. K. Bose, and H. M. Valenzuela, "Recursive reconstruction of high resolution image from noisy undersampled multiframes," IEEE Trans. Acoust., Speech, Signal Process., vol. 38, no. 6, pp. 1013-1027, Jun. 1990.
16. H. Ur and D. Gross, "Improved resolution from subpixel shifted pictures," CVGIP, Graph. Models Image Process., vol. 54, no. 2, pp. 181-186, 1992.
17. M. S. Alam, J. G. Bognar, R. C. Hardie, and B. J. Yasuda, "Infrared image registration and high-resolution reconstruction using multiple translationally shifted aliased video frames," IEEE Trans. Instrum. Meas., vol. 49, no. 5, pp. 915-923, Oct. 2000.
18. H. Takeda, S. Farsiu, and P. Milanfar, "Kernel regression for image processing and reconstruction," IEEE Trans. Image Process., vol. 16, no. 2, pp. 349-366, Feb. 2007.
19. M. Elad and A. Feuer, "Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images," IEEE Trans. Image Process., vol. 6, no. 12, pp. 1646-1658, Dec. 1997.
20. D. Capel and A. Zisserman, "Computer vision applied to super resolution," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 75-86, May 2003.
21. L. C. Pickup, D. P. Capel, S. J. Roberts, and A. Zisserman, "Bayesian methods for image super-resolution," Comput. J., vol. 52, no. 1, pp. 101-113, 2009.
22. L. J. Karam, N. G. Sadaka, R. Ferzli, and Z. A. Ivanovski, "An efficient selective perceptual-based super-resolution estimator," IEEE Trans. Image Process., vol. 20, no. 12, pp. 3470-3482, Dec. 2011.
23. H. Stark and P. Oskoui, "High-resolution image recovery from imageplane arrays, using convex projections," J. Opt. Soc. Amer. A-Opt. Image Sci. Vis., vol. 6, no. 11, pp. 1715-1726, 1989.
24. X. Zhang, M. Tang, and R. Tong, "Robust super resolution of compressed video," Vis. Comput., vol. 28, no. 12, pp. 1167-1180, 2012.
25. S. Izadpanahi and H. Demirel, "Motion based video super resolution using edge directed interpolation and complex wavelet transform," Signal Process., vol. 93, no. 7, pp. 2076-2086, 2013.
26. J. Salvador, A. Kochale, and S. Schweidler, "Patch-based spatiotemporal super-resolution for video with non-rigid motion," Signal Process., Image Commun., vol. 28, no. 5, pp. 483-493, 2013.
27. X. Li and M. T. Orchard, "New edge-directed interpolation," IEEE Trans. Image Process., vol. 10, no. 10, pp. 1521-1527, Oct. 2001.
28. Z. Wei and K.-K. Ma, "Contrast-guided image interpolation," IEEE Trans. Image Process., vol. 22, no. 11, pp. 4271-4285, Nov. 2013.
29. K. Jia, X. Wang, and X. Tang, "Image transformation based on learning dictionaries across image spaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 2, pp. 367-380, Feb. 2013.
30. S. Baker and T. Kanade, "Limits on super-resolution and how to break them," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 9, pp. 1167-1183, Sep. 2002.
31. Z. Lin and H.-Y. Shum, "Fundamental limits of reconstruction-based superresolution algorithms under local translation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 1, pp. 83-97, Jan. 2004.
32. L. I. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Phys. D, Nonlinear Phenomena, vol. 60, nos. 1-4, pp. 259-268, 1992.
33. R. Fergus, B. Singh, A. Hertzmann, S. T. Roweis, and W. T. Freeman, "Removing camera shake from a single photograph," ACM Trans. Graph., vol. 25, no. 3, pp. 787-794, 2006.
34. W. Zuo, L. Zhang, C. Song, and D. Zhang, "Texture enhanced image denoising via gradient histogram preservation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 1203-1210.
35. Y. Zhang, J. Liu, M. Li, and Z. Guo, "Joint image denoising using adaptive principal component analysis and self-similarity," Inf. Sci., vol. 259, pp. 128-141, Feb. 2014.
36. A. Buades, B. Coll, and J. M. Morel, "A review of image denoising algorithms, with a new one," SIAM Multiscale Model. Simul., vol. 4, no. 2, pp. 490-530, 2005.
37. V. Katkovnik, A. Foi, K. Egiazarian, and J. Astola, "From local kernel to nonlocal multiple-model image denoising," Int. J. Comput. Vis., vol. 86, no. 1, pp. 1-32, 2010.
38. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Non-local sparse models for image restoration," in Proc. IEEE Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 2272-2279.
39. W. Dong, L. Zhang, G. Shi, and X. Li, "Nonlocally centralized sparse representation for image restoration," IEEE Trans. Image Process., vol. 22, no. 4, pp. 1620-1630, Apr. 2013.
40. A. M. Bruckstein, D. L. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images," SIAM Rev., vol. 51, no. 1, pp. 34-81, 2009.
41. W. Dong, L. Zhang, G. Shi, and X. Wu, "Image deblurring and superresolution by adaptive sparse domain selection and adaptive regularization," IEEE Trans. Image Process., vol. 20, no. 7, pp. 1838-1857, Jul. 2011.
42. Y.-Q. Zhang, Y. Ding, J.-S. Xiao, J. Liu, and Z. Guo, "Visibility enhancement using an image filtering approach," EURASIP J. Adv. Signal Process., vol. 2012, pp. 1-6, Oct. 2012, Art. ID 220.
43. Y.-Q. Zhang, Y. Ding, J. Liu, and Z. Guo, "Guided image filtering using signal subspace projection," IET Image Process., vol. 7, no. 3, pp. 270-279, Apr. 2013.
44. C. Dong, C. C. Loy, K. He, and X. Tang, "Learning a deep convolutional network for image super-resolution," in Proc. Eur. Conf. Comput. Vis., Sep. 2014, pp. 184-199.
45. T. Michaeli and M. Irani, "Nonparametric blind super-resolution," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 945-952.
46. R. Timofte, V. De Smet, and L. Van Gool, "Anchored neighborhood regression for fast example-based super-resolution," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1920-1927.
47. R. Timofte, V. De Smet, and L. Van Gool, "A+: Adjusted anchored neighborhood regression for fast super-resolution," in Proc. Asian Conf. Comput. Vis., Nov. 2014, pp. 111-126.
48. E. Perez-Pellitero, J. Salvador, I. Torres-Xirau, J. Ruiz-Hidalgo, and B. Rosenhahn, "Fast super-resolution via dense local training and inverse regressor search," in Proc. Asian Conf. Comput. Vis., Nov. 2014, pp. 346-359.
49. H. A. Aly and E. Dubois, "Image up-sampling using total-variation regularization with a new observation model," IEEE Trans. Image Process., vol. 14, no. 10, pp. 1647-1659, Oct. 2005.
50. I. Daubechies, M. Defrise, and C. De Mol, "An iterative thresholding algorithm for linear inverse problems with a sparsity constraint," Commun. Pure Appl. Math., vol. 57, no. 11, pp. 1413-1457, 2004.
51. J. A. Tropp and S. J.Wright, "Computational methods for sparse solution of linear inverse problems," Proc. IEEE, vol. 98, no. 6, pp. 948-958, Jun. 2010.
52. G. Peyre, S. Bougleux, and L. Cohen, "Non-local regularization of inverse problems," Inverse Problems Imag., vol. 5, no. 2, pp. 511-530, 2011.
53. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006.
54. J. Mairal, G. Sapiro, and M. Elad, "Learning multiscale sparse representations for image and video restoration," SIAM Multiscale Model. Simul., vol. 7, no. 1, pp. 214-241, 2008.
55. R. Rubinstein, M. Zibulevsky, and M. Elad, "Double sparsity: Learning sparse dictionaries for sparse signal approximation," IEEE Trans. Signal Process., vol. 58, no. 3, pp. 1553-1564, Mar. 2010.
56. J. Mairal, F. Bach, and J. Ponce, "Task-driven dictionary learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 791-804, Apr. 2012.
57. Y. Zhang, J. Xiao, S. Li, C. Shi, and G. Xie, "Learning block-structured incoherent dictionaries for sparse representation," Sci. China Inf. Sci., vol. 58, pp. 102302-1-102302-15, 2015.
58. T. S. Cho, C. L. Zitnick, N. Joshi, S. B. Kang, R. Szeliski, and W. T. Freeman, "Image restoration by matching gradient distributions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 683-694, Apr. 2012.
59. E. J. Candes, M. B. Wakin, and S. P. Boyd, "Enhancing sparsity by reweighted 1 minimization," J. Fourier Anal. Appl., vol. 14, nos. 5-6, pp. 877-905, 2008.
60. H. Attouch, J. Bolte, P. Redont, and A. Soubeyran, "Proximal alternating minimization and projection methods for nonconvex problems. An approach based on the Kurdyka-?ojasiewicz inequality," Math. Oper. Res., vol. 35, no. 2, pp. 438-457, 2010.
61. H. Attouch, J. Bolte, and B. F. Svaiter, "Convergence of descent methods for semi-Algebraic and tame problems: Proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods," Math. Program., vol. 137, nos. 1-2, pp. 91-129, 2013.
62. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.