Learning multiple linear mappings for efficient single image super-resolution

IEEE Transactions on Image Processing

Volumn 24, Issue 3, 2015, Pages 846-861

  Zhang, Kaibing ^a,b   Tao, Dacheng ^c   Gao, Xinbo ^a   Li, Xuelong ^d   Xiong, Zenggang ^b  

^a XIDIAN UNIVERSITY   (China)

^b HUBEI ENGINEERING UNIVERSITY   (China)

^c UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^d INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

Author keywords

Fast non local means; feature subspace; multiple linear mappings (MLMs); single image super resolution (SR).

Indexed keywords

ALGORITHMS; MAPPING; OPTICAL RESOLVING POWER;

APPLICATION-ORIENTED; COMPUTATIONALLY EFFICIENT; FEATURE SUBSPACE; HIGH RESOLUTION IMAGE; LINEAR MAPPING; NON LOCAL MEANS; SINGLE IMAGES; TIME AND SPACE COMPLEXITY;

MATHEMATICAL TRANSFORMATIONS;

EID: 84921835242     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2389629     Document Type: Article

References (52)

1. R. Y. Tsai and T. S. Huang, "Multi-frame image restoration and registration, " Adv. Comput. Vis. Image Process., vol. 1, no. 2, pp. 317-339, 1984.
2. R. Keys, "Cubic convolution interpolation for digital image processing, " IEEE Trans. Acoust., Speech, Signal Process., vol. 29, no. 6, pp. 1153-1160, Dec. 1981.
3. X. Li and M. T. Orchard, "New edge-directed interpolation, " IEEE Trans. Image Process., vol. 10, no. 10, pp. 1521-1527, Oct. 2001.
4. L. Zhang and X. Wu, "An edge-guided image interpolation algorithm via directional filtering and data fusion, " IEEE Trans. Image Process., vol. 15, no. 8, pp. 2226-2238, Aug. 2006.
5. H. Takeda, S. Farsiu, and P. Milanfar, "Kernel regression for image processing and reconstruction, " IEEE Trans. Image Process., vol. 16, no. 2, pp. 349-366, Feb. 2007.
6. R. Fattal, "Image upsampling via imposed edge statistics, " ACM Trans. Graph., vol. 26, no. 3, Jul. 2007, Art. ID 95.
7. J. Sun, J. Zhu, and M. F. Tappen, "Context-constrained hallucination for image super-resolution, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 231-238.
8. H. Xu, G. Zhai, and X. Yang, "Single image super-resolution with detail enhancement based on local fractal analysis of gradient, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 10, pp. 1740-1754, Oct. 2013.
9. L. Wang, S. Xiang, G. Meng, H. Wu, and C. Pan, "Edge-directed single-image super-resolution via adaptive gradient magnitude self-interpolation, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 8, pp. 1289-1299, Aug. 2013.
10. K. Zhang, X. Gao, D. Tao, and X. Li, "Single image super-resolution with non-local means and steering kernel regression, " IEEE Trans. Image Process., vol. 21, no. 11, pp. 4544-4556, Nov. 2012.
11. K. Zhang, X. Gao, D. Tao, and X. Li, "Image super-resolution via nonlocal steering kernel regression regularization, " in Proc. 20th IEEE Conf. Image Process, Sep. 2013, pp. 943-946.
12. M. Protter, M. Elad, H. Takeda, and P. Milanfar, "Generalizing the nonlocal-means to super-resolution reconstruction, " IEEE Trans. Image Process., vol. 18, no. 1, pp. 36-51, Jan. 2009.
13. W. T. Freeman, T. R. Jones, and E. C. Pasztor, "Example-based super-resolution, " IEEE Comput. Graph. Appl., vol. 22, no. 2, pp. 56-65, Mar./Apr. 2002.
14. J. Sun, N.-N. Zheng, H. Tao, and H.-Y. Shum, "Image hallucination with primal sketch priors, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit, Jun. 2003, pp. 729-736.
15. H. Chang, D.-Y. Yeung, and Y. Xiong, "Super-resolution through neighbor embedding, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit, Jun./Jul. 2004, pp. 275-282.
16. K. Zhang, X. Gao, X. Li, and D. Tao, "Partially supervised neighbor embedding for example-based image super-resolution, " IEEE J. Sel. Topics Signal Process., vol. 5, no. 2, pp. 230-239, Apr. 2011.
17. X. Gao, K. Zhang, X. Li, and D. Tao, "Image super-resolution with sparse neighbor embedding, " IEEE Trans. Image Process., vol. 21, no. 7, pp. 3194-3205, Jul. 2012.
18. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution as sparse representation of raw image patches, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit, Jun. 2008, pp. 1-8.
19. J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution via sparse representation, " IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
20. R. Zeyde, M. Elad, and M. Protter, "On single image scale-up using sparse-representations, " in Proc. 7th Int. Conf. Curves Surf., 2010, pp. 711-730.
21. J. Yang, Z. Wang, Z. Lin, S. Cohen, and T. Huang, "Coupled dictionary training for image super-resolution, " IEEE Trans. Image Process., vol. 21, no. 8, pp. 3467-3478, Aug. 2012.
22. K. Jia, X. Wang, and X. Tang, "Image transformation based on learning dictionaries across image spaces, " IEEE Trans. Pattern Anal. Mach. Intell, vol. 35, no. 2, pp. 367-380, Feb. 2013.
23. K. S. Ni and T. Q. Nguyen, "Image superresolution using support vector regression, " IEEE Trans. Image Process., vol. 16, no. 6, pp. 1596-1610, Jun. 2007.
24. K. I. Kim and Y. Kwon, "Single-image super-resolution using sparse regression and natural image prior, " IEEE Trans. Pattern Anal. Mach. Intell, vol. 32, no. 6, pp. 1127-1133, Jun. 2010.
25. W. Fan and D.-Y. Yeung, "Image hallucination using neighbor embedding over visual primitive manifolds, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit, Jun. 2007, pp. 1-7.
26. L. Fang et al., "Fast acquisition and reconstruction of optical coherence tomography images via sparse representation, " IEEE Trans. Med. Imag., vol. 32, no. 11, pp. 2034-2049, Nov. 2013.
27. J. A. Tropp and A. C. Gilbert, "Signal recovery from random measurements via orthogonal matching pursuit, " IEEE Trans. Inf. Theory, vol. 53, no. 12, pp. 4655-4666, Dec. 2007.
28. D. Glasner, S. Bagon, and M. Irani, "Super-resolution from a single image, " in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2009, pp. 349-356.
29. K. Zhang, X. Gao, D. Tao, and X. Li, "Single image super-resolution with multiscale similarity learning, " IEEE Trans. Neural Netw. Learn. Syst, vol. 24, no. 10, pp. 1648-1659, Oct. 2013.
30. K. Zhang, X. Gao, D. Tao, and X. Li, "Multi-scale dictionary for single image super-resolution, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit, Jun. 2012, pp. 1114-1121.
31. R. Timofte, V. De, and L. Van Gool, "Anchored neighborhood regression for fast example-based super-resolution, " in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1920-1927.
32. C.-Y. Yang and M.-H. Yang, "Fast direct super-resolution by simple functions, " in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 561-568.
33. J. Yang, Z. Lin, and S. Cohen, "Fast image super-resolution based on in-place example regression, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit, Jun. 2013, pp. 1059-1066.
34. J. Darbon, A. Cunha, T. F. Chan, S. Osher, and G. J. Jensen, "Fast nonlocal filtering applied to electron cryomicroscopy, " in Proc. 5th IEEE Symp. Biomed. Imag., May 2008, pp. 1331-1334.
35. S. Lloyd, "Least squares quantization in PCM, " IEEE Trans. Inf. Theory, vol. 28, no. 2, pp. 129-137, Mar. 1982.
36. G. H. Golub and V. Pereyra, "The differentiation of pseudo-inverses and nonlinear least squares problems whose variables separate, " SIAM J. Numer. Anal, vol. 10, no. 2, pp. 413-432, Apr. 1973.
37. L. Zhang, M. Yang, and X. Feng, "Sparse representation or collaborative representation: Which helps face recognition?" in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 471-478.
38. A. Buades, B. Coll, and J.-M. Morel, "A non-local algorithm for image denoising, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 60-65.
39. X. Gao, X. Wang, X. Li, D. Tao, and K. Zhang, "Zernike-moment-based image super resolution, " IEEE Trans. Image Process., vol. 20, no. 10, pp. 2738-2747, Oct. 2011.
40. J. Yu, X. Gao, X. Li, D. Tao, and K. Zhang, "A unified learning framework for single image super-resolution, " IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 4, pp. 780-792, Apr. 2014.
41. G. Peyre, S. Bougleux, and L. Cohen, "Non-local regularization of inverse problems, " in Proc. Eur. Conf. Comput. Vis., Oct. 2008, pp. 57-68.
42. S. Farsiu, M. D. Robinson, M. Elad, and P. Milanfar, "Fast and robust multiframe super resolution, " IEEE Trans. Image Process., vol. 13, no. 10, pp. 1327-1344, Oct. 2004.
43. H. Zhang, J. Yang, Y. Zhang, and T. S. Huang, "Image and video restorations via nonlocal kernel regression, " IEEE Trans. Cybern., vol. 43, no. 3, pp. 1035-1046, Jun. 2013.
44. D. Martin, C. Fowlkes, D. Tal, and J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics, " in Proc. IEEE Int. Conf. Comput. Vis., Jul. 2001, pp. 416-423.
45. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity, " IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
46. R. Rubinstein, M. Zibulevsky, and M. Elad, "Efficient implementation of the K-SVD algorithm using batch orthogonal matching pursuit, " Dept. Comput. Sci., Technion-Israel Inst. Technol., Haifa, Israel, Tech. Rep. CS-2008-08, 2008.
47. N. K. Bose, S. Lertrattanapanich, and J. Koo, "Advances in superresolu-tion using L-curve, " in Proc. IEEE Int. Symp. Circuits Syst., May 2001, pp. 433-436.
48. N. Nguyen, P. Milanfar, and G. Golub, "A computationally efficient superresolution image reconstruction algorithm, " IEEE Trans. Image Process., vol. 10, no. 4, pp. 573-583, Apr. 2001.
49. Q. Yuan, L. Zhang, H. Shen, and P. Li, "Adaptive multiple-frame image super-resolution based on U-curve, " IEEE Trans. Image Process., vol. 19, no. 12, pp. 3157-3169, Dec. 2010.
50. Y. Su, X. Gao, X. Li, and D. Tao, "Multivariate multilinear regression, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 6, pp. 1560-1573, Dec. 2012.
51. B. Geng, D. Tao, C. Xu, L. Yang, and X.-S. Hua, "Ensemble manifold regularization, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 6, pp. 1227-1233, Jun. 2012.
52. N. Guan, D. Tao, Z. Luo, and B. Yuan, "Online nonnegative matrix factorization with robust stochastic approximation, " IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 7, pp. 1087-1099, Jul. 2012.