Deep Edge Guided Recurrent Residual Learning for Image Super-Resolution

IEEE Transactions on Image Processing

Volumn 26, Issue 12, 2017, Pages 5895-5907

  Yang, Wenhan ^a   Feng, Jiashi ^b   Yang, Jianchao ^c   Zhao, Fang ^b   Liu, Jiaying ^a   Guo, Zongming ^a   Yan, Shuicheng ^d  

^a PEKING UNIVERSITY   (China)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c SNAP INC   (United States)

^d Qihoo 360 Technology Co Ltd   (China)

Author keywords

edge guidance; recurrent residual network; sub band recovery; Super resolution

Indexed keywords

EDGE DETECTION; FEATURE EXTRACTION; FREQUENCY BANDS; IMAGE RECONSTRUCTION; IMAGE RESOLUTION; OPTICAL RESOLVING POWER; PERSONNEL TRAINING; RECOVERY; SIGNAL PROCESSING;

ALTERNATIVE ROUTES; BENCHMARK DATASETS; DIFFERENT FREQUENCY; HIGH RESOLUTION IMAGE; IMAGE EDGE DETECTION; IMAGE SUPER RESOLUTIONS; LOW RESOLUTION IMAGES; SIGNAL RESOLUTION;

IMAGE PROCESSING;

EID: 85030245009     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2017.2750403     Document Type: Article

References (42)

1. H. Aly and E. Dubois, "Image up-sampling using total-variation regularization with a new observation model, " IEEE Trans. Image Process., vol. 14, no. 10, pp. 1647-1659, Oct. 2005.
2. S. P. Belekos, N. P. Galatsanos, A. K. Katsaggelos, "Maximum a posteriori video super-resolution using a new multichannel image prior, " IEEE Trans. Image Process., vol. 19, no. 6, pp. 1451-1464, Jun. 2010.
3. M. Bevilacqua, A. Roumy, C. Guillemot, M. L. Alberi-Morel, "Lowcomplexity single-image super-resolution based on nonnegative neighbor embedding, " in Proc. Brit. Mach. Vis. Conf., 2012, p. 135.
4. P. Chatterjee, V. P. Namboodiri, S. Chaudhuri, "Super-resolution using sub-band constrained total variation, " in Proc. Int. Conf. Scale Space Variational Methods Comput. Vis., 2007, pp. 616-627.
5. S. Dai, M. Han, W. Xu, Y.Wu, Y. Gong, "Soft edge smoothness prior for alpha channel super resolution, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
6. I. Daubechies, M. Defrise, C. De Mol, "An iterative thresholding algorithm for linear inverse problems with a sparsity constraint, " Commun. Pure Appl. Math., vol. 57, no. 11, pp. 1413-1457, Nov. 2004.
7. C. Dong, C. C. Loy, K. He, X. Tang, "Image super-resolution using deep convolutional networks, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 2, pp. 295-307, Feb. 2016.
8. C. Dong, C. C. Loy, K. He, X. Tang, "Learning a deep convolutional network for image super-resolution, " in Proc. IEEE Eur. Conf. Comput. Vis., Sep. 2014, pp. 184-199.
9. W. Dong, L. Zhang, G. Shi, X. Wu, "Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization, " IEEE Trans. Image Process., vol. 20, no. 7, pp. 1838-1857, Jul. 2011.
10. S. Farsiu, D. Robinson, M. Elad, P. Milanfar, "Robust shift and add approach to super-resolution, " in Proc. SPIE's 48th Annu. Meet. Int. Symp. Opt. Sci. Technol., vol. 5203. San Diego, CA, USA, Aug. 2003, pp. 121-130.
11. A. Gholamreza and D. Hasan, "Image super resolution based on interpolation of wavelet domain high frequency subbands and the spatial domain input image, " ETRI J., vol. 32, no. 3, pp. 390-394, Jun. 2010.
12. H. Greenspan, "Super-resolution in medical imaging, " Comput. J., vol. 52, no. 1, pp. 43-63, Jan. 2009.
13. K. He, X. Zhang, S. Ren, J. Sun. (2015). "Deep residual learning for image recognition." [Online]. Available: Https://arxiv. org/abs/1512.03385
14. J.-B. Huang, A. Singh, N. Ahuja, "Single image super-resolution from transformed self-exemplars, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2015, pp. 5197-5206.
15. Q. Huynh-Thu and M. Ghanbari, "Scope of validity of PSNR in image/video quality assessment, " Electron. Lett., vol. 44, no. 13, pp. 800-801, Jun. 2008.
16. Y. Jia, et al. (2014). "Caffe: Convolutional architecture for fast feature embedding." [Online]. Available: Https://arxiv.org/abs/1408.5093
17. J. Kim, J. K. Lee, K. M. Lee, "Accurate image super-resolution using very deep convolutional networks, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2016, pp. 1646-1654 .
18. J. Kim, J. K. Lee, K. M. Lee, "Deeply-recursive convolutional network for image super-resolution, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2016, pp. 1637-1645.
19. A. Levin, Y. Weiss, F. Durand, W. T. Freeman, "Efficient marginal likelihood optimization in blind deconvolution, " in Proc. IEEE CVPR, Jun. 2011, pp. 2657-2664.
20. C. Liu, H.-Y. Shum, W. T. Freeman, "Face hallucination: Theory and practice, " Int. J. Comput. Vis., vol. 75, no. 1, pp. 115-134, 2007.
21. A. Marquina and S. J. Osher, "Image super-resolution by TV-regularization and Bregman iteration, " J. Sci. Comput., vol. 37, no. 3, pp. 367-382, Dec. 2008.
22. D. Martin, C. Fowlkes, D. Tal, J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics, " in Proc. 8th IEEE Int. Conf. Comput. Vis. (ICCV), vol. 2. Jul. 2001, pp. 416-423.
23. C. Osendorfer, H. Soyer, P. Smagt, "Image super-resolution with fast approximate convolutional sparse coding, " in Proc. Int. Conf. Neural Inf. Process., 2014, pp. 250-257.
24. G. Peyré, S. Bougleux, L. Cohen, "Non-local regularization of inverse problems, " in Proc. IEEE Eur. Conf. Comput. Vis., Aug. 2008, pp. 57-68.
25. L. C. Pickup, D. P. Capel, S. J. Roberts, A. Zisserman, "Bayesian image super-resolution, continued, " in Proc. Annu. Conf. Neural Inf. Process. Syst., 2006, pp. 1089-1096.
26. A. Singh and N. Ahuja, "Sub-band energy constraints for self-similarity based super-resolution, " in Proc. IEEE Int. Conf. Pattern Recognit., Aug. 2014, pp. 4447-4452.
27. S. Song, Y. Li, J. Liu, Z. Quo, "Joint sub-band based neighbor embedding for image super-resolution, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Mar. 2016, pp. 1661-1665.
28. J. Sun, J. Sun, Z. Xu, H.-Y. Shum, "Image super-resolution using gradient profile prior, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
29. J. Sun, J. Sun, Z. Xu, H.-Y. Shum, "Gradient profile prior and its applications in image super-resolution and enhancement, " IEEE Trans. Image Process., vol. 20, no. 6, pp. 1529-1542, Jun. 2011.
30. Y.-W. Tai, S. Liu, M. S. Brown, S. Lin, "Super resolution using edge prior and single image detail synthesis, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2400-2407.
31. R. Timofte, V. De Smet, L. van Gool, "A+: Adjusted anchored neighborhood regression for fast super-resolution, " in Proc. IEEE Asia Conf. Comput. Vis., Nov. 2015, pp. 111-126.
32. J. Tropp and S. Wright, "Computational methods for sparse solution of linear inverse problems, " Proc. IEEE, vol. 98, no. 6, pp. 948-958, Jun. 2010.
33. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, P.-A. Manzagol, "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion, " J. Mach. Learn. Res., vol. 11, no. 12, pp. 3371-3408, Dec. 2010.
34. Z. Wang, D. Liu, J. Yang, W. Han, T. Huang, "Deep networks for image super-resolution with sparse prior, " in Proc. IEEE Int. Conf. Comput. Vis., Jun. 2015, pp. 370-378.
35. Z. Wang, A. C. Bovik, H. R. Sheikh, E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity, " IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
36. J. Xie, L. Xu, E. Chen, "Image denoising and inpainting with deep neural networks, " in Proc. Annu. Conf. Neural Inf. Process. Syst., 2012, pp. 341-349.
37. J. Yang, J. Wright, T. S. Huang, Y. Ma, "Image super-resolution via sparse representation, " IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
38. G. Ye, Y. Wang, J. Xu, G. Herman, B. Zhang, "A practical approach to multiple super-resolution sprite generation, " in Proc. IEEE Workshop Multimedia Signal Process., Oct. 2008, pp. 70-75.
39. R. Zeyde, M. Elad, M. Protter, "On single image scale-up using sparse-representations, " in Proc. 7th Int. Conf. Curves Surfaces, 2012, pp. 711-730.
40. L. Zhang, H. Zhang, H. Shen, P. Li, "A super-resolution reconstruction algorithm for surveillance images, " Signal Process., vol. 90, no. 3, pp. 848-859, 2010.
41. Q. Zhou, S. Chen, J. Liu, X. Tang, "Edge-preserving single image super-resolution, " in Proc. ACM Trans. Multimedia, 2011, pp. 1037-1040.
42. W. Zuo, L. Zhang, C. Song, D. Zhang, H. Gao, "Gradient Histogram Estimation and Preservation for Texture Enhanced Image Denoising, " IEEE Trans. Image Process., vol. 23, no. 6, pp. 2459-2472, Jun. 2014.