Learning a no-reference quality metric for single-image super-resolution

Computer Vision and Image Understanding

Volumn 158, Issue , 2017, Pages 1-16

  Ma, Chao ^a,b   Yang, Chih Yuan ^c   Yang, Xiaokang ^b   Yang, Ming Hsuan ^c  

^a UNIVERSITY OF ADELAIDE   (Australia)

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Image quality assessment; No reference metric; Single image super resolution

Indexed keywords

OPTICAL RESOLVING POWER; REGRESSION ANALYSIS;

FULL REFERENCE METRICS; IMAGE QUALITY ASSESSMENT; NO-REFERENCE METRIC; REGRESSION MODEL; SINGLE IMAGES; SPATIAL AND FREQUENCY DOMAIN; STATISTICAL FEATURES; VISUAL PERCEPTION;

IMAGE QUALITY;

EID: 85010509972     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2016.12.009     Document Type: Article

References (45)

1. Breiman, L., Random forests. Mach. Learn. 45:1 (2001), 5–32.
2. Cho, T.S., Joshi, N., Zitnick, C.L., Kang, S.B., Szeliski, R., Freeman, W.T., A content-aware image prior. CVPR, 2010.
3. Criminisi, A., Shotton, J., Konukoglu, E., Decision Forests for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning. Microsoft Research Technical Report MSR-TR-2011-114, 2011 (28).
4. Dong, C., Loy, C.C., He, K., Tang, X., Learning a deep convolutional network for image super-resolution. ECCV, 2014, 184–199.
5. Dong, W., Zhang, L., Shi, G., Wu, X., Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. TIP 20:7 (2011), 1838–1857.
6. Farsiu, S., Robinson, M.D., Elad, M., Milanfar, P., Advances and challenges in super-resolution. Int. J. Imag. Syst. Technol. 14:2 (2004), 47–57.
7. Ferzli, R., Karam, L.J., A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB). TIP 18:4 (2009), 717–728.
8. Girod, B., What's wrong with mean-squared error?. Digital Images and Human Vision, 1993, MIT Press, 207–220.
9. Glasner, D., Bagon, S., Irani, M., Super-resolution from a single image. ICCV, 2009.
10. Handley, J.C., Comparative analysis of Bradley-Terry and Thurstone-Mosteller paired comparison models for image quality assessment. IS&T PICS, 2001.
11. Hogg, R., McKean, J., Craig, A., Introduction to Mathematical Statistics. 2005, Pearson Education.
12. Irani, M., Peleg, S., Improving resolution by image registration. CVGIP 53:3 (1991), 231–239.
13. Kang, L., Ye, P., Li, Y., Doermann, D.S., Convolutional neural networks for no-reference image quality assessment. CVPR, 2014, 1733–1740.
14. Kim, K.I., Kwon, Y., Single-image super-resolution using sparse regression and natural image prior. TPAMI 32:6 (2010), 1127–1133.
15. Larson, E.C., Chandler, D.M., Most apparent distortion: full-reference image quality assessment and the role of strategy. J. Electron. Imag., 19(1), 2010, 011006.
16. Liu, Y., Wang, J., Cho, S., Finkelstein, A., Rusinkiewicz, S., A no-reference metric for evaluating the quality of motion deblurring. ACM Trans. Graph., 32(6), 2013, 175.
17. Martin, D., Fowlkes, C., Tal, D., Malik, J., A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. ICCV, 2001.
18. Mittal, A., Moorthy, A.K., Bovik, A.C., No-reference image quality assessment in the spatial domain. TIP 21:12 (2012), 4695–4708.
19. Moorthy, A.K., Bovik, A.C., A two-step framework for constructing blind image quality indices. SPL 17:5 (2010), 513–516.
20. Moorthy, A.K., Bovik, A.C., Blind image quality assessment: from natural scene statistics to perceptual quality. TIP 20:12 (2011), 3350–3364.
21. Pérez, P., Gangnet, M., Blake, A., Poisson image editing. ACM Trans. Graph. 22:3 (2003), 313–318.
22. Reibman, A.R., Bell, R.M., Gray, S., Quality assessment for super-resolution image enhancement. ICIP, 2006.
23. Saad, M.A., Bovik, A.C., Charrier, C., Blind image quality assessment: a natural scene statistics approach in the dct domain. TIP 21:8 (2012), 3339–3352.
24. Schulter, S., Leistner, C., Bischof, H., Fast and accurate image upscaling with super-resolution forests. CVPR, 2015, 3791–3799.
25. Shan, Q., Li, Z., Jia, J., Tang, C., Fast image/video upsampling. ACM Trans. Graph., 27(5), 2008, 153.
26. Sheikh, H.R., Bovik, A.C., de Veciana, G., An information fidelity criterion for image quality assessment using natural scene statistics. TIP 14:12 (2005), 2117–2128.
27. Sheikh, H.R., Sabir, M.F., Bovik, A.C., A statistical evaluation of recent full reference image quality assessment algorithms. TIP 15:11 (2006), 3440–3451.
28. Simoncelli, E.P., Freeman, W.T., Adelson, E.H., Heeger, D.J., Shiftable multiscale transforms. TIT 38:2 (1992), 587–607.
29. Srivastava, A., Lee, A.B., Simoncelli, E.P., Zhu, S.-C., On advances in statistical modeling of natural images. J. Math. Imaging Vis. 30:6–7 (2003), 17–33.
30. Sun, J., Sun, J., Xu, Z., Shum, H.-Y., Gradient profile prior and its applications in image super-resolution and enhancement. TIP 20:6 (2011), 1529–1542.
31. Sun, J., Xu, Z., Shum, H., Image super-resolution using gradient profile prior. CVPR, 2008.
32. Tang, H., Joshi, N., Kapoor, A., Learning a blind measure of perceptual image quality. CVPR, 2011.
33. Tang, H., Joshi, N., Kapoor, A., Blind image quality assessment using semi-supervised rectifier networks. CVPR, 2014.
34. Timofte, R., Smet, V.D., Gool, L.J.V., Anchored neighborhood regression for fast example-based super-resolution. ICCV, 2013.
35. Timofte, R., Smet, V.D., Gool, L.J.V., A+: adjusted anchored neighborhood regression for fast super-resolution. ACCV, 2014, 111–126.
36. Wainwright, M.J., Simoncelli, E.P., Scale mixtures of Gaussians and the statistics of natural images. NIPS, 2000.
37. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P., Image quality assessment: from error visibility to structural similarity. TIP 13:4 (2004), 600–612.
38. Yang, C.-Y., Ma, C., Yang, M.-H., Single image super-resolution: a benchmark. ECCV, 2014.
39. Yang, C.-Y., Yang, M.-H., Fast direct super-resolution by simple functions. ICCV, 2013.
40. Yang, J., Lin, Z., Cohen, S., Fast image super-resolution based on in-place example regression. CVPR, 2013.
41. Yang, J., Wright, J., Huang, T.S., Ma, Y., Image super-resolution via sparse representation. TIP 19:11 (2010), 2861–2873.
42. Ye, P., Doermann, D., Active sampling for subjective image quality assessment. CVPR, 2014.
43. Ye, P., Kumar, J., Kang, L., Doermann, D.S., Unsupervised feature learning framework for no-reference image quality assessment. CVPR, 2012.
44. Yeganeh, H., Rostami, M., Wang, Z., Objective quality assessment for image super-resolution: a natural scene statistics approach. ICIP, 2012.
45. Zhang, L., Zhang, L., Mou, X., Zhang, D., FSIM: a feature similarity index for image quality assessment. TIP 20:8 (2011), 2378–2386.